A RetroSearch Logo

Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Search Query:

Showing content from https://github.com/simonw/csvs-to-sqlite/issues/17 below:

Lookup tables should be maintained directly in SQLite · Issue #17 · simonw/csvs-to-sqlite · GitHub

When evaluating -c we currently use a temporary table maintained in Python space:

def id_for_value(self, value): if pd.isnull(value): return None try: return self.value_to_id[value] except KeyError: id = self.next_id self.id_to_value[id] = value self.value_to_id[value] = id self.next_id += 1 return id

For handling larger CSV files (#16) this would work much better if it was a SQLite table that was queried and updated as we process data. This would also help make lookup tables re-usable across multiple CSVs across several runs of the command.

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4