OpenRefine vs qsv

OpenRefine is a free, open-source tool for cleaning, transforming, and extending messy data. It works on the user's machine rather than sending data to a cloud service, and basic functions can run offline through a small web server on that computer. Facets help explore large datasets and apply changes to filtered views. Clustering uses heuristics to find similar values and address inconsistencies; reconciliation matches values to external databases through reconciliation services. Users can undo and redo operations without a stated history limit. OpenRefine imports formats including CSV, TSV, fixed-width text, JSON, XML, spreadsheets, PC-Axis, MARC, RDF formats, and Wikitext. It can also upload data to Google Sheets and create or update Wikidata statements. Releases are available for Windows, Mac, and Linux. Java must be installed and configured, although the Mac version and some Windows packages include it. Data is not encrypted by default; operating-system full-disk encryption can protect it. The project offers support through its forum, GitHub, community calls, and Gitter chat.

qsv is a CSV data-wrangling toolkit for slicing, analyzing, and transforming data through more than 50 commands. Most commands stream their input and use constant memory, so they can handle very large CSV files without loading the full dataset into memory. It works with CSV, Excel, OpenDocument Spreadsheet, JSON and JSONL, DataPackage, Apache Arrow and Parquet, SQLite, and PostgreSQL. Luau and Python scripting are built in, and the join, joinp, and sqlp commands support SQL and join queries without a SQL database. qsv is designed to interoperate with Airbyte, Airflow, Pentaho Kettle, and command-line tools. Its qsv pro desktop app adds graphical spreadsheet viewing and transformation, plus CKAN upload and download. The code is automatically checked for security vulnerabilities, and prebuilt binary archives are zipsigned with integrity checks during self-updates. qsv requires UTF-8 input. The Free plan costs nothing and includes spreadsheet imports up to 1MB; Pro costs $99.99 a month after the trial ends.