DataCleaner vs qsv

DataCleaner is an open-source data quality application for profiling, validating, and cleansing data. Its profiling engine identifies patterns, missing values, character sets, and other traits in data values. It works with CSV files, Excel spreadsheets, relational databases, and NoSQL databases. Users can create cleansing rules with search and replace, regular expressions, pattern matching, or custom transformations, and use internal or external reference data to check values. DataCleaner supports batch processing, visual workflows, standardization, validation, enrichment, scheduled runs, and desktop deployment on Linux, macOS, and Windows. Named integrations and connectivity options include Apache Hadoop, Apache Spark, Pentaho Data Integration, and Apache MetaModel. Developers can embed it in other applications or build plugins; the project also describes community extensions, integrations, and shared content. The code is licensed under LGPL. The community edition is free at free. The downloads page lists 5.9.0 as the latest release; release news says version 5.8.1 runs on Java 9 through 17 and is dated February 9, 2022.

qsv is a CSV data-wrangling toolkit for slicing, analyzing, and transforming data through more than 50 commands. Most commands stream their input and use constant memory, so they can handle very large CSV files without loading the full dataset into memory. It works with CSV, Excel, OpenDocument Spreadsheet, JSON and JSONL, DataPackage, Apache Arrow and Parquet, SQLite, and PostgreSQL. Luau and Python scripting are built in, and the join, joinp, and sqlp commands support SQL and join queries without a SQL database. qsv is designed to interoperate with Airbyte, Airflow, Pentaho Kettle, and command-line tools. Its qsv pro desktop app adds graphical spreadsheet viewing and transformation, plus CKAN upload and download. The code is automatically checked for security vulnerabilities, and prebuilt binary archives are zipsigned with integrity checks during self-updates. qsv requires UTF-8 input. The Free plan costs nothing and includes spreadsheet imports up to 1MB; Pro costs $99.99 a month after the trial ends.