csvkit vs qsv

csvkit is a free suite of command-line tools for converting, inspecting and transforming CSV data on Linux, macOS and Windows. Its tools handle common file and table tasks: in2csv converts formats such as Excel, JSON and fixed-width files; csvcut selects, removes or reorders columns; and csvlook and csvstat display data and summary statistics. Other commands filter matching rows, sort records, join related data or stack subsets. For database workflows, csvsql can query CSV data with SQL and import it into PostgreSQL, while sql2csv exports query results. csvjson converts CSV to JSON or GeoJSON. Commands can read standard input and write standard output, making them suitable for repeatable pipelines. By default, csvkit infers format from the first 1024 bytes and infers cell types, with options to turn off either behavior. Installation instructions include pip and Homebrew and recommend a virtual environment. The tutorial assumes basic command-line familiarity, but not prior data-processing experience. The project notes that larger files or faster processing may exceed its limits and suggests SQL or other tools in that case.

qsv is a CSV data-wrangling toolkit for slicing, analyzing, and transforming data through more than 50 commands. Most commands stream their input and use constant memory, so they can handle very large CSV files without loading the full dataset into memory. It works with CSV, Excel, OpenDocument Spreadsheet, JSON and JSONL, DataPackage, Apache Arrow and Parquet, SQLite, and PostgreSQL. Luau and Python scripting are built in, and the join, joinp, and sqlp commands support SQL and join queries without a SQL database. qsv is designed to interoperate with Airbyte, Airflow, Pentaho Kettle, and command-line tools. Its qsv pro desktop app adds graphical spreadsheet viewing and transformation, plus CKAN upload and download. The code is automatically checked for security vulnerabilities, and prebuilt binary archives are zipsigned with integrity checks during self-updates. qsv requires UTF-8 input. The Free plan costs nothing and includes spreadsheet imports up to 1MB; Pro costs $99.99 a month after the trial ends.