DataKitchen TestGen vs SQLancer

DataKitchen TestGen profiles databases, generates data quality tests, and shows results and quality scores in dashboards. Its listed checks include 55 profiling characteristics, 32 hygiene detector tests, and 49 test types, including generated tests, business rules, and custom SQL. Monitors cover freshness, volume, schema, and custom metrics, using predictive models to flag changes such as late arrivals and schema drift. Supported databases include Snowflake, Databricks SQL, Azure Synapse Analytics, Azure SQL Database, SQL Server, OneLake, BigQuery, Redshift, Aurora PostgreSQL, Oracle 12c and later, SAP HANA, PostgreSQL, and Salesforce Data 360. It can also profile and test structured data in Iceberg, Parquet, Avro, ORC, CSV, and JSON through supported external-table options. TestGen runs in the customer’s infrastructure; DataKitchen says it does not host the application or receive customer data. It queries target databases with read-only access and stores results and metadata in its application database. The free Open Source plan is limited to one user, one connection, and one project. Enterprise costs $100 a month, billed per user and per database connection.

SQLancer automatically tests database management systems to find implementation bugs. It generates SQL statements and database states, then validates query behavior with test oracles including TLP, NoREC, PQS, DQP, CODDTest, and CERT. Targets include logic bugs, performance issues, unexpected internal errors, and crashes. The supported-databases list contains 21 implementations, including PostgreSQL, MySQL, SQLite, DuckDB, and ClickHouse, while the impact page reports evidence of use by 22 DBMS projects. SQLancer runs on Linux, macOS, and Windows and requires Java 11 or above plus Maven. Releases are available through GitHub, Maven Central, and DockerHub. DuckDB, H2, and SQLite can run as embedded systems with binaries included as JAR dependencies. Runs may continue indefinitely when no bugs appear, with options to stop after a selected bug count or timeout. It is free under the MIT License.