Amazon Deequ vs Percona pstress

Amazon Deequ is an Apache Spark library for writing data unit tests that measure quality in large datasets, including datasets with billions of rows. Its checks cover row counts, completeness, uniqueness, allowed values, nonnegative values, patterns, and approximate quantiles. Deequ also supports data profiling, stored and queryable metrics, anomaly detection over time, automatic constraint suggestions, and incremental metric computation. Its declarative Data Quality Definition Language includes rules for counts, completeness, uniqueness, statistics, schema matching, freshness, and custom SQL. Row-level evaluation can identify records that pass or fail supported rules, while dataset-level rules such as RowCount and Mean are skipped in that mode. Deequ targets specific Apache Spark versions, so the release must match the Spark version; versions 2.1.0 and later require Java 11. The project provides Maven and sbt dependency examples. It is licensed under Apache 2.0, and Python users can use the PyDeequ interface.

Percona pstress is a free, open-source Linux tool for concurrent database and crash-recovery testing. It creates randomized transactions from command-line options and runs concurrent workloads against a single server or cluster. Documented uses include checking database features, regressions, and recovery behavior for MySQL, Percona Server, and Percona XtraDB Cluster. A multithreaded C++ generator works with a Bash driver that coordinates concurrency and recovery steps. The driver can stop and restart a server between steps, change server variables, and continue with the preceding step’s data directory. Options control thread count, tables, records, transaction size, and SQL-operation probabilities. Trial directories normally retain the data directory, error logs, thread logs, mysqld binaries, and configuration. Building requires CMake 2.6 or later, a C++ compiler 4.7 or later, and development files for the target database version or fork. The repository identifies GPL-2.0 licensing. pstress runs self-hosted and does not verify that successful queries returned correct data.