Skip to content
SPECIFICTION
Get listed

Amazon Deequ vs AWS Glue Data Quality

Amazon Deequ

github.com

AWS Glue Data Quality

aws.amazon.com

Side by side

FigureAmazon DeequAWS Glue Data Quality
Price fromFree$0.44/mo
Free planYes—
Free trial——
Open source——
Web—Yes
WindowsYes—
macOSYes—
LinuxYes—
APIYesYes
Self-hostedYes—
Plans published11
Spec score · Data quality testing tools8.7 (#1)7.7 (#5)
IntegrationsDeequ is built on Apache Spark, is distributed through Maven artifacts, and has a Python interface called PyDeequ.The feature integrates with Amazon EventBridge and Amazon CloudWatch, and can write results to Amazon S3.
PurposeDeequ is an Apache Spark library for defining unit tests that measure data quality in large datasets.AWS Glue Data Quality measures and monitors data quality in data lakes and pipelines and can identify missing, stale, or bad data.

Plans

Amazon Deequ

  • Apache 2.0 open-source libraryFree

Amazon Deequ pricing →

AWS Glue Data Quality

  • AWS Glue Data Quality$0.44 a month

AWS Glue Data Quality pricing →

In their own words

Amazon Deequ

Amazon Deequ is an Apache Spark library for writing data unit tests that measure quality in large datasets, including datasets with billions of rows. Its checks cover row counts, completeness, uniqueness, allowed values, nonnegative values, patterns, and approximate quantiles. Deequ also supports data profiling, stored and queryable metrics, anomaly detection over time, automatic constraint suggestions, and incremental metric computation. Its declarative Data Quality Definition Language includes rules for counts, completeness, uniqueness, statistics, schema matching, freshness, and custom SQL. Row-level evaluation can identify records that pass or fail supported rules, while dataset-level rules such as RowCount and Mean are skipped in that mode. Deequ targets specific Apache Spark versions, so the release must match the Spark version; versions 2.1.0 and later require Java 11. The project provides Maven and sbt dependency examples. It is licensed under Apache 2.0, and Python users can use the PyDeequ interface.

Visit github.com

AWS Glue Data Quality

AWS Glue Data Quality has no write-up on Specifiction yet; its figures are above.

Visit aws.amazon.com