Marquez

Spec sheet

Purpose

Marquez consumes, stores, and visualizes OpenLineage metadata for use cases including data governance, data quality monitoring, and performance analytics.Read 11 Oct 2026 · marquezproject.ai

Audience

Marquez is designed for data teams managing metadata and lineage across data processing applications and pipelines.Read 11 Oct 2026 · marquezproject.ai

Deployment

The deployment guide describes Docker and Kubernetes deployments and says the HTTP API server uses PostgreSQL to store dataset, job, and run metadata.Read 11 Oct 2026 · marquezproject.ai

Integrations

The site names Apache Airflow, Apache Spark, Apache Flink, dbt, and Dagster as integrations supported through the OpenLineage community.Read 11 Oct 2026 · marquezproject.ai

Support

The site directs users to its Slack channel for help and feedback and encourages newcomers to join monthly community meetings.Read 11 Oct 2026 · marquezproject.ai

Architecture

The documented system includes a metadata repository, RESTful metadata API, and metadata UI.Read 11 Oct 2026 · marquezproject.ai

Authentication

Clients can send an API key using Bearer Auth when configured, while the Marquez HTTP API does not require authentication or authorization by default.Read 11 Oct 2026 · marquezproject.ai

Column lineage limit

The site says column lineage support is limited to the Spark integration.Read 11 Oct 2026 · marquezproject.ai

Getting started

The quickstart documents MacOS/Linux and Windows prerequisites and runs the Marquez HTTP server using Docker.Read 11 Oct 2026 · marquezproject.ai

Lineage API

The Lineage API supports dependency traversal and metadata queries for tasks such as backfills and root cause analysis.Read 11 Oct 2026 · marquezproject.ai

Lineage visualization

The web UI maps dependencies across a data ecosystem and lets users inspect job inputs and outputs, dataset lineage, performance metrics, and execution details.Read 11 Oct 2026 · marquezproject.ai

Metadata collection

Its metadata server provides an OpenLineage-compatible endpoint for real-time collection from running jobs and applications.Read 11 Oct 2026 · marquezproject.ai

Metadata history

Marquez records job run history, job statistics, and immutable versioned dataset metadata.Read 11 Oct 2026 · marquezproject.ai

Open source

The site says Marquez was released and open sourced by WeWork.Read 11 Oct 2026 · marquezproject.ai

Real-time collection

Its metadata server provides an OpenLineage-compatible endpoint to collect information from running jobs and applications.Read 11 Oct 2026 · marquezproject.ai

Security limitation

The deployment documentation states that authentication and authorization are not enabled on the API by default.Read 11 Oct 2026 · marquezproject.ai

Visual lineage

The web UI maps dependencies in a data ecosystem and lets users inspect job inputs and outputs, dataset lineage, performance metrics, and execution details.Read 11 Oct 2026 · marquezproject.ai

Where Specifiction places it

• Active Metadata Management Software#15 of 257.2
• Data Lineage Tools#27 of 437.1