Skip to content
SPECIFICTION
Get listed

data.all

data-dot-all.github.io

WebAPISelf-hosted
Visit data-dot-all.github.io
Spec score 7.6 #9 of 27 in Data Marketplace Software

What it is

data.all is an open-source platform for managing and discovering data assets in AWS accounts. Its central catalog inventories datasets, tables, folders, and dashboards, with filters for asset type, tags, region, and glossary terms. Datasets can contain structured tables or unstructured folders and use AWS S3, KMS, IAM, and Glue resources. Teams can share datasets between environments by granting selected roles read access through Lake Formation without moving data. The catalog imports tables from Redshift Serverless and provisioned clusters. Analytics options include Athena worksheets, SageMaker Studio access, Jupyter notebooks, and QuickSight dashboards. Administrators manage teams and users across environments. Authentication supports Cognito federation with a corporate identity provider or an external OIDC provider. Deployments may face the internet or remain inside a VPC. AWS setup requires at least two matching-region accounts and administrator credentials.

Spec sheet

Purpose
data.all is an open source platform that can be deployed in AWS accounts to help users manage and discover data assets.Read 8 Oct 2026 · data-dot-all.github.io
Deployment
The AWS deployment guide requires a tooling account and at least one deployment account, and their selected regions must match.Read 8 Oct 2026 · data-dot-all.github.io
Integrations
Documented modules include AWS Glue, Lake Formation, Amazon S3, Athena, SageMaker, QuickSight, and HealthOmics Ready2Run workflows.Read 8 Oct 2026 · data-dot-all.github.io
Security
Dataset S3 buckets are encrypted with AWS managed KMS keys, and data access is logged through CloudTrail.Read 8 Oct 2026 · data-dot-all.github.io
Administration
Administrators can organize and manage teams and users across environments.Read 8 Oct 2026 · data-dot-all.github.io
Analytics and ML
The platform provides Athena worksheets, Jupyter notebooks through SageMaker, SageMaker Studio access, and QuickSight dashboards.Read 8 Oct 2026 · data-dot-all.github.io
Audit
For structured data, SQL queries from EMR, Redshift, Glue Jobs, and Athena are captured through Lake Formation.Read 8 Oct 2026 · data-dot-all.github.io
AWS integrations
The documented architecture uses AWS services including Cognito, CloudFront or an internal Application Load Balancer, API Gateway, Lambda, Aurora PostgreSQL, ECS Fargate, and OpenSearch.Read 8 Oct 2026 · data-dot-all.github.io
Catalog
Its centralized catalog inventories datasets, tables, folders, and dashboards, with search filters for asset type, tags, region, and glossary terms.Read 8 Oct 2026 · data-dot-all.github.io
Configuration
Modules and some features can be enabled or disabled through configuration, and the guide notes that file uploads are disabled in its example configuration.Read 8 Oct 2026 · data-dot-all.github.io
Data catalog
Its centralized catalog inventories datasets, tables, folders, and dashboards, with search filters for asset type, tags, region, and glossary terms.Read 8 Oct 2026 · data-dot-all.github.io
Data sharing
Users can request access to another team’s data assets, and asset owners can accept or reject those requests.Read 8 Oct 2026 · data-dot-all.github.io
Datasets
Datasets can hold structured tables or unstructured folders and use AWS S3, KMS, IAM, and Glue resources.Read 8 Oct 2026 · data-dot-all.github.io
Deployment options
The deployment guide describes internet-facing and VPC-facing architectures; the VPC-facing option makes the UI and APIs reachable only within the VPC.Read 8 Oct 2026 · data-dot-all.github.io
Identity
Authentication can use Amazon Cognito federated with a corporate identity provider, or an external OIDC provider; data.all relies on identity-provider group information.Read 8 Oct 2026 · data-dot-all.github.io
Local use
The project documents a Docker Compose local setup with frontend, database, GraphQL, CDK proxy, and OpenSearch containers; AWS credentials are needed to create environments and datasets.Read 8 Oct 2026 · data-dot-all.github.io
Network options
Deployments can be internet facing, with public APIs protected by AWS WAF, or VPC facing, with private sites and APIs accessible through VPC endpoints.Read 8 Oct 2026 · data-dot-all.github.io
Notebooks
The platform provides notebooks based on Amazon SageMaker Studio for data scientists to build machine learning models.Read 8 Oct 2026 · data-dot-all.github.io
Operational limit
The AWS deployment instructions require administrator credentials for the tooling and deployment accounts during setup.Read 8 Oct 2026 · data-dot-all.github.io
Redshift integration
It supports importing tables from Redshift Serverless and provisioned clusters into the catalog; connections can use Secrets Manager secrets or Redshift users.Read 8 Oct 2026 · data-dot-all.github.io
Requirements
AWS deployment requires at least two AWS accounts and administrator credentials for the tooling and deployment accounts.Read 8 Oct 2026 · data-dot-all.github.io

Strong points and limits

Strong points

  • Central catalog with asset filters
  • Lake Formation sharing without moving data
  • Redshift Serverless and cluster imports
  • Athena, SageMaker, and QuickSight tools
  • Open source with free plan

Limits

  • AWS setup requires at least two accounts
  • Administrator credentials required during setup
  • File uploads disabled in example configuration
  • AWS deployment needs matching regions

Who it suits

It suits teams managing AWS-based data catalogs, sharing, analytics, and machine-learning workflows. It is also relevant to organizations needing internet-facing or VPC-facing deployment options.

Verdict

data.all combines cataloging, controlled sharing, and AWS analytics integrations in one platform. Its deployment requirements and administrator access expectations should be reviewed before adoption.

Where Specifiction places it

Alternatives to data.allAll alternatives →