AWS Glue DataBrew vs Polars
AWS Glue DataBrew
aws.amazon.com
Polars
pola.rsSide by side
| Figure | AWS Glue DataBrew | Polars |
|---|---|---|
| Price from | $0.48/mo | Free |
| Free plan | — | Yes |
| Free trial | Yes | Yes |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | — | Yes |
| macOS | — | Yes |
| Linux | — | Yes |
| API | Yes | Yes |
| Self-hosted | — | Yes |
| Plans published | 4 | 1 |
| Spec score · Data Transformation Tools | 8.9 (#6) | 7.7 (#20) |
| Integrations | DataBrew datasets can use files, Amazon S3, supported JDBC data sources, or the AWS Glue Data Catalog. | The homepage lists support for CSV, JSON, Parquet, Delta Lake, AVRO, Excel, Feather, Arrow, several databases, and cloud storage. |
| Security | AWS documentation recommends IAM access controls, TLS for communications, CloudTrail activity logging, and AWS encryption solutions. | Polars says Polars Cloud compute runs in the customer's cloud environment and that customer data does not leave that environment. |
Plans
AWS Glue DataBrew
- DataBrew interactive sessions$1 a month
- DataBrew jobs$0.48 a month
- DataBrew interactive sessions$1, paid once
- Pay-as-you-goPriced on request
In their own words
AWS Glue DataBrew
AWS Glue DataBrew has no write-up on Specifiction yet; its figures are above.
Polars
Polars is an open-source DataFrame library for data manipulation, designed for single-machine processing with a typed, expressive API. Its multithreaded query engine is written in Rust and uses vectorized columnar processing to execute work in parallel. A query optimizer selects an execution plan, and the streaming API can process datasets larger than memory without holding all results in memory. Installation examples cover Python, Rust, and JavaScript. Supported formats include CSV, JSON, Parquet, Delta Lake, Avro, Excel, Feather, and Arrow IPC; the homepage also lists databases and cloud storage. Polars can read and write data in AWS S3, Azure Blob Storage, and Google Cloud Storage. The open-source library costs nothing under the MIT license. Polars Cloud runs distributed queries through the Polars API and scales work from local execution to a cluster; it is available on AWS. Its 30-day trial begins when an organization connects its first workspace to AWS, and its compute runs in the customer's cloud environment. Polars On-Prem supports Kubernetes and bare-metal deployments, including air-gapped Enterprise deployments.