BRAT vs Prodigy
BRAT
brat.nlplab.orgProdigy
prodigy.aiSide by side
| Figure | BRAT | Prodigy |
|---|---|---|
| Price from | Free | — |
| Free plan | Yes | — |
| Free trial | — | — |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | — | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | — | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 2 |
| Spec score · AI Data Labeling Tools | 8.0 (#9) | 8.3 (#6) |
| Support | The project directs usage questions to its mailing list and bug reports or feature requests to its GitHub issue tracker. | The product includes documentation and access to a support forum; company licenses also include priority forum and email support. |
Plans
In their own words
BRAT
brat is a free, open-source tool for structured text annotation, with annotations represented in forms computers can process. It supports text spans, binary relations, n-ary associations, attributes, normalization annotations, and freeform notes. Teams can configure categories, types, and constraints for their tasks, and multiple annotators can work on the same document or collection while seeing one another’s edits nearly as they happen. Normalization can link annotations to external resources, and brat can incorporate output from automatic annotation services available as web services. Its server and client support Unicode across nearly 100 scripts. The tool checks edits against configured constraints and searches documents or collections, including keyword-in-context concordancing. Annotations export in brat stand-off format; visualizations can be saved as SVG, PNG, PDF, or EPS. The free v1.3 release is self-hosted under the MIT License. New server installations assume a UNIX-like environment; Windows users can run brat in a UNIX-like virtual machine. The experimental standalone server is not security-hardened and is not recommended for sensitive data or systems accessible from the internet.
Prodigy
Prodigy is a downloadable developer tool and Python library for creating training and evaluation data for machine-learning models. Its built-in recipes cover named entity recognition, text classification, computer vision, audio and video annotation, transcription, and model training and evaluation. A customizable web application offers 23 interfaces for work with text, images, audio, video, relations, multiple choice, HTML and conflict resolution. Users can define workflows with Python recipes and create interfaces using HTML, CSS and JavaScript. Prodigy supports spaCy, plugins for Hugging Face models and integrations with major LLM API providers. Data can be stored in SQLite, MySQL or PostgreSQL and exported to JSON. It runs on the user's own machines without connecting to the maker's or third-party servers, including on air-gapped machines. The standard Python web server and app can be deployed in the cloud or on-premise. Personal licensing costs $390, paid once, excluding tax; Company licensing costs $490, paid once per seat in packs of five, excluding tax.