BRAT vs LabelLLM

brat is a free, open-source tool for structured text annotation, with annotations represented in forms computers can process. It supports text spans, binary relations, n-ary associations, attributes, normalization annotations, and freeform notes. Teams can configure categories, types, and constraints for their tasks, and multiple annotators can work on the same document or collection while seeing one another’s edits nearly as they happen. Normalization can link annotations to external resources, and brat can incorporate output from automatic annotation services available as web services. Its server and client support Unicode across nearly 100 scripts. The tool checks edits against configured constraints and searches documents or collections, including keyword-in-context concordancing. Annotations export in brat stand-off format; visualizations can be saved as SVG, PNG, PDF, or EPS. The free v1.3 release is self-hosted under the MIT License. New server installations assume a UNIX-like environment; Windows users can run brat in a UNIX-like virtual machine. The experimental standalone server is not security-hardened and is not recommended for sensitive data or systems accessible from the internet.

LabelLLM has no write-up on Specifiction yet; its figures are above.