Augustus vs SuperRed
Augustus
github.comSuperRed
rdi.berkeley.eduSide by side
| Figure | Augustus | SuperRed |
|---|---|---|
| Price from | Free | — |
| Free plan | Yes | — |
| Free trial | — | — |
| Open source | — | — |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | Yes |
| Self-hosted | Yes | — |
| Plans published | 1 | 0 |
| Spec score · AI Security Testing Tools | 8.2 (#10) | 6.7 (#27) |
| Intended audience | The README describes Augustus as built for production security testing and identifies security professionals as its users. | The getting-started guide is for people who can read Python and have seen asyncio, and PyPI lists Science/Research as an intended audience. |
| Purpose | Augustus is a Go-based LLM vulnerability scanner for security professionals that tests models against adversarial attacks and produces vulnerability reports. | SuperRed is an open-source framework for red-teaming chatbots, agents, and assistants by testing whether attacks can violate security properties. |
Plans
In their own words
Augustus
Augustus is a free, self-hosted Go scanner for security professionals assessing large language models. It runs adversarial probes and produces vulnerability reports, with more than 210 probes across 47 attack categories, including jailbreaks, prompt injection, data extraction, safety benchmarks, and agent attacks. It supports 28 provider categories and 43 generator variants, including hosted providers, Ollama, and custom REST endpoints. More than 90 detectors cover approaches such as pattern matching, LLM-as-a-judge, HarmJudge, Perspective API, and unsafe-content detection; seven prompt transformations include encoding, paraphrase, poetry, low-resource-language translation, and case changes. Results can be written as tables, JSON, JSONL, or HTML. The project lists concurrent scanning, rate limits, retries, and timeout handling. Augustus compiles to a portable single binary and can be installed with Go or built from source; the README requires Go 1.27.0 or later. It is Apache 2.0 licensed. The project is intended for authorized security testing, and users are told to test only systems they own or have permission to assess. Provider API use may require credentials.
SuperRed
SuperRed has no write-up on Specifiction yet; its figures are above.