| Price from | — | — |
| Free plan | — | — |
| Free trial | — | — |
| Open source | — | — |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 0 | 0 |
| Spec score · LLM Evaluation Tools | 7.8 (#10) | 7.2 (#21) |
| License | The repository is licensed under Apache License 2.0. | The public GitHub repository lists an MIT license. |
| Purpose | AgentBench is a benchmark for evaluating the reasoning and decision-making abilities of LLMs acting as agents. | HarmBench is an open-source framework for evaluating automated red teaming methods and LLM attacks and defenses. |
| Support | The project invites users to join its Slack for questions and collaboration, and lists a Google Group for questions about AgentBench FC. | The repository documentation invites users to submit a pull request for support for another cluster manager. |