| Price from | — | Free |
| Free plan | — | Yes |
| Free trial | — | — |
| Open source | — | — |
| Linux | Yes | — |
| API | Yes | — |
| Self-hosted | Yes | Yes |
| Plans published | 0 | 1 |
| Spec score · LLM Evaluation Tools | 7.8 (#10) | 7.1 (#24) |
| License | The repository is licensed under Apache License 2.0. | The project is licensed under Apache-2.0. |
| Model setup | The original quick start configures an OpenAI API key and gives gpt-3.5-turbo-0613 as its example agent. | The example pipeline uses configurable extractor and checker models and documents an AWS Bedrock Llama 3 70B example. |
| Purpose | AgentBench is a benchmark for evaluating the reasoning and decision-making abilities of LLMs acting as agents. | RAGChecker is an automatic evaluation framework for assessing and diagnosing retrieval-augmented generation systems. |