Skip to content
SPECIFICTION
Get listed

AgentBench vs EvalPlus

AgentBench

github.com

EvalPlus

github.com

Side by side

FigureAgentBenchEvalPlus
Price from——
Free plan——
Free trial——
Open source——
LinuxYesYes
APIYesYes
Self-hostedYesYes
Plans published00
Spec score · LLM Evaluation Tools7.8 (#10)7.3 (#20)
LicenseThe repository is licensed under Apache License 2.0.The repository provides the software under the Apache License 2.0, with files under evalplus/eval additionally complying with the MIT License.
PurposeAgentBench is a benchmark for evaluating the reasoning and decision-making abilities of LLMs acting as agents.EvalPlus is a framework for rigorously evaluating large language models on code related tasks.

In their own words

AgentBench

AgentBench has no write-up on Specifiction yet; its figures are above.

Visit github.com

EvalPlus

EvalPlus has no write-up on Specifiction yet; its figures are above.

Visit github.com