Tech riderRev. 20 Sept 2026
OpenCompass
- 1Runs onNot stated by the maker
- 2CostsNot stated by the maker
- 3Deployment optionsself-hosted
- 4Custom metricsYes
- 5LLM-as-a-judgeYes
- 6Safety evaluationsYes
- 7Human review workflowsYes
5 lines stated Written from the maker's own pages: github.com
Overview
OpenCompass is ranked #17 of 29 in LLM evaluation tools on Specifiction.
Compared on LLM evaluation tools
- Free plan
- Yesgithub.com
- Deployment options
- self-hostedgithub.com
- Custom metrics
- Yesgithub.com
- LLM-as-a-judge
- Yesgithub.com
- Safety evaluations
- Yesgithub.com
- Human review workflows
- Yesgithub.com
Company
- Founded
- 2020github.com · 28 Sept 2026
Best OpenCompass alternatives
See all 20 All accessCh 01 Promptfoo Free planAPILinux Free to start7.6 All accessCh 02 DeepEval Free planLinuxMac Free to start7.4 All accessCh 03 Maxim AI Free planFree trialAPI from $29/mo7.4 All accessCh 04 Giskard Free planAPILinux Free to start7.2 All accessCh 05 Braintrust Free planAPIself-hosted from $249/mo7.1 All accessCh 06 Galileo Free planAPIself-hosted from $100/mo7.1
Where it ranks on Specifiction
- Best LLM Evaluation Tools in 2026#17 of 29
Is OpenCompass yours?
Claim it for free: prove the domain, then correct facts, plans and screenshots. An editor reviews every change.
Sources
- github.com/open-compass/opencompass· checked 28 Sept 2026