Specifiction
For vendors
AdvertiseTop spots, featured rows, home sponsor Get listedAdd a product we don't cover yet Claim a listingFree: verify the domain, then correct your page Vendor dashboardNumbers, orders and placements
List your tool
Vendor dashboard

Best LM Evaluation Harness Alternatives in 2026

Updated

20 tools from AI LLM evaluation tools ranked against LM Evaluation Harness on the same published basis.

  1. 1
    Weights & Biases Free plan apiiOSLinuxMacself-hosted $60/mo8.0
    LM Evaluation Harness vs Weights & Biases
  2. 2
    Evidently AI Free plan apiLinuxMacself-hostedWeb $80/mo7.8
    LM Evaluation Harness vs Evidently AI
  3. 3
    Vellum Free plan AndroidextensioniOSMacself-hosted $30/mo7.7
    LM Evaluation Harness vs Vellum
  4. 4
    Opik Free plan apiLinuxself-hostedWeb $19/mo7.5
    LM Evaluation Harness vs Opik
  5. 5
    Promptfoo Free plan apiLinuxMacself-hostedWeb Free7.4
    LM Evaluation Harness vs Promptfoo
  6. 6
    Maxim AI Free plan apiself-hostedWeb $29/mo7.3
    LM Evaluation Harness vs Maxim AI
  7. 7
    DeepEval Free plan LinuxMacself-hostedWin Free7.2
    LM Evaluation Harness vs DeepEval
  8. 8
    Giskard Free plan apiLinuxself-hostedWeb Free7.1
    LM Evaluation Harness vs Giskard
  9. 9
    LangWatch Free plan apiLinuxself-hostedWeb €29/mo7.1
    LM Evaluation Harness vs LangWatch
  10. 10
    Rhesis AI Free plan apiLinuxself-hostedWeb Free7.1
    LM Evaluation Harness vs Rhesis AI
  11. 11
    Galileo Free plan apiself-hostedWeb $100/mo7.0
    LM Evaluation Harness vs Galileo
  12. 12
    Langfuse Free plan apiself-hostedWeb $29/mo7.0
    LM Evaluation Harness vs Langfuse
  13. 13
    Braintrust Free plan apiself-hostedWeb $249/mo6.9
    LM Evaluation Harness vs Braintrust
  14. 14
    LangSmith Free plan apiself-hostedWeb $39/mo6.9
    LM Evaluation Harness vs LangSmith
  15. 15
    NVIDIA NeMo Evaluator Free plan apiLinuxself-hosted Free6.9
    LM Evaluation Harness vs NVIDIA NeMo Evaluator
  16. 16
    Arize Phoenix Free plan apiself-hostedWeb Free6.8
    LM Evaluation Harness vs Arize Phoenix
  17. 17
    Confident AI Free plan apiself-hostedWeb $200/mo6.8
    LM Evaluation Harness vs Confident AI
  18. 18
    HoneyHive Free plan apiself-hostedWeb Free6.8
    LM Evaluation Harness vs HoneyHive
  19. 19
    OpenAI Evals apiself-hostedWeb 6.7
    LM Evaluation Harness vs OpenAI Evals
  20. 20
    Pydantic Evals Linux 6.7
    LM Evaluation Harness vs Pydantic Evals

LM Evaluation Harness alternatives compared

#ToolScoreFree planFromRuns on
1Weights & Biases8.0Free plan$60/moAPI, iOS, Linux, Mac, self-hosted, Web, Windows
2Evidently AI7.8Free plan$80/moAPI, Linux, Mac, self-hosted, Web, Windows
3Vellum7.7Free plan$30/moAndroid, Browser, iOS, Mac, self-hosted, Web, Windows
4Opik7.5Free plan$19/moAPI, Linux, self-hosted, Web
5Promptfoo7.4Free planFreeAPI, Linux, Mac, self-hosted, Web, Windows
6Maxim AI7.3Free plan$29/moAPI, self-hosted, Web
7DeepEval7.2Free planFreeLinux, Mac, self-hosted, Windows
8Giskard7.1Free planFreeAPI, Linux, self-hosted, Web
9LangWatch7.1Free plan€29/moAPI, Linux, self-hosted, Web
10Rhesis AI7.1Free planFreeAPI, Linux, self-hosted, Web
11Galileo7.0Free plan$100/moAPI, self-hosted, Web
12Langfuse7.0Free plan$29/moAPI, self-hosted, Web
13Braintrust6.9Free plan$249/moAPI, self-hosted, Web
14LangSmith6.9Free plan$39/moAPI, self-hosted, Web
15NVIDIA NeMo Evaluator6.9Free planFreeAPI, Linux, self-hosted
16Arize Phoenix6.8Free planFreeAPI, self-hosted, Web
17Confident AI6.8Free plan$200/moAPI, self-hosted, Web
18HoneyHive6.8Free planFreeAPI, self-hosted, Web
19OpenAI Evals6.7No—API, self-hosted, Web
20Pydantic Evals6.7No—Linux
Make your tool an alternative to LM Evaluation Harness

The sponsored alternative slot on this page is labelled Sponsored.

See the price

Questions about LM Evaluation Harness alternatives

What is the best alternative to LM Evaluation Harness?

Weights & Biases, number 1 in AI LLM evaluation tools with a score of 8.0 out of 10. The others here: Evidently AI, Vellum, Opik and 16 more.

What is the best free alternative to LM Evaluation Harness?

Weights & Biases is the best-ranked alternative with a free plan. 18 of the 20 alternatives here publish a free plan on their own pricing pages.

How are these alternatives ranked?

Ranked on what each maker publishes, the fullest spec sheet first: how deeply the product is documented, the platforms it runs on, a free tier or trial to test it, and its standing.