| Price from | — | Free |
| Free plan | — | Yes |
| Free trial | — | — |
| Open source | — | Yes |
| Linux | Yes | — |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 0 | 2 |
| Spec score · LLM Evaluation Tools | 7.2 (#23) | 7.9 (#9) |
| Spec score · AI LLM Evaluation Tools | 7.2 (#26) | 8.0 (#16) |
| Spec score · LLM Observability Tools | 7.1 (#25) | 7.9 (#21) |
| Custom metrics | Users can create custom metrics tailored to their use case. | Users can define custom metrics with Python functions or LLM-as-judge prompts and tune judges with rubrics and examples. |
| Framework integrations | Documented framework integrations include LangChain, LlamaIndex, Haystack, Griptape, and others. | Official integrations instrument LangChain, LangGraph, LlamaIndex and NeMo Guardrails applications. |
| Installation | Ragas can be installed with pip or from its GitHub main branch. | The documented installation uses Conda with Python 3, followed by pip install trulens; source development uses the GitHub repository and editable installation. |
| Integrations | The documentation lists integrations with Arize, LangSmith, Amazon Bedrock, Google Gemini, OCI Gen AI, LangChain, LangGraph, LlamaIndex, and other frameworks. | The documentation lists integrations and providers for LangChain, LangGraph, LlamaIndex, MCP, OpenAI, Anthropic, Amazon Bedrock, HuggingFace, LiteLLM, Google, and Snowflake Cortex. |
| Purpose | Ragas is a library for systematically evaluating AI and large language model applications. | TruLens evaluates and traces AI agents to help find failures and reduce costs while maintaining quality. |
| Security | The opened product and documentation pages did not state security certifications or compliance details. | TruLens documentation describes Snowflake connector authentication with browser-based SSO, key-pair authentication, OAuth tokens, and existing Snowpark sessions. |
| Support | The Ragas site directs users with questions to its Discord questions chatroom and gives an email for enterprise features and collaborations. | The getting-started documentation points users to a community Slack. |
