Skip to content
SPECIFICTION
Get listed

Galileo vs Inspect AI

Galileo

galileo.ai

Inspect AI

inspect.aisi.org.uk

Side by side

FigureGalileoInspect AI
Price from$100/moFree
Free plan—Yes
Free trial——
Open source——
WebYes—
APIYesYes
Self-hostedYes—
Plans published31
Spec score · LLM Evaluation Tools7.8 (#11)7.4 (#19)
Spec score · AI LLM Evaluation Tools7.9 (#17)7.5 (#22)
Spec score · AI Agent Evaluation Tools7.8 (#18)7.4 (#23)
Founded20212024
PurposeGalileo is an observability, evaluation, and guardrail platform for GenAI and agentic applications.Inspect is an open-source framework for evaluating large language models across coding, agentic tasks, reasoning, knowledge, behavior, and multimodal understanding.

Plans

Galileo

  • Pro$100 a month
  • EnterprisePriced on request
  • FreePrice not published

Galileo pricing →

Inspect AI

  • Inspect AIFree

Inspect AI pricing →

In their own words

Galileo

Galileo is an observability, evaluation and guardrail platform for generative AI and agentic applications. It provides ready-made evaluations for RAG, agents, safety and security, as well as custom evaluators. Observability tools analyze agent behavior to surface patterns and failure modes, while Galileo Experiments let teams evaluate datasets and prompts systematically and compare results. Evaluation scores can guide agent actions, tool access and escalation paths. Developers can use Python and TypeScript SDKs or the API, with integrations including CrewAI, Google ADK, LangChain and LangGraph, OpenAI, Microsoft Agent Framework, Strands Agents and Vercel AI SDK. Deployment options include SaaS, virtual private cloud and on-premises. The Free plan includes 5,000 traces per month, unlimited users and unlimited custom evaluations. Pro costs $100 a month, billed yearly, and includes 50,000 traces per month; pricing scales with trace volume. SSO supports OIDC and SAML only on a customer's own Galileo cluster, not the free version or hosted app.galileo.ai service.

Visit galileo.ai

Inspect AI

Inspect AI is a free, open-source, self-hosted framework for evaluating large language models. It covers coding, agentic tasks, reasoning, knowledge, behavior, and multimodal understanding. Evaluations combine datasets, solvers, and scorers, with more than 200 pre-built evaluations available. Inspect View provides web-based monitoring and visualization, while a VS Code extension supports log browsing, task execution, debugging, and option configuration. The framework has built-in support for more than 20 model providers and local inference through Hugging Face, vLLM, and SGLang. Documented provider groups include OpenAI, Anthropic, Google, AWS Bedrock, Azure AI, Ollama, and others. Standard tools cover web search, code execution, text editing, computer use, and web browsing, with MCP support. Agents from OpenAI Agents SDK, Pydantic AI, LangChain, Claude Code, Codex CLI, and Gemini CLI can be integrated. Untrusted model code can run in Docker, Kubernetes, Modal, Proxmox, Vagrant, and other systems through an extension API.

Visit inspect.aisi.org.uk