Skip to content
SPECIFICTION
Get listed

Giskard vs Inspect AI

Giskard

giskard.ai

Inspect AI

inspect.aisi.org.uk

Side by side

FigureGiskardInspect AI
Price fromFreeFree
Free planYesYes
Free trial——
Open sourceYes—
WebYes—
LinuxYes—
APIYesYes
Self-hostedYes—
Plans published41
Spec score · LLM Evaluation Tools8.7 (#4)7.4 (#19)
Spec score · AI LLM Evaluation Tools8.8 (#8)7.5 (#22)
Spec score · AI Agent Evaluation Tools8.7 (#8)7.4 (#23)
Founded20212024
PurposeGiskard describes its platform as a way to find vulnerabilities in AI agents before they reach production.Inspect is an open-source framework for evaluating large language models across coding, agentic tasks, reasoning, knowledge, behavior, and multimodal understanding.

Plans

Giskard

  • FreeFree
  • Open-sourceFree
  • EnterprisePriced on request
  • ProfessionalPriced on request

Giskard pricing →

Inspect AI

  • Inspect AIFree

Inspect AI pricing →

In their own words

Giskard

Giskard provides tools for assessing AI agents before production, with coverage for prompt injection, data disclosure, inappropriate content, hallucinations, contradictions, and omissions. Its Hub performs black-box testing of conversational text-to-text agents available through an API endpoint. An assessment produces a structured report with a deploy-or-fix verdict, ranked vulnerabilities, and functional scenarios; passing agents receive a Giskard Label. Giskard describes a remediation process in which its team qualifies findings, discusses severity, prioritizes issues, opens workflow tickets, and reruns tests to check fixes. Enterprise evaluation options include adversarial probes, domain-specific datasets, RAG quality metrics, customizable metrics, and human review interfaces. Deployment choices include on-premise, private cloud, and SaaS. Giskard lists EU or US data residency, access controls, audit trails, identity-provider integration, encryption, and a zero-training policy, alongside GDPR, SOC 2 Type II, and HIPAA compliance. The free plan includes a local open-source library, basic vulnerability scanning and RAG evaluation, community support, and best-effort maintenance.

Visit giskard.ai

Inspect AI

Inspect AI is a free, open-source, self-hosted framework for evaluating large language models. It covers coding, agentic tasks, reasoning, knowledge, behavior, and multimodal understanding. Evaluations combine datasets, solvers, and scorers, with more than 200 pre-built evaluations available. Inspect View provides web-based monitoring and visualization, while a VS Code extension supports log browsing, task execution, debugging, and option configuration. The framework has built-in support for more than 20 model providers and local inference through Hugging Face, vLLM, and SGLang. Documented provider groups include OpenAI, Anthropic, Google, AWS Bedrock, Azure AI, Ollama, and others. Standard tools cover web search, code execution, text editing, computer use, and web browsing, with MCP support. Agents from OpenAI Agents SDK, Pydantic AI, LangChain, Claude Code, Codex CLI, and Gemini CLI can be integrated. Untrusted model code can run in Docker, Kubernetes, Modal, Proxmox, Vagrant, and other systems through an extension API.

Visit inspect.aisi.org.uk