LangSmith vs Respan (formerly Keywords AI)
LangSmith
langchain.comRespan (formerly Keywords AI)
respan.aiSide by side
| Figure | LangSmith | Respan (formerly Keywords AI) |
|---|---|---|
| Price from | $39/mo | $16.58/mo |
| Free plan | Yes | Yes |
| Free trial | — | Yes |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | — |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 3 | 3 |
| Spec score · AI Agent Observability Tools | 9.1 (#4) | 7.8 (#23) |
| Spec score · AI LLM Observability Tools | 9.1 (#3) | 7.7 (#22) |
| Spec score · LLM Observability Tools | 9.0 (#5) | 7.7 (#24) |
| Integrations | Documented integrations cover OpenAI, Anthropic, Bedrock, Gemini, Mistral, LiteLLM, OpenTelemetry, CrewAI, Vercel AI SDK, PydanticAI, AutoGen and many other frameworks and providers. | The integrations directory lists 171 integrations, including OpenTelemetry, LangChain, OpenAI, Anthropic, AWS Bedrock, Slack, and PostHog. |
| Monitoring | Monitoring dashboards track token usage, latency percentiles, error rates, cost and feedback scores, with webhook and PagerDuty alerts. | The product tracks requests, errors, cost, latency, and tokens, with threshold alerts sent through Slack, email, or webhook. |
| Support | The Developer plan includes community support, and the Enterprise plan lists a support SLA. | The pricing page lists Community Discord for Free, email support for Team, and a dedicated support engineer for Enterprise. |
| Tracing | Tracing records agent conversations and runs step by step, including prompts, model calls, tools, errors, latency and token usage. | Respan captures LLM calls, tool runs, retrievals, and agent turns as spans in a trace with input, output, latency, and cost. |
Plans
Respan (formerly Keywords AI)
- FreeFree
- Team$199 a year
- EnterprisePriced on request
In their own words
LangSmith
LangSmith is a commercial agent-engineering platform for building, evaluating, deploying, monitoring, and improving AI agents. It supports offline evaluations on curated datasets and real-time scoring of production interactions. Evaluation methods include human review, heuristic checks, LLM-as-judge evaluators, pairwise comparisons, and custom Python or TypeScript evaluators. Annotation queues route runs to subject-matter experts for feedback that can calibrate evaluations, improve prompts, or augment datasets. The Playground compares prompt versions or model providers, and LangSmith chat can auto-improve prompts. Observability includes agent and retrieval tracing, token and general cost tracking, trajectory monitoring, online evaluations, and webhook or PagerDuty alerts. Traces can arrive through SDKs or an API from LangGraph, custom Python, or other stacks; SDKs are listed for Python, TypeScript, Go, and Java. Hosting ranges from cloud to hybrid and self-hosted Enterprise options. The Developer plan costs nothing, Plus costs $39 a month, and Enterprise pricing is custom.
Respan (formerly Keywords AI)
Respan, formerly Keywords AI, is an AI gateway with observability, evaluation, and security testing features. Its OpenAI-compatible gateway routes requests to more than 1,000 models through one endpoint, with fallbacks, load balancing, automatic retries, and response caching. The gateway may add 50 to 150 ms of latency. Respan records LLM calls, tool runs, retrievals, and agent turns as trace spans with input, output, latency, and cost. Evaluators can combine LLM judges, deterministic code checks, and human review, including for sampled production traffic. Monitoring tracks requests, errors, cost, latency, and tokens, with threshold alerts through Slack, email, or webhook. The integrations directory lists 171 connections, including OpenTelemetry, LangChain, OpenAI, Anthropic, AWS Bedrock, Slack, and PostHog. Platforms are API, self-hosted, and web. Free is free; Team is $199/mo billed annually. Enterprise pricing is custom. The homepage states support for SOC 2, GDPR, and HIPAA, and says a BAA is available for healthcare teams.