Skip to content
SPECIFICTION
Get listed

Llm Developer Tools

Alternatives to Arize Phoenix

The tools Specifiction weighs against Arize Phoenix, from its list of llm developer tools, each with its plans, platforms and spec score.

  1. 01 DeepEval

    DeepEval suits developers building evaluation pipelines for AI systems, particularly those who want tests to run in CI/CD or Python scripts.

    From $200/mo Free plan Open source Web · Windows · macOS · Linux
    9.3 Visit Specs
  2. 02 Braintrust

    Braintrust is aimed at teams operating AI agents in production, from early-stage teams to enterprises.

    From $249/mo Free plan Web · API · Self-hosted
    9.2 Visit Specs
  3. 03 LangSmith

    LangSmith suits teams engineering AI agents that need evaluation, tracing, prompt work, deployment, and production monitoring.

    From $39/mo Free plan Web · Windows · macOS · Linux
    9.0 Visit Specs
  4. 04 Langfuse

    Langfuse suits teams building AI agent applications that need tracing, prompt management, and evaluation tools.

    From $29/mo Free plan Open source Web · Linux · API · Self-hosted
    8.9 Visit Specs
  5. 05 Opik

    Opik suits teams developing applications or agents that make calls to an LLM and want tracing and evaluation across the development cycle.

    From $19/mo Free plan Open source Web · Windows · macOS · Linux
    8.8 Visit Specs
  6. 06 Promptfoo

    It suits developers and enterprises evaluating prompts or testing AI applications for risks.

    Free plan Open source Web · Windows · macOS · Linux
    8.3 Visit Specs
  7. 07 Haystack

    Haystack is built for AI developers and engineers creating modular, transparent systems, including agent workflows, RAG and multimodal applications.

    Free plan API · Self-hosted
    8.1 Visit Specs
  8. 08 Helicone

    Helicone suits teams routing and observing AI application requests across model providers, including teams that need self-hosting or LLM cost tracking.

    From $79/mo Free plan Web · API · Self-hosted
    8.1 Visit Specs
  9. 09 LangChain

    It suits developers building configurable model-and-tool agents in Python or JavaScript/TypeScript.

    From $39/mo Free plan API · Self-hosted
    8.1 Visit Specs
  10. 10 CrewAI AMP
    Free plan Web · API · Self-hosted
    8.0 Visit Specs
  11. 11 Portkey

    Portkey suits teams that need a common API and operational controls for generative AI models and providers.

    From $49/mo Free plan Web · API · Self-hosted
    8.0 Visit Specs
  12. 12 PromptLayer

    PromptLayer is for engineers and domain experts who build or improve AI products together.

    From $49/mo Free plan Web · API · Self-hosted
    7.6 Visit Specs
  13. 13 Cohere North
    Web · Self-hosted
    7.5 Visit Specs
  14. 14 DSPy
    API · Self-hosted
    7.5 Visit Specs
  15. 15 LiteLLM

    LiteLLM is aimed at platform teams that need a shared gateway, model routing and spend controls.

    Free plan Web · API · Self-hosted
    7.5 Visit Specs
  16. 16 LlamaIndex

    LlamaIndex suits developers and enterprises building document-processing, retrieval and knowledge-work workflows.

    From $50/mo Web · Linux · API · Self-hosted
    7.5 Visit Specs
  17. 17 OpenRouter
    Free plan Web · API
    7.5 Visit Specs
  18. 18 Fireworks AI
    Web · API · Self-hosted
    7.4 Visit Specs
  19. 19 Hugging Face Inference Endpoints
    From $0.06/mo Web · API
    7.4 Visit Specs
  20. 20 Replicate
    Free plan Web · API
    7.3 Visit Specs
  21. 21 Ragas
    Linux · API · Self-hosted
    7.1 Visit Specs
  22. 22 AutoGen
    Windows · macOS · Linux
    6.2 Visit Specs
  23. 23 Google Gemini API
    Web
    5.7 Visit Specs
  24. 24 GroqCloud
    Web
    5.7 Visit Specs
  25. 25 Vercel AI SDK
    5.0 Visit Specs

Arize Phoenix, head to head