GEPA vs PromptPex
GEPA
gepa-ai.github.ioPromptPex
microsoft.github.ioSide by side
| Figure | GEPA | PromptPex |
|---|---|---|
| Price from | Free | — |
| Free plan | Yes | — |
| Free trial | — | — |
| Open source | — | — |
| Web | — | Yes |
| Windows | — | Yes |
| macOS | — | Yes |
| Linux | — | Yes |
| API | Yes | — |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 0 |
| Spec score · AI Prompt Generators | 8.6 (#4) | 7.2 (#21) |
| Integrations | The project lists integrations with DSPy, MLflow, Comet ML Opik, Pydantic AI, OpenAI Cookbook, Hugging Face Cookbook, and Google ADK. | PromptPex documents exports and integrations for OpenAI Evals, Azure OpenAI Stored Completions, GitHub Models Evals, and GitHub Actions. |
| Purpose | GEPA is a framework for optimizing prompts, code, agent architectures, configurations, and other text parameters against evaluation metrics. | PromptPex is a tool for developers to explore and test AI model prompts by treating prompts as functions and generating test inputs. |
| Support | The project points users to its documentation, GitHub issues, and a Discord community. | The transparency note invites feedback and reports of unexpected or offensive behavior by email to listed project contacts. |
Plans
In their own words
GEPA
GEPA is a free, open-source Python package for optimizing prompts, code, configurations, agent architectures, policies, and other text-based artifacts. Its optimize_anything API connects to any system through an evaluator you write, so DSPy or another framework is not required. GEPA examines execution traces and evaluator feedback, uses language-model reflection to diagnose problems and propose targeted mutations, then selects candidates with Pareto-aware criteria. It can optimize API-only GPT, Claude, and Gemini models without model-weight access. Human-readable traces explain changes and support agent debugging. Built-in adapters cover Default, Confidence, DSPy Full Program, Generic RAG, MCP, TerminalBench, AnyMaths, and LangChain, with integrations including MLflow, Comet ML Opik, Pydantic AI, and cookbook projects. You can limit metric calls and set several stopping conditions. GEPA works through API or self-hosted deployment, installs with pip, and uses the MIT license.
PromptPex
PromptPex is an open-source tool for developers who keep AI prompts in their codebase and want to examine how models follow prompt requirements. It treats prompts as functions, extracts output rules expressed in natural language, and generates unit tests to check whether a model follows those rules. It can also evaluate prompt performance across models, using an LLM to judge whether outputs meet stated requirements. Test generation can be shaped with scenarios, expansions, custom instructions, and effort levels. The CLI accepts Markdown or text templates, Prompty files, and GitHub Models prompt YAML files. Setup lists OpenAI, Azure OpenAI, GitHub Models, and Ollama as supported providers. PromptPex is packaged as an npm CLI and can run in Docker; its setup guide also describes a local web interface. Documented integrations include OpenAI Evals, Azure OpenAI Stored Completions, GitHub Models Evals, and GitHub Actions. Microsoft is identified as the maker. The project is intended for research, and its maker advises against downstream use without additional evaluation of robustness, safety, harm, and bias. Vague prompts can lead to suboptimal results, and rule extraction may be less accurate with complex or idiomatic language.