Prompt Engine vs PromptPex
Prompt Engine
promptengine.mePromptPex
microsoft.github.ioSide by side
| Figure | Prompt Engine | PromptPex |
|---|---|---|
| Price from | $4.99/mo | — |
| Free plan | Yes | — |
| Free trial | — | — |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | — | Yes |
| macOS | — | Yes |
| Linux | — | Yes |
| Self-hosted | — | Yes |
| Plans published | 3 | 0 |
| Spec score · AI Prompt Generators | 8.0 (#10) | 7.2 (#21) |
| Purpose | Prompt Engine is a platform for creating, editing, organizing, and optimizing prompts for ChatGPT and other AI systems. | PromptPex is a tool for developers to explore and test AI model prompts by treating prompts as functions and generating test inputs. |
| Support | The support guide offers documentation, video tutorials, a blog, and email support. | The transparency note invites feedback and reports of unexpected or offensive behavior by email to listed project contacts. |
Plans
In their own words
Prompt Engine
Prompt Engine is a web platform for creating, editing, organizing, and optimizing prompts for ChatGPT and other AI systems. Its assisted optimizer reviews prompts and suggests improvements, while prompt testing and dynamic template variables let users preview templates with entered values. Users can assemble multi-step prompt chains, with separate content and variables at each step. A library organizes prompts using folders, subfolders, tags, search, and grid or list views. The curated template collection can be copied to a personal library and customized. The FAQ says prompts can be created for systems including OpenAI, Anthropic Claude, Google, and open-source models. Personal-library prompts are private to the account, while administrators can create public templates; users can export individual prompts or their whole library. The free-forever Hobby plan allows up to 10 prompts and includes basic optimization, 25 credits, limited features, and email support. Pro costs $4.99 a month, with a yearly option at 49 USD per year. A one-time pack of 100 optimization credits costs 4.99 USD. Support resources include documentation, video tutorials, a blog, and email support.
PromptPex
PromptPex is an open-source tool for developers who keep AI prompts in their codebase and want to examine how models follow prompt requirements. It treats prompts as functions, extracts output rules expressed in natural language, and generates unit tests to check whether a model follows those rules. It can also evaluate prompt performance across models, using an LLM to judge whether outputs meet stated requirements. Test generation can be shaped with scenarios, expansions, custom instructions, and effort levels. The CLI accepts Markdown or text templates, Prompty files, and GitHub Models prompt YAML files. Setup lists OpenAI, Azure OpenAI, GitHub Models, and Ollama as supported providers. PromptPex is packaged as an npm CLI and can run in Docker; its setup guide also describes a local web interface. Documented integrations include OpenAI Evals, Azure OpenAI Stored Completions, GitHub Models Evals, and GitHub Actions. Microsoft is identified as the maker. The project is intended for research, and its maker advises against downstream use without additional evaluation of robustness, safety, harm, and bias. Vague prompts can lead to suboptimal results, and rule extraction may be less accurate with complex or idiomatic language.