Prompt Assay vs Vellum

Prompt Assay is a web and API workbench for authoring, refining, versioning, testing, and shipping LLM prompts and Agent Skills. Its critique feature evaluates clarity, completeness, structure, technique use, robustness, and efficiency, with written reasons. An in-editor AI pair can brainstorm, critique, improve, rewrite, compare, and convert content. Connect your own Anthropic, OpenAI, or Google models to run a prompt across 2–5 models in parallel and compare outputs, latency, token use, and cost; optional LLM-as-Judge scoring is available. For Agent Skills, users can create multi-file bundles, critique them, and run Behavioral Evals across Claude, GPT, and Gemini. Imports accept Markdown, Anthropic JSON, OpenAI JSON, or raw text; its bundle preserves versions, tags, fragments, and metadata. The Free plan is free, with 250 calls monthly and one seat; seven initial platform-funded calls are available before BYOK is needed for ongoing use. Solo costs $49 a month and includes API and TypeScript SDK access. The public API and SDK require Solo or higher.

Vellum is a personal AI assistant that can read files, manage calendars, send email, run code, and control a computer. It saves preferences and context in its workspace for later conversations, and users can create, install, and manage skills. Listed OAuth services include Discord, GitHub, Google services, HubSpot, Linear, Twitter (X), Asana, Notion, Microsoft Outlook, and Todoist. Vellum says OAuth tokens stay in a credential vault rather than being exposed to the language model. Sensitive actions prompt for approval, and users can set trust rules for standing permissions. By default, conversation context is sent to Anthropic to generate responses; OpenAI, Google, OpenRouter, Fireworks, and local Ollama are listed alternatives. An internet connection is required. Vellum Cloud runs assistants in isolated environments with private storage and 24/7 availability. The Free plan includes first tasks and pay-as-you-go credits. Mighty costs $30 a month, Super $100 a month, and Ultra $200 a month. There is no shipped Linux desktop client, but Linux users can use the web app, Chrome extension, or self-host the runtime.