agent-cu vs OpenComputer

agent-cu is a command-line tool for controlling desktop apps by clicking, typing, and reading interface information. It uses the accessibility tree that screen readers rely on to identify interface elements, then acts on them through references. Commands include snapshots, selectors, clicks, typing, scrolling, dragging, window management, and JSON output. Users can batch commands and reuse YAML workflows. The tool supports Electron apps through CDP, including Slack, Cursor, VS Code, Postman, Discord, and Notion. Its skill can be used with Claude Code, Cursor, Codex, Copilot, OpenCode, Cline, and 40+ other agents. agent-cu runs locally on macOS, Linux, and Windows; precompiled binaries are available for macOS Apple Silicon and Intel, Linux, and Windows. Installation instructions cover npm, pnpm, yarn, and bun. It requires explicit operating-system accessibility permissions to read and control apps. The project is free and MIT licensed. Its repository states that it is no longer maintained and recommends Cua and Cua Driver instead.

OpenComputer is a free, MIT-licensed open-source desktop agent that runs locally and uses screen understanding to operate applications through mouse and keyboard actions. It can click, drag, scroll, enter text, use shortcuts, open URLs, and wait for interface changes. The agent can connect to a local vision-language model through vLLM or to a hosted API; the endpoint must accept image inputs, function tools, and the model’s tool-call format. Ask first is the default permission mode and requests approval for mouse, keyboard, and URL actions, while Automatic mode runs them without individual prompts. Build targets include Linux AppImage and deb packages, Windows NSIS, and macOS DMG. Linux X11 is best supported; Wayland, Windows, and macOS are experimental. The current agent operates only on the primary display. Screenshots, prompts, and tool results can remain local. API keys use user-only file permissions but are not stored in the operating-system keychain. The project describes itself as early alpha and recommends supervision for sensitive workflows.