Computer Use OOTB vs open-computer-use

Computer Use OOTB is an open-source framework for automating desktop tasks through a graphical interface, using API-based or locally running models. It supports Windows and macOS and provides a Gradio interface without requiring Docker. Users can configure one model for a task or separate models for planning and computer control; listed options include Claude 3.5 Sonnet, GPT-4o, Qwen models, ShowUI, and UI-TARS. Local inference can avoid API costs, though a task using Claude 3.5 Computer Use may cost a few dollars. Setup requires Miniconda, Python 3.12 or newer, dependency installation, and starting the interface with `python app.py`. ShowUI local runs require a CUDA-enabled NVIDIA GPU with at least 6 GB of GPU memory on Windows, or an M1-or-newer Apple Silicon Mac with at least 16 GB unified RAM. A mobile browser can send commands to the computer running the software. The project uses an Apache-2.0 license. Its README warns that model actions can be unintended or harmful and recommends monitoring them; anyone with a public Gradio link may be able to control the computer.

open-computer-use is a free, MIT-licensed local MCP server that lets AI agents inspect and operate desktop applications through accessibility interfaces. Its nine core tools cover app discovery, accessibility-tree and screenshot capture, clicking, scrolling, dragging, typing, key presses, secondary actions, and control-value changes. The project says it runs entirely on the user’s machine and uses the accessibility layer for core app actions without taking over the physical mouse and keyboard. Setup documentation covers Codex CLI and App, Claude Code, Gemini CLI, and opencode, with manual configuration for other MCP clients. A ZCode plugin installs the skill and connects an MCP server. macOS 14 or later requires Accessibility and Screen Recording permissions. Windows and Linux use a signed-in desktop session, and Linux requires AT-SPI2. Additional window-level tools are currently available on Windows, while macOS and Linux support is in progress. Password managers are refused; app launching, focus changes, and global input injection require explicit environment-variable gates. The project warns that high-privilege automation should be used only on authorized machines.