open-computer-use vs Screenbox

open-computer-use is a free, MIT-licensed local MCP server that lets AI agents inspect and operate desktop applications through accessibility interfaces. Its nine core tools cover app discovery, accessibility-tree and screenshot capture, clicking, scrolling, dragging, typing, key presses, secondary actions, and control-value changes. The project says it runs entirely on the user’s machine and uses the accessibility layer for core app actions without taking over the physical mouse and keyboard. Setup documentation covers Codex CLI and App, Claude Code, Gemini CLI, and opencode, with manual configuration for other MCP clients. A ZCode plugin installs the skill and connects an MCP server. macOS 14 or later requires Accessibility and Screen Recording permissions. Windows and Linux use a signed-in desktop session, and Linux requires AT-SPI2. Additional window-level tools are currently available on Windows, while macOS and Linux support is in progress. Password managers are refused; app launching, focus changes, and global input injection require explicit environment-variable gates. The project warns that high-privilege automation should be used only on authorized machines.

Screenbox gives AI agents isolated virtual desktops with real browsers and desktop applications. Each desktop includes Chromium with DevTools and extensions, plus tools such as file managers, terminals, and office applications. Agents can use 21 MCP tools across more than 100 actions, including screenshots, OCR, clicks, typing, shell access, file operations, and clipboard control. It connects to MCP clients including Claude Desktop, Claude Code, and Cursor through stdio, streamable HTTP, or SSE. A web dashboard supports live viewing, agent management, snapshots, session logs, and a knowledge browser. Users can save and restore desktop states, including files and browser sessions, and clone desktops from templates. Activity can be viewed through RDP or noVNC, with mouse and keyboard control available. Desktops run in Docker containers with memory limits, network isolation, and no bind mounts; the maker cautions that they are not hardened sandboxes. The software is self-hosted and open source under AGPL-3.0. The maker says deployment data stays on the user's infrastructure and the software sends no telemetry to Screenbox or third parties. It requires about 2 GB of RAM per desktop and no GPU; idle desktops pause automatically.