Panchangam18/background-computer-use
5 stars · Last commit 2026-04-18
MCP server + skill library for driving macOS apps in the background — click, type, scroll, and inspect accessibility trees without activating apps or moving your cursor. Works with Claude Code, Claude Desktop, Cursor, Codex CLI, Goose, and any other MCP-capable LLM client.
README preview
# background-computer-use An **MCP server + skill library** that lets any MCP-capable LLM client (Claude Code, Claude Desktop, Cursor, Codex CLI, Goose, Continue, Zed, etc.) drive other macOS apps **in the background** — without activating them, bringing them to the front, or moving your cursor. Two things ship here: 1. **MCP server** (`server/cua_server.py`) — exposes nine tools (`list_apps`, `get_app_state`, `click`, `drag`, `perform_secondary_action`, `press_key`, `scroll`, `set_value`, `type_text`) wrapping the macOS Accessibility, CGEvent, and `CGWindowList` APIs. Pure stdio MCP — any compliant client works. 2. **Skill library** (`skills/`) — markdown files with YAML frontmatter that teach the model the one-snapshot-per-turn loop and app-specific heuristics for Safari, Chrome, Clock, Numbers, Apple Music, Spotify, and Notion. Any skill-aware client auto- loads them; for clients without native skill support, you can read the files directly into a system prompt.