MCP Computer Use

What it does

This server allows AI agents to interact directly with a local desktop. It provides a set of tools to control the mouse, keyboard, and capture screenshots, following the OpenAI Computer Use (CUA) specification to ensure compatibility with CUA-aware models.

Tools

• computer_use (Default): A single tool that accepts an array of actions (click, type, screenshot, etc.).
• computer_click: Performs a mouse click at specific coordinates.
• computer_type: Types text into the active window.
• computer_screenshot: Captures the current screen and returns a downscaled image with coordinate mapping.
• computer_drag: Moves the mouse while holding the button.
• computer_keypress: Sends a specific key or chord (e.g., Ctrl+C).

Installation

Build from source using Cargo: cargo build --release

Claude Desktop Configuration:

{
  "mcpServers": {
    "mcp-computer-use": {
      "command": "/path/to/target/release/mcp-computer-use"
    }
  }
}

Supported hosts

Confirmed for Claude Desktop and Cursor.