Agent Device Controller

What it does

Agent Device Controller gives an agent deterministic, conservative workflows to interact with mobile and desktop app UIs. It provides snapshot-based inspection, interactive refs for targeting elements, decision rules to prefer read-only checks before mutations, and guidance for collecting logs, network traces, and perf snapshots. Concrete use cases: automated QA, reproducing UI bugs, capturing verification screenshots, and scripted interaction flows for mobile/TV/desktop targets.

When to use it

Use this skill whenever an agent must examine or interact with a running app on iOS, Android, tvOS, or macOS. Typical triggers: "take a snapshot of the current screen", "tap this button and verify the result", "collect logs and network traces", or "run a QA acceptance loop". Start by running the bootstrap references to ensure the device and app session are correct.

What's included

• Scripts: none in-skill, but the repo includes references with bootstrap and exploration guides (has_references=true).
• References: bootstrap-install.md, exploration.md, debugging and verification guides linked from the skill.
• Instructions: step-by-step operating rules (use snapshot then snapshot -i for interactive refs, prefer get/is/find before mutating, use diff snapshot after changes, dismiss transient overlays conservatively).

Compatible agents

Best with agents that can run CLI tools and follow procedural rules (Copilot-style agents, Claude/Code, Cursor) and any host that can call the device CLI.