e8a5403f91
Major update based on Anthropic's March 24, 2026 releases: - feature-map.md: expanded from 20 to 22 capabilities, gaps reduced from 2 to 1 (only Canvas/A2UI remains) - examples/11-computer-use: desktop control via screenshots and clicks - examples/12-remote-control: /rc and Dispatch for phone control - examples/13-auto-mode: AI safety classifier for autonomous execution - cowork-integration/: how Code + Cowork + Dispatch together replicate OpenClaw's full feature set - security/auto-mode-explained.md: deep-dive on the new permission mode - Updated README with broader ecosystem table and revised scores Score: 12 full match (55%), 9 different approach (41%), 1 gap (4%) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
54 lines
1.8 KiB
Markdown
54 lines
1.8 KiB
Markdown
# Example 11: Computer Use
|
|
|
|
Demonstrate Claude Code's ability to control your desktop: open
|
|
apps, click buttons, fill forms, take screenshots. This is the
|
|
capability that made people say "Anthropic just killed OpenClaw."
|
|
|
|
**OpenClaw equivalent:** Browser automation + macOS/iOS/Android
|
|
companion apps with screen control.
|
|
|
|
**Requirements:**
|
|
- Claude Code Desktop app (not CLI-only)
|
|
- macOS with Accessibility and Screen Recording permissions granted
|
|
- Computer Use enabled in Settings > Desktop app > General
|
|
- Pro or Max plan
|
|
|
|
## The prompt
|
|
|
|
```
|
|
Open Safari, navigate to Hacker News, take a screenshot of the
|
|
front page, then open TextEdit and write a summary of the top
|
|
5 stories with their point counts. Save the file as
|
|
hn-summary-today.txt on the Desktop.
|
|
```
|
|
|
|
## What happens
|
|
|
|
1. Claude takes control of your screen (golden border appears)
|
|
2. Opens Safari, navigates to news.ycombinator.com
|
|
3. Takes a screenshot to read the page content
|
|
4. Opens TextEdit (or creates a new document)
|
|
5. Types the summary with story titles and point counts
|
|
6. Saves the file to your Desktop
|
|
|
|
## How this compares to OpenClaw
|
|
|
|
OpenClaw controls the browser via CDP/Playwright (programmatic).
|
|
Its macOS/iOS companion apps can interact with the desktop.
|
|
|
|
Claude Code Computer Use controls the screen like a human:
|
|
screenshots, mouse clicks, keyboard input. It is slower but
|
|
works with any application, not just browsers.
|
|
|
|
## Limitations (honest)
|
|
|
|
- Research preview. Expect rough edges.
|
|
- macOS only (for now)
|
|
- Slower than Playwright for browser-only tasks
|
|
- Cannot interact with apps that block screen recording
|
|
- Some actions cannot be undone (the macOS permission warning
|
|
is real)
|
|
|
|
For browser-only automation, Playwright MCP (example 04) is
|
|
faster and more reliable. Computer Use shines when you need to
|
|
interact with native desktop apps that have no API or CLI.
|