Kjell Tore Guttormsen e8a5403f91 feat: add Computer Use, Remote Control, Auto Mode, and Cowork integration

Major update based on Anthropic's March 24, 2026 releases:

- feature-map.md: expanded from 20 to 22 capabilities, gaps reduced
  from 2 to 1 (only Canvas/A2UI remains)
- examples/11-computer-use: desktop control via screenshots and clicks
- examples/12-remote-control: /rc and Dispatch for phone control
- examples/13-auto-mode: AI safety classifier for autonomous execution
- cowork-integration/: how Code + Cowork + Dispatch together replicate
  OpenClaw's full feature set
- security/auto-mode-explained.md: deep-dive on the new permission mode
- Updated README with broader ecosystem table and revised scores

Score: 12 full match (55%), 9 different approach (41%), 1 gap (4%)

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-26 10:04:05 +01:00

1.8 KiB

Raw Blame History

Example 11: Computer Use

Demonstrate Claude Code's ability to control your desktop: open apps, click buttons, fill forms, take screenshots. This is the capability that made people say "Anthropic just killed OpenClaw."

OpenClaw equivalent: Browser automation + macOS/iOS/Android companion apps with screen control.

Requirements:

Claude Code Desktop app (not CLI-only)
macOS with Accessibility and Screen Recording permissions granted
Computer Use enabled in Settings > Desktop app > General
Pro or Max plan

The prompt

Open Safari, navigate to Hacker News, take a screenshot of the
front page, then open TextEdit and write a summary of the top
5 stories with their point counts. Save the file as
hn-summary-today.txt on the Desktop.

What happens

Claude takes control of your screen (golden border appears)
Opens Safari, navigates to news.ycombinator.com
Takes a screenshot to read the page content
Opens TextEdit (or creates a new document)
Types the summary with story titles and point counts
Saves the file to your Desktop

How this compares to OpenClaw

OpenClaw controls the browser via CDP/Playwright (programmatic). Its macOS/iOS companion apps can interact with the desktop.

Claude Code Computer Use controls the screen like a human: screenshots, mouse clicks, keyboard input. It is slower but works with any application, not just browsers.

Limitations (honest)

Research preview. Expect rough edges.
macOS only (for now)
Slower than Playwright for browser-only tasks
Cannot interact with apps that block screen recording
Some actions cannot be undone (the macOS permission warning is real)

For browser-only automation, Playwright MCP (example 04) is faster and more reliable. Computer Use shines when you need to interact with native desktop apps that have no API or CLI.

1.8 KiB Raw Blame History