Claude Controls the Computer: Computer Use in Cowork and Code from Anthropic
Anthropic has integrated computer use technology into its Claude Cowork and Claude Code products. The model now independently controls the mouse, keyboard, and screen, opening browsers, clicking on elements, and filling out forms when direct connectors are unavailable.
How Computer Use Works
The technology debuted in October 2024 as an API for developers. In consumer products, it activates without code: Claude first checks for built-in integrations (Slack, Google Calendar), then switches to screen control. Explicit user permission is required before accessing a new application. The built-in scanner monitors processes for malicious activity, blocking suspicious operations.
This allows the model to handle tasks where APIs are absent: following links, entering data into forms, navigating interfaces. The speed is lower than direct integrations, but the functionality is broader.
Integration with Dispatch
Dispatch, launched a week ago, turns your smartphone into a controller: tasks are sent from mobile and executed on desktop. Computer use enhances this combo:
- Automating routine tasks: checking email, generating morning summaries.
- DevOps operations: running tests in IDE, creating pull requests.
- Cross-platform scenarios: controlling desktop from mobile interface.
Example workflow: a developer initiates a task from their phone, Claude opens the terminal, runs scripts, and returns the logs.
Limitations and Security
The feature is in research preview for Pro/Max subscribers, macOS only. Anthropic emphasizes its raw status:
- Complex tasks require restarts.
- Screen control is slower than API.
- Sensitive apps are blocked by default.
Recommendations:
- Use with trusted services.
- Avoid highly sensitive data.
- Monitor access permissions.
The scanner prevents jailbreaks and unauthorized actions, but you shouldn't rely on it alone.
Key Points
- Versatility: fallback to screen control expands scenarios beyond APIs.
- Security: mandatory permissions and scanner minimize risks.
- Integration: Dispatch + computer use automates end-to-end tasks.
- Availability: research preview on macOS for Pro/Max.
- Performance: suitable for prototypes, not production.
Prospects for Developers
For middle/senior specialists, computer use opens automation without custom integrations. In CI/CD, you can delegate manual deploys, UI A/B tests, or dashboard monitoring to Claude. Paired with IDE—generating PRs with automatic fixes.
Testing will show stability on production workloads. Expect expansion to Windows/Linux and full release.
— Editorial Team
No comments yet.