Computer use
Anthropic opened a mode in which the model looks at a screenshot, moves the cursor, clicks and types, working an interface the way a person does.
Why it matters
Models stopped needing a purpose-built programmatic interface: whatever a person can reach became reachable for them too.
Until then an agent could act in the world only through tools described in advance: an API call, a function, a plugin. Working the screen removes that limit: any old program with no machine interface at all suddenly becomes operable. Anthropic released the mode with a direct warning that it was unreliable and slow, and recommended running it in a sandbox. The risk is plain: a model that acts on what it sees on screen is exposed to whatever reaches that screen.