# Vercel Labs open-sources agent-desktop for computer use on macOS, Windows and Linux

published: 2026-10-31T11:05:26.482Z
topic: browsers
source: https://www.marktechpost.com/2026/10/31/vercel-labs-agent-desktop-computer-use/
url: https://aiagentnews.io/stories/vercel-labs-open-sources-agent-desktop-for-computer-use-on-macos-windows-and

Vercel Labs has released agent-desktop, an Apache-2.0 licensed Rust command-line tool that gives AI agents computer use on macOS, Windows and Linux. It works by reading operating system accessibility trees and acting on stable element references instead of screenshots.

The project is published under the Apache-2.0 license and is written as a Rust CLI. According to MarkTechPost, it lets any AI agent operate a computer on macOS, Windows and Linux.

Rather than analyzing pixels, agent-desktop reads the accessibility trees that each operating system exposes and acts on stable refs taken from them. The approach targets the interface structure of desktop applications rather than what appears on screen.

## Why it matters if you build agents

Agent developers get an open-source, cross-platform option for desktop control that does not depend on screenshot parsing, which can be a useful starting point for automating native apps.

Because the tool relies on accessibility data, its results will depend on how well each application exposes that data, so testing against the specific apps an agent needs is a sensible first step.