Component

core/ai-tool/computer-use

A tool that presents an agent with a virtual desktop it can see and control, taking screenshots and issuing pointer and keyboard input, so a deployment can automate applications that expose neither an API nor a web page. The desktop's screen geometry is set by the developer, defaulting to 1024 by 768, because the agent reasons over the pixels it is given. Declared as a server: the desktop session is a long-running workload the agent connects to. Marked mutating, since that input drives real applications. Realized on Kubernetes as a single-replica Deployment fronted by a ClusterIP Service, so one desktop stays resident across an agent's turns and every screenshot comes from the session the previous input acted on. An edge from the tool, on a socket the author names, delivers what its `inject:` block dictates, as variables or as files, on every realization that runs the tool. The catalog pins no image, so nothing renders until the Release sets `infra.image`. The component's own `inject:` block takes `env` and `file` entries too, and one reading a value of the tool alone replaces that value's default variable name.

Provenance

OfficialSigned by a signing identity this catalog recognizes as an official publisher.
Content digest
sha256:82a9932e7d9a2f8df015ccf1814bfe926f694228b0130e9671b35c479612fa5a
Published
2026-11-10T10:09:51Z
Signing identity
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

Signature

  • Officialapplication/vnd.dev.sigstore.bundle.v0.3+json

    https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

    sha256:8a22dc63826efb86a642d370ac08613c89b9139de18a4a7c039f609c3bb99964

Reference at this version

oci://hub.aggrega.ai/component/core/ai-tool/computer-use:1.0.0

Developer parameters

Values the developer sets in the Aggregate.

Extends BaseComponents#/schemas/BaseToolParameter

NameTypeDefaultRequiredDescription
display_widthinteger1024yes—
display_heightinteger768yes—

Operator sizing

Infrastructure sizing the operator tunes per environment.

NameTypeDefaultRequiredDescription
imagestring—noContainer image serving the desktop session and its control API over HTTP.
portinteger (min 1024, max 65535)8080noPort the tool listens on, and the port it publishes to consumers.
computeobject—no—

Output contract

Values this component publishes to consumers over the uses topology.

NameTypeDefaultRequiredDescription
hoststring—yesIn-cluster DNS name an agent calls to see and control the desktop. A consumer that composes its own address dials this name; one that does not reads `endpoint` instead.
portinteger—yesTCP port the control API is accepted on. It follows the port an operator set in the Release, so a consumer reads it rather than assuming a default.
endpointstring—yesFull base URL an agent sends screenshot and input requests to, with the host and the port already composed. A consumer hands it to its tool client as the address it calls.
protocolstring—noURL scheme to reach `host` and `port` over, for a consumer composing its own address rather than reading `endpoint`.

Uses sockets

The dependency sockets this component connects through. The target of every connection wired through a socket must satisfy its label selector, and each connection may carry an attachment in the slots the socket declares. A required slot is owed by each connection the Aggregate or the Release wires through the socket.

No uses sockets declared.

Attachment slots

Named binding points at which a Feature attaches to this component. A slot's selector constrains which Feature may fill it and its inject list names how the Feature's material may be delivered. A required slot must be bound on every instance, by an attachment on the instance or at a scope above it, and a sensitive slot is declared to handle secret material. A Feature may also attach under a name no slot declares.

No attachment slots declared.

Self-inject allowlist

env, file

Relationships

Typed edges to and from other published entities. A reference with no published target renders as a broken edge rather than a link.

Uses

Used by

Component concept reference →

The Aggrega catalog — an open index of components, features, recipes, and the plugins that render them.

Built with the shared Aggrega design system.

Privacy