Component
core/ai-tool/computer-use
A tool that presents an agent with a virtual desktop it can see and control, taking screenshots and issuing pointer and keyboard input, so a deployment can automate applications that expose neither an API nor a web page. The desktop's screen geometry is set by the developer, defaulting to 1024 by 768, because the agent reasons over the pixels it is given. Declared as a server: the desktop session is a long-running workload the agent connects to. Marked mutating, since that input drives real applications. Realized on Kubernetes as a single-replica Deployment fronted by a ClusterIP Service, so one desktop stays resident across an agent's turns and every screenshot comes from the session the previous input acted on. An edge from the tool, on a socket the author names, delivers what its `inject:` block dictates, as variables or as files, on every realization that runs the tool. The catalog pins no image, so nothing renders until the Release sets `infra.image`. The component's own `inject:` block takes `env` and `file` entries too, and one reading a value of the tool alone replaces that value's default variable name.
Provenance
- Content digest
- sha256:82a9932e7d9a2f8df015ccf1814bfe926f694228b0130e9671b35c479612fa5a
- Published
- 2026-11-10T10:09:51Z
- Signing identity
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Signature
- Officialapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:8a22dc63826efb86a642d370ac08613c89b9139de18a4a7c039f609c3bb99964
Reference at this version
oci://hub.aggrega.ai/component/core/ai-tool/computer-use:1.0.0Developer parameters
Values the developer sets in the Aggregate.
Extends BaseComponents#/schemas/BaseToolParameter
| Name | Type | Default | Required | Description |
|---|---|---|---|---|
| display_width | integer | 1024 | yes | — |
| display_height | integer | 768 | yes | — |
Operator sizing
Infrastructure sizing the operator tunes per environment.
| Name | Type | Default | Required | Description |
|---|---|---|---|---|
| image | string | — | no | Container image serving the desktop session and its control API over HTTP. |
| port | integer (min 1024, max 65535) | 8080 | no | Port the tool listens on, and the port it publishes to consumers. |
| compute | object | — | no | — |
Output contract
Values this component publishes to consumers over the uses topology.
| Name | Type | Default | Required | Description |
|---|---|---|---|---|
| host | string | — | yes | In-cluster DNS name an agent calls to see and control the desktop. A consumer that composes its own address dials this name; one that does not reads `endpoint` instead. |
| port | integer | — | yes | TCP port the control API is accepted on. It follows the port an operator set in the Release, so a consumer reads it rather than assuming a default. |
| endpoint | string | — | yes | Full base URL an agent sends screenshot and input requests to, with the host and the port already composed. A consumer hands it to its tool client as the address it calls. |
| protocol | string | — | no | URL scheme to reach `host` and `port` over, for a consumer composing its own address rather than reading `endpoint`. |
Uses sockets
The dependency sockets this component connects through. The target of every connection wired through a socket must satisfy its label selector, and each connection may carry an attachment in the slots the socket declares. A required slot is owed by each connection the Aggregate or the Release wires through the socket.
No uses sockets declared.
Attachment slots
Named binding points at which a Feature attaches to this component. A slot's selector constrains which Feature may fill it and its inject list names how the Feature's material may be delivered. A required slot must be bound on every instance, by an attachment on the instance or at a scope above it, and a sensitive slot is declared to handle secret material. A Feature may also attach under a name no slot declares.
No attachment slots declared.
Self-inject allowlist
env, file
Relationships
Typed edges to and from other published entities. A reference with no published target renders as a broken edge rather than a link.
Uses
- $refextends schema (values)
BaseComponents#/schemas/BaseToolParameter
Used by
uses socket «upstream»
uses socket «forward_target»
uses socket «scrape_target»
uses socket «store»
applies to
applies to
applies to
applies to
applies to
applies to
applies to
implements