Component
core/security/trustyai-guardrails-gateway
TrustyAI's guardrails gateway in a model's path: a service speaking the OpenAI chat-completions API on one route, values.route, that sends every request through the orchestrator wired on its orchestrator socket with a fixed detector applied, overwriting any detectors a caller names. When the detector reports the latest message at or above values.threshold, the gateway answers with an ordinary completion carrying values.fallback_message, and the model is not asked to reply, though its server's /tokenize route still counts the refused text; with values.check_output set, a flagged reply is replaced the same way. It reads no system message, earlier turn or tool result, refuses a request whose latest message is a list of content parts or a tool result, and answers a refused streamed request with a stream carrying the detections and no text. When the orchestrator or its detector cannot be reached, the request is refused with an error. Its verdict is the detector's: a probabilistic classifier misses some attacks, refuses some legitimate requests and is known to be evadable. It authenticates no caller and serves no model listing. The Release supplies the image in infra.image and the catalog names none: TrustyAI's build adds the compat-openssl11 package, whose declared licence includes the OpenSSL licence, and is published only under a floating tag. Nothing renders until the Release sets `infra.image`. Realized on Kubernetes by its Helm Recipe and for local development by its Compose Recipe, each running that image as a single stateless service.
来源
- 内容摘要
- sha256:091ede15c669b068e2f0474f55a3d5097529b29bacb32efc11db83308e84a4f7
- 发布时间
- 2026-11-10T10:13:56Z
- 签名身份
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
签名
- 官方application/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:6f5bb002d081f8b3b5527f6d5f28f3c4d3b5b43c046415095961fd74ea7da560
此版本的引用
oci://hub.aggrega.ai/component/core/security/trustyai-guardrails-gateway:1.0.0开发者参数
开发者在 Aggregate 中设置的值。
| 名称 | 类型 | 默认值 | 必需 | 描述 |
|---|---|---|---|---|
| route | string | guarded | 否 | Name of the gateway's one route: it serves chat completions at /<route>/v1/chat/completions, and provides.endpoint ends in /<route>/v1, the base URL a client library takes. |
| threshold | number (min 0, max 1) | 0.5 | 否 | Score at or above which the detector's verdict refuses the request. The orchestrator applies it, and core/security/trustyai-huggingface-detector reports to the orchestrator only labels scored at or above its own 0.5, so with that detector a value below 0.5 has no effect; above 0.5, a higher value lets through a prompt the detector scores below it. |
| fallback_message | string (min 1) | I'm sorry, I can't respond to that. | 否 | Text of the assistant message the gateway answers a refused request with, in an ordinary completion that also carries the detections. A refused streamed request is answered with the detections and no text. |
| check_output | boolean | false | 否 | Also checks the model's reply with the same detector and threshold, and replaces a flagged reply with values.fallback_message. The model is called before its reply is checked. |
运维规格
运维人员按环境调整的基础设施规格。
| 名称 | 类型 | 默认值 | 必需 | 描述 |
|---|---|---|---|---|
| port | integer (min 1024, max 65535) | 8090 | 否 | Port the gateway listens on and its Service accepts callers on. Most operators should omit this and let the Recipe assign the default (8090), the product's own. |
| image | string | — | 是 | Image the gateway runs, supplied by the Release; the catalog names none. The Recipes run the published build's own binary at /app/bin/vllm-orchestrator-gateway, so the image is TrustyAI's guardrails gateway or a copy of it. That build adds the compat-openssl11 package and is tagged only as latest, so a Release that must keep one build mirrors it and names the copy here. |
| compute | object | — | 否 | — |
输出契约
此组件通过 uses 拓扑向使用方发布的值。
| 名称 | 类型 | 默认值 | 必需 | 描述 |
|---|---|---|---|---|
| host | string | — | 是 | In-cluster DNS name of the Service fronting the gateway. Every caller reaching this name can send requests through the gateway, so it is an address for the component routing model traffic through it rather than one to publish. |
| port | integer | — | 是 | TCP port that Service accepts callers on. It follows the port an operator set in the Release, so a consumer reads it rather than assuming a default. |
| endpoint | string | — | 是 | Base URL of the OpenAI-compatible API the gateway serves, with the host, the port and the route already composed. A consumer hands it to a client library as its base URL, and sends chat completions to it. |
| protocol | string | — | 否 | URL scheme to reach `host` and `port` over, for a consumer composing its own address rather than reading `endpoint`. |
uses 套接字
此组件用于建立连接的依赖套接字。通过某个套接字接入的每个连接,其目标都必须满足该套接字的标签选择器,且每个连接都可以在该套接字声明的槽位中携带附加项。必需槽位须由 Aggregate 或 Release 通过该套接字接入的每个连接来填充。
orchestrator
- 选择器
- security.aggrega.ai/text-detection=orchestrator
- 注入
- —
此套接字未声明附加槽位,因此经由它的连接不携带任何附加项。
附加槽位
Feature 附加到此组件时所用的命名绑定点。槽位的选择器限定哪个 Feature 可以填充该槽位,其 inject 列表则指明 Feature 的内容可以如何交付。必需槽位必须在每个实例上完成绑定,可以通过实例上的附加,也可以通过其上层作用域的附加;敏感槽位则声明为用于处理机密内容。Feature 也可以以任何槽位都未声明的名称进行附加。
未声明附加槽位。
自注入允许列表
未声明自注入管道。
关系
与其他已发布实体之间的类型化边。没有已发布目标的引用会呈现为断开的边,而不是链接。
使用
- 使用使用套接字 «orchestrator»
security.aggrega.ai/text-detection=orchestrator
未声明附加槽位。
被使用
使用套接字 «auth_core»
使用套接字 «auth_core»
使用套接字 «auth_core»
使用套接字 «auth_core»
使用套接字 «guard»
使用套接字 «upstream»
使用套接字 «guard»
使用套接字 «forward_target»
使用套接字 «scrape_target»
使用套接字 «store»
使用套接字 «jailbreak_detection»
适用于
适用于
适用于
适用于
适用于
适用于
适用于
实现
实现