FeatureRecipe
semantic-caching-apisix
Realizes core/semantic-caching on the gateway core/gateway/apisix; a Release binds it in its Manifest. It emits no file: the gateway's chart Recipe, apisix-chart, reads the attachment and writes APISIX 3.18.0's ai-cache onto the chat route of each model wired to the gateway's models socket, keeping the replies in the core/datastore/redis wired to its cache_store socket. A reply is stored per route and per caller: under the consumer the request authenticated as, one of the callers infra.callers declares, each by its own key, so no caller is served a reply stored for another. The gateway embeds a request's last user message with embedding_model, the alias of a models connection, through that model's own endpoint and credential, and serves a stored reply whose message is at least similarity_threshold alike and whose earlier messages are the same; a request identical to a stored one is served from the exact layer. A reply is kept ttl_seconds, and one served by meaning is stored again under that request for ttl_seconds more. Completion requests are not cached. A store or embedding failure is a miss: the request is answered. So it keeps scope key alone, and refuses end_user, the default, by name: the gateway cannot tell end users behind one key apart. It halts with no caller declared, with nothing wired to cache_store or the models socket, on an embedding_model no models connection carries, on a second such attachment, and on any component other than core/gateway/apisix.
来源
- 内容摘要
- sha256:0a9a42a27280d5378c116a33f9f4feb1d98cc203c6f93d32ebf6a15054b04253
- 发布时间
- 2026-11-10T10:16:22Z
- 签名身份
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
签名
- 官方application/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:cae09ffb90e9f4512856fe4242f9f61470577371e61224a1d0061079f349650a
此版本的引用
oci://hub.aggrega.ai/featurerecipe/helm/semantic-caching-apisix:1.0.0- 目标
- —
- 实现
- core/semantic-caching:1.0.0
提供
此配方为使用方接入的确定性指针模板。
未声明 provides 模板。
Workload
未声明工作负载模板。
局部变量
未声明局部变量。
值映射
未声明值映射。
关系
与其他已发布实体之间的类型化边。没有已发布目标的引用会呈现为断开的边,而不是链接。
使用
- 实现实现
core/semantic-caching:1.0.0
被使用
目录中没有任何内容依赖此实体。