FeatureRecipe
semantic-caching-apisix
Realizes core/semantic-caching on the gateway core/gateway/apisix; a Release binds it in its Manifest. It emits no file: the gateway's chart Recipe, apisix-chart, reads the attachment and writes APISIX 3.18.0's ai-cache onto the chat route of each model wired to the gateway's models socket, keeping the replies in the core/datastore/redis wired to its cache_store socket. A reply is stored per route and per caller: under the consumer the request authenticated as, one of the callers infra.callers declares, each by its own key, so no caller is served a reply stored for another. The gateway embeds a request's last user message with embedding_model, the alias of a models connection, through that model's own endpoint and credential, and serves a stored reply whose message is at least similarity_threshold alike and whose earlier messages are the same; a request identical to a stored one is served from the exact layer. A reply is kept ttl_seconds, and one served by meaning is stored again under that request for ttl_seconds more. Completion requests are not cached. A store or embedding failure is a miss: the request is answered. So it keeps scope key alone, and refuses end_user, the default, by name: the gateway cannot tell end users behind one key apart. It halts with no caller declared, with nothing wired to cache_store or the models socket, on an embedding_model no models connection carries, on a second such attachment, and on any component other than core/gateway/apisix.
Provenance
- Content digest
- sha256:0a9a42a27280d5378c116a33f9f4feb1d98cc203c6f93d32ebf6a15054b04253
- Published
- 2026-11-10T10:16:22Z
- Signing identity
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Signature
- Officialapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:cae09ffb90e9f4512856fe4242f9f61470577371e61224a1d0061079f349650a
Reference at this version
oci://hub.aggrega.ai/featurerecipe/helm/semantic-caching-apisix:1.0.0- Target
- —
- Implements
- core/semantic-caching:1.0.0
Provides
Deterministic pointer templates this recipe wires for consumers.
No provides templates declared.
Workload
No workload template declared.
Locals
No locals declared.
Values mapping
No values mapping declared.
Relationships
Typed edges to and from other published entities. A reference with no published target renders as a broken edge rather than a link.
Uses
- implementsimplements
core/semantic-caching:1.0.0
Used by
Nothing in the catalog depends on this entity.