FeatureRecipe
semantic-caching-apisix
Realizes core/semantic-caching on the gateway core/gateway/apisix; a Release binds it in its Manifest. It emits no file: the gateway's chart Recipe, apisix-chart, reads the attachment and writes APISIX 3.18.0's ai-cache onto the chat route of each model wired to the gateway's models socket, keeping the replies in the core/datastore/redis wired to its cache_store socket. A reply is stored per route and per caller: under the consumer the request authenticated as, one of the callers infra.callers declares, each by its own key, so no caller is served a reply stored for another. The gateway embeds a request's last user message with embedding_model, the alias of a models connection, through that model's own endpoint and credential, and serves a stored reply whose message is at least similarity_threshold alike and whose earlier messages are the same; a request identical to a stored one is served from the exact layer. A reply is kept ttl_seconds, and one served by meaning is stored again under that request for ttl_seconds more. Completion requests are not cached. A store or embedding failure is a miss: the request is answered. So it keeps scope key alone, and refuses end_user, the default, by name: the gateway cannot tell end users behind one key apart. It halts with no caller declared, with nothing wired to cache_store or the models socket, on an embedding_model no models connection carries, on a second such attachment, and on any component other than core/gateway/apisix.
Provenienza
- Digest del contenuto
- sha256:0a9a42a27280d5378c116a33f9f4feb1d98cc203c6f93d32ebf6a15054b04253
- Pubblicato
- 2026-11-10T10:16:22Z
- Identità di firma
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Firma
- Ufficialeapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:cae09ffb90e9f4512856fe4242f9f61470577371e61224a1d0061079f349650a
Riferimento a questa versione
oci://hub.aggrega.ai/featurerecipe/helm/semantic-caching-apisix:1.0.0- Destinazione
- —
- Implementa
- core/semantic-caching:1.0.0
Fornisce
Modelli di puntatori deterministici che questa ricetta collega per i consumatori.
Nessun modello provides dichiarato.
Workload
Nessun modello di workload dichiarato.
Variabili locali
Nessuna variabile locale dichiarata.
Mappatura dei valori
Nessuna mappatura dei valori dichiarata.
Relazioni
Archi tipizzati da e verso altre entità pubblicate. Un riferimento senza una destinazione pubblicata viene mostrato come arco interrotto anziché come link.
Usa
- implementaimplementa
core/semantic-caching:1.0.0
Usato da
Nulla nel catalogo dipende da questa entità.