FeatureRecipe
semantic-caching-apisix
Realizes core/semantic-caching on the gateway core/gateway/apisix; a Release binds it in its Manifest. It emits no file: the gateway's chart Recipe, apisix-chart, reads the attachment and writes APISIX 3.18.0's ai-cache onto the chat route of each model wired to the gateway's models socket, keeping the replies in the core/datastore/redis wired to its cache_store socket. A reply is stored per route and per caller: under the consumer the request authenticated as, one of the callers infra.callers declares, each by its own key, so no caller is served a reply stored for another. The gateway embeds a request's last user message with embedding_model, the alias of a models connection, through that model's own endpoint and credential, and serves a stored reply whose message is at least similarity_threshold alike and whose earlier messages are the same; a request identical to a stored one is served from the exact layer. A reply is kept ttl_seconds, and one served by meaning is stored again under that request for ttl_seconds more. Completion requests are not cached. A store or embedding failure is a miss: the request is answered. So it keeps scope key alone, and refuses end_user, the default, by name: the gateway cannot tell end users behind one key apart. It halts with no caller declared, with nothing wired to cache_store or the models socket, on an embedding_model no models connection carries, on a second such attachment, and on any component other than core/gateway/apisix.
Pochodzenie
- Skrót zawartości
- sha256:0a9a42a27280d5378c116a33f9f4feb1d98cc203c6f93d32ebf6a15054b04253
- Opublikowano
- 2026-11-10T10:16:22Z
- Tożsamość podpisująca
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Podpis
- Oficjalnyapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:cae09ffb90e9f4512856fe4242f9f61470577371e61224a1d0061079f349650a
Referencja w tej wersji
oci://hub.aggrega.ai/featurerecipe/helm/semantic-caching-apisix:1.0.0- Cel
- —
- Implementuje
- core/semantic-caching:1.0.0
Udostępnia
Deterministyczne szablony wskaźników, które ta receptura podłącza dla konsumentów.
Nie zadeklarowano szablonów provides.
Workload
Nie zadeklarowano szablonu obciążenia roboczego.
Zmienne lokalne
Nie zadeklarowano zmiennych lokalnych.
Mapowanie wartości
Nie zadeklarowano mapowania wartości.
Relacje
Typowane krawędzie do innych opublikowanych encji i od nich. Odwołanie bez opublikowanego celu jest renderowane jako przerwana krawędź, a nie jako łącze.
Używa
- implementujeimplementuje
core/semantic-caching:1.0.0
Używane przez
Nic w katalogu nie zależy od tej encji.