FeatureRecipe
semantic-caching-apisix
Realizes core/semantic-caching on the gateway core/gateway/apisix; a Release binds it in its Manifest. It emits no file: the gateway's chart Recipe, apisix-chart, reads the attachment and writes APISIX 3.18.0's ai-cache onto the chat route of each model wired to the gateway's models socket, keeping the replies in the core/datastore/redis wired to its cache_store socket. A reply is stored per route and per caller: under the consumer the request authenticated as, one of the callers infra.callers declares, each by its own key, so no caller is served a reply stored for another. The gateway embeds a request's last user message with embedding_model, the alias of a models connection, through that model's own endpoint and credential, and serves a stored reply whose message is at least similarity_threshold alike and whose earlier messages are the same; a request identical to a stored one is served from the exact layer. A reply is kept ttl_seconds, and one served by meaning is stored again under that request for ttl_seconds more. Completion requests are not cached. A store or embedding failure is a miss: the request is answered. So it keeps scope key alone, and refuses end_user, the default, by name: the gateway cannot tell end users behind one key apart. It halts with no caller declared, with nothing wired to cache_store or the models socket, on an embedding_model no models connection carries, on a second such attachment, and on any component other than core/gateway/apisix.
Proveniência
- Digest do conteúdo
- sha256:0a9a42a27280d5378c116a33f9f4feb1d98cc203c6f93d32ebf6a15054b04253
- Publicado
- 2026-11-10T10:16:22Z
- Identidade de assinatura
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Assinatura
- Oficialapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:cae09ffb90e9f4512856fe4242f9f61470577371e61224a1d0061079f349650a
Referência nesta versão
oci://hub.aggrega.ai/featurerecipe/helm/semantic-caching-apisix:1.0.0- Destino
- —
- Implementa
- core/semantic-caching:1.0.0
Fornece
Modelos de ponteiros determinísticos que esta receita liga para os consumidores.
Nenhum modelo provides declarado.
Workload
Nenhum modelo de carga de trabalho declarado.
Variáveis locais
Nenhuma variável local declarada.
Mapeamento de valores
Nenhum mapeamento de valores declarado.
Relações
Arestas tipadas de e para outras entidades publicadas. Uma referência sem destino publicado é apresentada como uma aresta quebrada em vez de uma ligação.
Usa
- implementaimplementa
core/semantic-caching:1.0.0
Usado por
Nada no catálogo depende desta entidade.