Questa pagina è stata tradotta automaticamente. Leggi l’originale in inglese.

FeatureRecipe

period-budget-higress

Realizes core/period-budget on the gateway core/gateway/higress; a Release binds it in its Manifest. It emits no file: the gateway's chart Recipe, higress-chart, writes Higress's ai-token-ratelimit plugin onto the model routes, counting in the Redis-protocol store on the cache socket. The gateway adds the prompt and completion tokens each reply reports once the reply completes, over a fixed window of period that opens when the first reply in it is counted, and answers model requests with HTTP 429 while the count exceeds limit, until the window ends; the request crossing the limit is served. Scope gateway keeps one count for all it serves, scope model one for each alias. A reply reporting no usage counts nothing, and a streamed request turning the usage report off is refused with HTTP 403, as are a request with a compressed body or an upgrade and one whose content type contains octet-stream or grpc, or neither contains application/json nor begins with multipart/form-data; a client crafting a body the gateway's validation cannot decode gets past them. Without masking, a body over 32 KiB may be refused with HTTP 413, depending on when the store answers. While the store cannot be reached, model requests are served and not counted. So it honours unit total_tokens, scope gateway or model, and a period of one second, minute, hour or day, however spelt. It refuses usd, prompt_tokens, completion_tokens, scope caller, since the gateway verifies no caller, any other period and a limit that is not a whole number by name, and halts on a second such attachment, with nothing wired to the models or cache socket, and on any component other than core/gateway/higress.

Provenienza

UfficialeFirmato da un’identità di firma che questo catalogo riconosce come editore ufficiale.
Digest del contenuto
sha256:1cab4a366fa7b9a1e973022a2c4a626e90e10d37ac8f589a457f56a52ac68a3c
Pubblicato
2026-11-10T10:15:51Z
Identità di firma
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

Firma

  • Ufficialeapplication/vnd.dev.sigstore.bundle.v0.3+json

    https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

    sha256:f0fa44b82f51d878839f40b94817b2b970ca42ead267c92d59a29ed18dc4edb5

Riferimento a questa versione

oci://hub.aggrega.ai/featurerecipe/helm/period-budget-higress:1.0.0
Destinazione
—
Implementa
core/period-budget:1.0.0

Fornisce

Modelli di puntatori deterministici che questa ricetta collega per i consumatori.

Nessun modello provides dichiarato.

Workload

Nessun modello di workload dichiarato.

Variabili locali

Nessuna variabile locale dichiarata.

Mappatura dei valori

Nessuna mappatura dei valori dichiarata.

Relazioni

Archi tipizzati da e verso altre entità pubblicate. Un riferimento senza una destinazione pubblicata viene mostrato come arco interrotto anziché come link.

Usa

Usato da

Nulla nel catalogo dipende da questa entità.

Riferimento al concetto FeatureRecipe →

Il catalogo Aggrega — un indice aperto di componenti, funzionalità, ricette e dei plugin che li renderizzano.

Realizzato con il design system condiviso di Aggrega.

Privacy