Questa pagina è stata tradotta automaticamente. Leggi l’originale in inglese.

FeatureRecipe

period-budget-envoy-gateway

Realizes core/period-budget on core/gateway/envoy-gateway; a Release binds it in its Manifest. It emits no file: the gateway's Recipe writes it as Envoy Gateway's usage-based rate limit on the route serving the wired models, counted by the control plane's rate-limit service in the store on the cache socket. The gateway counts the tokens each reply reports, read, written or both as unit names, over fixed windows on the UTC clock — 1s, 1m, 1h, 1d, 7d from a Thursday, 30d or 365d from 1 January 1970, or 1mo, a calendar month under a setting the Recipe turns on for every monthly rate limit that install keeps. Once the count exceeds limit it answers model requests with HTTP 429 until the window ends. While the store or the rate-limit service cannot be reached, or a check outlasts Envoy's rate-limit timeout, it answers them with HTTP 500, under a setting the Recipe turns on for every rate limit that install keeps, so a hand-applied one fails closed too. Tokens are added once a reply completes, so the request crossing the limit, any answered beside it, and one admitted just before an outage are served, the last uncounted. A store keeping the count in memory, as core/datastore/redis does by default, starts every window again on a restart. So it honours unit total_tokens, prompt_tokens or completion_tokens, scope gateway or model, and those periods, or the same length spelt otherwise. It refuses usd, scope caller, since nothing here verifies a caller, and any other period by name, and halts on a limit that is not a whole number of tokens up to 4294967295, on a second such attachment, with nothing wired to the models or cache socket, and on any component other than core/gateway/envoy-gateway.

Provenienza

UfficialeFirmato da un’identità di firma che questo catalogo riconosce come editore ufficiale.
Digest del contenuto
sha256:26d4159d7ac0fa48d5cbcd4eaef67aba309bdfe752631f54937ba844c246e663
Pubblicato
2026-11-10T10:15:50Z
Identità di firma
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

Firma

  • Ufficialeapplication/vnd.dev.sigstore.bundle.v0.3+json

    https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

    sha256:43997b312c579cf78939506eb2e6a577b8a30baa26cf051cd63054ce41f26a46

Riferimento a questa versione

oci://hub.aggrega.ai/featurerecipe/helm/period-budget-envoy-gateway:1.0.0
Destinazione
—
Implementa
core/period-budget:1.0.0

Fornisce

Modelli di puntatori deterministici che questa ricetta collega per i consumatori.

Nessun modello provides dichiarato.

Workload

Nessun modello di workload dichiarato.

Variabili locali

Nessuna variabile locale dichiarata.

Mappatura dei valori

Nessuna mappatura dei valori dichiarata.

Relazioni

Archi tipizzati da e verso altre entità pubblicate. Un riferimento senza una destinazione pubblicata viene mostrato come arco interrotto anziché come link.

Usa

Usato da

Nulla nel catalogo dipende da questa entità.

Riferimento al concetto FeatureRecipe →

Il catalogo Aggrega — un indice aperto di componenti, funzionalità, ricette e dei plugin che li renderizzano.

Realizzato con il design system condiviso di Aggrega.

Privacy