Recipe
tgi
Text Generation Inference as a self-hosted inference server on Kubernetes via the helm provider's Workload synthesis, running the official upstream image directly (no external Helm chart). Renders a StatefulSet: a weights-pull initContainer resolves the model pointer into a per-replica model-cache volume, and the serving container mounts the same volume and serves the API behind a ClusterIP Service. The model value is a deterministic pointer the initContainer resolves at pod start; the compiler never fetches weights. When the optional model_pull_token credential slot is attached the token reaches the initContainer as an env secretKeyRef, so it never appears in the rendered manifest; unattached, weights are pulled anonymously, byte-identically to a recipe with no slot. When the optional api_key slot is attached the key reaches the serving container as API_KEY the same way, and the server requires it of every caller on its generation routes; unattached, it requires none. provides.host is the bare, self-contained in-cluster service name; a consumer in another namespace qualifies it on its own side. provides.metrics_endpoint names the server's metrics on the same Service while it runs one replica; above one it is empty and metrics_service names that Service for a scraper to discover every replica behind it.
Provenance
- Empreinte du contenu
- sha256:c8b7893730d761d2b587fb42ce111d4a894faf7a3f17ef32df5b8a26b330ab41
- Publié
- 2026-11-10T10:27:31Z
- Identité de signature
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Signature
- Officielapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:8a0a362bf100833fa0c13844f030023bfbe117bc1a8e583e58672182af92bdfb
Référence à cette version
oci://hub.aggrega.ai/recipe/helm/tgi:1.0.0- Cible
- —
- Implémente
- core/ai-model/tgi:1.0.0
Fournit
Modèles de pointeurs déterministes que cette recette câble pour les consommateurs.
| Nom | Modèle |
|---|---|
| host | {{ .context.rendered_name }}-default |
| port | {{ .infra.port }} |
| endpoint | http://{{ .context.rendered_name }}-default:{{ .infra.port }}/v1 |
| model | {{ .values.model }} |
| protocol | http |
| metrics_endpoint | {{ if le (int .infra.replicas) 1 }}http://{{ .context.rendered_name }}-default:{{ .infra.port }}/metrics{{ end }} |
| metrics_service | {{ if gt (int .infra.replicas) 1 }}{{ .context.rendered_name }}-default{{ end }} |
| metrics_service_port | {{ if gt (int .infra.replicas) 1 }}http{{ end }} |
| metrics_path | {{ if gt (int .infra.replicas) 1 }}/metrics{{ end }} |
Workload
Workload · form: stateful · replicas: {{ · containers: main
Variables locales
Aucune variable locale déclarée.
Correspondance des valeurs
Aucune correspondance des valeurs déclarée.
Relations
Arêtes typées vers et depuis d’autres entités publiées. Une référence sans cible publiée s’affiche comme une arête rompue plutôt que comme un lien.
Utilise
- implémenteimplémentecontrat compatible
core/ai-model/tgi:1.0.0
Toutes les sorties obligatoires sont satisfaites et chaque sortie fournie est nommée dans le contrat.
Utilisé par
Rien dans le catalogue ne dépend de cette entité.