Recipe
nvidia-nim-service
NVIDIA Inference Microservice realized as a `NIMService` custom resource that NVIDIA's NIM Operator reconciles, rather than a directly synthesized StatefulSet, selectable in the Manifest beside the synthesis and chart realizations. Using it needs an NVIDIA account and an NGC API key, under NVIDIA's licence terms: the operator runs the NIM image infra.image names, which the reader must be entitled to pull, and reads the key from the Secret the ngc_api_key slot names, so the build halts while that slot is unattached. The catalog names no image. The resource is authored against the operator's 3.1.2 release at the `apps.nvidia.com/v1alpha1` API, and written into the namespace the Release, or else the Aggregate, names through the aggrega.ai/namespace annotation. The operator runs one serving replica on one model-cache claim it creates, requests the GPU on the container, and creates the Service provides names. The NIM Operator is a runtime prerequisite: the build halts unless the operator affirms it with infra.control_plane_present. Reach for this realization where the operator runs, or is declared beside the model as `core/ai-model/nvidia-nim-operator`; reach for `nvidia-nim`, the synthesis, where it is not, or where more than one replica is wanted.
Provenienza
- Digest del contenuto
- sha256:4f44a85304e3debda09a88693d88910da6f8deb2435585967d39ef477e733469
- Pubblicato
- 2026-11-10T10:25:58Z
- Identità di firma
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Firma
- Ufficialeapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:08096bff187317b22fc05bc2c06fa1ec7ef80483f6a014d0e4d9a50a2de7a562
Riferimento a questa versione
oci://hub.aggrega.ai/recipe/helm/nvidia-nim-service:1.0.0- Destinazione
- —
- Implementa
- core/ai-model/nvidia-nim:1.0.0
Fornisce
Modelli di puntatori deterministici che questa ricetta collega per i consumatori.
| Nome | Modello |
|---|---|
| host | {{ .context.instance_id }} |
| port | {{ .infra.port }} |
| endpoint | http://{{ .context.instance_id }}:{{ .infra.port }}/v1 |
| model | {{ .values.model }} |
| protocol | http |
| metrics_endpoint | http://{{ .context.instance_id }}:{{ .infra.port }}/v1/metrics |
| metrics_service | |
| metrics_service_port | |
| metrics_path |
Workload
Nessun modello di workload dichiarato.
Variabili locali
Nessuna variabile locale dichiarata.
Mappatura dei valori
Nessuna mappatura dei valori dichiarata.
Relazioni
Archi tipizzati da e verso altre entità pubblicate. Un riferimento senza una destinazione pubblicata viene mostrato come arco interrotto anziché come link.
Usa
- implementaimplementacontratto compatibile
core/ai-model/nvidia-nim:1.0.0
Tutti gli output obbligatori sono soddisfatti e ogni output fornito è nominato nel contratto.
Usato da
Nulla nel catalogo dipende da questa entità.