Recipe
nvidia-nim-service
NVIDIA Inference Microservice realized as a `NIMService` custom resource that NVIDIA's NIM Operator reconciles, rather than a directly synthesized StatefulSet, selectable in the Manifest beside the synthesis and chart realizations. Using it needs an NVIDIA account and an NGC API key, under NVIDIA's licence terms: the operator runs the NIM image infra.image names, which the reader must be entitled to pull, and reads the key from the Secret the ngc_api_key slot names, so the build halts while that slot is unattached. The catalog names no image. The resource is authored against the operator's 3.1.2 release at the `apps.nvidia.com/v1alpha1` API, and written into the namespace the Release, or else the Aggregate, names through the aggrega.ai/namespace annotation. The operator runs one serving replica on one model-cache claim it creates, requests the GPU on the container, and creates the Service provides names. The NIM Operator is a runtime prerequisite: the build halts unless the operator affirms it with infra.control_plane_present. Reach for this realization where the operator runs, or is declared beside the model as `core/ai-model/nvidia-nim-operator`; reach for `nvidia-nim`, the synthesis, where it is not, or where more than one replica is wanted.
Procedencia
- Digest del contenido
- sha256:4f44a85304e3debda09a88693d88910da6f8deb2435585967d39ef477e733469
- Publicado
- 2026-11-10T10:25:58Z
- Identidad de firma
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Firma
- Oficialapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:08096bff187317b22fc05bc2c06fa1ec7ef80483f6a014d0e4d9a50a2de7a562
Referencia en esta versión
oci://hub.aggrega.ai/recipe/helm/nvidia-nim-service:1.0.0- Destino
- —
- Implementa
- core/ai-model/nvidia-nim:1.0.0
Proporciona
Plantillas de punteros deterministas que esta receta cablea para los consumidores.
| Nombre | Plantilla |
|---|---|
| host | {{ .context.instance_id }} |
| port | {{ .infra.port }} |
| endpoint | http://{{ .context.instance_id }}:{{ .infra.port }}/v1 |
| model | {{ .values.model }} |
| protocol | http |
| metrics_endpoint | http://{{ .context.instance_id }}:{{ .infra.port }}/v1/metrics |
| metrics_service | |
| metrics_service_port | |
| metrics_path |
Workload
No se declaró ninguna plantilla de carga de trabajo.
Variables locales
No se declararon variables locales.
Mapeo de valores
No se declaró ningún mapeo de valores.
Relaciones
Aristas tipadas hacia y desde otras entidades publicadas. Una referencia sin un destino publicado se muestra como una arista rota en lugar de como un enlace.
Usa
- implementaimplementacontrato compatible
core/ai-model/nvidia-nim:1.0.0
Todas las salidas obligatorias se satisfacen y cada salida proporcionada está nombrada en el contrato.
Usado por
Nada en el catálogo depende de esta entidad.