Esta página se tradujo automáticamente. Leer el original en inglés.

Recipe

nvidia-nim

NVIDIA Inference Microservice as a self-hosted, GPU-native inference server on a single Docker host via Docker Compose, synthesized from the Workload kind. The NIM container resolves the model profile into a named model-cache volume at start and serves the OpenAI-compatible API on the compose network; the compiler never fetches the profile. The image is infra.image, which the Release supplies: the catalog names no NIM image, since NIM images are distributed under NVIDIA's own terms. Docker pulls it with the host's own registry login, so where the image needs credentials, log the host in to nvcr.io first; infra.image_pull_secret names a Kubernetes Secret, and a Release setting it here halts the build. An attached ngc_api_key arrives on the inject pipe and is rendered as the NGC_API_KEY variable, written into the file as delivered: attach a Compose variable reference such as ${NGC_API_KEY} to keep the key out of it. Unattached, no such variable is emitted. The service always reserves infra.gpu.count NVIDIA GPUs, at least one, which the host must hand to containers through the NVIDIA Container Toolkit. The replica count and the GPU runtime class are reported as unsupported-field warnings, and the service declares no healthcheck, because NVIDIA does not document a health client inside the image. provides.host is the compose service name; provides.metrics_endpoint is always set, since compose runs one instance.

Procedencia

OficialFirmado por una identidad de firma que este catálogo reconoce como editor oficial.
Digest del contenido
sha256:88d4fcd5b645ad6e02fddbacf61693a180ed07c9ee8b444810df1b2b3aaa8f06
Publicado
2026-11-10T10:20:03Z
Identidad de firma
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

Firma

  • Oficialapplication/vnd.dev.sigstore.bundle.v0.3+json

    https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

    sha256:948a87634e4104444fa05f09a5700101c4eefd2948e5306754268012bfcad8a6

Referencia en esta versión

oci://hub.aggrega.ai/recipe/compose/nvidia-nim:1.0.0
Destino
—
Implementa
core/ai-model/nvidia-nim:1.0.0

Proporciona

Plantillas de punteros deterministas que esta receta cablea para los consumidores.

NombrePlantilla
host{{ .context.instance_id }}
port{{ .infra.port }}
endpointhttp://{{ .context.instance_id }}:{{ .infra.port }}/v1
model{{ .values.model }}
protocolhttp
metrics_endpointhttp://{{ .context.instance_id }}:{{ .infra.port }}/v1/metrics
metrics_service
metrics_service_port
metrics_path

Workload

Workload · form: stateless · replicas: {{ · containers: main

Variables locales

No se declararon variables locales.

Mapeo de valores

No se declaró ningún mapeo de valores.

Relaciones

Aristas tipadas hacia y desde otras entidades publicadas. Una referencia sin un destino publicado se muestra como una arista rota en lugar de como un enlace.

Usa

  • implementaimplementacontrato compatible

    core/ai-model/nvidia-nim:1.0.0

    Todas las salidas obligatorias se satisfacen y cada salida proporcionada está nombrada en el contrato.

Usado por

Nada en el catálogo depende de esta entidad.

Referencia del concepto Recipe →

El catálogo de Aggrega — un índice abierto de componentes, funcionalidades, recetas y los plugins que los renderizan.

Creado con el sistema de diseño compartido de Aggrega.

Privacidad