本页面为机器翻译。阅读英文原文。

Recipe

nvidia-nim

NVIDIA Inference Microservice as a self-hosted, GPU-native inference server on a single Docker host via Docker Compose, synthesized from the Workload kind. The NIM container resolves the model profile into a named model-cache volume at start and serves the OpenAI-compatible API on the compose network; the compiler never fetches the profile. The image is infra.image, which the Release supplies: the catalog names no NIM image, since NIM images are distributed under NVIDIA's own terms. Docker pulls it with the host's own registry login, so where the image needs credentials, log the host in to nvcr.io first; infra.image_pull_secret names a Kubernetes Secret, and a Release setting it here halts the build. An attached ngc_api_key arrives on the inject pipe and is rendered as the NGC_API_KEY variable, written into the file as delivered: attach a Compose variable reference such as ${NGC_API_KEY} to keep the key out of it. Unattached, no such variable is emitted. The service always reserves infra.gpu.count NVIDIA GPUs, at least one, which the host must hand to containers through the NVIDIA Container Toolkit. The replica count and the GPU runtime class are reported as unsupported-field warnings, and the service declares no healthcheck, because NVIDIA does not document a health client inside the image. provides.host is the compose service name; provides.metrics_endpoint is always set, since compose runs one instance.

来源

官方由本目录认定为官方发布者的签名身份签名。
内容摘要
sha256:88d4fcd5b645ad6e02fddbacf61693a180ed07c9ee8b444810df1b2b3aaa8f06
发布时间
2026-11-10T10:20:03Z
签名身份
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

签名

  • 官方application/vnd.dev.sigstore.bundle.v0.3+json

    https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

    sha256:948a87634e4104444fa05f09a5700101c4eefd2948e5306754268012bfcad8a6

此版本的引用

oci://hub.aggrega.ai/recipe/compose/nvidia-nim:1.0.0
目标
—
实现
core/ai-model/nvidia-nim:1.0.0

提供

此配方为使用方接入的确定性指针模板。

名称模板
host{{ .context.instance_id }}
port{{ .infra.port }}
endpointhttp://{{ .context.instance_id }}:{{ .infra.port }}/v1
model{{ .values.model }}
protocolhttp
metrics_endpointhttp://{{ .context.instance_id }}:{{ .infra.port }}/v1/metrics
metrics_service
metrics_service_port
metrics_path

Workload

Workload · form: stateless · replicas: {{ · containers: main

局部变量

未声明局部变量。

值映射

未声明值映射。

关系

与其他已发布实体之间的类型化边。没有已发布目标的引用会呈现为断开的边,而不是链接。

使用

被使用

目录中没有任何内容依赖此实体。

Recipe 概念参考 →

Aggrega 目录 — 收录组件、功能、配方以及渲染它们的插件的开放索引。

基于共享的 Aggrega 设计系统构建。

隐私