本页面为机器翻译。阅读英文原文。

Recipe

nvidia-nim

NVIDIA Inference Microservice as a self-hosted, GPU-native inference server on Kubernetes via the helm provider's Workload synthesis, running the NIM container directly with no chart. Using it needs an NVIDIA account and an NGC API key, under NVIDIA's licence terms: the serving image comes from infra.image, a NIM image the reader must be entitled to pull, and the catalog names none. Renders a StatefulSet whose container resolves the model profile into a per-replica model-cache volume at start and serves the OpenAI-compatible API behind a ClusterIP Service. It always requests a GPU (nvidia.com/gpu), and schedules the pod under infra.gpu.runtime_class when one is named. An attached ngc_api_key reaches the container as an env secretKeyRef, so the key never appears in the rendered manifest. provides.host is the bare in-cluster Service name. Reach for this realization where no NIM Operator runs and the build must fetch nothing. Reach for `nvidia-nim-chart` where NVIDIA's nim-llm chart is wanted and its repository is reachable from the build, and for `nvidia-nim-service` where the NIM Operator runs or is declared beside the model.

来源

官方由本目录认定为官方发布者的签名身份签名。
内容摘要
sha256:efd7b7358ad4fd148b0b3f4a55fb81c847e184c51d8b7e9679e1d0ba2be51925
发布时间
2026-11-10T10:26:03Z
签名身份
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

签名

  • 官方application/vnd.dev.sigstore.bundle.v0.3+json

    https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

    sha256:5ca1db81cbd568e92cdcafaebd3662bfcea761ce81b587fc930c3816698e2570

此版本的引用

oci://hub.aggrega.ai/recipe/helm/nvidia-nim:1.0.0
目标
—
实现
core/ai-model/nvidia-nim:1.0.0

提供

此配方为使用方接入的确定性指针模板。

名称模板
host{{ .context.rendered_name }}-default
port{{ .infra.port }}
endpointhttp://{{ .context.rendered_name }}-default:{{ .infra.port }}/v1
model{{ .values.model }}
protocolhttp
metrics_endpoint{{ if le (int .infra.replicas) 1 }}http://{{ .context.rendered_name }}-default:{{ .infra.port }}/v1/metrics{{ end }}
metrics_service{{ if gt (int .infra.replicas) 1 }}{{ .context.rendered_name }}-default{{ end }}
metrics_service_port{{ if gt (int .infra.replicas) 1 }}http{{ end }}
metrics_path{{ if gt (int .infra.replicas) 1 }}/v1/metrics{{ end }}

Workload

Workload · form: stateful · replicas: {{ · containers: main

局部变量

未声明局部变量。

值映射

未声明值映射。

关系

与其他已发布实体之间的类型化边。没有已发布目标的引用会呈现为断开的边,而不是链接。

使用

被使用

目录中没有任何内容依赖此实体。

Recipe 概念参考 →

Aggrega 目录 — 收录组件、功能、配方以及渲染它们的插件的开放索引。

基于共享的 Aggrega 设计系统构建。

隐私