本页面为机器翻译。阅读英文原文。

Recipe

docker-model-runner

Docker Model Runner as a self-hosted inference server on Kubernetes, synthesized as a StatefulSet running the runner's own image. It serves the OCI model reference the Aggregate names, the same reference the Docker Compose realization hands the host's runner, so one Aggregate asks both targets for the same model. A pull step running the same image puts the model into a per-replica model cache before the server starts. The server applies the context size and runtime flags each time it starts, and serves the OpenAI-compatible API under /engines/v1 behind a ClusterIP Service. The compiler never fetches the model. This realization is synthesized because the project's own Helm chart fails the maintained and complete tests: it lags the runner's releases, and it exposes no setting for the context size, runtime flags, compute resources or listen port. It is also published to no chart repository. provides.host is the bare in-cluster name of the Service, with no namespace, so a consumer in another namespace qualifies it itself. infra.endpoint, the host runner's address on Docker Compose, is refused here.

来源

官方由本目录认定为官方发布者的签名身份签名。
内容摘要
sha256:9f5fe4734eef47c6afe621aaf1b546c1aad7467ba403f8a1e856284457867cbd
发布时间
2026-11-10T10:23:16Z
签名身份
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

签名

  • 官方application/vnd.dev.sigstore.bundle.v0.3+json

    https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

    sha256:1cb0a71537ad3d5999068177f4b7e55d20c62a76eef82d0c38e43487f1efc05d

此版本的引用

oci://hub.aggrega.ai/recipe/helm/docker-model-runner:1.0.0
目标
—
实现
core/ai-model/docker-model-runner:1.0.0

提供

此配方为使用方接入的确定性指针模板。

名称模板
host{{ .context.rendered_name }}-default
port{{ .locals.port }}
endpointhttp://{{ .context.rendered_name }}-default:{{ .locals.port }}/engines/v1
model{{ .values.model }}
protocolhttp

Workload

Workload · form: stateful · replicas: {{ · containers: main

局部变量

名称模板
port{{ optional .infra "port" 12434 }}
gpu_count{{ optional (optional .infra "gpu" dict) "count" 0 }}
runtime_class{{ optional (optional .infra "gpu" dict) "runtime_class" "" }}
imagedocker/model-runner:{{ optional .infra "engine_version" "v1.2.8" }}{{ if ne .locals.gpu_count "0" }}-cuda{{ end }}
replicas{{ optional .infra "replicas" 1 }}
cpu{{ optional (optional .infra "compute" dict) "cpu" "1" }}
memory{{ optional (optional .infra "compute" dict) "memory" "4Gi" }}
cache_size{{ optional (optional .infra "model_cache" dict) "size" "20Gi" }}
cache_class{{ optional (optional .infra "model_cache" dict) "class" "" }}

值映射

未声明值映射。

关系

与其他已发布实体之间的类型化边。没有已发布目标的引用会呈现为断开的边,而不是链接。

使用

被使用

目录中没有任何内容依赖此实体。

Recipe 概念参考 →

Aggrega 目录 — 收录组件、功能、配方以及渲染它们的插件的开放索引。

基于共享的 Aggrega 设计系统构建。

隐私