Recipe
vllm
vLLM as a self-hosted inference server for local development via Docker Compose. Synthesized-mode Workload: the image, the command line, the environment, the model-cache volume and the weights-pull step are translated from the Workload kind by the compose provider. The weights pull is an init container, so it becomes a run-to-completion service that the serving service waits on before it starts. The model value is a deterministic pointer that step resolves at start; the compiler never fetches weights. Both services mount the same named model-cache volume, so the weights outlive the containers and a restart re-runs the pull step against an already-populated cache — how the downloader reconciles that is the downloader's own behaviour. When the optional model_pull_token credential slot is attached its value arrives on the inject pipe and is rendered as the HF_TOKEN environment variable on the weights-pull service, which is therefore also the key the attached credential must publish under; unattached, no such variable is emitted and weights are pulled anonymously. An attached api_key is rendered the same way as VLLM_API_KEY on the serving service, and the server then requires it of every caller under /v1. A GPU count is reserved as that many NVIDIA GPUs for the serving service, which the Docker host must provide. Compose is single-host, so the replica count and the GPU runtime class the Kubernetes realization honours are not honoured here; the build reports each as an unsupported-field warning naming the setting rather than dropping it in silence. provides.host is the compose service name, which a consumer on the same compose network resolves directly.
Köken
- İçerik özeti
- sha256:c28c526c53c3493724e66dd87738ab3f4d13555f15acd0c558dd9a2f70d5ecbc
- Yayımlanma
- 2026-11-10T10:21:30Z
- İmzalama kimliği
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
İmza
- Resmiapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:e91af8a7f9d69936f300bfb1f65c533703b680658ffbbe37ba386ecbccd012bf
Bu sürümdeki referans
oci://hub.aggrega.ai/recipe/compose/vllm:1.0.0- Hedef
- —
- Uygular
- core/ai-model/vllm:1.0.0
Sağlar
Bu tarifin tüketiciler için bağladığı deterministik işaretçi şablonları.
| Ad | Şablon |
|---|---|
| host | {{ .context.instance_id }} |
| port | {{ .infra.port }} |
| endpoint | http://{{ .context.instance_id }}:{{ .infra.port }}/v1 |
| model | {{ default .values.model .values.served_model_name }} |
| protocol | http |
| metrics_endpoint | http://{{ .context.instance_id }}:{{ .infra.port }}/metrics |
| metrics_service | |
| metrics_service_port | |
| metrics_pod_selector | |
| metrics_pod_port | |
| metrics_path |
Workload
Workload · form: stateless · replicas: {{ · containers: main
Yerel değerler
Yerel değer bildirilmemiş.
Değer eşlemesi
Değer eşlemesi bildirilmemiş.
İlişkiler
Diğer yayımlanmış varlıklara giden ve onlardan gelen tipli kenarlar. Yayımlanmış bir hedefi olmayan bir başvuru, bağlantı yerine kopuk bir kenar olarak gösterilir.
Kullanır
- uygularuygularsözleşme uyumlu
core/ai-model/vllm:1.0.0
Tüm zorunlu çıktılar karşılanır ve sağlanan her çıktı sözleşmede adlandırılmıştır.
Kullananlar
Katalogdaki hiçbir şey bu varlığa bağımlı değildir.