Recipe
vllm-kubeai
vLLM realized as a KubeAI Model the KubeAI operator reconciles, rather than a directly synthesized StatefulSet — a second controller-driven realization of the same model component, selectable in the Manifest alongside the synthesis recipe and the KServe realization. The recipe emits a Model custom resource whose url is the model pointer; the operator serves it behind its OpenAI-compatible proxy and autoscales it. The model value is a deterministic pointer the operator resolves at reconcile time; the compiler never fetches weights. GPU and CPU sizing carry through resourceProfile. provides is filled from the operator's proxy, which addresses a model by its resource name, so a consumer wires to it exactly as it would to the synthesized realization. An attached api_key reaches the server through the Model's envFrom, which imports the credential's secret by name and names each variable after one of its data keys, so the credential publishes its key as VLLM_API_KEY, and the build halts naming the key when it does not. The KubeAI control plane is a runtime prerequisite: the build halts unless the operator affirms it is installed (infra.control_plane_present), so no custom resource is emitted into a cluster that cannot reconcile it. The Model is written into the namespace the Release, or else the Aggregate, names for this component through the aggrega.ai/namespace annotation, where one is set, and the operator creates the model's pods there; the metrics keys publish the pod label, port name and path a scraper discovers those pods by.
Procedencia
- Digest del contenido
- sha256:87547c9db1672236495dcfc92d462ffef874c08d1e106e33fb90e571e4af47dd
- Publicado
- 2026-11-10T10:28:00Z
- Identidad de firma
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Firma
- Oficialapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:7be843fe44c8081ec54eafe898757702098034be7c6955fdf1910671a01e3fde
Referencia en esta versión
oci://hub.aggrega.ai/recipe/helm/vllm-kubeai:1.0.0- Destino
- —
- Implementa
- core/ai-model/vllm:1.0.0
Proporciona
Plantillas de punteros deterministas que esta receta cablea para los consumidores.
| Nombre | Plantilla |
|---|---|
| host | kubeai |
| port | 80 |
| endpoint | http://kubeai/openai/v1 |
| model | {{ .context.instance_id }} |
| protocol | http |
| metrics_endpoint | |
| metrics_service | |
| metrics_service_port | |
| metrics_pod_selector | kubeai.org/model={{ .context.instance_id }} |
| metrics_pod_port | http |
| metrics_path | /metrics |
Workload
No se declaró ninguna plantilla de carga de trabajo.
Variables locales
No se declararon variables locales.
Mapeo de valores
No se declaró ningún mapeo de valores.
Relaciones
Aristas tipadas hacia y desde otras entidades publicadas. Una referencia sin un destino publicado se muestra como una arista rota en lugar de como un enlace.
Usa
- implementaimplementacontrato compatible
core/ai-model/vllm:1.0.0
Todas las salidas obligatorias se satisfacen y cada salida proporcionada está nombrada en el contrato.
Usado por
Nada en el catálogo depende de esta entidad.