Recipe
litellm
LiteLLM as a self-hosted, OpenAI-compatible model proxy on Kubernetes via the helm provider's Workload synthesis, running the official upstream image directly (no external Helm chart). Renders a Deployment, a ClusterIP Service and a ConfigMap carrying the proxy's configuration, which publishes the alias in values.model and points it at values.upstream_model. An attached api_key, provider_key or database_url reaches the proxy as an env secretKeyRef, so no credential value appears in the proxy's own resources. The configuration contract is authored against LiteLLM v1.103.1. On every Release a second ConfigMap carries a request guard, which forwards only the request fields the proxy declares for the route, plus any the Release admits in infra.admitted_request_fields, and refuses the rest naming the field. The same ConfigMap configures a path allowlist, a second container running the official nginx image (BSD-2-Clause) in front of the proxy on infra.port, which answers 403 to every path but the model routes, the model listing, the health routes and key management. Both come from the LiteLLMGuard bundle. PROXY_BASE_URL is emitted only when infra.external_base_url is set, the build halting on one carrying a path. With `values.metrics_enabled` true the proxy serves its Prometheus metrics on its loopback address, and the path allowlist forwards a GET of /metrics alone there from port 9090, on the ClusterIP Service, published as provides.metrics_endpoint; false leaves that key empty. Reach for this realization where the build must fetch nothing; reach for `litellm-chart`, BerriAI's own chart, where its registry is reachable at build time.
来歴
- コンテンツダイジェスト
- sha256:682e3cc45fe21819a0a95e7ffe22930a1b97c775d51292f2cf4e87109b7c3ace
- 公開日
- 2026-11-10T10:25:06Z
- 署名 ID
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
署名
- 公式application/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:396ce3bfb8ab0d412cdcc7a560a126b9667bed3619c60499c0623acc97696f70
このバージョンの参照
oci://hub.aggrega.ai/recipe/helm/litellm:1.0.0- ターゲット
- —
- 実装対象
- core/ai-model/litellm:1.0.0
提供
このレシピが利用側のために配線する決定論的なポインターテンプレートです。
| 名前 | テンプレート |
|---|---|
| host | {{ .context.rendered_name }}-default |
| port | {{ .infra.port }} |
| endpoint | http://{{ .context.rendered_name }}-default:{{ .infra.port }}/v1 |
| model | {{ .values.model }} |
| protocol | http |
| metrics_endpoint | {{ if .values.metrics_enabled }}http://{{ .context.rendered_name }}-default:{{ .locals.metrics_port }}/metrics{{ end }} |
Workload
Workload · form: stateless · replicas: 1 · containers: main
ローカル変数
| 名前 | テンプレート |
|---|---|
| config_file | config.yaml |
| request_filter_module | request_field_filter |
| gateway_address | 127.0.0.1 |
| gateway_port | {{ if eq (int .infra.port) 65535 }}65534{{ else }}{{ add1 (int .infra.port) }}{{ end }} |
| metrics_port | 9090 |
| gateway_metrics_port | 9091 |
| path_allowlist_file | path-allowlist.conf |
| path_allowlist_image_tag | 1.27.5-alpine |
| request_guard_config_map_name | {{ .context.instance_id }}-request-guard |
| request_guard_dir | /etc/litellm-request-guard |
| request_guard_delivery | config_map |
| forward_organization_routes | false |
値のマッピング
値のマッピングは宣言されていません。
関係
他の公開エンティティとの間の型付きエッジです。公開されたターゲットがない参照は、リンクではなく切れたエッジとして表示されます。
使用先
- 実装実装コントラクト互換
core/ai-model/litellm:1.0.0
必須の出力はすべて満たされており、提供されるすべての出力がコントラクトに記載されています。
使用元
カタログ内にこのエンティティに依存しているものはありません。