Recipe
litellm
LiteLLM as a self-hosted, OpenAI-compatible model proxy for local development via Docker Compose, synthesized from the Workload kind by the compose provider. A compose config carries the proxy's configuration, which publishes the alias in values.model and points it at values.upstream_model. The configuration contract is authored against LiteLLM v1.103.1. Compose has no env-from-secret primitive, so an attached credential is rendered as a plain environment variable, and a credential written as a Compose variable reference lands as that reference rather than its value. On every Release two further configs carry a request guard, which forwards only the request fields the proxy declares for the route, plus any the Release admits in infra.admitted_request_fields, and refuses the rest naming the field; and a path allowlist, a service of its own running the official nginx image (BSD-2-Clause) in the proxy's network namespace on infra.port, which answers 403 to every path but the model routes, the model listing, the health routes and key management. Both come from the LiteLLMGuard bundle. PROXY_BASE_URL is emitted only when infra.external_base_url is set, the build halting on one carrying a path. With `values.metrics_enabled` true the proxy serves its Prometheus metrics on its loopback address, and the path allowlist forwards a GET of /metrics alone there from port 9090, which every peer on the compose network reaches, published as provides.metrics_endpoint; false leaves that key empty. The port checks no caller, and the metrics name the hashed keys, key aliases and user emails the proxy attributes spend to.
출처
- 콘텐츠 다이제스트
- sha256:887b26237802ad5625a1a1fd2fc7fcb7da336364e5b359f0feb6014dc1a72485
- 게시일
- 2026-11-10T10:19:32Z
- 서명 ID
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
서명
- 공식application/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:991eb8cd793b320763398edf8fe5c43adb654fcff47fed165e824176b099e5ca
이 버전의 참조
oci://hub.aggrega.ai/recipe/compose/litellm:1.0.0- 대상
- —
- 구현 대상
- core/ai-model/litellm:1.0.0
제공
이 레시피가 소비자를 위해 배선하는 결정적 포인터 템플릿입니다.
| 이름 | 템플릿 |
|---|---|
| host | {{ .context.instance_id }} |
| port | {{ .infra.port }} |
| endpoint | http://{{ .context.instance_id }}:{{ .infra.port }}/v1 |
| model | {{ .values.model }} |
| protocol | http |
| metrics_endpoint | {{ if .values.metrics_enabled }}http://{{ .context.instance_id }}:{{ .locals.metrics_port }}/metrics{{ end }} |
Workload
Workload · form: stateless · containers: main
로컬 변수
| 이름 | 템플릿 |
|---|---|
| config_file | config.yaml |
| config_name | {{ .context.instance_id }}-config |
| request_filter_module | request_field_filter |
| gateway_address | 127.0.0.1 |
| gateway_port | {{ if eq (int .infra.port) 65535 }}65534{{ else }}{{ add1 (int .infra.port) }}{{ end }} |
| metrics_port | 9090 |
| gateway_metrics_port | 9091 |
| path_allowlist_file | path-allowlist.conf |
| path_allowlist_image_tag | 1.27.5-alpine |
| request_guard_delivery | compose_configs |
| request_guard_module_config_name | {{ .context.instance_id }}-request-guard-module |
| request_guard_allowlist_config_name | {{ .context.instance_id }}-request-guard-allowlist |
| request_guard_dir | /etc/litellm-request-guard |
| forward_organization_routes | false |
값 매핑
선언된 값 매핑이 없습니다.
관계
게시된 다른 엔터티와 주고받는 타입 지정 에지입니다. 게시된 대상이 없는 참조는 링크가 아닌 끊어진 에지로 표시됩니다.
사용함
- 구현구현계약 호환
core/ai-model/litellm:1.0.0
모든 필수 출력이 충족되며, 제공되는 모든 출력이 계약에 명시되어 있습니다.
사용됨
카탈로그에서 이 엔터티에 의존하는 것이 없습니다.