이 페이지는 기계 번역되었습니다. 영어 원문 읽기.

Recipe

litellm-gateway

An AI gateway on Kubernetes via the helm provider's Workload synthesis, running the official upstream proxy image directly. Renders a Deployment, a ClusterIP Service and a ConfigMap carrying the routing table. Every credential reaches the gateway as an env secretKeyRef, so no credential value appears in its own resources. It is proven at LiteLLM v1.103.1 and halts on any other engine_version. On every Release a second ConfigMap carries a request guard, which forwards only the request fields the proxy declares for the route, plus any the Release admits in infra.admitted_request_fields, and refuses the rest naming the field. The same ConfigMap configures a path allowlist, a container running the official nginx image (BSD-2-Clause) on infra.port, which answers 403 to every path but the routes the gateway serves. A core/context-propagation attachment, a core/data-masking one listing what to mask, or values.log_masking listing it, adds the module each relies on. A core/prompt-injection-shield attachment sends every map entry to the guard on the guard socket. PROXY_BASE_URL and the Presidio and cache store addresses appear only when infra.external_base_url and their sockets are set. A store publishing redis-tls is reached over TLS, its password inside the cache's URL: keep that password to letters and digits. With `values.metrics_enabled` true the path allowlist forwards a GET of /metrics alone from port 9090, on the ClusterIP Service, to the gateway's metrics, published as provides.metrics_endpoint; false leaves that key empty. Reach for this realization where the build must fetch nothing; reach for `litellm-gateway-chart`, BerriAI's own chart, where its registry is reachable at build time.

출처

공식이 카탈로그가 공식 게시자로 인정하는 서명 ID로 서명되었습니다.
콘텐츠 다이제스트
sha256:1bd9c826a387e9d5d865a58bd1be2954fde9373af8533b5c24dfae2fa9896e22
게시일
2026-11-10T10:25:06Z
서명 ID
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

서명

  • 공식application/vnd.dev.sigstore.bundle.v0.3+json

    https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

    sha256:c2097aaeb345d727adeb5057c268933b86653cef71a6e4e4240558784ea99db5

이 버전의 참조

oci://hub.aggrega.ai/recipe/helm/litellm-gateway:1.0.0
대상
—
구현 대상
core/gateway/litellm:1.0.0

제공

이 레시피가 소비자를 위해 배선하는 결정적 포인터 템플릿입니다.

이름템플릿
host{{ .context.rendered_name }}-default
port{{ .infra.port }}
endpointhttp://{{ .context.rendered_name }}-default:{{ .infra.port }}/v1
model{{ .locals.published_model }}
protocolhttp
metrics_endpoint{{ if .values.metrics_enabled }}http://{{ .context.rendered_name }}-default:{{ .locals.metrics_port }}/metrics{{ end }}

Workload

Workload · form: stateless · replicas: 1 · containers: main

로컬 변수

이름템플릿
config_fileconfig.yaml
provider_key_variableLITELLM_PROVIDER_API_KEY
connection_key_variable_prefixLITELLM_MODEL_
connection_key_variable_suffix_API_KEY
guard_api_keythe-guard-holds-the-upstream-credential
caller_identity_modulecaller_identity
masking_moduledata_masking
field_entity_masking_classFieldEntityMasking
reply_masking_classReplyMasking
buffered_reply_masking_classBufferedReplyMasking
field_pattern_masking_classFieldPatternMasking
held_reply_classHeldStreamedReply
log_masking_modulelog_masking
log_masking_classLogMasking
log_masking_failure_callbackwithhold_failed_calls
request_filter_modulerequest_field_filter
gateway_address127.0.0.1
gateway_port{{ if eq (int .infra.port) 65535 }}65534{{ else }}{{ add1 (int .infra.port) }}{{ end }}
metrics_port9090
gateway_metrics_port9091
path_allowlist_filepath-allowlist.conf
path_allowlist_image_tag1.27.5-alpine
request_guard_config_map_name{{ .context.instance_id }}-request-guard
request_guard_dir/etc/litellm-request-guard
request_guard_deliveryconfig_map
forward_organization_routesfalse
model_aliases{{ $aliases := list }}{{ range (optional .values "models" list) }}{{ $aliases = append $aliases .name }}{{ end }}{{ toJson $aliases }}
model_entries{{ toJson (optional .values "models" list) }}
published_model{{ with optional .values "model" "" }}{{ . }}{{ else }}{{ with optional .values "models" list }}{{ (index . 0).name }}{{ end }}{{ end }}
analyzer_entity_types["CREDIT_CARD", "CRYPTO", "DATE_TIME", "EMAIL_ADDRESS", "IBAN_CODE", "IP_ADDRESS", "LOCATION", "MAC_ADDRESS", "MEDICAL_LICENSE", "NRP", "PERSON", "PHONE_NUMBER", "UK_NHS", "URL", "US_BANK_NUMBER", "US_DRIVER_LICENSE", "US_ITIN", "US_PASSPORT", "US_SSN"]
proven_engine_versions["v1.103.1"]
cache_store_host_variableSEMANTIC_CACHE_STORE_HOST
cache_store_port_variableSEMANTIC_CACHE_STORE_PORT
cache_store_password_variableREDIS_PASSWORD
cache_store_url_variableSEMANTIC_CACHE_STORE_URL

값 매핑

선언된 값 매핑이 없습니다.

관계

게시된 다른 엔터티와 주고받는 타입 지정 에지입니다. 게시된 대상이 없는 참조는 링크가 아닌 끊어진 에지로 표시됩니다.

사용함

  • 구현구현계약 호환

    core/gateway/litellm:1.0.0

    모든 필수 출력이 충족되며, 제공되는 모든 출력이 계약에 명시되어 있습니다.

사용됨

카탈로그에서 이 엔터티에 의존하는 것이 없습니다.

Recipe 개념 레퍼런스 →

Aggrega 카탈로그 — 컴포넌트, 기능, 레시피, 그리고 이를 렌더링하는 플러그인의 공개 인덱스입니다.

공유 Aggrega 디자인 시스템으로 구축되었습니다.

개인정보 보호