이 페이지는 기계 번역되었습니다. 영어 원문 읽기.

Feature

core/concurrency-limit

Caps how many requests a gateway carries at once — the control that keeps a burst of callers from becoming a queue at the upstream. scope names what one cap counts: gateway, every request the gateway forwards, counted together; or model, each target the gateway sends requests to, counted apart. A target is each upstream entry the gateway routes to, so where one model name has several entries each entry is counted apart. The count is per running proxy, so where several replicas run each of them admits max_in_flight: size it against one replica, not against the whole. Every input is the operator's, so the operator attaches it in the Release, on the gateway's entry under that component's features, and sets max_in_flight in infra, with scope where the default, gateway, is not the count wanted. It attaches to a component in the request path that declares it can keep such a cap (dataplane.aggrega.ai/concurrency-cap, whichever value), and each realization refuses the scope its gateway does not count, naming the cap the gateway keeps. On core/gateway/nginx scope gateway is realized and a request past the cap is answered 503; scope model is refused, because NGINX keeps one total. On core/gateway/envoy-gateway scope model is realized, one cap for each wired model, and a request past it is answered 503; scope gateway is refused, because Envoy Gateway keeps a cap for each backend and none on their total. On core/gateway/litellm scope model is realized, one cap for each entry of its model map, and a request past it is answered 429 unless a fallback chain sends it on; scope gateway is refused, because the proxy keeps no total that holds.

출처

공식이 카탈로그가 공식 게시자로 인정하는 서명 ID로 서명되었습니다.
콘텐츠 다이제스트
sha256:8f20e59cffb4e898dccdc2abb9e12c3c2cd3c9409b8350257d8aca7c121ec73e
게시일
2026-11-10T10:17:01Z
서명 ID
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

서명

  • 공식application/vnd.dev.sigstore.bundle.v0.3+json

    https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main

    sha256:5e9450f993be21df92acc29be844b33bfdc4b53d3830e5e7e572fde1a681a914

이 버전의 참조

oci://hub.aggrega.ai/feature/core/concurrency-limit:1.0.0
적용 대상
dataplane.aggrega.ai/concurrency-cap
충돌 대상
—

개발자 매개변수

이 기능을 첨부할 때 개발자가 설정하는 값입니다.

BaseComponents#/schemas/BaseFeatureParameter 확장

출력 계약

이 기능이 소비자에게 게시하는 값입니다.

선언된 출력 값이 없습니다.

어노테이션

선언된 어노테이션이 없습니다.

관계

게시된 다른 엔터티와 주고받는 타입 지정 에지입니다. 게시된 대상이 없는 참조는 링크가 아닌 끊어진 에지로 표시됩니다.

사용함

사용됨

Feature 개념 레퍼런스 →

Aggrega 카탈로그 — 컴포넌트, 기능, 레시피, 그리고 이를 렌더링하는 플러그인의 공개 인덱스입니다.

공유 Aggrega 디자인 시스템으로 구축되었습니다.

개인정보 보호