Recipe
tei
Text Embeddings Inference as a self-hosted embedding server for local development via Docker Compose, synthesized from the Workload kind by the compose provider. A weights-pull step resolves the model pointer into a named model-cache volume before the server starts; the compiler never fetches weights. The serving image carries no download tool, so that step runs a general-purpose Python image pinned by this Recipe, and engine_version moves the serving image only. The server is started under the weights identifier, which is the model name published to consumers, with values.pooling as its pooling strategy. An attached model_pull_token is rendered as the HF_TOKEN environment variable on the pull step, which is also the key the credential must publish under; unattached, weights are pulled anonymously. An attached api_key is rendered the same way as API_KEY on the serving service, and the server then requires it of every caller, a scrape of provides.metrics_endpoint included. A GPU count is honoured: the compose provider reserves that many NVIDIA GPUs for the serving service, which the Docker host must be able to hand out. Compose is single-host: the replica count and the GPU runtime class are authored all the same, and the build reports each as an unsupported-field warning naming the setting. provides.host is the compose service name, which a consumer on the same compose network resolves directly.
Asal-usul
- Digest konten
- sha256:8a6fac1d9a75c30cb1fa299e244b112bd9b048d321d3d713fabdcc31216ac1f9
- Dipublikasikan
- 2026-11-10T10:20:59Z
- Identitas penandatangan
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Tanda tangan
- Resmiapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:ce7b257b3a5f74d5e8384dc537d6e845ce75a329b917317a75e611eb39d1d788
Referensi pada versi ini
oci://hub.aggrega.ai/recipe/compose/tei:1.0.0- Target
- —
- Mengimplementasikan
- core/ai-model/tei:1.0.0
Menyediakan
Templat pointer deterministik yang dihubungkan resep ini untuk konsumen.
| Nama | Templat |
|---|---|
| host | {{ .context.instance_id }} |
| port | {{ .infra.port }} |
| endpoint | http://{{ .context.instance_id }}:{{ .infra.port }}/v1 |
| model | {{ .values.model }} |
| protocol | http |
| metrics_endpoint | http://{{ .context.instance_id }}:{{ .infra.port }}/metrics |
| metrics_service | |
| metrics_service_port | |
| metrics_path |
Workload
Workload · form: stateless · replicas: {{ · containers: main
Nilai lokal
Tidak ada nilai lokal yang dideklarasikan.
Pemetaan values
Tidak ada pemetaan values yang dideklarasikan.
Relasi
Sisi bertipe ke dan dari entitas lain yang dipublikasikan. Referensi tanpa target yang dipublikasikan ditampilkan sebagai sisi yang terputus, bukan sebagai tautan.
Menggunakan
- mengimplementasikanmengimplementasikankontrak kompatibel
core/ai-model/tei:1.0.0
Semua keluaran wajib terpenuhi dan setiap keluaran yang disediakan disebutkan dalam kontrak.
Digunakan oleh
Tidak ada apa pun di katalog yang bergantung pada entitas ini.