Component
core/messaging/kafka
An Apache Kafka event-streaming broker in KRaft mode, with no ZooKeeper, keeping its commit log on durable storage, so it renders as a stateful server. Its primary contract to consumers is the client bootstrap endpoint: a producer or consumer wires to it, through `host` and `port` or the `bootstrap_servers` list, and reaches the cluster there. Realized on Kubernetes two ways, both through Helm Recipes and chosen in the Manifest: a synthesis Recipe that builds one node, running the broker and controller roles in one process, from the official Apache Kafka image, and a controller-driven Recipe that emits a Kafka custom resource for the Strimzi Cluster Operator to reconcile. Reach for the synthesis Recipe on a cluster that runs no Kafka control plane — it needs no operator installed and no chart repository, so it builds with nothing fetched — and for the controller-driven Recipe where the Strimzi Cluster Operator is already in place and the cluster should own broker upgrades, rolling restarts and partition rebalancing; it runs Kafka 4.2.0 to 4.3.1 only, which the `engine_version` default is not. Reach for terraform/kafka-msk where Kafka is an Amazon MSK cluster in the operator's AWS account: two or three brokers, one per client subnet, serving plaintext on 9092 inside the VPC, or TLS on 9094. There is no Compose realization, and no CloudFormation one: a stack reads no bootstrap address off an MSK cluster without running code of its own. `infra.client_tls`, off by default, serves clients TLS alone and publishes `protocol` `kafka-ssl`: the synthesized broker presents the certificate attached to `server_certificate`, Strimzi one its cluster authority issues, MSK one AWS issues.
Provenance
- Empreinte du contenu
- sha256:a17a606a9df7d91ff68b87ff8dd99f611a3fdb195c1104a6fd65070a01011d37
- Publié
- 2026-11-10T10:12:25Z
- Identité de signature
- https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
Signature
- Officielapplication/vnd.dev.sigstore.bundle.v0.3+json
https://token.actions.githubusercontent.com/https://github.com/aggrega-ai/aggrega-hub/.github/workflows/catalog-publish-sign.yml@refs/heads/main
sha256:fc7be806070c32bac4e3a6f89f6defad3cf1bbe71d5b105146497c93acc71af2
Référence à cette version
oci://hub.aggrega.ai/component/core/messaging/kafka:1.0.0Paramètres du développeur
Valeurs que le développeur définit dans l’Aggregate.
| Nom | Type | Valeur par défaut | Obligatoire | Description |
|---|---|---|---|---|
| cluster_id | string | 4L6g3nShT-eMCtK--X86sw | non | Pinned KRaft cluster identity; a fixed value keeps the render deterministic. Honoured by the synthesized realization; on the controller-driven one the operator generates the identity, and on MSK the service does, so neither reads it and each halts the build on any value other than this default. |
| metrics_enabled | boolean | false | non | Turns on the brokers' own metrics, in the Prometheus format, on a port of their own on every node, and publishes the pod label selector, port name and path a scraper discovers them by; while false those keys are empty. The port checks no caller, so anything that reaches a node can read them. Honored by the controller-driven realization; the synthesized one serves no Prometheus metrics, and MSK runs no pod these keys could name, so both halt the build when this is true. |
Dimensionnement de l’opérateur
Dimensionnement de l’infrastructure que l’opérateur ajuste pour chaque environnement.
| Nom | Type | Valeur par défaut | Obligatoire | Description |
|---|---|---|---|---|
| broker_port | integer | 9092 | non | Client bootstrap port — the endpoint producers and consumers connect to. MSK fixes its ports itself, serving plaintext on 9092 and, while infra.client_tls is true, TLS on 9094, which its realization publishes as port; so the MSK realization halts the build on any value other than this default. |
| client_tls | boolean | false | non | Serve client connections over TLS alone. Off by default, which serves plaintext and renders exactly as a broker without the setting. On, the client listener accepts TLS alone on the published host and port, requests no client certificate, and the published `protocol` is `kafka-ssl`. The synthesized realization presents the certificate attached to `server_certificate` (required while this is on). The controller-driven realization presents one the Strimzi cluster certificate authority issues, or the one attached to `server_certificate`; a consumer trusts the authority's certificate, `ca.crt` in the Secret `<cluster>-cluster-ca-cert`, through its `server_ca`. On MSK it turns client-broker encryption in transit to TLS alone, on port 9094, whose certificate AWS issues and clients trust without a `server_ca`; that certificate does not name a DNS name the Release sets in `infra.overrides.host`, so the MSK realization halts on the two together. The controller quorum is unchanged. |
| controller_port | integer | 9093 | non | Internal KRaft controller-quorum port. Not part of the exported contract. Honoured by the synthesized realization; on the controller-driven one the operator fixes the port, and on MSK the controllers are the service's own, so neither reads it and each halts the build on any value other than this default. |
| engine_version | string | 4.1.2 | non | Apache Kafka image tag. Pins the packaged Kafka version the workload references. On the controller-driven realization it is the Kafka version the operator runs, one of 4.2.0 to 4.3.1, which this default is not. On MSK the major and minor version it begins with (4.1 from this default) is the cluster's Kafka version, one of 3.8, 3.9, 4.0 and 4.1, and any other halts the build naming them. |
| storage | object | — | non | — |
| compute | object | — | non | — |
| overrides | object (open) | — | non | Provider-specific overrides. Accepts any nested structure. Each Recipe documents which keys it reads. |
| control_plane_present | boolean | false | non | Operator affirmation that the Kafka operator (control plane) is installed in the target cluster. An operator-driven realization halts the build unless this is set true, so a Kafka custom resource is never emitted as an orphan into a cluster that cannot reconcile it. The synthesized StatefulSet realization ignores this flag. The MSK realization does not read it and halts the build while it is true: no Kafka control plane is installed for MSK. |
Contrat de sortie
Valeurs que ce composant publie vers les consommateurs via la topologie uses.
| Nom | Type | Valeur par défaut | Obligatoire | Description |
|---|---|---|---|---|
| host | string | — | oui | Bootstrap address a producer or consumer connects to first, from which the client learns the rest of the cluster. Which Service carries it follows the realization the Manifest selected, so a consumer reads this rather than deriving a name. On MSK it is a pointer string Terraform resolves to the first broker of the bootstrap list, or the DNS name the Release sets in infra.overrides.host instead, so a consumer on another target receives an address it can resolve. |
| port | integer | — | oui | TCP port the bootstrap address accepts client connections on. It carries the broker port an operator set, never the controller-quorum port, which is internal to the cluster; on MSK it is 9092, or 9094 while infra.client_tls is true. |
| bootstrap_servers | string | — | oui | Comma-separated `host:port` list a Kafka client takes as its bootstrap servers — what a client that takes a list reads, where `host` and `port` serve one that takes a single address. A realization with one bootstrap address publishes that address as the whole list. On MSK it is a pointer string Terraform resolves to every broker, or the infra.overrides.host name with the port while the Release sets one; a consumer on another target receives the pointer as text. |
| protocol | string | — | non | Wire protocol the published address speaks, which is what a consumer selects a client library and its connection security for, on every realization — `kafka` while `infra.client_tls` is off, and `kafka-ssl` while it is on, when the address accepts TLS connections alone: a Kafka client then sets its `security.protocol` to `SSL`. A client that reads only `host` and `port` reads this key too to learn that TLS is required: a plaintext client reaching a TLS listener fails its handshake and exchanges no record. |
| metrics_pod_selector | string | — | non | Kubernetes label selector matching every Kafka node pod, for a scraper that discovers those pods directly. Set by the controller-driven realization while values.metrics_enabled is true, beside `metrics_pod_port` and `metrics_path`; empty otherwise. |
| metrics_pod_port | string | — | non | Name of the container port on those pods that carries the metrics, `tcp-prometheus`. Set and empty together with `metrics_pod_selector`. |
| metrics_path | string | — | non | Path the metrics are served at on that port, `/metrics`. Set and empty together with `metrics_pod_selector`. |
Sockets uses
Les sockets de dépendance par lesquels ce composant se connecte. La cible de chaque connexion câblée via un socket doit satisfaire son sélecteur d’étiquettes, et chaque connexion peut porter une attache dans les emplacements que le socket déclare. Un emplacement obligatoire doit être rempli par chaque connexion que l’Aggregate ou la Release câble via le socket.
Aucun socket uses déclaré.
Emplacements d’attache
Points de liaison nommés auxquels une Feature s’attache à ce composant. Le sélecteur d’un emplacement restreint la Feature qui peut le remplir, et sa liste inject indique comment le matériel de la Feature peut être livré. Un emplacement obligatoire doit être lié sur chaque instance, par une attache sur l’instance ou à une portée supérieure, et un emplacement sensible est déclaré pour traiter du matériel secret. Une Feature peut aussi s’attacher sous un nom qu’aucun emplacement ne déclare.
| Emplacement | Sélecteur | Obligatoire | Injection | Sensible | Description |
|---|---|---|---|---|---|
| server_certificate | feature.aggrega.ai/kind=secret | non | file | oui | Optional certificate the broker presents to its clients while infra.client_tls is true: a Secret holding tls.crt, the certificate followed by any intermediate certificates, and tls.key, its private key, the two keys a kubernetes.io/tls Secret holds, the key unencrypted in PKCS #8 form (BEGIN PRIVATE KEY), the one form Kafka reads. The certificate names every address a client dials: the published host, and its namespace-qualified forms where clients in other namespaces connect; on the controller-driven realization a client also dials each broker under <instance>-kafka-brokers, beside the published <instance>-kafka-bootstrap, so the certificate also names *.<instance>-kafka-brokers and its namespace-qualified forms. Mounted as files, so attach a Feature that names an existing Secret, such as core/referenced-secret. Required by the synthesized realization while client_tls is true; the controller-driven one presents it in place of the certificate the Strimzi cluster authority issues, from a Secret in the Kafka resource's namespace. A build halts on it attached while client_tls is false. MSK presents a certificate AWS issues, so its realization halts on any attachment here. |
Liste d’autorisation d’auto-injection
Aucun canal d’auto-injection déclaré.
Relations
Arêtes typées vers et depuis d’autres entités publiées. Une référence sans cible publiée s’affiche comme une arête rompue plutôt que comme un lien.
Utilise
Cette entité n’utilise rien du catalogue.
Utilisé par
utilise le socket « target_messaging »
utilise le socket « backend »
utilise le socket « databases »
utilise le socket « etcd »
utilise le socket « backend »
utilise le socket « backend »
utilise le socket « forward_target »
utilise le socket « scrape_target »
utilise le socket « backend »
utilise le socket « database »
s’applique à
s’applique à
s’applique à
implémente
implémente
implémente