Questions tagged [kafka]

Use this tag for questions about Apache Kafka - a distributed streaming (aka publish and subscribe or pub/sub) platform.

Filter by
Sorted by
Tagged with
1
vote
0answers
17 views

How does topography affect composite SLA?

I looked at How do you calculate the compound Service Level Agreement (SLA) for cloud services? and am still not sure how topography affects SLA. Suppose a request... passes through one instance of ...
0
votes
0answers
9 views

Best pv storage solution for on-premise k8s cluster

I have on-premise cluster with 3 worker nodes, I have confluent kafka installed and I need it for 3 namespaces, what is the best storage solution I can use to manage the persistence here, I am trying ...
1
vote
0answers
13 views

Run kafka-exporter against Confluent Kafka Cluster

Whenever I install the helm chart and point the kafkaServer to my k8s broker service the pod crashes due to failing to connect to the api, is this some confluent restriction and can it be workaround ...
2
votes
0answers
139 views

Confluent Kafka helm chart - broker pods not being able to communicate to Zookeper overtime

We are running confluent helm chart on a lot of clusters, we occasionally get brokers pods failing after some time and no self-heal after is following, the error in the broker usually is the following:...
0
votes
1answer
45 views

Confluent Kafka on K8s - offset is stuck, lag increases, what can be done?

We are using Confluent Kafka cluster on production K8s. It looks like our consumers are stuck in a loop as offset is static and lag keeps going up. When I restart zookeper/brokers (persistent volume) ...
0
votes
1answer
65 views

AWS MSK: deploying all Kafka brokers in the same availability zone

When using AWS MSK, is it possible to deploy Kafka brokers in the same AWS availability zone? From what I read, AWS enforces deployments across availability zones. If you use three brokers, it will ...
2
votes
1answer
348 views

How to add LinkedIn's Burrow to a Docker Compose?

It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub, but there are others who have forked it. However, I can't find any examples of how to add any of them to a docker ...
1
vote
1answer
32 views

Kafka from client to server vs. “router” in the DC

I want to use Kafka as a message broker on the server side of a distributed application. We have clients that can be located around the world, and that send frequent messages to the server. Right ...
2
votes
1answer
2k views

Multiple Kafka brokers behind a single OpenShift service?

Is it possible to have several brokers behind a single TCP/IP port? I.e., offer a single endpoint for Kafka clients, and having a scalable amount of brokers behind that? In my company, some people ...