Questions tagged [kafka]

Use this tag for questions about Apache Kafka - a distributed streaming (aka publish and subscribe or pub/sub) platform.

Filter by
Sorted by
Tagged with
0
votes
0answers
6 views

Confluent Kafka Helm Chart - how to choose a different Zookeeper version

According to provider documentation for Helm Release for example 5.5.0 there is a wide range of Zookeeper version that can be utilized, how can I choose that, I can't find any info about it or example,...
-1
votes
0answers
38 views

ERROR Unexpected exception causing shutdown while sock still open (org.apache.zookeeper.server.quorum.LearnerHandler) - Zookeper Cluster failure

Often enough to damage business our Zookeper memembers fail with "ERROR Unexpected exception causing shutdown while sock still open (org.apache.zookeeper.server.quorum.LearnerHandler)", I ...
1
vote
0answers
10 views

Run kafka-exporter against Confluent Kafka Cluster

Whenever I install the helm chart and point the kafkaServer to my k8s broker service the pod crashes due to failing to connect to the api, is this some confluent restriction and can it be workaround ...
0
votes
0answers
11 views

Confluent Kafka JMX curl on localhost - only default jmx response with no metrics from kafka

Running confluent helm chart 0.5.0, JMX is enabled in chart, when I login into broker and I curl localhost or 127.0.0.1 on port 5556 I get only some default endpoints and no metrics from kafka, why? ...
2
votes
0answers
24 views

Confluent Kafka helm chart - broker pods not being able to communicate to Zookeper overtime

We are running confluent helm chart on a lot of clusters, we occasionally get brokers pods failing after some time and no self-heal after is following, the error in the broker usually is the following:...
0
votes
1answer
9 views

Confluent Kafka on K8s - offset is stuck, lag increases, what can be done?

We are using Confluent Kafka cluster on production K8s. It looks like our consumers are stuck in a loop as offset is static and lag keeps going up. When I restart zookeper/brokers (persistent volume) ...
0
votes
1answer
31 views

AWS MSK: deploying all Kafka brokers in the same availability zone

When using AWS MSK, is it possible to deploy Kafka brokers in the same AWS availability zone? From what I read, AWS enforces deployments across availability zones. If you use three brokers, it will ...
2
votes
1answer
260 views

How to add LinkedIn's Burrow to a Docker Compose?

It appears LinkedIn doesn't have an official Burrow docker image on Docker Hub, but there are others who have forked it. However, I can't find any examples of how to add any of them to a docker ...
1
vote
1answer
29 views

Kafka from client to server vs. “router” in the DC

I want to use Kafka as a message broker on the server side of a distributed application. We have clients that can be located around the world, and that send frequent messages to the server. Right ...
2
votes
1answer
1k views

Multiple Kafka brokers behind a single OpenShift service?

Is it possible to have several brokers behind a single TCP/IP port? I.e., offer a single endpoint for Kafka clients, and having a scalable amount of brokers behind that? In my company, some people ...