365体育足球滚球比分

Questions tagged [spring-kafka]

The Spring for Apache Kafka (spring-kafka) project applies core Spring concepts to the development of Kafka-based messaging solutions.

Filter by
Sorted by
Tagged with
0
votes
1answer
10 views

How can setConsumerRebalanceListener get the calling ConsumerAwareRebalanceListener instance?

Maybe this is a naive question but it somhow stuck me there for some time. Please bear with me. I have a class DataConsumer.java that implements ConsumerAwareRebalanceListener: @Component public ...
0
votes
2answers
26 views

Number of consumers in kafka comsumer-group

If a producer have 3 topics, 4 partitions each, should the consumer group contains 4 or 12 consumers? I want to achieve ideal consumption
1
vote
2answers
25 views

how to stop consuming messages from kafka when error occurred and restart consuming again after some time in spring boot

This is the first time i am using Kafka. i have a spring boot application and i am consuming messages from kafka topics and storing messages in DB. I have a requirement to handle DB fail over, if DB ...
0
votes
2answers
44 views

Kafka Consumer diamond operator cannot infer arguments

I am creating a Kafka consumer. Mentioned piece of code is running fine on my sample POC project. Somehow when I use this in my project application, it gives error, of not able to resolve Diamond ...
0
votes
0answers
22 views

Problem of scheduling and deployment for kakfa consumers

Our product has design of multiple kafka topics with single group of consumers for each topic. When consuming the messages from kafka the consumers should batch jobs for faster processing. The ...
0
votes
1answer
35 views

How can I effectively bind my @KafkaListener to ConcurrentKafkaListenerContainerFactory?

I hit this scenario which appears strange to me: So basically I have defined two @KafkaListener in one class: @KafkaListener(id = "listener1", idIsGroup = false, topics = "data1", containerFactory =...
0
votes
0answers
32 views

Spring kafka with ssl, producer error “Duplicate key”

I have a Kafka server with SSL. When producing messages to it, error occurs: 2020-05-29 19:19:27.677 [kafka-producer-network-thread | producer-1] ERROR o.a.k.c.producer.internals.Sender - [Producer ...
0
votes
1answer
41 views

Why kakfa topic partition is not receiving messages?

I have a kafka cluster with 3 brokers and a topic with 8 partitions. A producer written in java using spring boot and without custom rule for load balancing. It means it should do round robin. The ...
0
votes
1answer
19 views

Garbage value published as key in kafka topic

I am using Long serializer for the keys and String serializer for value , after posting the message to the kafka topic when we retrieved the message and along with key are seeing key as some garbage ...
0
votes
1answer
22 views

Strategy for maximum throughput having 6 Kafka Consumers when the processing of each message requires a long time

Consider this scenario: Kafka topic with 6 partitions. Spring Java Kafka Consumer Application with 6 replicas so that each of them deals with one of the partitions. The problem I'm facing is the ...
2
votes
1answer
37 views

How should I implement delayed topic architecture in Kafka

If my consumers fails to process the message for the time being, I want it to push to 5 minutes delayed Topic and if it fails to process from there also I want it to push to 30 minutes delayed topic. ...
0
votes
1answer
31 views

How to read 2 Kafka topics sequentially in one consumer class using spring boot?

I have 2 Kafka topics A and B. I want that every time when my consumer starts up, it goes to topic A first. Topic A contains information about topic B, and I'll depend on that information to fetch ...
0
votes
1answer
27 views

Kafka consumer returning from poll earlier than the set pollTimeout?

I have created a Kafka consumer (Using KafkaListener interface) using the Spring Kafka starter. I set the pollTimeout in the containerFactory for my consumer. I set it to 5 seconds. When I send a ...
0
votes
0answers
14 views

Grouped and enriched mysql sink view using Kafka Streams + KTable

I'm looking for the best approach for the following problem: Kafka topic (sample data): { id: 0, value: '1', value_changed_on: 'lastWeek', value_type: 'user' } { id: 0, value: '2', value_changed_on: ...
0
votes
0answers
29 views

How to reprocess the batch in Kafka if it fails with timeout exception

I have following configuration in my Kafka-Producer: kafkaProducer.linger.ms : 0 kafkaProducer.batch.size : 0 kafkaProducer.buffer.memory : 33554432 kafkaProducer.retries : 3 kafkaProducer.request....

15 30 50 per page
1
2 3 4 5
123