Skip to content
This repository has been archived by the owner on May 27, 2022. It is now read-only.

Excessive warnings in in logs when topic or broker not present #97

Open
pratikaher88 opened this issue Sep 8, 2020 · 0 comments
Open

Comments

@pratikaher88
Copy link

We are successfully able to connect to the designated broker and topic. But when we try to test for a situation when there is a situation with some issue with the broker then we get get following Warnings:
WARN 09/07/2020:06:37:39.722[::::][kafka-producer-network-thread | -default-logback-relaxed] org.apache.kafka.clients.NetworkClient [Producer clientId=-default-logback-relaxed] Error while fetching metadata with correlation id 68252 :
{some_topic=UNKNOWN_TOPIC_OR_PARTITION}
The correlation ID starts from 1 and doesnt seem to stop.

These warnings don't stop and they quickly fill up the logs. Is there some configuration that we need to set in logstash appender to avoid these excessive logs

configs used:

	<producerConfig>acks=1</producerConfig>
	<producerConfig>linger.ms=10000</producerConfig>
	<producerConfig>retries=0</producerConfig>
	<producerConfig>max.block.ms=100</producerConfig>
	<producerConfig>batch.size=655360</producerConfig>
	<producerConfig>buffer.memory=33554432</producerConfig>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant