Logstash Kafka input plugin does not consume data

Elastic Stack Logstash
1

Hi all,
Recently, I got into a problem that Logstash Kafka plugin does not consume data. Below is my config file:
input {
kafka {
auto_offset_reset => "earliest"
bootstrap_servers => "kafka-proxy-1.phx02.dev.company.com:9092"
client_id => "c77b9282-8017-46a1-9d6e-0e6fe93f1c28"
consumer_threads => 1
enable_auto_commit => "true"
group_id => "gro.out.nadeals"
topics => "tora.out.gro.na.deals.test"
partition_assignment_strategy => "org.apache.kafka.clients.consumer.RoundRobinAssignor"
}
}

output {
stdout { }
}

and I enabled the debug , get below information, and then Pushing flush onto pipeline is looping again and again.

[2017-10-26T23:18:15,824][DEBUG][logstash.agent ] Trying to start WebServer {:port=>9619}
[2017-10-26T23:18:15,825][DEBUG][logstash.api.service ] [api-service] start
[2017-10-26T23:18:15,830][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9619}
[2017-10-26T23:18:20,752][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-10-26T23:18:25,756][DEBUG][logstash.pipeline ] Pushing flush onto pipeline
[2017-10-26T23:18:30,759][DEBUG][logstash.pipeline ] Pushing flush onto pipeline

Anyone help?

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.