i use :
kafka input plugin
es output plugin
logstash 7.3
es 7.3
my config file for logstash:
input{
kafka
{
bootstrap_servers => "192.168.50.97:9092"
topics => ["log-aggregator"]
client_id => "logstash_consumer_50.97"
group_id => "logstash-4"
codec => avro { schema_uri => "/etc/logstash/conf.d/t4-avro-schema.avsc" }
}
}
output {
elasticsearch {
hosts => ["localhost:9200"]
id => "kafka_elastic_input_t4_v2"
index => "t4"
user => ""
password => ""
}
stdout { codec => json }
}
there is no error when i execute logstash but no index created in es!!!
when i run logstash:
[INFO ] 2019-08-11 11:14:50.638 [Ruby-0-Thread-28: :1] Fetcher - [Consumer clientId=logstash_consumer_50.97-0, groupId=logstash-4] Resetting offset for partition log-aggregator-2 to offset 16. [INFO ] 2019-08-11 11:14:50.639 [Ruby-0-Thread-28: :1] Fetcher - [Consumer clientId=logstash_consumer_50.97-0, groupId=logstash-4] Resetting offset for partition log-aggregator-1 to offset 3. [INFO ] 2019-08-11 11:14:50.639 [Ruby-0-Thread-28: :1] Fetcher - [Consumer clientId=logstash_consumer_50.97-0, groupId=logstash-4] Resetting offset for partition log-aggregator-0 to offset 2. [INFO ] 2019-08-11 11:14:50.639 [Ruby-0-Thread-28: :1] Fetcher - [Consumer clientId=logstash_consumer_50.97-0, groupId=logstash-4] Resetting offset for partition log-aggregator-7 to offset 1. [INFO ] 2019-08-11 11:14:50.639 [Ruby-0-Thread-28: :1] Fetcher - [Consumer clientId=logstash_consumer_50.97-0, groupId=logstash-4] Resetting offset for partition log-aggregator-6 to offset 5. [INFO ] 2019-08-11 11:14:50.639 [Ruby-0-Thread-28: :1] Fetcher - [Consumer clientId=logstash_consumer_50.97-0, groupId=logstash-4] Resetting offset for partition log-aggregator-5 to offset 4. [INFO ] 2019-08-11 11:14:50.640 [Ruby-0-Thread-28: :1] Fetcher - [Consumer clientId=logstash_consumer_50.97-0, groupId=logstash-4] Resetting offset for partition log-aggregator-4 to offset 6. [INFO ] 2019-08-11 11:14:50.640 [Ruby-0-Thread-28: :1] Fetcher - [Consumer clientId=logstash_consumer_50.97-0, groupId=logstash-4] Resetting offset for partition log-aggregator-11 to offset 4. [INFO ] 2019-08-11 11:14:50.640 [Ruby-0-Thread-28: :1] Fetcher - [Consumer clientId=logstash_consumer_50.97-0, groupId=logstash-4] Resetting offset for partition log-aggregator-10 to offset 11.
there is no error when it is executing! also no output!!!!!!!!!!!!!!!!!!!!