Hi,
I create a pipeline to logstash to read all files (58k) existing on specific directory. Inside of each file has a line of json terminated with a new line.
The problems is: the logstash only read (send to my elasticsearch) 502 files (502 entries)... the other files aren't readed.
Whats the possible problem?
See the my pipeline:
input {
file {
path => "/path/to/files/*.json"
codec => json
start_position => "beginning"
}
}
output {
elasticsearch {
hosts => ["http://localhost:9200"]
index => "myindex"
}
#stdout { codec=> rubydebug }
}