Logstash don't log more than 500 files


(Mauricio Rodrigues) #1

Hi,

I create a pipeline to logstash to read all files (58k) existing on specific directory. Inside of each file has a line of json terminated with a new line.

The problems is: the logstash only read (send to my elasticsearch) 502 files (502 entries)... the other files aren't readed.

Whats the possible problem?

See the my pipeline:

input { 
    file {
        path => "/path/to/files/*.json"
        codec => json
        start_position => "beginning"
    }
}

output {
    elasticsearch { 
        hosts => ["http://localhost:9200"] 
        index => "myindex"
    }
    #stdout { codec=> rubydebug }
}

(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.