Logstash reads only 10 rows

[Lubos_Marek (Luboš Marek)]

Hello,
I am trying to read csv file with logstash but logstash reads only firs 10 rows. Where could be a problem?

Structure of my CSV file:
500;message 1
200;message 2
500;message 1
200;message 2
500;message 1
200;message 2
500;message 1
200;message 2
500;message 1
200;message 2
500;message 1
200;message 2
500;message 1
200;message 2

my logstash.conf

input {
  file {
    path => ["/usr/share/logstash/data1/*"]
    start_position => "beginning"
    sincedb_path => "/dev/null"
  }
}

filter {
  csv {
    separator => ";"
    columns => ["statuscode", "message"]
  }
}

output {
  elasticsearch {
    hosts => ["http://host.docker.internal:9200"]
    index => "mylog"
  }
}

When I open http://localhost:9200/mylog/_search?pretty I see only first 10 rows of my file.

[andres-perez (Andrés Pérez)]

Thanks for your detailed input, configuration and query commands used to get your desired output. It makes it really easier to troubleshoot

@Lubos_Marek

When I open http://localhost:9200/mylog/_search?pretty I see only first 10 rows of my file.

Your issue is related to the elasticsearch query: if the output "size" is not specified, the default is 10 results.

It is better explained in this response: Get query is showing only 10 results while searching for a particular data - #2 by ogtool