LOGSTASH: How to setup logstash to get all query's data not only a part of it?

I've a database table which contains 400+ records, but each time, I use logstash and JDBC it only gets 126 records. I tried many times with different indices each time, but still the 126 only retrieving.

Here is the output configurations:

input {
    jdbc {
        jdbc_driver_class => "org.postgresql.Driver"
        statement => "SELECT * from xfailure"
output {
elasticsearch {
   hosts => ["localhost:9200"]
   manage_template => false
   index => "test_predictions"
   document_id => "%{id}"

When I check the number of rows, I found that it has 400+ records here is the select statment:

SELECT * FROM xfailure;

here is a sample of the record columns:


Whem I create an index on Kibanna, I used the timestamp as time field, but the number of hits is just 162 hits!

If two records have the same value of id the second will overwrite the first. Can you do a SELECT COUNT (DISTINCT id) FROM xfailure?

400+. the id field is unique in that postgres database table. @Badger

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.