Not able to import complete data using Logstash to Elasticsearch


I am using Logstash with JDBC connection for importing data from database to elasticsearch.

When i am importing data, all the data present in database is not imported.

There are 487745 records in my database but when i see the elasticsearch, i hardly get few data.

Please suggest a way. I am also attaching my logstash config file through which i am doing this.

Please don't post pictures of text, they are difficult to read and some people may not be even able to see them.

How many? What's in your logs?

ok sure. Will not send picture of text.

10 - 15 data.

No Error log is gererated.

Hi @warkolm,

It was mistake from my end. Actually i was importing huge amount of data i.e. Approx 5 lac. So it is taking nearly 1.5hr time to load in to elasticsearch.

So in between i was closing up the command prompt so whole bunch of data was not loading.

Try by adding
document_id => "%{primary_key}" below document_type

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.