Jdbc input plugin not indexing all data to elasticsearch

snigdharao · July 25, 2018, 6:59pm

Hi ,
I am trying to index 80 Million data by using postgres jdbc plugin.
I have tried pagination and it doesnot index all the records.It is indexing only 60 Million records.
I have also used jdbc_fetch_size .It doesnt work

magnusbaeck · July 25, 2018, 8:06pm

What does your configuration look like? Have you looked in your Logstash logs for errors or warnings?

Topic		Replies	Views
Logstash jdbc input plugin not indexing all data to elasticsearch Logstash	2	1532	February 5, 2018
JDBC INPUT plugin not syncing all eligible records from postgres db to elasticsearch Logstash	1	150	July 5, 2023
Indexed records with logstash-input-jdbc not appearing in elasticsearch Logstash	2	583	March 28, 2017
Logstash not sending all data to elasticsearch Logstash	8	1132	June 1, 2023
Jdbc_page_size doesn't dump all my data to elastic search Logstash	1	818	October 22, 2017

Jdbc input plugin not indexing all data to elasticsearch

Related topics