I am using logstash-jdbc plugin for extracting millions of records from DB to ElasticSearch. Is there any UI available for logstash where we can monitor if all the records are getting inserted into ES ?
Any issues like if the DB goes down in middle while extracting records how can we which records are inserted and which are still pending
There is no UI at this point. We do have plans of collecting metrics for each plugins and exposing them via RESTful APIs so you can get information that you asked for - # of rows consumed, errors etc.
For now, as @warkolm suggested, please use metrics-filter.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.