It happens too often and after some time I don't see this issue. Is it a problem with Logstash HTTP plugin or my network? If it retries, there would definitely be a lag for indexing. And also can you please confirm there wouldn't be any data loss? What would be the alternative for this? Please help me with all the questions I have.
The output tells what the lag might be. The code uses a power 2 curve to determine the sleep time to a max of 60 seconds.
Its probably your network.
There may be data loss. You should test. Run your http endpoint with a file input that reads a large number of lines, say, 10 or 100 million. While LS is running, pause the http endpoint in some way or maybe use a simple http db service like riak. Count the documents in riak.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.