File size which i am ingesting through filebeat to Elasticsearch is about 70 GB per day but it takes whole day to upload data to elasticsearch is there is any possibility to increase the threads to read a single file or any other way to upload data quickly

Multiple Thread for ingesting a single file filebeat

Michal_Pristas (Michal Pristas) April 2, 2019, 11:49am 2

can you try to setup configuration as mentioned here (link)

Please let me know if this helps

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.