I have splitted a large text file into multiple files of 50 MB each. When the setting of bulk_size is 1 in Fscrawler _settings.json, each file is indexed into Elasticsearch without any error. If the bulk size is increased I am getting the HTTP 413 Request Entity Too Large error. When I have a folde…

FSCrawler - Indexing mix of Big and small files - HTTP Entity too large error

kamalsharma (Kamal sharma) January 12, 2024, 12:53pm 7

I have a query, if the byte_size is 60 MB and we didn't mention bulk_size, how much document should be indexed at a time

Topic		Replies	Views
Request Entity Too Large when index file json has size large 100mb Elasticsearch	5	1839	November 6, 2019
Elasticsearch : cannot bulk index file larger than 6mb Elasticsearch	1	590	August 21, 2017
ElasticSearch 2.2.0 - File Too Large while bulk indexing Elasticsearch	3	1466	July 5, 2017
Bulk API does not work for huge data! Elasticsearch	4	1170	July 6, 2017
[elastic/elasticsearch] Cannot bulk index a JSON file greater than 100MB in Elasticsearch. Tried changing HTTP content length but it doesn't work Elasticsearch	14	2232	September 18, 2018