We are in a situation where extremely large documents were indexed (to text fields) and our ElasticSearch instance has been going down/crazy recently with out of disk and out of memory. We've also run into HTTP response errors just viewing the documents. As I understand it there is no way to limit …

[image] cawoodm: OK, will it also help to delete unwanted documents from indices? Not at all. [image] cawoodm: My feeling is ES doesn't really delete (docs still appear as docs.deleted in _cat/indices). If you are removing documents (and not indices), then you need to forcemerge the i…

Discuss the Elastic Stack

Extremely Large Documents: Querying and Dealing with

Elastic Stack Elasticsearch

dadoonet (David Pilato) September 16, 2021, 1:12pm 2

What does look like the query you are sending to elasticsearch ?

Topic		Replies	Views
Size limitations? Elasticsearch	6	10064	July 6, 2017
Indexing very large document in ES Elasticsearch	6	9628	July 6, 2017
Strange limits when using Java API (SOLVED) Elasticsearch	6	1972	July 5, 2017
ElasticSearch- IndexReaders cannot exceed 2147483647 Elasticsearch	7	1448	July 6, 2017
Performance suggestions for Indexing large documents Elasticsearch	8	409	July 6, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Extremely Large Documents: Querying and Dealing with

Related topics