Planning to increase document size in elastic, from 4KB to ~100KB each. What is the performance impact with document size increase? The new fields will have to be additonality used to calculate/modify final scores of documents that are retrieved.

Planning to keep doc_values true for all the newly added fields.

How are you querying? Are you primarily running aggregations or doing searches? How many documents do you typically return? What is driving the increase in document size?

Search + aggregation both. The newly added fields will only be used for script_score though. We return around 30 to150 documents based on use case. We are adding 4000 extra keys which would ultimately calculate/modify the final _score of ES docs. Our cluster is 20 data nodes 200 GB disk size eac…

Reading significantly larger documents from disk could affect performance. It is impossible to determine how much impact it will have though, so I recommend you run a test or benchmark using as realistic data and load as you can to find out.

Discuss the Elastic Stack

How does document size affect ElasticSearch performance?

Elastic Stack Elasticsearch

Topic		Replies	Views
Document size effect on aggregations Elasticsearch	2	844	May 19, 2017
Document Count vs. Document Size on search performance Elasticsearch	1	425	March 29, 2020
How does an index's document count affect performance? Elasticsearch	2	1137	July 5, 2017
Elastic search Design - Room for improvement Elasticsearch	6	545	June 19, 2020
Elastic Search performance issues when searching on docs with large field data Elasticsearch	6	1403	October 22, 2018

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

How does document size affect ElasticSearch performance?

Related topics