# Partial update vs re-index 20 To 30 million records every day

**URL:** <https://discuss.elastic.co/t/partial-update-vs-re-index-20-to-30-million-records-every-day/369043>\
**Category:** Elasticsearch\
**Created:** [October 18, 2024, 7:06am UTC](https://discuss.elastic.co/t/partial-update-vs-re-index-20-to-30-million-records-every-day/369043 "2024-10-18T07:06:41Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Sasiganth\_Manikandan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sasiganth_manikandan/32/137896_2.png) [@Sasiganth\_Manikandan](https://discuss.elastic.co/u/Sasiganth_Manikandan)\
**Post date:** [October 18, 2024, 7:06am UTC](https://discuss.elastic.co/t/partial-update-vs-re-index-20-to-30-million-records-every-day/369043/1 "2024-10-18T07:06:41Z")

</div>

My index contains 300 millions documents. Every document has the same structure. Each document contains 40 to 50 fields, such as first\_name, last\_name, nick\_name, weight, height, preferred\_language, preferred\_currency, etc. Averagely, 25 Million documents will be updated every day, some days it might go high. For a specific usecase i have to add one value to existing list in Elasticsearch index. Apart from this reindexing of entire document will happen in parallelly for few 100k every day.  
Should i prefer update by query api or reindex entire document by index api?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [October 18, 2024, 7:45am UTC](https://discuss.elastic.co/t/partial-update-vs-re-index-20-to-30-million-records-every-day/369043/2 "2024-10-18T07:45:06Z")

</div>

If it's only 100k on 20 million docs, I'd use update by query.

---

<div class="post-metadata">

**Author:** ![Sasiganth\_Manikandan](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/sasiganth_manikandan/32/137896_2.png) [@Sasiganth\_Manikandan](https://discuss.elastic.co/u/Sasiganth_Manikandan)\
**Post date:** [October 18, 2024, 12:15pm UTC](https://discuss.elastic.co/t/partial-update-vs-re-index-20-to-30-million-records-every-day/369043/3 "2024-10-18T12:15:49Z")

</div>

@dadoonet Can I update 100k on each update by query in synchronously upto 20 million docs every day ?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [October 18, 2024, 4:37pm UTC](https://discuss.elastic.co/t/partial-update-vs-re-index-20-to-30-million-records-every-day/369043/4 "2024-10-18T16:37:23Z")

</div>

If I understand correctly your question, yes.