# In rollover, Is it possible to update the document of old indexes? **URL:** \ **Category:** Elasticsearch\ **Created:** [February 17, 2021, 6:24am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512 "2021-02-17T06:24:03Z")\ **Posts on this page:** 18\ **Page:** 1
**Author:** ![Nikunj210903](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikunj210903/32/84241_2.png) [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Post date:** [February 17, 2021, 6:24am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/1 "2021-02-17T06:24:04Z")
Hello community.I have implemented rollover feature of elastic search. It will create a new index every day. Below is my question 1. Is it possible to update the document of **old indexes**? I have read somewhere that old indexes are set **read-only**. Can I prevent that because I want to update the document in both **current-index** and **old-index**. ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [February 17, 2021, 7:15am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/2 "2021-02-17T07:15:25Z")
Welcome to our community! 😃 > [@Nikunj210903](#): > > I have read somewhere Can you elaborate where you read that? It's not part of our docs. ---
**Author:** ![Nikunj210903](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikunj210903/32/84241_2.png) [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Post date:** [February 17, 2021, 7:47am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/3 "2021-02-17T07:47:18Z")
@warkolm I meant. I don't know the index name(Because indices are created dynamically) then how can I update a doc? ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [February 17, 2021, 7:48am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/4 "2021-02-17T07:48:16Z")
Update which doc sorry? ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [February 17, 2021, 7:49am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/5 "2021-02-17T07:49:36Z")
How are you updating old documents? Do you assign a unique ID that you can use? What type of data are you indexing? ---
**Author:** ![Nikunj210903](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikunj210903/32/84241_2.png) [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Post date:** [February 17, 2021, 9:02am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/6 "2021-02-17T09:02:44Z")
@Christian_Dahlqvist Yes I assigned a unique ID that I can use. But suppose I have 100 old indexes. Then Do I need to fire a update query 100 times? Like try to update document in 1st index, if document is missing then try to update document in 2nd index and so on upto 100th index. Is there any way that I fire only one query to update document which is in any one index of that 100 indices. ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [February 17, 2021, 9:08am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/7 "2021-02-17T09:08:10Z")
Do you know the timestamp of the documents to update when you issue the update? ---
**Author:** ![Nikunj210903](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikunj210903/32/84241_2.png) [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Post date:** [February 17, 2021, 9:11am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/8 "2021-02-17T09:11:58Z")
@Christian_Dahlqvist You mean document creation time? I will not have the document creation time. I just have **unique ID** , **alias name** , and **index pattern** ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [February 17, 2021, 9:49am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/9 "2021-02-17T09:49:48Z")
It does not necessarily sound like your data naturally fits with time-based indices. Do the documents have a retention period? What type of updates are you performing? What type of data is it? ---
**Author:** ![Nikunj210903](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikunj210903/32/84241_2.png) [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Post date:** [February 17, 2021, 1:24pm UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/10 "2021-02-17T13:24:20Z")
@Christian_Dahlqvist Below is my document structure. Here **id** is unique. { "id": 1 "name":"John", "company": "TCS" } I have set **max\_docs: 2** in rollover, so It will create a new index after every 2 documents inserted. Suppose I have added 11 documents then It created 6 indexes. Now I need to update **document no: 3(id: 3)**, which is on the **2nd index**. So If I use **index alias** to update **document no: 3** then It will give the **document missing error** because current index is **6th index** which contains only one **document(ID: 11)**. I used **update\_by\_query** and provided **index pattern** in Elasticsearch URL, so it will try to update all indexes which matches the index pattern. Is it Right approach or is there any alternative? ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [February 17, 2021, 1:58pm UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/11 "2021-02-17T13:58:01Z")
If you need to perform lots of updated efficiently it might be better to use a single index and avoid rollover. If you can tell us more about the data and use case we may be able to help. ---
**Author:** ![Nikunj210903](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikunj210903/32/84241_2.png) [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Post date:** [February 18, 2021, 3:37am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/12 "2021-02-18T03:37:32Z")
Thanks @Christian_Dahlqvist for your support. ---
**Author:** ![Nikunj210903](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikunj210903/32/84241_2.png) [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Post date:** [February 19, 2021, 3:31pm UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/13 "2021-02-19T15:31:41Z")
@Christian_Dahlqvist Here is the my detailed requirements: I am making a chat application. Please refer below 3 terms 1. **bot** : one who replies automatically when someone sends a message to bot 2. **visitor** : one who can chat with a bot. 3. **conservation** : chat between visitor and bot is called a conversation Relationship: A **visitor** can have multiple **conversations** So the mapping between **visitor** and **conversation** is one to many. I have below 3 approaches for index structure 1. I create only one index **conversation**. And keep a **visitor object** in each conversation **Advantages** : Easy to search based on visitor, conversation properties **Disadvantages** : Suppose one visitor have 5 conversations. Now visitor updates his property then I need to updates that all 5 conversation documents. I am using **rollover** index feature of elastic search. So if my document is in old indices then need to update document using **index pattern** because i don't know in which index my document is. Using **index pattern** instead of **index name** is more time consuming. 2. I create only one index **visitor**. And keep a list of **conversation object** in each visitor **Advantages** : Easy to search based on visitor, conversation properties **Disadvantage** : I need pagination on total conversations which is not possible in this approach. 3. I create 2 indexes **visitor** and **conversation**. I implement **rollover** in both indexes **Advantages** : It don't need to update **conversation** when **visitor** property is updated because I have separate index for **visitor** object and I am not keeping **visitor** object in **conversation** object **Disadvantage** : Same disadvantage as in the 1st approach, suppose I update visitor property and as I am using **rollover** , if visitor is in old index then need to update it using the **index pattern** instead of **index name** so it will consume more time. Second disadvantage is that suppose I want to search on both conversation and visitor property then need to invoke 2 ES queries for both the index which will take more time. Please suggest a better approach that how do I keep my index structure so It can fulfil below requirements 1. I can search on both properties visitor and conversation 2. I can do pagination on total conversions 3. I can update document using index name instead of index pattern ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [February 19, 2021, 3:39pm UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/14 "2021-02-19T15:39:30Z")
Do you have a defined retention period for your data? How much data do you expect to index every day? ---
**Author:** ![Nikunj210903](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikunj210903/32/84241_2.png) [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Post date:** [February 19, 2021, 3:44pm UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/15 "2021-02-19T15:44:13Z")
@Christian_Dahlqvist No. I have not defined retention period . I have 5000 conversation per day of 3000 visitors ---
**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\ **Post date:** [February 20, 2021, 8:56am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/16 "2021-02-20T08:56:09Z")
Given that a single shard can hold over a billion documents I do not see why you would need to use time based indices, which are better suited for immutable data with limited retention period. Instead create a single index with 3 or 4 primary shards and that would probably last you a long time. If the shards get too large you can always use the [split index API](https://www.elastic.co/guide/en/elasticsearch/reference/7.11/indices-split-index.html), although you probably would like to set up an alias linked to the index so you can reindex and switch this easily without affecting the application. ---
**Author:** ![Nikunj210903](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nikunj210903/32/84241_2.png) [@Nikunj210903](https://discuss.elastic.co/u/Nikunj210903)\ **Post date:** [February 22, 2021, 3:57am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/17 "2021-02-22T03:57:41Z")
@Christian_Dahlqvist Thanks for your support. I will got with only one index and used split API when my index have sufficient data. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [March 22, 2021, 3:58am UTC](https://discuss.elastic.co/t/in-rollover-is-it-possible-to-update-the-document-of-old-indexes/264512/18 "2021-03-22T03:58:36Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.