# Backup and create new data

**URL:** <https://discuss.elastic.co/t/backup-and-create-new-data/152882>\
**Category:** Logstash\
**Created:** [October 17, 2018, 4:59pm UTC](https://discuss.elastic.co/t/backup-and-create-new-data/152882 "2018-10-17T16:59:43Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![shani\_angarkadu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shani_angarkadu/32/50638_2.png) [@shani\_angarkadu](https://discuss.elastic.co/u/shani_angarkadu)\
**Post date:** [October 17, 2018, 4:59pm UTC](https://discuss.elastic.co/t/backup-and-create-new-data/152882/1 "2018-10-17T16:59:44Z")

</div>

hi community,  
we are using the log-stash to import the data from oracle db everyday to elastic.

what would be the best workflow and steps to automate the job?

Current steps,each runs individually, Is there anyway to make them to run after the previous job is succeed?

- Deleting the index through log-stash HTTP polling,
- Importing the data to elastic using the jdbc plugin
- taking a index backup and deleting the previous day backup using again HTTP polling

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [October 17, 2018, 8:41pm UTC](https://discuss.elastic.co/t/backup-and-create-new-data/152882/2 "2018-10-17T20:41:38Z")

</div>

There's no way of automating this from within Logstash.

Do you really need to reindex from scratch each time? Why?

---

<div class="post-metadata">

**Author:** ![shani\_angarkadu](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shani_angarkadu/32/50638_2.png) [@shani\_angarkadu](https://discuss.elastic.co/u/shani_angarkadu)\
**Post date:** [October 17, 2018, 9:36pm UTC](https://discuss.elastic.co/t/backup-and-create-new-data/152882/3 "2018-10-17T21:36:10Z")

</div>

because the data changes every day.

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [October 22, 2018, 6:09pm UTC](https://discuss.elastic.co/t/backup-and-create-new-data/152882/4 "2018-10-22T18:09:38Z")

</div>

That doesn't explain why you can't update the index incrementally, e.g. by only updating the rows that have changed (including added rows).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 19, 2018, 6:21pm UTC](https://discuss.elastic.co/t/backup-and-create-new-data/152882/5 "2018-11-19T18:21:20Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.