# Elasticsearch to Oracle Table

**URL:** <https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998>\
**Category:** Elasticsearch\
**Created:** [October 14, 2020, 7:01am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998 "2020-10-14T07:01:42Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![tusharnemade](https://avatars.discourse-cdn.com/v4/letter/t/67e7ee/32.png) [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\
**Post date:** [October 14, 2020, 7:01am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/1 "2020-10-14T07:01:42Z")

</div>

Hello Team

I have a requirement where in I have to move selected data from Elasticsearch INDEX to oracle Table {RDBMS} , in real-time.

Could you please help me in suggesting the method / examples / links / blogs / open-source tools using which I could fulfil my requirement.

Thanks

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [October 14, 2020, 7:03am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/2 "2020-10-14T07:03:37Z")

</div>

I'm not aware of any magic tool that would do this in real time, on the fly.

I'd probably try to do that from the application which is actually writing to Elasticsearch. Is that an application you wrote? Something else?

---

<div class="post-metadata">

**Author:** ![tusharnemade](https://avatars.discourse-cdn.com/v4/letter/t/67e7ee/32.png) [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\
**Post date:** [October 14, 2020, 7:06am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/3 "2020-10-14T07:06:30Z")

</div>

Hi David

I have not written the application code which sends data to elasticsearch. I know its comes via fluentd to elasticsearch.

This Elasticsearch has our critical data which need to be filtered and only portion of that data is needed in oracle for further Analysis.

---

<div class="post-metadata">

**Author:** ![tusharnemade](https://avatars.discourse-cdn.com/v4/letter/t/67e7ee/32.png) [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\
**Post date:** [October 14, 2020, 7:09am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/4 "2020-10-14T07:09:54Z")

</div>

We are expecting GB's of data daily basis in Elasticsearch. This DB's of data cannot be inserted into Oracle database directly because of our infra setup / capability to handle soo much inserts is also doubtful in oracle ... Elasticsearch is fast , as our data does not involve any transactions hence we have Elasticsearch for our application logging.

Any methodology you can suggest to be used to achieve ES - to - Oracle Table , in real time or say delay of 1 hour

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 14, 2020, 7:13am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/5 "2020-10-14T07:13:34Z")

</div>

You could use an ingest pipeline linked to the indices you want to extract data from to add a timestamp indicating when the data was indexed. You can then write a script/application to periodically extract data for a specific time period and index this into Oracle.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [October 14, 2020, 7:19am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/6 "2020-10-14T07:19:04Z")

</div>

Why do you need Oracle for? What is the use case that Elasticsearch can not cover?

---

<div class="post-metadata">

**Author:** ![tusharnemade](https://avatars.discourse-cdn.com/v4/letter/t/67e7ee/32.png) [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\
**Post date:** [October 14, 2020, 7:19am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/7 "2020-10-14T07:19:12Z")

</div>

Okay. How to put data into oracle from that injest pipeline , injest pipeline has output directed to oracle directly

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [October 14, 2020, 7:20am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/8 "2020-10-14T07:20:55Z")

</div>

No, you can not write to Oracle from an ingest pipeline. You need a separate application that periodically queries and exports data.

---

<div class="post-metadata">

**Author:** ![tusharnemade](https://avatars.discourse-cdn.com/v4/letter/t/67e7ee/32.png) [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\
**Post date:** [October 14, 2020, 7:20am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/9 "2020-10-14T07:20:56Z")

</div>

Oracle has our major data of application based on OLTP.

Elasticsearch has our logging data from application / middleware servers ...

what ever logging information success / failure we have is in ES. This data we have to use with user information and map some reports for business purpose. Hence we have this architecture in place.

---

<div class="post-metadata">

**Author:** ![tusharnemade](https://avatars.discourse-cdn.com/v4/letter/t/67e7ee/32.png) [@tusharnemade](https://discuss.elastic.co/u/tusharnemade)\
**Post date:** [October 14, 2020, 7:21am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/10 "2020-10-14T07:21:42Z")

</div>

.Okay .. That will require an separate efforts from development team..

Thank You for your response.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [October 14, 2020, 8:28am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/11 "2020-10-14T08:28:09Z")

</div>

> [@tusharnemade](#):
>
> what ever logging information success / failure we have is in ES. This data we have to use with user information and map some reports for business purpose. Hence we have this architecture in place.

Why not doing that on elasticsearch side?

You can enrich every log with the user information and store that in elasticsearch.  
Then do your analysis in Kibana. In real time. Whatever the size of the data is and without needing to read again tons of data and write them elsewhere.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [November 11, 2020, 8:28am UTC](https://discuss.elastic.co/t/elasticsearch-to-oracle-table/251998/12 "2020-11-11T08:28:38Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
