# Ingesting the ElasticSearch index

**URL:** <https://discuss.elastic.co/t/ingesting-the-elasticsearch-index/94438>\
**Category:** Elasticsearch\
**Created:** [July 25, 2017, 7:57am UTC](https://discuss.elastic.co/t/ingesting-the-elasticsearch-index/94438 "2017-07-25T07:57:57Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![angelcab](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/angelcab/32/45618_2.png) [@angelcab](https://discuss.elastic.co/u/angelcab)\
**Post date:** [July 25, 2017, 7:57am UTC](https://discuss.elastic.co/t/ingesting-the-elasticsearch-index/94438/1 "2017-07-25T07:57:57Z")

</div>

I want to create an ElasticSearch index with some content of my database. That's a relational database.

What I want to index is document that I have stored in my database in blob fields. I want to index it and perform full text search over them.

I have tryied with a single document using the ingest plugin and it works properly. What I want now is to automitize my process, but I don't know if I can't do it with logstash (with a connection to my database) or what solution to implement. And how about the index for that field?

Thanks in advance!

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [July 25, 2017, 8:47am UTC](https://discuss.elastic.co/t/ingesting-the-elasticsearch-index/94438/2 "2017-07-25T08:47:01Z")

</div>

Do you mean binary documents like PDF, Open Office... ?  
Or JSON documents that you stored as blobs?

---

<div class="post-metadata">

**Author:** ![angelcab](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/angelcab/32/45618_2.png) [@angelcab](https://discuss.elastic.co/u/angelcab)\
**Post date:** [July 25, 2017, 9:24am UTC](https://discuss.elastic.co/t/ingesting-the-elasticsearch-index/94438/3 "2017-07-25T09:24:00Z")

</div>

Binary Documents. Pdf and Word stored as blob.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [July 25, 2017, 9:46am UTC](https://discuss.elastic.co/t/ingesting-the-elasticsearch-index/94438/4 "2017-07-25T09:46:21Z")

</div>

I'm not sure how LS JDBC input can support blobs TBH. May be something to ask in #logstash group.

What I did in the past was hacking the application which actually stores the data in the database and I was sending attachments from the application to the database to be stored and in the same "transaction" to elasticsearch to be ingested.

Then I wrote a batch which was using somehow the same process to read entirely existing blobs and index them into elasticsearch.

That's the way to go to keep in sync as much as possible both systems IMO.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [August 22, 2017, 9:46am UTC](https://discuss.elastic.co/t/ingesting-the-elasticsearch-index/94438/5 "2017-08-22T09:46:25Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.