# Can I do query to retrieve some doc in ingest processor

**URL:** <https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878>\
**Category:** Elasticsearch\
**Created:** [November 16, 2017, 8:10am UTC](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878 "2017-11-16T08:10:36Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![itplayer](https://avatars.discourse-cdn.com/v4/letter/i/d26b3c/32.png) [@itplayer](https://discuss.elastic.co/u/itplayer)\
**Post date:** [November 16, 2017, 8:10am UTC](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878/1 "2017-11-16T08:10:36Z")

</div>

Hi  
Does anyone have experience that writes your own ingest processor?  
Is this possible to make a ingest processor that can query ES to retrieve a doc and that fill to the ingest doc before actual index?

By directly using Java API to query from ES is okay?

Please input your valuable advice. Thanks~

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [November 16, 2017, 8:22am UTC](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878/2 "2017-11-16T08:22:13Z")

</div>

Ingest processors are limited to working with the current document, and should not call out. What you are looking to do should however be possible though Logstash and the use of the elasticsearch filter.

---

<div class="post-metadata">

**Author:** ![itplayer](https://avatars.discourse-cdn.com/v4/letter/i/d26b3c/32.png) [@itplayer](https://discuss.elastic.co/u/itplayer)\
**Post date:** [November 16, 2017, 8:37am UTC](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878/3 "2017-11-16T08:37:47Z")

</div>

Hi @Christian_Dahlqvist  
Thanks for your quick reply.  
I'm limited to use elasticsearch only in this case. Basically what I need to do is to add a field to this ingest doc and that value is query from another index(in the same elasticsearch cluster). The easiest way to achieve to this is constructing doc in application side but unfortunately, application can't. So, I come to ingest pipeline to seek solution.

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 16, 2017, 8:53am UTC](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878/4 "2017-11-16T08:53:45Z")

</div>

In case it helps:

> <https://github.com/elastic/elasticsearch/pull/20340>

---

<div class="post-metadata">

**Author:** ![itplayer](https://avatars.discourse-cdn.com/v4/letter/i/d26b3c/32.png) [@itplayer](https://discuss.elastic.co/u/itplayer)\
**Post date:** [November 16, 2017, 9:08am UTC](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878/5 "2017-11-16T09:08:36Z")

</div>

Thank you @dadoonet  
So this is not officailly supported by Elasticsearch right? Where can I have this plug-in though?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [November 16, 2017, 9:45am UTC](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878/6 "2017-11-16T09:45:07Z")

</div>

It’s not available. You just have some code source available within the PR and that’s all.

It was a WIP though.

---

<div class="post-metadata">

**Author:** ![itplayer](https://avatars.discourse-cdn.com/v4/letter/i/d26b3c/32.png) [@itplayer](https://discuss.elastic.co/u/itplayer)\
**Post date:** [November 16, 2017, 10:18am UTC](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878/7 "2017-11-16T10:18:20Z")

</div>

Thanks for your guidance. Let me think how to start with it.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [December 14, 2017, 10:18am UTC](https://discuss.elastic.co/t/can-i-do-query-to-retrieve-some-doc-in-ingest-processor/107878/8 "2017-12-14T10:18:24Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
