# Remove pipeline using field wildcard

**URL:** <https://discuss.elastic.co/t/remove-pipeline-using-field-wildcard/167849>\
**Category:** Elasticsearch\
**Created:** [February 11, 2019, 12:31pm UTC](https://discuss.elastic.co/t/remove-pipeline-using-field-wildcard/167849 "2019-02-11T12:31:11Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![manikandanid](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/manikandanid/32/91013_2.png) [@manikandanid](https://discuss.elastic.co/u/manikandanid)\
**Post date:** [February 11, 2019, 12:31pm UTC](https://discuss.elastic.co/t/remove-pipeline-using-field-wildcard/167849/1 "2019-02-11T12:31:11Z")

</div>

I want to remove a field starting with ElapsedTimeAt\* in my remove processor pipeline. Is it possible?

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 11, 2019, 12:43pm UTC](https://discuss.elastic.co/t/remove-pipeline-using-field-wildcard/167849/2 "2019-02-11T12:43:57Z")

</div>

Reading the code, I don't think it is possible to use wildcards.

> <https://github.com/elastic/elasticsearch/blob/master/modules/ingest-common/src/main/java/org/elasticsearch/ingest/common/RemoveProcessor.java#L56-L65>

---

<div class="post-metadata">

**Author:** ![manikandanid](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/manikandanid/32/91013_2.png) [@manikandanid](https://discuss.elastic.co/u/manikandanid)\
**Post date:** [February 11, 2019, 12:51pm UTC](https://discuss.elastic.co/t/remove-pipeline-using-field-wildcard/167849/3 "2019-02-11T12:51:12Z")

</div>

Thanks for the quick reply. This is what i am trying to achieve.

I have a incoming document and in Logstash i add a field for which the name is dynamic (filed name will be ElapsedTimeAt\_timestamp where timestamp will be substituted with @timestamp value). This field i need to make it available in one index and should be removed before indexing into other index. Struggling to implement this. Is there any way to do this ??

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 11, 2019, 1:11pm UTC](https://discuss.elastic.co/t/remove-pipeline-using-field-wildcard/167849/4 "2019-02-11T13:11:29Z")

</div>

May using an ingest script processor?

---

<div class="post-metadata">

**Author:** ![manikandanid](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/manikandanid/32/91013_2.png) [@manikandanid](https://discuss.elastic.co/u/manikandanid)\
**Post date:** [February 11, 2019, 1:26pm UTC](https://discuss.elastic.co/t/remove-pipeline-using-field-wildcard/167849/5 "2019-02-11T13:26:12Z")

</div>

Can i have something like  
ctx.ElapsedTimeAt\_%{timestamp} ? Will it compute the column name dynamically ?

If you have any example that would help me great ..

---

<div class="post-metadata">

**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\
**Post date:** [February 11, 2019, 1:39pm UTC](https://discuss.elastic.co/t/remove-pipeline-using-field-wildcard/167849/6 "2019-02-11T13:39:47Z")

</div>

Yes you can have something similar to this if there is a field which contains the value you are looking for. See [https://www.elastic.co/guide/en/elasticsearch/reference/6.6/accessing-data-in-pipelines.html#accessing-template-fields](https://www.elastic.co/guide/en/elasticsearch/reference/6.6/accessing-data-in-pipelines.html#accessing-template-fields)

For Ingest Script Processor, read [https://www.elastic.co/guide/en/elasticsearch/reference/6.6/script-processor.html](https://www.elastic.co/guide/en/elasticsearch/reference/6.6/script-processor.html). I'm not a painless expert so I can't really tell how to read all the fields from your documents and compare to a regex/wildcard and remove it or not.

---

<div class="post-metadata">

**Author:** ![manikandanid](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/manikandanid/32/91013_2.png) [@manikandanid](https://discuss.elastic.co/u/manikandanid)\
**Post date:** [February 11, 2019, 3:16pm UTC](https://discuss.elastic.co/t/remove-pipeline-using-field-wildcard/167849/7 "2019-02-11T15:16:16Z")

</div>

Same here David.... very beginner in painless ... But will figure it out and update you if i am successful... BTW thanks much for the quick reply.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [March 11, 2019, 3:16pm UTC](https://discuss.elastic.co/t/remove-pipeline-using-field-wildcard/167849/8 "2019-03-11T15:16:27Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
