Help deleting by field name

Elastic Stack Elasticsearch
1

I have a number of fields (15K) that were created inadvertently.

How would I delete them all from all indexes based on a pattern of the
field name.

Eg all the fields I want to delete are in indexes named with the standard
logstash naming and are

"calculus_data.calculus_*"

Thanks,

-Chris

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/0ff099ca-5db2-4f34-a6fb-e418d8d38dac%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Are you looking to delete the documents or just the field? If you are
trying to delete the entire document that contains the field, you could use
a delete by query where the query contains on exists filter:

However, you will not be able to use wildcards in the exists filter, so you
will need to explicitly state each filter. That's the best I can think of.
:slight_smile:

Cheers,

Ivan

On Mon, May 5, 2014 at 3:25 PM, Chris Laplante chrisla23@gmail.com wrote:

I have a number of fields (15K) that were created inadvertently.

How would I delete them all from all indexes based on a pattern of the
field name.

Eg all the fields I want to delete are in indexes named with the standard
logstash naming and are

"calculus_data.calculus_*"

Thanks,

-Chris

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0ff099ca-5db2-4f34-a6fb-e418d8d38dac%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/0ff099ca-5db2-4f34-a6fb-e418d8d38dac%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDRZczMoRahZfOvAhezU66zXT9ijq63xfgWj9zcnDWCeg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

Trying to just delete the field. The main real world problem I'm facing is
that if the fields picker is expanded in Kibana and there are 15K of them
it bogs down the browser. :slight_smile: Could be a area of improvement there for
Kibana to impose a limit.

Thanks,

-Chris

On Wed, May 7, 2014 at 2:37 PM, Ivan Brusic ivan@brusic.com wrote:

Are you looking to delete the documents or just the field? If you are
trying to delete the entire document that contains the field, you could use
a delete by query where the query contains on exists filter:

Elasticsearch Platform — Find real-time answers at scale | Elastic

Elasticsearch Platform — Find real-time answers at scale | Elastic

However, you will not be able to use wildcards in the exists filter, so
you will need to explicitly state each filter. That's the best I can think
of. :slight_smile:

Cheers,

Ivan

On Mon, May 5, 2014 at 3:25 PM, Chris Laplante chrisla23@gmail.comwrote:

I have a number of fields (15K) that were created inadvertently.

How would I delete them all from all indexes based on a pattern of the
field name.

Eg all the fields I want to delete are in indexes named with the standard
logstash naming and are

"calculus_data.calculus_*"

Thanks,

-Chris

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0ff099ca-5db2-4f34-a6fb-e418d8d38dac%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/0ff099ca-5db2-4f34-a6fb-e418d8d38dac%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/C6rr8dJf_ZM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDRZczMoRahZfOvAhezU66zXT9ijq63xfgWj9zcnDWCeg%40mail.gmail.comhttps://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDRZczMoRahZfOvAhezU66zXT9ijq63xfgWj9zcnDWCeg%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPWb6tqpLHk46hVeJfVyD9rZHPJP%2BmqPv6dLg8ytHYoeMVr3cA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

4

Unfortunately, Elasticsearch does not support update by query, so you
cannot programatically delete a field. Perhaps there is something that can
be done on the Kibana side.

--
Ivan

On Wed, May 7, 2014 at 3:45 PM, Chris Laplante chrisla23@gmail.com wrote:

Trying to just delete the field. The main real world problem I'm facing is
that if the fields picker is expanded in Kibana and there are 15K of them
it bogs down the browser. :slight_smile: Could be a area of improvement there for
Kibana to impose a limit.

Thanks,

-Chris

On Wed, May 7, 2014 at 2:37 PM, Ivan Brusic ivan@brusic.com wrote:

Are you looking to delete the documents or just the field? If you are
trying to delete the entire document that contains the field, you could use
a delete by query where the query contains on exists filter:

Elasticsearch Platform — Find real-time answers at scale | Elastic

Elasticsearch Platform — Find real-time answers at scale | Elastic

However, you will not be able to use wildcards in the exists filter, so
you will need to explicitly state each filter. That's the best I can think
of. :slight_smile:

Cheers,

Ivan

On Mon, May 5, 2014 at 3:25 PM, Chris Laplante chrisla23@gmail.comwrote:

I have a number of fields (15K) that were created inadvertently.

How would I delete them all from all indexes based on a pattern of the
field name.

Eg all the fields I want to delete are in indexes named with the
standard logstash naming and are

"calculus_data.calculus_*"

Thanks,

-Chris

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.

To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0ff099ca-5db2-4f34-a6fb-e418d8d38dac%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/0ff099ca-5db2-4f34-a6fb-e418d8d38dac%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to a topic in the
Google Groups "elasticsearch" group.
To unsubscribe from this topic, visit
https://groups.google.com/d/topic/elasticsearch/C6rr8dJf_ZM/unsubscribe.
To unsubscribe from this group and all its topics, send an email to
elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDRZczMoRahZfOvAhezU66zXT9ijq63xfgWj9zcnDWCeg%40mail.gmail.comhttps://groups.google.com/d/msgid/elasticsearch/CALY%3DcQDRZczMoRahZfOvAhezU66zXT9ijq63xfgWj9zcnDWCeg%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAPWb6tqpLHk46hVeJfVyD9rZHPJP%2BmqPv6dLg8ytHYoeMVr3cA%40mail.gmail.comhttps://groups.google.com/d/msgid/elasticsearch/CAPWb6tqpLHk46hVeJfVyD9rZHPJP%2BmqPv6dLg8ytHYoeMVr3cA%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQC1bnH2%3D7qMKz6NAcAuC1AVwVe5gN9OmaytyLJ42-O8vQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.