# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=972

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 973

---

## [How to create indexes in bulk using Elasticseach\_dsl?](https://discuss.elastic.co/t/how-to-create-indexes-in-bulk-using-elasticseach-dsl/225525)

<div class="topic-metadata">

**Author:** [@Lisahtwy](https://discuss.elastic.co/u/Lisahtwy)\
**Replies:** 1\
**Last updated:** [March 30, 2020, 4:20pm UTC](https://discuss.elastic.co/t/how-to-create-indexes-in-bulk-using-elasticseach-dsl/225525 "2020-03-30T16:20:21Z")

</div>

Hi, I was able to create a single index using below code: Single index code from elasticsearch import Elasticsearch from elasticsearch\_dsl import Index,Search,Document, analyzer, tokenizer,\\ …

---

## [Ability to search ES based on a result of previous search in a watcher](https://discuss.elastic.co/t/ability-to-search-es-based-on-a-result-of-previous-search-in-a-watcher/224693)

<div class="topic-metadata">

**Author:** [@Jasonespo](https://discuss.elastic.co/u/Jasonespo)\
**Replies:** 6\
**Last updated:** [March 30, 2020, 3:59pm UTC](https://discuss.elastic.co/t/ability-to-search-es-based-on-a-result-of-previous-search-in-a-watcher/224693 "2020-03-30T15:59:57Z")

</div>

Hi I was wondering if it was possible (in a watcher) to do the following: Search an index for a keyword e.g document must contain "tag": "laptop" In that document it contains another field called "identifier": "09…

---

## [Custom tokenizer for letter and digits](https://discuss.elastic.co/t/custom-tokenizer-for-letter-and-digits/225317)

<div class="topic-metadata">

**Author:** [@lfcnassif](https://discuss.elastic.co/u/lfcnassif)\
**Replies:** 2\
**Last updated:** [March 30, 2020, 3:49pm UTC](https://discuss.elastic.co/t/custom-tokenizer-for-letter-and-digits/225317 "2020-03-30T15:49:38Z")

</div>

Hi, Searched the docs and I was not able to find a solution to create a custom tokenizer to break text at any char different from digit or unicode letter (like those returned by java Character.isLetterOrDigit()). In the…

---

## [Aggregation with distinct null elements](https://discuss.elastic.co/t/aggregation-with-distinct-null-elements/225393)

<div class="topic-metadata">

**Author:** [@Ekaterina\_Nekrasova](https://discuss.elastic.co/u/Ekaterina_Nekrasova)\
**Replies:** 2\
**Last updated:** [March 30, 2020, 3:23pm UTC](https://discuss.elastic.co/t/aggregation-with-distinct-null-elements/225393 "2020-03-30T15:23:20Z")

</div>

Hello everybody ! I have PersonType with groupId field, which can be null, or even doesn't exist { Id: 1 Name : ToTo, GroupId: 1 } { Id: 2 Name : TaTo, GroupId: 2 } { Id: 3 Name : ToTa, GroupId: null } { Id: 4 Name : T…

---

## [Curl XPOST errors not supported 406](https://discuss.elastic.co/t/curl-xpost-errors-not-supported-406/225509)

<div class="topic-metadata">

**Author:** [@Ketan\_Chachad](https://discuss.elastic.co/u/Ketan_Chachad)\
**Replies:** 3\
**Last updated:** [March 30, 2020, 3:10pm UTC](https://discuss.elastic.co/t/curl-xpost-errors-not-supported-406/225509 "2020-03-30T15:10:29Z")

</div>

I have installed elasticsearch 7.6.1 on an AWS EC2 instance. When I give the following curl command from Windows I get a valid JSON response: curl -XGET "http://\<EC2-IP\>:9200" However when I give the following command…

---

## [Length filter: array index out of bounds exception](https://discuss.elastic.co/t/length-filter-array-index-out-of-bounds-exception/225261)

<div class="topic-metadata">

**Author:** [@jetnet](https://discuss.elastic.co/u/jetnet)\
**Replies:** 4\
**Last updated:** [March 30, 2020, 3:08pm UTC](https://discuss.elastic.co/t/length-filter-array-index-out-of-bounds-exception/225261 "2020-03-30T15:08:38Z")

</div>

I encountered a strange issue, when a query fails depending on the position of a term and only then the length filter is active (see below): works: GET test/\_search?filter\_path=\*\*.productNumber { "query": { "mat…

---

## [Autocomplete enhancement](https://discuss.elastic.co/t/autocomplete-enhancement/225473)

<div class="topic-metadata">

**Author:** [@vijay2](https://discuss.elastic.co/u/vijay2)\
**Replies:** 2\
**Last updated:** [March 30, 2020, 2:56pm UTC](https://discuss.elastic.co/t/autocomplete-enhancement/225473 "2020-03-30T14:56:58Z")

</div>

Hello, I have built a e-commerce autocomplete feature which works with the product names. Searching “Gucci” gives me phrases found in the rest of the product title. But I would like to build something like Amazon, E.…

---

## [Map embedded json object to one field](https://discuss.elastic.co/t/map-embedded-json-object-to-one-field/225667)

<div class="topic-metadata">

**Author:** [@cowensel](https://discuss.elastic.co/u/cowensel)\
**Replies:** 1\
**Last updated:** [March 30, 2020, 2:49pm UTC](https://discuss.elastic.co/t/map-embedded-json-object-to-one-field/225667 "2020-03-30T14:49:32Z")

</div>

I can see there a number of posts about this but I cannot seem to make heads or tails of them. We have some logs that get sent to our ELK server where an embedded Json object is sent. I would like to map everything in t…

---

## [Logstash: retrying failed action with response code: 403; reason=\> blocked by: FORBIDDEN/5/index read-only (api)](https://discuss.elastic.co/t/logstash-retrying-failed-action-with-response-code-403-reason-blocked-by-forbidden-5-index-read-only-api/225405)

<div class="topic-metadata">

**Author:** [@pavank](https://discuss.elastic.co/u/pavank)\
**Replies:** 1\
**Last updated:** [March 30, 2020, 2:47pm UTC](https://discuss.elastic.co/t/logstash-retrying-failed-action-with-response-code-403-reason-blocked-by-forbidden-5-index-read-only-api/225405 "2020-03-30T14:47:47Z")

</div>

We have set up our production environment with a 5 ES node cluster (3 hot and 2 warm) with a curator executing cronjob to push older logs into the warm nodes. As per industry regulations, curator password expired and was…

---

## [Compile a category hierarchy list from several different such hierarchies](https://discuss.elastic.co/t/compile-a-category-hierarchy-list-from-several-different-such-hierarchies/225696)

<div class="topic-metadata">

**Author:** [@Catalin](https://discuss.elastic.co/u/Catalin)\
**Replies:** 0\
**Last updated:** [March 30, 2020, 2:34pm UTC](https://discuss.elastic.co/t/compile-a-category-hierarchy-list-from-several-different-such-hierarchies/225696 "2020-03-30T14:34:57Z")

</div>

My final goal is to create the most relevant category hierarchy steaming from several different such hierarchies. But for a first step, being given a number of lists each containing 1 or more categories, I'd like to cre…

---

## [Enrich pipeline policy using child record attributes](https://discuss.elastic.co/t/enrich-pipeline-policy-using-child-record-attributes/224528)

<div class="topic-metadata">

**Author:** [@askids](https://discuss.elastic.co/u/askids)\
**Replies:** 4\
**Last updated:** [March 30, 2020, 2:26pm UTC](https://discuss.elastic.co/t/enrich-pipeline-policy-using-child-record-attributes/224528 "2020-03-30T14:26:03Z")

</div>

hi, Is it possible to use enrich policy pipeline to perform a lookup against a child record to pull required attributes? I have 1 to 1 parent-child data in another index. But the attributes that I want to be included ar…

---

## [Sub aggregations on bucket key](https://discuss.elastic.co/t/sub-aggregations-on-bucket-key/224755)

<div class="topic-metadata">

**Author:** [@Michael\_Jackson1](https://discuss.elastic.co/u/Michael_Jackson1)\
**Replies:** 3\
**Last updated:** [March 30, 2020, 2:03pm UTC](https://discuss.elastic.co/t/sub-aggregations-on-bucket-key/224755 "2020-03-30T14:03:14Z")

</div>

Hello everyone, new member here. I have been testing the path\_hierarchy tokenizer. Just looking for advice with my situation. I have a simple index with docs that look like this: { "keyword": "stuff and things", …

---

## [Sum aggregation on "counter like" object field](https://discuss.elastic.co/t/sum-aggregation-on-counter-like-object-field/224884)

<div class="topic-metadata">

**Author:** [@fhdz](https://discuss.elastic.co/u/fhdz)\
**Replies:** 3\
**Last updated:** [March 30, 2020, 1:58pm UTC](https://discuss.elastic.co/t/sum-aggregation-on-counter-like-object-field/224884 "2020-03-30T13:58:53Z")

</div>

Hi there, I find myself with 'counter like' fields, e.g. for counting some occurrences of my docs in different domains. (When a doc is used in a context of such or such domain, the counter is incremented.) I have an o…

---

## [Can Elasticsearch run together with a Cloudera instance?](https://discuss.elastic.co/t/can-elasticsearch-run-together-with-a-cloudera-instance/225593)

<div class="topic-metadata">

**Author:** [@Miguel\_Plazas](https://discuss.elastic.co/u/Miguel_Plazas)\
**Replies:** 2\
**Last updated:** [March 30, 2020, 1:16pm UTC](https://discuss.elastic.co/t/can-elasticsearch-run-together-with-a-cloudera-instance/225593 "2020-03-30T13:16:04Z")

</div>

I would like if it's possible to run elasticsearch with a cloudera instance? The nodes have 1TB of RAM. Thanks.

---

## [Aggregations after upgrading to ES 7 - request slowed down](https://discuss.elastic.co/t/aggregations-after-upgrading-to-es-7-request-slowed-down/224992)

<div class="topic-metadata">

**Author:** [@egoMojKolego](https://discuss.elastic.co/u/egoMojKolego)\
**Replies:** 4\
**Last updated:** [March 30, 2020, 12:59pm UTC](https://discuss.elastic.co/t/aggregations-after-upgrading-to-es-7-request-slowed-down/224992 "2020-03-30T12:59:20Z")

</div>

Hi all, in our app, we updated version of ES from 6 to 7. Everything is working fine as it was but I spot one issue. Previously when we retrive aggregations for 200k of medias, it took 10-15 sec, right now same reques…

---

## [Problem elastic search not down](https://discuss.elastic.co/t/problem-elastic-search-not-down/225658)

<div class="topic-metadata">

**Author:** [@Youssef\_SBAI](https://discuss.elastic.co/u/Youssef_SBAI)\
**Replies:** 1\
**Last updated:** [March 30, 2020, 12:36pm UTC](https://discuss.elastic.co/t/problem-elastic-search-not-down/225658 "2020-03-30T12:36:22Z")

</div>

I have this problem when in start elastic search invalid mount config for type "bind": bind mount source path does not exist: /data/volumes/monitoring/elasticsearch/data

---

## [Restricting Security Index deletion and minimal configuration requirement for user other than super user for health management with XPACK 6.8.1](https://discuss.elastic.co/t/restricting-security-index-deletion-and-minimal-configuration-requirement-for-user-other-than-super-user-for-health-management-with-xpack-6-8-1/225673)

<div class="topic-metadata">

**Author:** [@AsifIqbal](https://discuss.elastic.co/u/AsifIqbal)\
**Replies:** 0\
**Last updated:** [March 30, 2020, 12:36pm UTC](https://discuss.elastic.co/t/restricting-security-index-deletion-and-minimal-configuration-requirement-for-user-other-than-super-user-for-health-management-with-xpack-6-8-1/225673 "2020-03-30T12:36:21Z")

</div>

Hi, We are facing issues with security implementation of XPACK-elastic 6.8.1. 1- Security index got deleted twice automatically recently due to super user password change but earlier reason was unknown. I have certain…

---

## [Unable to add key-value pair to keystore from command-line](https://discuss.elastic.co/t/unable-to-add-key-value-pair-to-keystore-from-command-line/224941)

<div class="topic-metadata">

**Author:** [@sandeepkanabar](https://discuss.elastic.co/u/sandeepkanabar)\
**Replies:** 4\
**Last updated:** [March 30, 2020, 11:34am UTC](https://discuss.elastic.co/t/unable-to-add-key-value-pair-to-keystore-from-command-line/224941 "2020-03-30T11:34:14Z")

</div>

In ES 6.8: I'm unable to add a key-value pair from command-line using keystore: /usr/share/elasticsearch/bin/elasticsearch-keystore add -E "foo=bar" ERROR: The setting name can not be null. What could I be missing? I…

---

## [Using reindex api from kibana fails, but works from curl](https://discuss.elastic.co/t/using-reindex-api-from-kibana-fails-but-works-from-curl/225660)

<div class="topic-metadata">

**Author:** [@Norman\_Khine](https://discuss.elastic.co/u/Norman_Khine)\
**Replies:** 0\
**Last updated:** [March 30, 2020, 10:56am UTC](https://discuss.elastic.co/t/using-reindex-api-from-kibana-fails-but-works-from-curl/225660 "2020-03-30T10:56:26Z")

</div>

Hello, A bit of strange issue which I am unclear as to why it could happen, it is related to https://discuss.elastic.co/t/merge-multiple-indices-in-one/220543 Currently I have a single index where I am reindexing this …

---

## [How to share custom Elasticsearch plugin specific data across nodes](https://discuss.elastic.co/t/how-to-share-custom-elasticsearch-plugin-specific-data-across-nodes/225654)

<div class="topic-metadata">

**Author:** [@sbrisi](https://discuss.elastic.co/u/sbrisi)\
**Replies:** 0\
**Last updated:** [March 30, 2020, 10:23am UTC](https://discuss.elastic.co/t/how-to-share-custom-elasticsearch-plugin-specific-data-across-nodes/225654 "2020-03-30T10:23:47Z")

</div>

How to share custom Elasticsearch plugin-specific data across nodes. Our plugin uses the temp filesystem to store data which would be re-used, how do I share this across multiple nodes in an Elasticsearch cluster without…

---

## [Multiple index search java](https://discuss.elastic.co/t/multiple-index-search-java/225643)

<div class="topic-metadata">

**Author:** [@rohit.singh3](https://discuss.elastic.co/u/rohit.singh3)\
**Replies:** 1\
**Last updated:** [March 30, 2020, 10:15am UTC](https://discuss.elastic.co/t/multiple-index-search-java/225643 "2020-03-30T10:15:53Z")

</div>

i want a searchstring to searched in multiple indices. i have written below code: SearchRequest searchRequest = new SearchRequest("indexA","indexB"); SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder(); …

---

## [Elasticsearch 7.1 have rediculously high disk read io (100%)](https://discuss.elastic.co/t/elasticsearch-7-1-have-rediculously-high-disk-read-io-100/225619)

<div class="topic-metadata">

**Author:** [@huntlyroad](https://discuss.elastic.co/u/huntlyroad)\
**Replies:** 2\
**Last updated:** [March 30, 2020, 9:56am UTC](https://discuss.elastic.co/t/elasticsearch-7-1-have-rediculously-high-disk-read-io-100/225619 "2020-03-30T09:56:00Z")

</div>

Hi, We are seeing unexpected write I/O on elasticsearch data nodes. this is what is captured by iotop: As you can see, the disk io is 100% all the time, following is captured detailed threads. Here is the output …

---

## [Return task\_Id after POST](https://discuss.elastic.co/t/return-task-id-after-post/225644)

<div class="topic-metadata">

**Author:** [@Norman\_Khine](https://discuss.elastic.co/u/Norman_Khine)\
**Replies:** 0\
**Last updated:** [March 30, 2020, 9:40am UTC](https://discuss.elastic.co/t/return-task-id-after-post/225644 "2020-03-30T09:40:38Z")

</div>

Hello, Is there a way to return the task id after making a POST request, rather than parsing this out from GET /\_tasks/?detailed Any advice is much appreciated?

---

## [Unable to match data, e.g. \`/service/${id}\`](https://discuss.elastic.co/t/unable-to-match-data-e-g-service-id/224356)

<div class="topic-metadata">

**Author:** [@LiuDui](https://discuss.elastic.co/u/LiuDui)\
**Replies:** 4\
**Last updated:** [March 30, 2020, 9:40am UTC](https://discuss.elastic.co/t/unable-to-match-data-e-g-service-id/224356 "2020-03-30T09:40:24Z")

</div>

Dev Tools GET http-log/kong/\_search { "query": { "match": { "request.uri": "/service" } }, "size": 0, "aggs": { "group": { "terms": { "field": "request.uri.keyword", "si…

---

## [Indices having filter with required.\_id = NODE\_ID blocking replica shard to allocate](https://discuss.elastic.co/t/indices-having-filter-with-required-id-node-id-blocking-replica-shard-to-allocate/225641)

<div class="topic-metadata">

**Author:** [@oneoneonepig](https://discuss.elastic.co/u/oneoneonepig)\
**Replies:** 0\
**Last updated:** [March 30, 2020, 9:29am UTC](https://discuss.elastic.co/t/indices-having-filter-with-required-id-node-id-blocking-replica-shard-to-allocate/225641 "2020-03-30T09:29:24Z")

</div>

My indices are having 1 replicas and 3 shards (3x2) There are some indices having a filter "index.routing.allocation.required.\_id": id-of-a-certain-node, blocking the replica shard to allocate on any node due to two res…

---

## [Aggregating across indices](https://discuss.elastic.co/t/aggregating-across-indices/225215)

<div class="topic-metadata">

**Author:** [@mc\_teo](https://discuss.elastic.co/u/mc_teo)\
**Replies:** 2\
**Last updated:** [March 30, 2020, 9:19am UTC](https://discuss.elastic.co/t/aggregating-across-indices/225215 "2020-03-30T09:19:41Z")

</div>

Hi everyone, I've been dabbling with Elasticsearch on and off for a year, but I've recently dusted off an old project and wanted to retrofit it with Elasticsearch. One thing that has me very stumped is being able to ag…

---

## [Elastic search data node java process is consuming high virtual memory](https://discuss.elastic.co/t/elastic-search-data-node-java-process-is-consuming-high-virtual-memory/225347)

<div class="topic-metadata">

**Author:** [@Krish\_7](https://discuss.elastic.co/u/Krish_7)\
**Replies:** 3\
**Last updated:** [March 30, 2020, 9:21am UTC](https://discuss.elastic.co/t/elastic-search-data-node-java-process-is-consuming-high-virtual-memory/225347 "2020-03-30T09:21:59Z")

</div>

Hi Team, we have elastic data node which is triggering alerts for high virtual memory , upon checking i could see below stats in server . top - 07:25:19 up 549 days, 15 min, 4 users, load average: 0.76, 0.88, 0.90 T…

---

## [Check where a query comes from](https://discuss.elastic.co/t/check-where-a-query-comes-from/225601)

<div class="topic-metadata">

**Author:** [@Jehutywong](https://discuss.elastic.co/u/Jehutywong)\
**Replies:** 1\
**Last updated:** [March 30, 2020, 8:25am UTC](https://discuss.elastic.co/t/check-where-a-query-comes-from/225601 "2020-03-30T08:25:56Z")

</div>

ES version 7.6.1 I notice that there are some problematic queries in my cluster, but i have no idea where they come from. I'd wonder if I can find the source IP/hostname of a query? Thanks

---

## [Lifecycle policy to a different cluster](https://discuss.elastic.co/t/lifecycle-policy-to-a-different-cluster/224257)

<div class="topic-metadata">

**Author:** [@chiara](https://discuss.elastic.co/u/chiara)\
**Replies:** 2\
**Last updated:** [March 30, 2020, 7:46am UTC](https://discuss.elastic.co/t/lifecycle-policy-to-a-different-cluster/224257 "2020-03-30T07:46:32Z")

</div>

I would like to maintain data 6 month on my main elasticsearch cluster. Then I would like to apply a lifecycle policy to move indexes to a DIFFERENT cluster. I can't use the same cluster because of security and complianc…

---

## [Transform time-based event logs](https://discuss.elastic.co/t/transform-time-based-event-logs/224484)

<div class="topic-metadata">

**Author:** [@jpchev](https://discuss.elastic.co/u/jpchev)\
**Replies:** 10\
**Last updated:** [March 30, 2020, 6:14am UTC](https://discuss.elastic.co/t/transform-time-based-event-logs/224484 "2020-03-30T06:14:26Z")

</div>

Hello, I'd like to import raw logs from an application where I have time-based events reporting the change of items' state. I'd like to get a transformation on data where each point in time reports the latest known st…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=971)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=973)
