# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=951

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 952

---

## [ES: failed to execute bulk item (index) index {\[shakespeare\]](https://discuss.elastic.co/t/es-failed-to-execute-bulk-item-index-index-shakespeare/228614)

<div class="topic-metadata">

**Author:** [@Dejrgn](https://discuss.elastic.co/u/Dejrgn)\
**Replies:** 5\
**Last updated:** [April 18, 2020, 9:52pm UTC](https://discuss.elastic.co/t/es-failed-to-execute-bulk-item-index-index-shakespeare/228614 "2020-04-18T21:52:52Z")

</div>

(Edited: replaced pictures from outputs by formated outputs) Hi all, first of all: I greatly appreciate it that you want to take your time to see what is going wrong in my project. I'm new to Elasticsearch and Kibana …

---

## [Significant\_terms JLH scientific paper](https://discuss.elastic.co/t/significant-terms-jlh-scientific-paper/228655)

<div class="topic-metadata">

**Author:** [@crab86](https://discuss.elastic.co/u/crab86)\
**Replies:** 2\
**Last updated:** [April 18, 2020, 8:38pm UTC](https://discuss.elastic.co/t/significant-terms-jlh-scientific-paper/228655 "2020-04-18T20:38:58Z")

</div>

Does anybody know if there is a scientific paper describing JLH as a statistical significance method? I did not find any document describing what JLH actually does - although i looked it up in the source code already. I …

---

## [Match query with type phrase](https://discuss.elastic.co/t/match-query-with-type-phrase/228669)

<div class="topic-metadata">

**Author:** [@nages](https://discuss.elastic.co/u/nages)\
**Replies:** 0\
**Last updated:** [April 18, 2020, 5:58pm UTC](https://discuss.elastic.co/t/match-query-with-type-phrase/228669 "2020-04-18T17:58:42Z")

</div>

Is the following query equvalent to "match phrase" type of query { "query": { "match": { "useragent.name.keyword": { "query": "Firefox", "type": "phrase" } } } } I didnt see any reference related to - " "type…

---

## [Artifacts.elastic.co is very slow? Can't download analysis-icu plugin](https://discuss.elastic.co/t/artifacts-elastic-co-is-very-slow-cant-download-analysis-icu-plugin/228654)

<div class="topic-metadata">

**Author:** [@vorapoap](https://discuss.elastic.co/u/vorapoap)\
**Replies:** 1\
**Last updated:** [April 18, 2020, 4:17pm UTC](https://discuss.elastic.co/t/artifacts-elastic-co-is-very-slow-cant-download-analysis-icu-plugin/228654 "2020-04-18T16:17:39Z")

</div>

I have tried to download the analysis-icu plugin many times, but failed. Stuck at 1.1M, 1.4M 5.5M.. and halt.. Please help.. Why there is no mirror for aritifacts.elastic.co? wget https://artifacts.elastic.co/downloa…

---

## [Do I need to manually copy over mappings before a reindex operation?](https://discuss.elastic.co/t/do-i-need-to-manually-copy-over-mappings-before-a-reindex-operation/226107)

<div class="topic-metadata">

**Author:** [@ishanjain](https://discuss.elastic.co/u/ishanjain)\
**Replies:** 4\
**Last updated:** [April 18, 2020, 3:17pm UTC](https://discuss.elastic.co/t/do-i-need-to-manually-copy-over-mappings-before-a-reindex-operation/226107 "2020-04-18T15:17:10Z")

</div>

Hi! I am trying to reindex multiple indexes into one. Right now, My code looks like this. Create the destination index with settings.number\_of\_replicas = 0. Iterate over source index one by one and reindex each index…

---

## [Watcher not triggering alerts](https://discuss.elastic.co/t/watcher-not-triggering-alerts/228304)

<div class="topic-metadata">

**Author:** [@namar321](https://discuss.elastic.co/u/namar321)\
**Replies:** 1\
**Last updated:** [April 18, 2020, 1:41pm UTC](https://discuss.elastic.co/t/watcher-not-triggering-alerts/228304 "2020-04-18T13:41:09Z")

</div>

Hello. We set up an ML job to identify anomalous events which runs every 15 minutes. While the job is able to find the events, the watcher that runs every 15 minutes is not triggered. Any tips on implementing the watcher…

---

## [How the fixed\_interval time buckets were divided in date\_histogram aggregation?](https://discuss.elastic.co/t/how-the-fixed-interval-time-buckets-were-divided-in-date-histogram-aggregation/228646)

<div class="topic-metadata">

**Author:** [@STAR\_DEVX](https://discuss.elastic.co/u/STAR_DEVX)\
**Replies:** 0\
**Last updated:** [April 18, 2020, 1:21pm UTC](https://discuss.elastic.co/t/how-the-fixed-interval-time-buckets-were-divided-in-date-histogram-aggregation/228646 "2020-04-18T13:21:30Z")

</div>

Hi, I'm puzzled with the how the time buckets are divided with the fixed\_interval in date\_histogram aggregations. I have the following simple query: { "query": { "bool": { "filter": \[ {"range": {"sta…

---

## [Wrong zone used for query?](https://discuss.elastic.co/t/wrong-zone-used-for-query/228642)

<div class="topic-metadata">

**Author:** [@klahnakoski](https://discuss.elastic.co/u/klahnakoski)\
**Replies:** 1\
**Last updated:** [April 18, 2020, 12:45pm UTC](https://discuss.elastic.co/t/wrong-zone-used-for-query/228642 "2020-04-18T12:45:03Z")

</div>

How do I ensure my queries are directed to nodes in the same zone? My queries are running slow, and I just learned about "profile": true,. In the profile I could see the slow \[node\]\[index\]\[shard\] that was causing the pr…

---

## [Loading performance - what should I expect?](https://discuss.elastic.co/t/loading-performance-what-should-i-expect/228621)

<div class="topic-metadata">

**Author:** [@shawmat](https://discuss.elastic.co/u/shawmat)\
**Replies:** 4\
**Last updated:** [April 18, 2020, 11:47am UTC](https://discuss.elastic.co/t/loading-performance-what-should-i-expect/228621 "2020-04-18T11:47:16Z")

</div>

This is Day 1 of me using elasticsearch so apologies for the basic question. Line-by-line loading seems really slow, but I've no idea what to expect. I have 80 character text strings (lines of English words from books) …

---

## [Slow Query, where to start? (v6.5.4)](https://discuss.elastic.co/t/slow-query-where-to-start-v6-5-4/228404)

<div class="topic-metadata">

**Author:** [@klahnakoski](https://discuss.elastic.co/u/klahnakoski)\
**Replies:** 4\
**Last updated:** [April 18, 2020, 10:55am UTC](https://discuss.elastic.co/t/slow-query-where-to-start-v6-5-4/228404 "2020-04-18T10:55:04Z")

</div>

I am wondering if there is a solution to a slow-query problem I am having. Can it be a single, slow node? How do I find out? Maybe the query node is the bottleneck? It does not look busy, how to find out? The shards a…

---

## [Perform recovery twice when the full cluster restarts](https://discuss.elastic.co/t/perform-recovery-twice-when-the-full-cluster-restarts/228633)

<div class="topic-metadata">

**Author:** [@yc1024](https://discuss.elastic.co/u/yc1024)\
**Replies:** 0\
**Last updated:** [April 18, 2020, 10:01am UTC](https://discuss.elastic.co/t/perform-recovery-twice-when-the-full-cluster-restarts/228633 "2020-04-18T10:01:57Z")

</div>

Elasticsearch version：7.6.0 When I perform a full cluster restart, when active\_shards\_percent\_as\_number\> 90%, a new recovery is triggered.Why did it recover twice？ I find the log as follows: recovered \[582\] indices i…

---

## [How can I get the bucket script result unconditionally even when the value is 0?](https://discuss.elastic.co/t/how-can-i-get-the-bucket-script-result-unconditionally-even-when-the-value-is-0/228631)

<div class="topic-metadata">

**Author:** [@Yungyoung\_Ok](https://discuss.elastic.co/u/Yungyoung_Ok)\
**Replies:** 0\
**Last updated:** [April 18, 2020, 9:40am UTC](https://discuss.elastic.co/t/how-can-i-get-the-bucket-script-result-unconditionally-even-when-the-value-is-0/228631 "2020-04-18T09:40:52Z")

</div>

1.Calculate the total time using sum aggs. 2. Calculate the number of users using cardinality aggs. 3. Count the total time/number of users using a bucket script to get the average time. However, if the total time is …

---

## [Store, render and search different types of semi-structured data in elasticsearch](https://discuss.elastic.co/t/store-render-and-search-different-types-of-semi-structured-data-in-elasticsearch/228511)

<div class="topic-metadata">

**Author:** [@jgeek](https://discuss.elastic.co/u/jgeek)\
**Replies:** 4\
**Last updated:** [April 18, 2020, 8:41am UTC](https://discuss.elastic.co/t/store-render-and-search-different-types-of-semi-structured-data-in-elasticsearch/228511 "2020-04-18T08:41:47Z")

</div>

We have a couple of different features in our application both of which have different types of semi-structured data sets. One of them has a json data set (rest api responses) while other has html files that includes aud…

---

## [GROK strange issue](https://discuss.elastic.co/t/grok-strange-issue/228618)

<div class="topic-metadata">

**Author:** [@brunus0475](https://discuss.elastic.co/u/brunus0475)\
**Replies:** 0\
**Last updated:** [April 18, 2020, 5:27am UTC](https://discuss.elastic.co/t/grok-strange-issue/228618 "2020-04-18T05:27:44Z")

</div>

Hi All, where is my configuration error, we've only moved the timestamp field at the start of the message: ## GROK NOT WORK POST /\_ingest/pipeline/\_simulate { "pipeline": { "processors": \[ …

---

## [Filter (RANGE) on different fields in elasticsearch](https://discuss.elastic.co/t/filter-range-on-different-fields-in-elasticsearch/228613)

<div class="topic-metadata">

**Author:** [@jeanpjm](https://discuss.elastic.co/u/jeanpjm)\
**Replies:** 0\
**Last updated:** [April 18, 2020, 4:52am UTC](https://discuss.elastic.co/t/filter-range-on-different-fields-in-elasticsearch/228613 "2020-04-18T04:52:07Z")

</div>

Hello people, I'm a beginner in elasticsarch and I wanted this query below to work with two RANGE filters in different fields, but only the first RANGE is working. This filter below is working normally: "range" : {"pg…

---

## [OpenDistro Elasticsearch - Repository Empty After Restart](https://discuss.elastic.co/t/opendistro-elasticsearch-repository-empty-after-restart/228595)

<div class="topic-metadata">

**Author:** [@kvickery](https://discuss.elastic.co/u/kvickery)\
**Replies:** 1\
**Last updated:** [April 18, 2020, 2:21am UTC](https://discuss.elastic.co/t/opendistro-elasticsearch-repository-empty-after-restart/228595 "2020-04-18T02:21:06Z")

</div>

I have installed OpenDistro 1.4.0 and I launch my Elasticsearch build with: docker run -p 9200:9200 -p 9600:9600 -e "discovery.type=single-node" elasticsearch-wao:latest I can create indexes, pipelines, index files, an…

---

## [Visual Basic Examples for ElasticSearch.net and NEST](https://discuss.elastic.co/t/visual-basic-examples-for-elasticsearch-net-and-nest/226304)

<div class="topic-metadata">

**Author:** [@kvickery](https://discuss.elastic.co/u/kvickery)\
**Replies:** 16\
**Last updated:** [April 17, 2020, 11:56pm UTC](https://discuss.elastic.co/t/visual-basic-examples-for-elasticsearch-net-and-nest/226304 "2020-04-17T23:56:41Z")

</div>

Hi. I am trying to update a Visual Basic project to use the new Elasticsearch.Net and NEST api versions. Unfortunately whenever I try to find examples all I can find is c#. Can anyone show me some examples of the foll…

---

## [Index and lifecycle error and failed to rotate to warm phrase by ILM](https://discuss.elastic.co/t/index-and-lifecycle-error-and-failed-to-rotate-to-warm-phrase-by-ilm/227570)

<div class="topic-metadata">

**Author:** [@chunan](https://discuss.elastic.co/u/chunan)\
**Replies:** 13\
**Last updated:** [April 17, 2020, 11:13pm UTC](https://discuss.elastic.co/t/index-and-lifecycle-error-and-failed-to-rotate-to-warm-phrase-by-ilm/227570 "2020-04-17T23:13:57Z")

</div>

vector-diags-000005 failed to rotate. As you can see, 000004 was automatically rotated to 000005. But 000005 continued on to grow in size until it errors out. vector-diags-000005 3 P STARTED 1745886 262.8mb 192.16…

---

## [Elasticsearch avg aggregation is taking ages to return in 7.2](https://discuss.elastic.co/t/elasticsearch-avg-aggregation-is-taking-ages-to-return-in-7-2/228493)

<div class="topic-metadata">

**Author:** [@Faiz\_Ahmed\_Mushtak\_H](https://discuss.elastic.co/u/Faiz_Ahmed_Mushtak_H)\
**Replies:** 0\
**Last updated:** [April 17, 2020, 10:38am UTC](https://discuss.elastic.co/t/elasticsearch-avg-aggregation-is-taking-ages-to-return-in-7-2/228493 "2020-04-17T10:38:18Z")

</div>

We recently moved from 1.7 to 7.2 and I was running some aggregations to verify a few statistics { "size": 0, "aggs": { "avgcsat": { "avg": { "field": "csat" } } } } The csat field is …

---

## [TypeError: unhashable type: "Term"](https://discuss.elastic.co/t/typeerror-unhashable-type-term/228594)

<div class="topic-metadata">

**Author:** [@prasad98](https://discuss.elastic.co/u/prasad98)\
**Replies:** 0\
**Last updated:** [April 17, 2020, 10:23pm UTC](https://discuss.elastic.co/t/typeerror-unhashable-type-term/228594 "2020-04-17T22:23:54Z")

</div>

Hi, I'm working with elasticsearch-dsl package (version 2.5) This is my query being formed with the help of elasticsearch-dsl package. Python code for building query: if self.\_filters: base = base.filter('bool', m…

---

## [Rollup job lost some data](https://discuss.elastic.co/t/rollup-job-lost-some-data/228593)

<div class="topic-metadata">

**Author:** [@Jason\_Du](https://discuss.elastic.co/u/Jason_Du)\
**Replies:** 0\
**Last updated:** [April 17, 2020, 10:13pm UTC](https://discuss.elastic.co/t/rollup-job-lost-some-data/228593 "2020-04-17T22:13:46Z")

</div>

I have a rollup job, it does daily aggregations. But for unknown reason, some data not included in the rollup index. The job was created at the beginning of each month and was running in the started state until the end o…

---

## [Indexing strategy for small IoT sensor data project](https://discuss.elastic.co/t/indexing-strategy-for-small-iot-sensor-data-project/228589)

<div class="topic-metadata">

**Author:** [@vanessa](https://discuss.elastic.co/u/vanessa)\
**Replies:** 0\
**Last updated:** [April 17, 2020, 9:46pm UTC](https://discuss.elastic.co/t/indexing-strategy-for-small-iot-sensor-data-project/228589 "2020-04-17T21:46:04Z")

</div>

Hello! We are new to Elasticsearch and want to use Elastic Stack for our data pipeline project. Basically we have a vehicle with multiple IMU (motion) sensors and we want to figure out the most efficient way to index ou…

---

## [Terms agregation](https://discuss.elastic.co/t/terms-agregation/228586)

<div class="topic-metadata">

**Author:** [@ilhem](https://discuss.elastic.co/u/ilhem)\
**Replies:** 0\
**Last updated:** [April 17, 2020, 9:30pm UTC](https://discuss.elastic.co/t/terms-agregation/228586 "2020-04-17T21:30:28Z")

</div>

By default, the terms aggregation will return the buckets for the top ten terms ordered by the doc\_count . I want to get buckets for all terms (without setting the size parameter) is it possible?

---

## [Only in AWS Lambda: Json\_parse\_exception Illegal character CTRL-CHAR code 31](https://discuss.elastic.co/t/only-in-aws-lambda-json-parse-exception-illegal-character-ctrl-char-code-31/228585)

<div class="topic-metadata">

**Author:** [@derrickl](https://discuss.elastic.co/u/derrickl)\
**Replies:** 0\
**Last updated:** [April 17, 2020, 9:25pm UTC](https://discuss.elastic.co/t/only-in-aws-lambda-json-parse-exception-illegal-character-ctrl-char-code-31/228585 "2020-04-17T21:25:39Z")

</div>

Hi all, I'm using the python Elasticsearch library to query an index. When I run the search on AWS Lambda I get this json\_parse\_execption: "errorMessage": "TransportError(500, 'json\_parse\_exception', 'Illegal character…

---

## [Can curl https://elasticsearch:9200 from host, but connection refused in kibana container](https://discuss.elastic.co/t/can-curl-https-elasticsearch-9200-from-host-but-connection-refused-in-kibana-container/228562)

<div class="topic-metadata">

**Author:** [@J7mbo](https://discuss.elastic.co/u/J7mbo)\
**Replies:** 1\
**Last updated:** [April 17, 2020, 8:05pm UTC](https://discuss.elastic.co/t/can-curl-https-elasticsearch-9200-from-host-but-connection-refused-in-kibana-container/228562 "2020-04-17T20:05:13Z")

</div>

I have elasticsearch and kibana running on the same node in a swarm, connected to the same docker network. From the node (host machine), I can curl https://elasticsearch:9200 and I get a response. From inside the kiban…

---

## [Index privilege to update setting](https://discuss.elastic.co/t/index-privilege-to-update-setting/228570)

<div class="topic-metadata">

**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\
**Replies:** 0\
**Last updated:** [April 17, 2020, 7:55pm UTC](https://discuss.elastic.co/t/index-privilege-to-update-setting/228570 "2020-04-17T19:55:44Z")

</div>

Hi! I'm trying to create a user that's restricted to updating settings (\[indices:admin/settings/update\]) for indices, but it seems that I can only give "all" or "manage" but both can delete indices that I don't want. I …

---

## [Securing ELK](https://discuss.elastic.co/t/securing-elk/228359)

<div class="topic-metadata">

**Author:** [@ManuelF](https://discuss.elastic.co/u/ManuelF)\
**Replies:** 1\
**Last updated:** [April 17, 2020, 7:51pm UTC](https://discuss.elastic.co/t/securing-elk/228359 "2020-04-17T19:51:52Z")

</div>

Hi, I am trying to secure my ELK. I have been checking some documentation, tutorials and also topics in discuss.elastic.co, but everybody shows different steps and settings enabled, so I am confused. \*Note: I am using …

---

## [Too many scroll contexts error while running Scroll request through RestHighLevelClient in ElasticSearch 7.3.2](https://discuss.elastic.co/t/too-many-scroll-contexts-error-while-running-scroll-request-through-resthighlevelclient-in-elasticsearch-7-3-2/228560)

<div class="topic-metadata">

**Author:** [@Nazim\_Hussain](https://discuss.elastic.co/u/Nazim_Hussain)\
**Replies:** 0\
**Last updated:** [April 17, 2020, 7:22pm UTC](https://discuss.elastic.co/t/too-many-scroll-contexts-error-while-running-scroll-request-through-resthighlevelclient-in-elasticsearch-7-3-2/228560 "2020-04-17T19:22:45Z")

</div>

Hi, I am new to ES and we migrated from ES 6 to ES 7 recently, but while making a Scroll search call, we are getting following error: org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception \[type=search…

---

## [ELK watcher : painless script - stream.filter](https://discuss.elastic.co/t/elk-watcher-painless-script-stream-filter/228392)

<div class="topic-metadata">

**Author:** [@Jags](https://discuss.elastic.co/u/Jags)\
**Replies:** 3\
**Last updated:** [April 17, 2020, 6:40pm UTC](https://discuss.elastic.co/t/elk-watcher-painless-script-stream-filter/228392 "2020-04-17T18:40:01Z")

</div>

Below is the reslut of Elastic query with derivative aggregation "utils\_per\_5m": { "buckets": \[ { "key\_as\_string": "2020-04-15T21:10:00.000Z", "doc\_count": 1, "utils": { "value": 924 }, "key": 1586985000000 }, …

---

## [How to do settting "is\_write\_index": true for alias in curator action](https://discuss.elastic.co/t/how-to-do-settting-is-write-index-true-for-alias-in-curator-action/228464)

<div class="topic-metadata">

**Author:** [@Dragon9](https://discuss.elastic.co/u/Dragon9)\
**Replies:** 1\
**Last updated:** [April 17, 2020, 6:20pm UTC](https://discuss.elastic.co/t/how-to-do-settting-is-write-index-true-for-alias-in-curator-action/228464 "2020-04-17T18:20:25Z")

</div>

my use case is to rollover indices in every 4 hours .so i use curator for define alias and rollover for indices. so new indices is created but in new indices no data is written by logstash into it. by exploring i foun…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=950)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=952)
