# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1306

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1307

---

## [Standard analyzer](https://discuss.elastic.co/t/standard-analyzer/180287)

<div class="topic-metadata">

**Author:** [@nayun\_oh](https://discuss.elastic.co/u/nayun_oh)\
**Replies:** 5\
**Last updated:** [May 9, 2019, 7:46am UTC](https://discuss.elastic.co/t/standard-analyzer/180287 "2019-05-09T07:46:46Z")

</div>

Hello, Elasticsearch Member, I used whitespace tokenizer with lowercase filter. but it turned out that it took a longer time than standard analyzer. But I need to split sentence only by white spaces and I also need to u…

---

## [CompositeAgg Histograms - fill empty interval gaps like normal histogramAggregation](https://discuss.elastic.co/t/compositeagg-histograms-fill-empty-interval-gaps-like-normal-histogramaggregation/180296)

<div class="topic-metadata">

**Author:** [@stogo](https://discuss.elastic.co/u/stogo)\
**Replies:** 0\
**Last updated:** [May 9, 2019, 7:02am UTC](https://discuss.elastic.co/t/compositeagg-histograms-fill-empty-interval-gaps-like-normal-histogramaggregation/180296 "2019-05-09T07:02:20Z")

</div>

Hi, I think it's a bug that CompositeAggregation histograms does not have a way to "fill empty interval buckets". It is the default behaviour in normal Histogram Aggregations. The documentation says in: Histogram Aggre…

---

## [About How to access doc.freq for single element in nested in script inline](https://discuss.elastic.co/t/about-how-to-access-doc-freq-for-single-element-in-nested-in-script-inline/180289)

<div class="topic-metadata">

**Author:** [@spsanthoshi](https://discuss.elastic.co/u/spsanthoshi)\
**Replies:** 0\
**Last updated:** [May 9, 2019, 6:34am UTC](https://discuss.elastic.co/t/about-how-to-access-doc-freq-for-single-element-in-nested-in-script-inline/180289 "2019-05-09T06:34:41Z")

</div>

I have nested address field, addressline is bigram analyzer is applied.I need to get no.of pairs matched in addressline field for each element in nested

---

## [Index size and docs count are not proportional](https://discuss.elastic.co/t/index-size-and-docs-count-are-not-proportional/180045)

<div class="topic-metadata">

**Author:** [@Alex\_Huo](https://discuss.elastic.co/u/Alex_Huo)\
**Replies:** 3\
**Last updated:** [May 9, 2019, 5:15am UTC](https://discuss.elastic.co/t/index-size-and-docs-count-are-not-proportional/180045 "2019-05-09T05:15:06Z")

</div>

Hi, I'm trying to use index size to throttle the number of docs going into ES. However, I found that docs.count and store.size are not proportional. With the same template, the index with more docs.count has smaller sto…

---

## [Create Mapping Before Uploading Json Data](https://discuss.elastic.co/t/create-mapping-before-uploading-json-data/180272)

<div class="topic-metadata">

**Author:** [@MNurhakimB](https://discuss.elastic.co/u/MNurhakimB)\
**Replies:** 1\
**Last updated:** [May 9, 2019, 4:49am UTC](https://discuss.elastic.co/t/create-mapping-before-uploading-json-data/180272 "2019-05-09T04:49:05Z")

</div>

I have the following code in python that does upload JSON file to elastic search. What it does is it loops every file in the directory and upload it but unfortunately uses the default type, keyword, for all columns. # G…

---

## [Elasticsearch.py Python API communication over HTTPS](https://discuss.elastic.co/t/elasticsearch-py-python-api-communication-over-https/180075)

<div class="topic-metadata">

**Author:** [@kbrase](https://discuss.elastic.co/u/kbrase)\
**Replies:** 4\
**Last updated:** [May 9, 2019, 2:16am UTC](https://discuss.elastic.co/t/elasticsearch-py-python-api-communication-over-https/180075 "2019-05-09T02:16:18Z")

</div>

My goal is to secure communications between my elasticsearch cluster and my python application that I am creating. I however do not want to pay for a platinum license. Is it possible to use a gold license to secure betwe…

---

## [Scroll api issue](https://discuss.elastic.co/t/scroll-api-issue/180254)

<div class="topic-metadata">

**Author:** [@iukea](https://discuss.elastic.co/u/iukea)\
**Replies:** 2\
**Last updated:** [May 9, 2019, 2:15am UTC](https://discuss.elastic.co/t/scroll-api-issue/180254 "2019-05-09T02:15:39Z")

</div>

Hello, I am trying to use the scroll API in Python, and i having an issue for it looping through my whole dataset. I get about 100 results returned when there should be over 150k of them (I can see them in kibana) att…

---

## [Elasticsearch \< 7.0.0 is obsoleted by elasticsearch-0:7.0.1-1.x86\_64](https://discuss.elastic.co/t/elasticsearch-7-0-0-is-obsoleted-by-elasticsearch-0-7-0-1-1-x86-64/180071)

<div class="topic-metadata">

**Author:** [@kiyokat](https://discuss.elastic.co/u/kiyokat)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 11:16pm UTC](https://discuss.elastic.co/t/elasticsearch-7-0-0-is-obsoleted-by-elasticsearch-0-7-0-1-1-x86-64/180071 "2019-05-08T23:16:37Z")

</div>

Hi all, I am trying to upgrade elasticsearch from 6.3.2 to 7.0.1 on CentOS (CentOS Linux release 7.6.1810 (Core)). I am getting "elasticsearch \< 7.0.0 is obsoleted by elasticsearch-0:7.0.1-1.x86\_64" error when I try to…

---

## [How to get 95th percentile and 99th percentile for response-times?](https://discuss.elastic.co/t/how-to-get-95th-percentile-and-99th-percentile-for-response-times/179584)

<div class="topic-metadata">

**Author:** [@pinakinab](https://discuss.elastic.co/u/pinakinab)\
**Replies:** 3\
**Last updated:** [May 8, 2019, 9:27pm UTC](https://discuss.elastic.co/t/how-to-get-95th-percentile-and-99th-percentile-for-response-times/179584 "2019-05-08T21:27:07Z")

</div>

We want to extract performance-metrics from Elastic-Search using telegraf or any API from Elastic-Search. But it seems that both telegraf and elastic-search APIs have no way to find that. They report the following: "s…

---

## [ElastAlert for No logs in Kibana](https://discuss.elastic.co/t/elastalert-for-no-logs-in-kibana/180219)

<div class="topic-metadata">

**Author:** [@Arnav\_Bose](https://discuss.elastic.co/u/Arnav_Bose)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 4:06pm UTC](https://discuss.elastic.co/t/elastalert-for-no-logs-in-kibana/180219 "2019-05-08T16:06:57Z")

</div>

Currently, I have a flatine alert that correctly triggers if there is no log in Kibana for a component. The component's logs are sent to Kibana from 4 IPs. The problem I have is: since I am using flatline alert, it does …

---

## [Elasticsearch Percolcate Perforemance Issue](https://discuss.elastic.co/t/elasticsearch-percolcate-perforemance-issue/180247)

<div class="topic-metadata">

**Author:** [@ahmadsharifpour](https://discuss.elastic.co/u/ahmadsharifpour)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 8:16pm UTC](https://discuss.elastic.co/t/elasticsearch-percolcate-perforemance-issue/180247 "2019-05-08T20:16:34Z")

</div>

We recently started using Elasticsearch percolator and when we pushed code to production it is taking too long to match a document against registered queries in percolator index. Here is some information: Percolator ind…

---

## [How to easily see log events that caused the anomaly?](https://discuss.elastic.co/t/how-to-easily-see-log-events-that-caused-the-anomaly/180235)

<div class="topic-metadata">

**Author:** [@FlorinAndrei](https://discuss.elastic.co/u/FlorinAndrei)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 7:35pm UTC](https://discuss.elastic.co/t/how-to-easily-see-log-events-that-caused-the-anomaly/180235 "2019-05-08T19:35:51Z")

</div>

ES 6.6 I'm indexing logs from a cluster. One field is numeric and shows the duration of DB transactions. I made an anomaly detector tracking the numeric field. I see it flagging anomalies. In the Anomaly Explorer, I ex…

---

## [Index lifecycle policy not applied to active index](https://discuss.elastic.co/t/index-lifecycle-policy-not-applied-to-active-index/179228)

<div class="topic-metadata">

**Author:** [@john.hoogeveen](https://discuss.elastic.co/u/john.hoogeveen)\
**Replies:** 2\
**Last updated:** [May 8, 2019, 7:13pm UTC](https://discuss.elastic.co/t/index-lifecycle-policy-not-applied-to-active-index/179228 "2019-05-08T19:13:26Z")

</div>

Hello, I have created a new ELK 7.0 stack and am struggling with index roll over. Currently I have a packetbeat-7.0.0-2019.04.21-000001 index that is 55gb large, the alias of that index is packetbeat-7.0.0. The attach…

---

## [Bulk Index stopped working](https://discuss.elastic.co/t/bulk-index-stopped-working/180234)

<div class="topic-metadata">

**Author:** [@adwaitjoshi](https://discuss.elastic.co/u/adwaitjoshi)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 6:29pm UTC](https://discuss.elastic.co/t/bulk-index-stopped-working/180234 "2019-05-08T18:29:49Z")

</div>

we were using python to send data to elastic search using a simple routine es = elasticsearch.Elasticsearch(\[{'host' : es\_host, 'port' : es\_port}\]) es.bulk(index=index\_name, doc\_type=document\_type, body=json\_data\_str, …

---

## [Date histogram missing last bucket when using days](https://discuss.elastic.co/t/date-histogram-missing-last-bucket-when-using-days/180229)

<div class="topic-metadata">

**Author:** [@elpaisa](https://discuss.elastic.co/u/elpaisa)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 6:13pm UTC](https://discuss.elastic.co/t/date-histogram-missing-last-bucket-when-using-days/180229 "2019-05-08T18:13:56Z")

</div>

I would like to recall on this https://discuss.elastic.co/t/date-histogram-buckets-not-as-expected/76864, i have te same requirement I have the same issue, when doing the date histogram, i use different interval values …

---

## [Wh not run elasticsearch as root](https://discuss.elastic.co/t/wh-not-run-elasticsearch-as-root/180211)

<div class="topic-metadata">

**Author:** [@Why1214](https://discuss.elastic.co/u/Why1214)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 6:04pm UTC](https://discuss.elastic.co/t/wh-not-run-elasticsearch-as-root/180211 "2019-05-08T18:04:55Z")

</div>

org.elasticsearch.bootstrap.StartupException: java.lang.RuntimeException: can not run elasticsearch as root at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:163) ~\[elasticsearch-7.0.1.jar:7.0.1\] at …

---

## ["totalTermFreq must be at least docFreq" error after upgrading to 7.0.1](https://discuss.elastic.co/t/totaltermfreq-must-be-at-least-docfreq-error-after-upgrading-to-7-0-1/179977)

<div class="topic-metadata">

**Author:** [@i333](https://discuss.elastic.co/u/i333)\
**Replies:** 9\
**Last updated:** [May 8, 2019, 5:36pm UTC](https://discuss.elastic.co/t/totaltermfreq-must-be-at-least-docfreq-error-after-upgrading-to-7-0-1/179977 "2019-05-08T17:36:03Z")

</div>

After upgrading from 7.0.0 to 7.0.1 my search query gives totalTermFreq must be at least docFreq. root\_cause: \[ { type: 'illegal\_argument\_exception', reason: 'totaltermfreq must be at least docfreq, to…

---

## [java.lang.ClassNotFoundException: org.elasticsearch.common.CharArrays](https://discuss.elastic.co/t/java-lang-classnotfoundexception-org-elasticsearch-common-chararrays/180223)

<div class="topic-metadata">

**Author:** [@Bill\_Bensing](https://discuss.elastic.co/u/Bill_Bensing)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 4:51pm UTC](https://discuss.elastic.co/t/java-lang-classnotfoundexception-org-elasticsearch-common-chararrays/180223 "2019-05-08T16:51:42Z")

</div>

I'm attempting to wire ES Cloud with a Spring Boot App, using x-pack, and get the following error. Any idea of where I may start looking? I've spent the past day hunting down dependency issues and I can't seem to find …

---

## [Build for heroku and Dockerfile](https://discuss.elastic.co/t/build-for-heroku-and-dockerfile/180221)

<div class="topic-metadata">

**Author:** [@leobaiano](https://discuss.elastic.co/u/leobaiano)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 4:29pm UTC](https://discuss.elastic.co/t/build-for-heroku-and-dockerfile/180221 "2019-05-08T16:29:38Z")

</div>

I created a docker-compose to run elasticsearch and kibana with SSO and SAML, this is working fine for me locally. Now I need to send this to heroku, but it seems that heroku does not do the direct build of docker-compos…

---

## [Combining index\_prefixes and term\_vector](https://discuss.elastic.co/t/combining-index-prefixes-and-term-vector/180217)

<div class="topic-metadata">

**Author:** [@cthibodeau](https://discuss.elastic.co/u/cthibodeau)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 4:00pm UTC](https://discuss.elastic.co/t/combining-index-prefixes-and-term-vector/180217 "2019-05-08T16:00:56Z")

</div>

Hi We are trying to speed up our searches and highlightings on ES 6.7.2. We first activated the term\_vector feature with the "with\_positions\_offsets" value. And it worked fine. Then we added the "index\_prefixes" feat…

---

## [Can't see the text content in images that are inside pdf or word file](https://discuss.elastic.co/t/cant-see-the-text-content-in-images-that-are-inside-pdf-or-word-file/180206)

<div class="topic-metadata">

**Author:** [@kumar4](https://discuss.elastic.co/u/kumar4)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 3:19pm UTC](https://discuss.elastic.co/t/cant-see-the-text-content-in-images-that-are-inside-pdf-or-word-file/180206 "2019-05-08T15:19:44Z")

</div>

Hi dears, i ma using fscrawler to index pdf, word ... document and i used tesseract-ocr to extract text content from images indexed with fscrawler; my problem is that i cant see the texte content of images that are insi…

---

## [Multiple contexts with completion suggeston query not working](https://discuss.elastic.co/t/multiple-contexts-with-completion-suggeston-query-not-working/180204)

<div class="topic-metadata">

**Author:** [@tarunnar](https://discuss.elastic.co/u/tarunnar)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 3:04pm UTC](https://discuss.elastic.co/t/multiple-contexts-with-completion-suggeston-query-not-working/180204 "2019-05-08T15:04:30Z")

</div>

I am not getting why I am not getting exact document match. I have specified different context for completion suggestion but I got different suggestions. python #elasticsearch #completion suggestion. I had inserted dat…

---

## [Filter on wildcard nested filed](https://discuss.elastic.co/t/filter-on-wildcard-nested-filed/180205)

<div class="topic-metadata">

**Author:** [@Arab\_Said](https://discuss.elastic.co/u/Arab_Said)\
**Replies:** 0\
**Last updated:** [May 8, 2019, 3:05pm UTC](https://discuss.elastic.co/t/filter-on-wildcard-nested-filed/180205 "2019-05-08T15:05:46Z")

</div>

Hi, I was trying to combine multi\_search query with filter on a document { tilte: test description: test cities : \[ "fr": "Alger" "en": "Algiers" \] } my query as : bool: { must: …

---

## [Parallelizing cluster state listeners](https://discuss.elastic.co/t/parallelizing-cluster-state-listeners/180165)

<div class="topic-metadata">

**Author:** [@Bukhtawar\_Khan](https://discuss.elastic.co/u/Bukhtawar_Khan)\
**Replies:** 7\
**Last updated:** [May 8, 2019, 2:55pm UTC](https://discuss.elastic.co/t/parallelizing-cluster-state-listeners/180165 "2019-05-08T14:55:29Z")

</div>

Based on my understanding the ClusterApplierService uses callClusterStateListeners to invoke listeners serially which slows down the cluster state publication. Since the action performed by the listeners involve invoking…

---

## [Add Tag to existing \_id field](https://discuss.elastic.co/t/add-tag-to-existing-id-field/179947)

<div class="topic-metadata">

**Author:** [@Datakids](https://discuss.elastic.co/u/Datakids)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 2:26pm UTC](https://discuss.elastic.co/t/add-tag-to-existing-id-field/179947 "2019-05-08T14:26:44Z")

</div>

Hi all, is there any chance to add a tag to an existing \_id field via Put ? For instance: Now I would like to add a tag to each entrie to be able to add information about their runnnng status. Lets say: for lxvqkWo…

---

## [Modifying Elasticsearch Basic License](https://discuss.elastic.co/t/modifying-elasticsearch-basic-license/180065)

<div class="topic-metadata">

**Author:** [@Tyler\_Buckwalter](https://discuss.elastic.co/u/Tyler_Buckwalter)\
**Replies:** 5\
**Last updated:** [May 8, 2019, 2:25pm UTC](https://discuss.elastic.co/t/modifying-elasticsearch-basic-license/180065 "2019-05-08T14:25:29Z")

</div>

I am setting up a forensics virtual training environment where the system date/time is in May 2016. A lot of the basic features are turned off and the Beats agents are not able to communicate. the Elasticsearch basic l…

---

## [Elastic cluster problem](https://discuss.elastic.co/t/elastic-cluster-problem/180135)

<div class="topic-metadata">

**Author:** [@jof300](https://discuss.elastic.co/u/jof300)\
**Replies:** 1\
**Last updated:** [May 8, 2019, 1:30pm UTC](https://discuss.elastic.co/t/elastic-cluster-problem/180135 "2019-05-08T13:30:53Z")

</div>

Hello, We have an old production cluster which is in version 1.6.2 (yes we should upgrade) We have 3 masters (one is also data node) and 9 data nodes. For moment, we are facing some problem and after the master's node…

---

## [How to get daily new index?](https://discuss.elastic.co/t/how-to-get-daily-new-index/179496)

<div class="topic-metadata">

**Author:** [@frankm](https://discuss.elastic.co/u/frankm)\
**Replies:** 3\
**Last updated:** [May 8, 2019, 1:11pm UTC](https://discuss.elastic.co/t/how-to-get-daily-new-index/179496 "2019-05-08T13:11:31Z")

</div>

Hi, for my Index I would like to get every day a new one name\_date like my\_index\_190503. With Logstast it works out of the box. But how to realize it with a own index? Can I create a index out of my C# -code? Or is it p…

---

## [Shrinking an index](https://discuss.elastic.co/t/shrinking-an-index/180159)

<div class="topic-metadata">

**Author:** [@atom](https://discuss.elastic.co/u/atom)\
**Replies:** 6\
**Last updated:** [May 8, 2019, 1:06pm UTC](https://discuss.elastic.co/t/shrinking-an-index/180159 "2019-05-08T13:06:53Z")

</div>

Hi, i have many indexes with 5 primary shards and 1 replica (default). Since i have only one node and the data the indexes are holding are small, i want to reduce the number of shards. This is my machine: 64GB ram, ~1…

---

## [Unable to include fields present in index while using email action in watcher](https://discuss.elastic.co/t/unable-to-include-fields-present-in-index-while-using-email-action-in-watcher/179975)

<div class="topic-metadata">

**Author:** [@Vishnu\_mk](https://discuss.elastic.co/u/Vishnu_mk)\
**Replies:** 2\
**Last updated:** [May 8, 2019, 12:59pm UTC](https://discuss.elastic.co/t/unable-to-include-fields-present-in-index-while-using-email-action-in-watcher/179975 "2019-05-08T12:59:23Z")

</div>

This is my hearbeat configuration heartbeat.config.monitors: Directory + glob pattern to search for configuration files path: ${path.config}/monitors.d/\*.yml If enabled, heartbeat will periodically check the config.mo…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1305)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1307)
