# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1420

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1421

---

## [Support JSON "\_comment" name/value?](https://discuss.elastic.co/t/support-json-comment-name-value/164831)

<div class="topic-metadata">

**Author:** [@m9aertner](https://discuss.elastic.co/u/m9aertner)\
**Replies:** 2\
**Last updated:** [January 21, 2019, 8:44am UTC](https://discuss.elastic.co/t/support-json-comment-name-value/164831 "2019-01-21T08:44:19Z")

</div>

We all know that JSON syntax does not support comments, for good and bad reasons. Also, we know that in many cases, comments are really, really useful, and that it's mostly up to the receiver to not do anything bad with…

---

## [How can I get the count of documents, clipped at a maximum by using only the Lucene query string?](https://discuss.elastic.co/t/how-can-i-get-the-count-of-documents-clipped-at-a-maximum-by-using-only-the-lucene-query-string/165003)

<div class="topic-metadata">

**Author:** [@Michel\_Albert](https://discuss.elastic.co/u/Michel_Albert)\
**Replies:** 0\
**Last updated:** [January 21, 2019, 8:24am UTC](https://discuss.elastic.co/t/how-can-i-get-the-count-of-documents-clipped-at-a-maximum-by-using-only-the-lucene-query-string/165003 "2019-01-21T08:24:33Z")

</div>

I am trying to graph the count of log-messages of several applications in a graph. But some applications send a log more logs than others. So the idea was to graph something like the following for each application (as SQ…

---

## [Elasticsearch does not allocate shards to one node](https://discuss.elastic.co/t/elasticsearch-does-not-allocate-shards-to-one-node/164978)

<div class="topic-metadata">

**Author:** [@pszemesy](https://discuss.elastic.co/u/pszemesy)\
**Replies:** 4\
**Last updated:** [January 21, 2019, 7:57am UTC](https://discuss.elastic.co/t/elasticsearch-does-not-allocate-shards-to-one-node/164978 "2019-01-21T07:57:31Z")

</div>

Hi All, I have a 3 node cluster of Elasticsearch. Somehow the system does not allocate any shards to node 2 (node 1 holds 34 and node 3 holds 31 shards). I'm using ES 6.1.2. elasticsearch.yml (from node 2) cluster.…

---

## [Which method is usually used to age the data in elasticsearch?](https://discuss.elastic.co/t/which-method-is-usually-used-to-age-the-data-in-elasticsearch/164986)

<div class="topic-metadata">

**Author:** [@guisong](https://discuss.elastic.co/u/guisong)\
**Replies:** 1\
**Last updated:** [January 21, 2019, 7:28am UTC](https://discuss.elastic.co/t/which-method-is-usually-used-to-age-the-data-in-elasticsearch/164986 "2019-01-21T07:28:52Z")

</div>

Hello! Which method is usually used to age the data in elasticsearch? I start a crontab task which run a shell script to call DELETE INDEX API of elasticsearch regularly.elasticsearth lost large data when it is called …

---

## [Aggregation response time is slow in ES Version 6.4](https://discuss.elastic.co/t/aggregation-response-time-is-slow-in-es-version-6-4/164676)

<div class="topic-metadata">

**Author:** [@Thillai\_Natarajan\_Ra](https://discuss.elastic.co/u/Thillai_Natarajan_Ra)\
**Replies:** 2\
**Last updated:** [January 21, 2019, 5:19am UTC](https://discuss.elastic.co/t/aggregation-response-time-is-slow-in-es-version-6-4/164676 "2019-01-21T05:19:07Z")

</div>

Hi, I'm using elasticsearch version 2.2 and also 6.4. Since indices in version 2.2 cannot be directly reindexed to 6.4 i'm running both version at same time and once if data inside version 6.4 is large enough, i will st…

---

## [Must condition with OR condition](https://discuss.elastic.co/t/must-condition-with-or-condition/164654)

<div class="topic-metadata">

**Author:** [@Chaitanya1](https://discuss.elastic.co/u/Chaitanya1)\
**Replies:** 4\
**Last updated:** [January 21, 2019, 4:53am UTC](https://discuss.elastic.co/t/must-condition-with-or-condition/164654 "2019-01-21T04:53:20Z")

</div>

Hi Team, I want to optimize the watcher scripts created. I created almost 21 scripts with different message patterns. My aim is to reduce the number of scripts. I want to change the must match pattern with OR conditio…

---

## [ES 6.5.4 and S3 repo issue](https://discuss.elastic.co/t/es-6-5-4-and-s3-repo-issue/164779)

<div class="topic-metadata">

**Author:** [@phr0gz](https://discuss.elastic.co/u/phr0gz)\
**Replies:** 3\
**Last updated:** [January 21, 2019, 4:40am UTC](https://discuss.elastic.co/t/es-6-5-4-and-s3-repo-issue/164779 "2019-01-21T04:40:39Z")

</div>

Hello, We are trying to use the repository-s3 on our ES servers. but when we are trying to create a repository with: PUT \_snapshot/s3 { "type": "s3", "settings": { "endpoint": "elasticsearch.is.working.in.the.lab.…

---

## [6.5.0 JVM Crash](https://discuss.elastic.co/t/6-5-0-jvm-crash/161620)

<div class="topic-metadata">

**Author:** [@bitva77](https://discuss.elastic.co/u/bitva77)\
**Replies:** 9\
**Last updated:** [January 21, 2019, 12:43am UTC](https://discuss.elastic.co/t/6-5-0-jvm-crash/161620 "2019-01-21T00:43:49Z")

</div>

Hi. Running Elasticsearch 6.5.0 in Docker. Been upgrading our environment and so replacing Elastic servers. Everything was going fine until one of our servers started JVM crashing. Here's the JVM output: https://gis…

---

## [Reindex with \`term\_vector\` results in deleted docs](https://discuss.elastic.co/t/reindex-with-term-vector-results-in-deleted-docs/164956)

<div class="topic-metadata">

**Author:** [@workmanw](https://discuss.elastic.co/u/workmanw)\
**Replies:** 0\
**Last updated:** [January 20, 2019, 7:15pm UTC](https://discuss.elastic.co/t/reindex-with-term-vector-results-in-deleted-docs/164956 "2019-01-20T19:15:08Z")

</div>

I've been testing out the text mapping properties stored: true and term\_vector: with\_positions\_offsets for text highlighting. Really I wanted to understand the impacts to storage on disk. I'm starting with an existing in…

---

## [Jar hell when installing custom plugin](https://discuss.elastic.co/t/jar-hell-when-installing-custom-plugin/164938)

<div class="topic-metadata">

**Author:** [@ninesalt](https://discuss.elastic.co/u/ninesalt)\
**Replies:** 4\
**Last updated:** [January 20, 2019, 3:46pm UTC](https://discuss.elastic.co/t/jar-hell-when-installing-custom-plugin/164938 "2019-01-20T15:46:18Z")

</div>

I'm trying to install a custom plugin I'm working on which includes CoreNLP. I'm getting the jar hell error with the following jars: Caused by: java.lang.IllegalStateException: jar hell! class: com.sun.xml.bind.Locatabl…

---

## [Cant roll over index via index template?](https://discuss.elastic.co/t/cant-roll-over-index-via-index-template/164264)

<div class="topic-metadata">

**Author:** [@bmatoki](https://discuss.elastic.co/u/bmatoki)\
**Replies:** 8\
**Last updated:** [January 20, 2019, 2:50pm UTC](https://discuss.elastic.co/t/cant-roll-over-index-via-index-template/164264 "2019-01-20T14:50:39Z")

</div>

Hey all. im trying to set roll over in my index template. my logstash using index template this is my index template \> \> { \> "template" : "logstash-\*", \> "version" : 60001, \> "settings" : { \> "index.refre…

---

## [Microsoft Teams Channel stream into ES](https://discuss.elastic.co/t/microsoft-teams-channel-stream-into-es/164007)

<div class="topic-metadata">

**Author:** [@Jackson\_Pollock](https://discuss.elastic.co/u/Jackson_Pollock)\
**Replies:** 2\
**Last updated:** [January 20, 2019, 2:12pm UTC](https://discuss.elastic.co/t/microsoft-teams-channel-stream-into-es/164007 "2019-01-20T14:12:40Z")

</div>

I would like to index conversations from a Microsoft Teams Channel into elastic. Any ideas on the best approach? Nothing turns up, I suppose I can write something if there is a good API for teams. thanks

---

## [Loading data from .csv file to elasticsearch using logstash on localhost](https://discuss.elastic.co/t/loading-data-from-csv-file-to-elasticsearch-using-logstash-on-localhost/164903)

<div class="topic-metadata">

**Author:** [@Hetal\_Parmar](https://discuss.elastic.co/u/Hetal_Parmar)\
**Replies:** 4\
**Last updated:** [January 20, 2019, 1:41pm UTC](https://discuss.elastic.co/t/loading-data-from-csv-file-to-elasticsearch-using-logstash-on-localhost/164903 "2019-01-20T13:41:02Z")

</div>

hi i m new to elastic. so i m trying to upload data from .csv file to elasticsearch using logstash on my local desktop (windows10) the problem is only 10 data from excel is uploading on elasticsearch. no error in logs…

---

## [ES v 6.5.4 Not enough master nodes discovered during pinging - gce discovery](https://discuss.elastic.co/t/es-v-6-5-4-not-enough-master-nodes-discovered-during-pinging-gce-discovery/164904)

<div class="topic-metadata">

**Author:** [@aech](https://discuss.elastic.co/u/aech)\
**Replies:** 9\
**Last updated:** [January 20, 2019, 12:19pm UTC](https://discuss.elastic.co/t/es-v-6-5-4-not-enough-master-nodes-discovered-during-pinging-gce-discovery/164904 "2019-01-20T12:19:02Z")

</div>

I have a small ES 6.5.4 cluster (3 nodes) I'm trying to get going in a google cloud project. I have the latest gce - discovery plugin installed (6.5.4), however it seems like it starts and I never see anything in the l…

---

## [Need Help to write a watcher for alerting some beat.hostname missing on the last 1h or every day](https://discuss.elastic.co/t/need-help-to-write-a-watcher-for-alerting-some-beat-hostname-missing-on-the-last-1h-or-every-day/164918)

<div class="topic-metadata">

**Author:** [@bayoumben](https://discuss.elastic.co/u/bayoumben)\
**Replies:** 2\
**Last updated:** [January 20, 2019, 9:35am UTC](https://discuss.elastic.co/t/need-help-to-write-a-watcher-for-alerting-some-beat-hostname-missing-on-the-last-1h-or-every-day/164918 "2019-01-20T09:35:32Z")

</div>

Hi all, I really need your help to write a watcher for alerting some beat.hostname missing on the last 1h or every day. Thanks

---

## [Elastic Search Issue cannot connect it from browser of my local machine](https://discuss.elastic.co/t/elastic-search-issue-cannot-connect-it-from-browser-of-my-local-machine/164927)

<div class="topic-metadata">

**Author:** [@Arvind\_Singh](https://discuss.elastic.co/u/Arvind_Singh)\
**Replies:** 0\
**Last updated:** [January 20, 2019, 8:54am UTC](https://discuss.elastic.co/t/elastic-search-issue-cannot-connect-it-from-browser-of-my-local-machine/164927 "2019-01-20T08:54:49Z")

</div>

Hi I am trying to connect to elasticsearch from browser of my local machine and elastic search installed into my ubuntu server 16.04 but i cannot connect to it. i have network.host: 0 and elastic search is being runnin…

---

## [Elastic cluster capacity planning](https://discuss.elastic.co/t/elastic-cluster-capacity-planning/164880)

<div class="topic-metadata">

**Author:** [@vivektsb](https://discuss.elastic.co/u/vivektsb)\
**Replies:** 2\
**Last updated:** [January 20, 2019, 7:39am UTC](https://discuss.elastic.co/t/elastic-cluster-capacity-planning/164880 "2019-01-20T07:39:24Z")

</div>

Hi, We have requirement to index around 8TB data per day including replica( 4TB per day) We are planning for 12 nodes cluster each with 8 core, 30TB Hdd,64gb ram out of 5 will be master nodes with SSD. Do we need to …

---

## [Elasticsearch-repository-s3-plugin-doesnt-work](https://discuss.elastic.co/t/elasticsearch-repository-s3-plugin-doesnt-work/164905)

<div class="topic-metadata">

**Author:** [@22a33b154fedb6b33b85](https://discuss.elastic.co/u/22a33b154fedb6b33b85)\
**Replies:** 2\
**Last updated:** [January 20, 2019, 5:26am UTC](https://discuss.elastic.co/t/elasticsearch-repository-s3-plugin-doesnt-work/164905 "2019-01-20T05:26:17Z")

</div>

Hello The backup to s3 does not work. I am very embarrassed. I would like if there is some knowledge. Es version 6.5.0 Multi master cluster(master\*3) ・s3 bucket is open to the public. curl -X PUT localhost:9200/\_sn…

---

## [Best index performance](https://discuss.elastic.co/t/best-index-performance/164892)

<div class="topic-metadata">

**Author:** [@fadihaddad](https://discuss.elastic.co/u/fadihaddad)\
**Replies:** 5\
**Last updated:** [January 20, 2019, 3:02am UTC](https://discuss.elastic.co/t/best-index-performance/164892 "2019-01-20T03:02:31Z")

</div>

I have 2 servers each has 4 cpus and each cpu has 4 cores and the servers have 16gb RAM. I receive every hour 2 8gb files and 2 3gb files. What are the best number of shards and pipelines workers and batch size and JVM …

---

## [Strange shard cache misses with huge evictions](https://discuss.elastic.co/t/strange-shard-cache-misses-with-huge-evictions/163910)

<div class="topic-metadata">

**Author:** [@pySilver](https://discuss.elastic.co/u/pySilver)\
**Replies:** 1\
**Last updated:** [January 19, 2019, 7:32pm UTC](https://discuss.elastic.co/t/strange-shard-cache-misses-with-huge-evictions/163910 "2019-01-19T19:32:01Z")

</div>

Hi! I'm having hard times to make shard cache work for my aggregations. I've spent hours to figure out what the cause and I'm afraid I'm out of ideas. My indices.requests.cache.size: 10% and there is 4 machines dedicat…

---

## [Elastic Search hangs after start on Linux VM](https://discuss.elastic.co/t/elastic-search-hangs-after-start-on-linux-vm/164810)

<div class="topic-metadata">

**Author:** [@Vishal\_Goel](https://discuss.elastic.co/u/Vishal_Goel)\
**Replies:** 7\
**Last updated:** [January 19, 2019, 7:11pm UTC](https://discuss.elastic.co/t/elastic-search-hangs-after-start-on-linux-vm/164810 "2019-01-19T19:11:32Z")

</div>

Hi, I am running Elastic Search 6.5.4 on small Linux VM in dev mode. It is started successfully, I can access http://localhost:9200 in browser perfectly. But when Kibana is run and it start using ES, ES gets hanged. N…

---

## [Runing FScrawler and ES as background tasks](https://discuss.elastic.co/t/runing-fscrawler-and-es-as-background-tasks/164781)

<div class="topic-metadata">

**Author:** [@davlinds](https://discuss.elastic.co/u/davlinds)\
**Replies:** 2\
**Last updated:** [January 19, 2019, 6:57pm UTC](https://discuss.elastic.co/t/runing-fscrawler-and-es-as-background-tasks/164781 "2019-01-19T18:57:06Z")

</div>

I am using win7 and have successfully tested Elasticsearch and FScrawler although a complete novice :slight\_smile: I want to transfer the system to another computer that is an underused mailserver; and thus they need to…

---

## [How to use parent child relationships between types residing in different index in ElasticSearch 6.5](https://discuss.elastic.co/t/how-to-use-parent-child-relationships-between-types-residing-in-different-index-in-elasticsearch-6-5/164849)

<div class="topic-metadata">

**Author:** [@akkash.bansal](https://discuss.elastic.co/u/akkash.bansal)\
**Replies:** 2\
**Last updated:** [January 19, 2019, 5:11pm UTC](https://discuss.elastic.co/t/how-to-use-parent-child-relationships-between-types-residing-in-different-index-in-elasticsearch-6-5/164849 "2019-01-19T17:11:47Z")

</div>

Hi, I am trying to migrate from ES 5.x to 6.5 and I am stuck at migrating mappings of parent child relationships. Right now in ES 5 I have all the types in one index but the ES6.5 does not support multiple types in same…

---

## [ELK Stack Architecture recommendation](https://discuss.elastic.co/t/elk-stack-architecture-recommendation/164894)

<div class="topic-metadata">

**Author:** [@Amir\_Soleimani](https://discuss.elastic.co/u/Amir_Soleimani)\
**Replies:** 0\
**Last updated:** [January 19, 2019, 12:36pm UTC](https://discuss.elastic.co/t/elk-stack-architecture-recommendation/164894 "2019-01-19T12:36:18Z")

</div>

Hello, I want to deploy Elastichsearch in a environment to collect logs from few virtual machines in a network and insert those logs in a single Elasticsearch node and visualize the data via Kibana, but I don't know how …

---

## [Setting password via x-pack](https://discuss.elastic.co/t/setting-password-via-x-pack/164819)

<div class="topic-metadata">

**Author:** [@Amir\_Soleimani](https://discuss.elastic.co/u/Amir_Soleimani)\
**Replies:** 2\
**Last updated:** [January 19, 2019, 5:12am UTC](https://discuss.elastic.co/t/setting-password-via-x-pack/164819 "2019-01-19T05:12:04Z")

</div>

Hello, I'm using elasticsearch-6.5.4 with this yml file: xpack.security.enabled: true xpack.license.self\_generated.type: basic i want to set interactive password via : "bin/x-pack/setup-passwords interactive" but i go…

---

## [Ecommerce Data modelling with nested documents](https://discuss.elastic.co/t/ecommerce-data-modelling-with-nested-documents/164421)

<div class="topic-metadata">

**Author:** [@codobbit](https://discuss.elastic.co/u/codobbit)\
**Replies:** 8\
**Last updated:** [January 19, 2019, 11:53am UTC](https://discuss.elastic.co/t/ecommerce-data-modelling-with-nested-documents/164421 "2019-01-19T11:53:24Z")

</div>

Hello everyone! It's my first ElasticSearch project and I could use some input. Situation: Ecommerce scenario with 6000 products and 6000 customers. Each customer can have a specific discount for a product and every cu…

---

## [Deploying behind NAT and Firewall](https://discuss.elastic.co/t/deploying-behind-nat-and-firewall/164783)

<div class="topic-metadata">

**Author:** [@Nikola\_Radovanovic](https://discuss.elastic.co/u/Nikola_Radovanovic)\
**Replies:** 2\
**Last updated:** [January 19, 2019, 11:30am UTC](https://discuss.elastic.co/t/deploying-behind-nat-and-firewall/164783 "2019-01-19T11:30:37Z")

</div>

Hi, I am not sure if this is the right place for this topic, so please move it if there is a better one. My question is how Elasticsearch shall be deployed when behind NAT and Firewall? I created basic setup of Elastic…

---

## [Documentation license](https://discuss.elastic.co/t/documentation-license/164852)

<div class="topic-metadata">

**Author:** [@Kronuz](https://discuss.elastic.co/u/Kronuz)\
**Replies:** 2\
**Last updated:** [January 19, 2019, 10:41am UTC](https://discuss.elastic.co/t/documentation-license/164852 "2019-01-19T10:41:23Z")

</div>

I'm seeking clarification about what is the license under which Elasticsearch documentation is released. Apparently some documentation (definitive guide) is under Creative Commons (https://creativecommons.org/licenses/by…

---

## [Getting string-out-of\_bound exception while using highlight](https://discuss.elastic.co/t/getting-string-out-of-bound-exception-while-using-highlight/164890)

<div class="topic-metadata">

**Author:** [@smile-sunsshine](https://discuss.elastic.co/u/smile-sunsshine)\
**Replies:** 0\
**Last updated:** [January 19, 2019, 10:13am UTC](https://discuss.elastic.co/t/getting-string-out-of-bound-exception-while-using-highlight/164890 "2019-01-19T10:13:40Z")

</div>

Hi, all: i have something confusing on highlight query. i have an index named book1,and it has two fields,bookid and bookcontent. And the mapping type of bookcontent is text, there is some docs data in it.When i do f…

---

## [Aggregating urls with slightly different variations in elasticsearch query](https://discuss.elastic.co/t/aggregating-urls-with-slightly-different-variations-in-elasticsearch-query/164888)

<div class="topic-metadata">

**Author:** [@Geoffrey\_De\_Vylder](https://discuss.elastic.co/u/Geoffrey_De_Vylder)\
**Replies:** 0\
**Last updated:** [January 19, 2019, 8:53am UTC](https://discuss.elastic.co/t/aggregating-urls-with-slightly-different-variations-in-elasticsearch-query/164888 "2019-01-19T08:53:26Z")

</div>

I am new to Elastic search and learning about how the tooling works. I have an "audit" database containing records of HTTP requests to different endpoints in my application and which time they were executed. You can ima…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1419)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1421)
