# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1118

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1119

---

## [CPU and Garbage Collection Time Reguraily Spike For Long Periods of Time](https://discuss.elastic.co/t/cpu-and-garbage-collection-time-reguraily-spike-for-long-periods-of-time/204291)

<div class="topic-metadata">

**Author:** [@stockhausenj](https://discuss.elastic.co/u/stockhausenj)\
**Replies:** 3\
**Last updated:** [October 21, 2019, 5:12pm UTC](https://discuss.elastic.co/t/cpu-and-garbage-collection-time-reguraily-spike-for-long-periods-of-time/204291 "2019-10-21T17:12:17Z")

</div>

Hello, Elasticsearch 6.7 This is regarding 8 nodes that have these settings: node.data: true node.master: false node.ingest: true -Xms30g -Xmx30g -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+Use…

---

## [\[ES 7.4\] elasticsearch node dont see each other](https://discuss.elastic.co/t/es-7-4-elasticsearch-node-dont-see-each-other/204355)

<div class="topic-metadata">

**Author:** [@JustinLe](https://discuss.elastic.co/u/JustinLe)\
**Replies:** 8\
**Last updated:** [October 21, 2019, 4:54pm UTC](https://discuss.elastic.co/t/es-7-4-elasticsearch-node-dont-see-each-other/204355 "2019-10-21T16:54:52Z")

</div>

Hi Im just start in ES about some days I have 3 machine in network ips: machine 1 : 10.255.255.6 ,machine 2 : 10.255.255.7, machine 3: 10.255.255.8 i want to setup a es cluster with machine 1 is a master node and two…

---

## [Bad request response when adding WAF logs to Elasticsearch](https://discuss.elastic.co/t/bad-request-response-when-adding-waf-logs-to-elasticsearch/204093)

<div class="topic-metadata">

**Author:** [@ben.sharp](https://discuss.elastic.co/u/ben.sharp)\
**Replies:** 13\
**Last updated:** [October 21, 2019, 4:30pm UTC](https://discuss.elastic.co/t/bad-request-response-when-adding-waf-logs-to-elasticsearch/204093 "2019-10-21T16:30:30Z")

</div>

Hi there, Due to some custom requirements, I am attempting to ship my WAF logs into Elasticsearch using lambda. The function is fairly simple Python, as follows: import re import requests from requests\_aws4auth import…

---

## [Search in multiple fields with highlighting](https://discuss.elastic.co/t/search-in-multiple-fields-with-highlighting/204507)

<div class="topic-metadata">

**Author:** [@sandeepv](https://discuss.elastic.co/u/sandeepv)\
**Replies:** 2\
**Last updated:** [October 21, 2019, 3:41pm UTC](https://discuss.elastic.co/t/search-in-multiple-fields-with-highlighting/204507 "2019-10-21T15:41:33Z")

</div>

Can we search in multipe fields with hightlighs. GET /index\_name/\_doc/\_search { "\_source": false, "query": { "bool": { "should": \[ { "match": { "call\_data.source\_id": { …

---

## [Upsert Using NEST 7](https://discuss.elastic.co/t/upsert-using-nest-7/204276)

<div class="topic-metadata">

**Author:** [@han1](https://discuss.elastic.co/u/han1)\
**Replies:** 4\
**Last updated:** [October 21, 2019, 3:22pm UTC](https://discuss.elastic.co/t/upsert-using-nest-7/204276 "2019-10-21T15:22:06Z")

</div>

Unfortunately, the docs for NEST is completely useless in providing answers to so many issues. Everything is available for Elasticsearch and can easily be found. But if you are looking for the same thing in NEST - Forget…

---

## [How to sort buckets across nested bucket fields](https://discuss.elastic.co/t/how-to-sort-buckets-across-nested-bucket-fields/204508)

<div class="topic-metadata">

**Author:** [@MarcelMan](https://discuss.elastic.co/u/MarcelMan)\
**Replies:** 0\
**Last updated:** [October 21, 2019, 2:58pm UTC](https://discuss.elastic.co/t/how-to-sort-buckets-across-nested-bucket-fields/204508 "2019-10-21T14:58:22Z")

</div>

I'm unable to figure out how to write a query which will sort buckets based on their nested fields. Each document in my index has this schema: { "provider\_message\_text": "this is about a song", "sentiment\_score": 0…

---

## [Can i get bucket count of terms aggregation?](https://discuss.elastic.co/t/can-i-get-bucket-count-of-terms-aggregation/203561)

<div class="topic-metadata">

**Author:** [@Yungyoung\_Ok](https://discuss.elastic.co/u/Yungyoung_Ok)\
**Replies:** 3\
**Last updated:** [October 21, 2019, 2:47pm UTC](https://discuss.elastic.co/t/can-i-get-bucket-count-of-terms-aggregation/203561 "2019-10-21T14:47:40Z")

</div>

"aggs": { "terms\_aggs": { "terms": { "field": "topic.keyword", "size": 10000 } } } first, If I actually got 600 bucket count, can i get 600 in the query or agg…

---

## [My license has expired. How can I export my indexes?](https://discuss.elastic.co/t/my-license-has-expired-how-can-i-export-my-indexes/203888)

<div class="topic-metadata">

**Author:** [@Rosho](https://discuss.elastic.co/u/Rosho)\
**Replies:** 3\
**Last updated:** [October 21, 2019, 2:22pm UTC](https://discuss.elastic.co/t/my-license-has-expired-how-can-i-export-my-indexes/203888 "2019-10-21T14:22:07Z")

</div>

Hi I am using Kibana 6.8.2. Originally I started using the X-pack (the trail version). It has expired now. I want to take info of an index to export it and analyze data with python. But as the license has expired I do n…

---

## [Using elasticSearch to index git repository](https://discuss.elastic.co/t/using-elasticsearch-to-index-git-repository/204491)

<div class="topic-metadata">

**Author:** [@manu4387](https://discuss.elastic.co/u/manu4387)\
**Replies:** 1\
**Last updated:** [October 21, 2019, 2:19pm UTC](https://discuss.elastic.co/t/using-elasticsearch-to-index-git-repository/204491 "2019-10-21T14:19:54Z")

</div>

Hi All, I am new to the Elastic search , and want to index the git repository through elastic search , what are the options i can use to make it connect to git hub repository. Thanks

---

## [Data Masking ES 7.x](https://discuss.elastic.co/t/data-masking-es-7-x/203259)

<div class="topic-metadata">

**Author:** [@rschirin](https://discuss.elastic.co/u/rschirin)\
**Replies:** 5\
**Last updated:** [October 21, 2019, 2:06pm UTC](https://discuss.elastic.co/t/data-masking-es-7-x/203259 "2019-10-21T14:06:56Z")

</div>

Hi all, can I know what is the current situation regarding any kind of plugin/method for data masking? I mean, if I would like to do it, what should be the best or suggest approach?

---

## [Difference between two fields based on a field value filter](https://discuss.elastic.co/t/difference-between-two-fields-based-on-a-field-value-filter/204492)

<div class="topic-metadata">

**Author:** [@Prashant\_Kumar3](https://discuss.elastic.co/u/Prashant_Kumar3)\
**Replies:** 0\
**Last updated:** [October 21, 2019, 2:05pm UTC](https://discuss.elastic.co/t/difference-between-two-fields-based-on-a-field-value-filter/204492 "2019-10-21T14:05:46Z")

</div>

Hi,I need to find the time difference between two fields from two different hits or events or \_source . For example. Each hit contain a field @timestamp OUR APPLIED FILTER (Based on question\_id or \_id) which returns …

---

## [Regex - license](https://discuss.elastic.co/t/regex-license/204460)

<div class="topic-metadata">

**Author:** [@AstroSlazak](https://discuss.elastic.co/u/AstroSlazak)\
**Replies:** 1\
**Last updated:** [October 21, 2019, 2:04pm UTC](https://discuss.elastic.co/t/regex-license/204460 "2019-10-21T14:04:34Z")

</div>

Hi, Using basic license can i enable regexp or need another license ?

---

## [Where can I find in Elastic's official documentation the default installation ports for Elasticsearch, Kibana and Logstash?](https://discuss.elastic.co/t/where-can-i-find-in-elastics-official-documentation-the-default-installation-ports-for-elasticsearch-kibana-and-logstash/204490)

<div class="topic-metadata">

**Author:** [@wilsondias.ti](https://discuss.elastic.co/u/wilsondias.ti)\
**Replies:** 0\
**Last updated:** [October 21, 2019, 2:03pm UTC](https://discuss.elastic.co/t/where-can-i-find-in-elastics-official-documentation-the-default-installation-ports-for-elasticsearch-kibana-and-logstash/204490 "2019-10-21T14:03:37Z")

</div>

https://www.elastic.co/guide/en/elasticsearch/reference/7.4/index.html https://www.elastic.co/guide/en/kibana/7.4/index.html https://www.elastic.co/guide/en/logstash/7.4/index.html

---

## [Error since 7.4 upgrade - field expansion matches too many fields](https://discuss.elastic.co/t/error-since-7-4-upgrade-field-expansion-matches-too-many-fields/204087)

<div class="topic-metadata">

**Author:** [@L33T](https://discuss.elastic.co/u/L33T)\
**Replies:** 1\
**Last updated:** [October 21, 2019, 1:47pm UTC](https://discuss.elastic.co/t/error-since-7-4-upgrade-field-expansion-matches-too-many-fields/204087 "2019-10-21T13:47:22Z")

</div>

Hi, Whenever i view any of my dashboards i get the below... How can i debug this? { "took": 48, "timed\_out": false, "\_shards": { "total": 188, "successful": 187, "skipped": 172, "failed": 1, "failures": \[ { "…

---

## [Production cluster not visible from Kibana on monitoring cluster](https://discuss.elastic.co/t/production-cluster-not-visible-from-kibana-on-monitoring-cluster/203292)

<div class="topic-metadata">

**Author:** [@lschmid](https://discuss.elastic.co/u/lschmid)\
**Replies:** 1\
**Last updated:** [October 21, 2019, 1:34pm UTC](https://discuss.elastic.co/t/production-cluster-not-visible-from-kibana-on-monitoring-cluster/203292 "2019-10-21T13:34:23Z")

</div>

I have a production cluster with 3 nodes all running 5.6.7. I also have a monitoring cluster with a single node also running 5.6.7. I have configured everything as per this guide: https://www.elastic.co/guide/en/x-pack/…

---

## [JSON with script and aggregation Query to Java REST High or Low Level Client](https://discuss.elastic.co/t/json-with-script-and-aggregation-query-to-java-rest-high-or-low-level-client/204477)

<div class="topic-metadata">

**Author:** [@rakotomandimby](https://discuss.elastic.co/u/rakotomandimby)\
**Replies:** 0\
**Last updated:** [October 21, 2019, 1:08pm UTC](https://discuss.elastic.co/t/json-with-script-and-aggregation-query-to-java-rest-high-or-low-level-client/204477 "2019-10-21T13:08:40Z")

</div>

Hi all, I'm querying ES 7.3 from the Java REST High Level Client. For "simple" queries, I have always been able to transcript them to Java, but this time, I face the problem. This is the JSON query { "query": { …

---

## [How to config remote monitoring for Elasticsearch node in kubernetes](https://discuss.elastic.co/t/how-to-config-remote-monitoring-for-elasticsearch-node-in-kubernetes/203837)

<div class="topic-metadata">

**Author:** [@tamilsweet](https://discuss.elastic.co/u/tamilsweet)\
**Replies:** 2\
**Last updated:** [October 21, 2019, 1:03pm UTC](https://discuss.elastic.co/t/how-to-config-remote-monitoring-for-elasticsearch-node-in-kubernetes/203837 "2019-10-21T13:03:00Z")

</div>

Hi All, I have a Elasticsearch node setup in kubernetes cluster with following configuration. Another ES node to store the monitoring data. But how to pass the http exporter config to yaml file ? Both Elasticsearch Ver…

---

## [Remote Reindex is failing with connect\_exception](https://discuss.elastic.co/t/remote-reindex-is-failing-with-connect-exception/204471)

<div class="topic-metadata">

**Author:** [@sree\_hari](https://discuss.elastic.co/u/sree_hari)\
**Replies:** 0\
**Last updated:** [October 21, 2019, 12:43pm UTC](https://discuss.elastic.co/t/remote-reindex-is-failing-with-connect-exception/204471 "2019-10-21T12:43:25Z")

</div>

I am trying to re-index from 6.7 to 7.3. root@elk730 ~ $curl -X POST "localhost:9200/\_reindex?pretty" -H 'Content-Type: application/json' -d' { "source": { "remote": { "host": "http://10.10.10.60:9200" }, "index":…

---

## [Elasticsearch 5.6.0 : using kstem in custom analyzer throws error](https://discuss.elastic.co/t/elasticsearch-5-6-0-using-kstem-in-custom-analyzer-throws-error/204459)

<div class="topic-metadata">

**Author:** [@Renuka](https://discuss.elastic.co/u/Renuka)\
**Replies:** 0\
**Last updated:** [October 21, 2019, 12:07pm UTC](https://discuss.elastic.co/t/elasticsearch-5-6-0-using-kstem-in-custom-analyzer-throws-error/204459 "2019-10-21T12:07:17Z")

</div>

Been using elasticsearch 5.6.0 in prod environment. now we are replicating prod setup. during which when creating the same index with same settings, it throws illegal argument exception. {"error":{"root\_cause":\[{"type":…

---

## [Too\_many\_buckets\_exception after patching to 7.x](https://discuss.elastic.co/t/too-many-buckets-exception-after-patching-to-7-x/204409)

<div class="topic-metadata">

**Author:** [@stefws](https://discuss.elastic.co/u/stefws)\
**Replies:** 3\
**Last updated:** [October 21, 2019, 11:14am UTC](https://discuss.elastic.co/t/too-many-buckets-exception-after-patching-to-7-x/204409 "2019-10-21T11:14:46Z")

</div>

I'm getting this error in our some of our Grafana panels now after updating to 7.4 from 6.8: type:"too\_many\_buckets\_exception" reason:"Trying to create too many buckets. Must be less than or equal to: \[10000\] but was \[…

---

## [GeoIP ASN database on Elastic Cloud](https://discuss.elastic.co/t/geoip-asn-database-on-elastic-cloud/204447)

<div class="topic-metadata">

**Author:** [@Ruben\_Laban](https://discuss.elastic.co/u/Ruben_Laban)\
**Replies:** 0\
**Last updated:** [October 21, 2019, 11:08am UTC](https://discuss.elastic.co/t/geoip-asn-database-on-elastic-cloud/204447 "2019-10-21T11:08:59Z")

</div>

Using the default Country GeoIP database is trivial on Elastic Cloud. However, it's not clear to me how to enrich my data using the ASN database on Elastic Cloud.

---

## [Couldnt upload the log file in ML-Data Visualizer](https://discuss.elastic.co/t/couldnt-upload-the-log-file-in-ml-data-visualizer/204304)

<div class="topic-metadata">

**Author:** [@anusree\_arun](https://discuss.elastic.co/u/anusree_arun)\
**Replies:** 4\
**Last updated:** [October 21, 2019, 11:05am UTC](https://discuss.elastic.co/t/couldnt-upload-the-log-file-in-ml-data-visualizer/204304 "2019-10-21T11:05:03Z")

</div>

I have tried to upload a sample access log with size of 65mb using ML -\> Data Visualizer,but the file is couldn't upload completely.The page is still loading.. Please provide a solution

---

## [Connecting 2 clusters in kubernetes](https://discuss.elastic.co/t/connecting-2-clusters-in-kubernetes/204164)

<div class="topic-metadata">

**Author:** [@SukeshGupta](https://discuss.elastic.co/u/SukeshGupta)\
**Replies:** 4\
**Last updated:** [October 21, 2019, 10:54am UTC](https://discuss.elastic.co/t/connecting-2-clusters-in-kubernetes/204164 "2019-10-21T10:54:23Z")

</div>

Hi, I have one cluster in zone-1 with 2 nodes and I have one more cluster in zone-2 with 2 nodes and both the clusters are having the same cluster name. Would like know how to establish a connection between 2 clusters i…

---

## [How to validate data uploaded on Elastic cluster successfully](https://discuss.elastic.co/t/how-to-validate-data-uploaded-on-elastic-cluster-successfully/203975)

<div class="topic-metadata">

**Author:** [@niraj\_pandey](https://discuss.elastic.co/u/niraj_pandey)\
**Replies:** 1\
**Last updated:** [October 21, 2019, 9:50am UTC](https://discuss.elastic.co/t/how-to-validate-data-uploaded-on-elastic-cluster-successfully/203975 "2019-10-21T09:50:02Z")

</div>

Hi , I have some raw data and after preprocessing it through python I am uploading it on ELK through logstash in the following way. cat get\_info.sh #!/bin/bash /home/abc/script/allocated\_budget\_info.py | /usr/share/l…

---

## [Problems when starting elasticsearch](https://discuss.elastic.co/t/problems-when-starting-elasticsearch/202203)

<div class="topic-metadata">

**Author:** [@fgomez17](https://discuss.elastic.co/u/fgomez17)\
**Replies:** 2\
**Last updated:** [October 21, 2019, 9:24am UTC](https://discuss.elastic.co/t/problems-when-starting-elasticsearch/202203 "2019-10-21T09:24:34Z")

</div>

Hello there, I'm working on a VM on RHEL 7.4 and I need to install ElasticSearch and Kibana. But here is my problem, elasticsearch is installed on my vm but when I try to start it i got this : I check what happened by …

---

## [How to Disable allocation awareness attributes in indices level](https://discuss.elastic.co/t/how-to-disable-allocation-awareness-attributes-in-indices-level/204415)

<div class="topic-metadata">

**Author:** [@luyuncheng](https://discuss.elastic.co/u/luyuncheng)\
**Replies:** 2\
**Last updated:** [October 21, 2019, 9:17am UTC](https://discuss.elastic.co/t/how-to-disable-allocation-awareness-attributes-in-indices-level/204415 "2019-10-21T09:17:20Z")

</div>

When allocation-awareness set to zone. It make primary and replicas shard must split into different zone. When we need make cluster how-warm or shrink , we need move all shards which is warm indices into one zone. but w…

---

## [Explain:true cause my painless script to stop working](https://discuss.elastic.co/t/explain-true-cause-my-painless-script-to-stop-working/203733)

<div class="topic-metadata">

**Author:** [@Rick\_Choo](https://discuss.elastic.co/u/Rick_Choo)\
**Replies:** 3\
**Last updated:** [October 21, 2019, 7:36am UTC](https://discuss.elastic.co/t/explain-true-cause-my-painless-script-to-stop-working/203733 "2019-10-21T07:36:54Z")

</div>

resume mapping PUT resume { "mappings":{ "properties":{ "job\_experience":{ "type": "nested", "properties": { "company": { "type": "text", "fielddata":true …

---

## [Using Slack for notification alerts](https://discuss.elastic.co/t/using-slack-for-notification-alerts/203724)

<div class="topic-metadata">

**Author:** [@akalra](https://discuss.elastic.co/u/akalra)\
**Replies:** 3\
**Last updated:** [October 21, 2019, 7:17am UTC](https://discuss.elastic.co/t/using-slack-for-notification-alerts/203724 "2019-10-21T07:17:34Z")

</div>

Hi, I want to create some notification alerts for a kubernetes cluster that i am monitoring and send them to a Slack channel. I am using watcher to configure these threshhold alerts. I followed the steps for creating th…

---

## [MultiSearch in Watcher input section](https://discuss.elastic.co/t/multisearch-in-watcher-input-section/203631)

<div class="topic-metadata">

**Author:** [@RamyaGowda](https://discuss.elastic.co/u/RamyaGowda)\
**Replies:** 3\
**Last updated:** [October 21, 2019, 7:14am UTC](https://discuss.elastic.co/t/multisearch-in-watcher-input-section/203631 "2019-10-21T07:14:52Z")

</div>

Hello Team, I have a \_msearch query wherin each queries gives me different hits, how can i pass this multisearch quey in watcher input section . Is there any way? Thanks and Regards, Ramya

---

## [Elastic cluster: docker or VM for production?](https://discuss.elastic.co/t/elastic-cluster-docker-or-vm-for-production/203567)

<div class="topic-metadata">

**Author:** [@Petr.Simik](https://discuss.elastic.co/u/Petr.Simik)\
**Replies:** 6\
**Last updated:** [October 21, 2019, 6:48am UTC](https://discuss.elastic.co/t/elastic-cluster-docker-or-vm-for-production/203567 "2019-10-21T06:48:10Z")

</div>

We have to use 3 old servers as Elasticsearch cluster. Each server is CPU(s): 32 Thread(s) per core: 2 Model name: Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz Memory: 94GB …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1117)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1119)
