# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1148

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1149

---

## [How to fix hitting maximum shards open error](https://discuss.elastic.co/t/how-to-fix-hitting-maximum-shards-open-error/200502)

<div class="topic-metadata">

**Author:** [@yuecong](https://discuss.elastic.co/u/yuecong)\
**Replies:** 9\
**Last updated:** [September 22, 2019, 8:12am UTC](https://discuss.elastic.co/t/how-to-fix-hitting-maximum-shards-open-error/200502 "2019-09-22T08:12:26Z")

</div>

I got the following error when writing docs to Elasticseach cluster. it works till today. I guess I need to increase some limit, but can not find any doc on this yet. Validation Failed: 1: this action would add \[2\] tot…

---

## [Object mapping issue](https://discuss.elastic.co/t/object-mapping-issue/195739)

<div class="topic-metadata">

**Author:** [@Osama\_Tariq](https://discuss.elastic.co/u/Osama_Tariq)\
**Replies:** 20\
**Last updated:** [September 22, 2019, 12:54am UTC](https://discuss.elastic.co/t/object-mapping-issue/195739 "2019-09-22T00:54:27Z")

</div>

Hi, I am getting following issue in elasticsearch. Object mapping for \[ClientIP\] tried to parse field \[ClientIP\] as object. How do I fixed configuration to adjust the mapping ? \[2019-08-19T16:03:30,213\]\[DEBUG\]\[o.e.a.b.…

---

## [Help with Ruby code please (Using user input in searches)](https://discuss.elastic.co/t/help-with-ruby-code-please-using-user-input-in-searches/200545)

<div class="topic-metadata">

**Author:** [@michaelberg](https://discuss.elastic.co/u/michaelberg)\
**Replies:** 0\
**Last updated:** [September 21, 2019, 7:44pm UTC](https://discuss.elastic.co/t/help-with-ruby-code-please-using-user-input-in-searches/200545 "2019-09-21T19:44:48Z")

</div>

puts "\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*\*" puts "\* This program will search Elastic Search Cloud \*" puts "\* based on a single field name and a single value \*" puts "\* for the given field name …

---

## [Mapping for query life events of user](https://discuss.elastic.co/t/mapping-for-query-life-events-of-user/200541)

<div class="topic-metadata">

**Author:** [@aess](https://discuss.elastic.co/u/aess)\
**Replies:** 0\
**Last updated:** [September 21, 2019, 5:57pm UTC](https://discuss.elastic.co/t/mapping-for-query-life-events-of-user/200541 "2019-09-21T17:57:51Z")

</div>

Mapping for time-series data Alind · Lecture 13 · a minute ago Hi, I am trying to create a mapping where intent is to record events for a user and aggregate them based on any given condition, for example a user …

---

## [120s Timeout on Elasticsearch Queries](https://discuss.elastic.co/t/120s-timeout-on-elasticsearch-queries/199735)

<div class="topic-metadata">

**Author:** [@seth.yes](https://discuss.elastic.co/u/seth.yes)\
**Replies:** 5\
**Last updated:** [September 18, 2019, 12:41pm UTC](https://discuss.elastic.co/t/120s-timeout-on-elasticsearch-queries/199735 "2019-09-18T12:41:12Z")

</div>

I have two clusters (ES 7.3.1) that are hosted by an internal team here at my org. Each cluster has 6 data nodes, three master nodes, and one cluster has two client nodes that perform searches against both clusters simul…

---

## [Want to extract day number and day time from current data](https://discuss.elastic.co/t/want-to-extract-day-number-and-day-time-from-current-data/200530)

<div class="topic-metadata">

**Author:** [@shahrukh](https://discuss.elastic.co/u/shahrukh)\
**Replies:** 0\
**Last updated:** [September 21, 2019, 1:29pm UTC](https://discuss.elastic.co/t/want-to-extract-day-number-and-day-time-from-current-data/200530 "2019-09-21T13:29:16Z")

</div>

I am reading cloudfront logs using logstash and storing the data into elasticsearch, the process works fines and stores all the required fields, so far I have 11M records in cluster. Now for the statistics purposes I fee…

---

## [Probable memory leak: Heap utilization stuck at ~max heap for idle cluster](https://discuss.elastic.co/t/probable-memory-leak-heap-utilization-stuck-at-max-heap-for-idle-cluster/193785)

<div class="topic-metadata">

**Author:** [@pokaleshrey](https://discuss.elastic.co/u/pokaleshrey)\
**Replies:** 9\
**Last updated:** [September 21, 2019, 10:39am UTC](https://discuss.elastic.co/t/probable-memory-leak-heap-utilization-stuck-at-max-heap-for-idle-cluster/193785 "2019-09-21T10:39:05Z")

</div>

Cluster setup : Version : 7.1.1 3 master node 3 data node (16core, 64Mb Ram, Xms=Xmx=12Gb each) 2 coordinating node 650 indexes with a shard each. Total data=~2Tb Query: All my data nodes are stuck at ~10Gb heap u…

---

## [Cluster-issue with import and query at same time](https://discuss.elastic.co/t/cluster-issue-with-import-and-query-at-same-time/200518)

<div class="topic-metadata">

**Author:** [@Yashwantbokadia](https://discuss.elastic.co/u/Yashwantbokadia)\
**Replies:** 1\
**Last updated:** [September 21, 2019, 7:35am UTC](https://discuss.elastic.co/t/cluster-issue-with-import-and-query-at-same-time/200518 "2019-09-21T07:35:46Z")

</div>

Hello All, I'm importing data on my cluster using elasticdump in bulk, I want to run query on Cluster while the import is going on, but when I do that, the import stops with an error "heap out of memory". I want to comp…

---

## [Related to node query cache](https://discuss.elastic.co/t/related-to-node-query-cache/200516)

<div class="topic-metadata">

**Author:** [@Yashwantbokadia](https://discuss.elastic.co/u/Yashwantbokadia)\
**Replies:** 0\
**Last updated:** [September 21, 2019, 7:18am UTC](https://discuss.elastic.co/t/related-to-node-query-cache/200516 "2019-09-21T07:18:25Z")

</div>

How to disable Filter cache in elasticsearch-6.7? if possible give the complete details on how to do that. Thanks in advance.

---

## [Case-sensitive search and custom analyzer](https://discuss.elastic.co/t/case-sensitive-search-and-custom-analyzer/200399)

<div class="topic-metadata">

**Author:** [@Mohammad.ali](https://discuss.elastic.co/u/Mohammad.ali)\
**Replies:** 2\
**Last updated:** [September 20, 2019, 2:05pm UTC](https://discuss.elastic.co/t/case-sensitive-search-and-custom-analyzer/200399 "2019-09-20T14:05:15Z")

</div>

Hello every one I have been trying to activate case sensitive search in elasticsearch and what i found is it depend on type of analyzer. so i create a custom analyzer: PUT test\_index { "settings": { "analysis": { "…

---

## [What happens when we do service elasticsearch stop](https://discuss.elastic.co/t/what-happens-when-we-do-service-elasticsearch-stop/200294)

<div class="topic-metadata">

**Author:** [@Parvez](https://discuss.elastic.co/u/Parvez)\
**Replies:** 3\
**Last updated:** [September 21, 2019, 12:29am UTC](https://discuss.elastic.co/t/what-happens-when-we-do-service-elasticsearch-stop/200294 "2019-09-21T00:29:40Z")

</div>

I have 3 node cluster configure in AWS Cloud which has ASG enable as shown in image below . Let say \[ node-1, node-2, node3\] are the 3 nodes and are hosted under same vpc subnet on different ip's. When i login to one …

---

## [Scroll setting on reindex task](https://discuss.elastic.co/t/scroll-setting-on-reindex-task/200500)

<div class="topic-metadata">

**Author:** [@viniciof](https://discuss.elastic.co/u/viniciof)\
**Replies:** 0\
**Last updated:** [September 20, 2019, 10:08pm UTC](https://discuss.elastic.co/t/scroll-setting-on-reindex-task/200500 "2019-09-20T22:08:37Z")

</div>

Hi all, I'm looking at this doc: Scroll | Elasticsearch Reference \[5.6\] | Elastic Scroll While a search request returns a single “page” of results, the scroll API can be used to retrieve large numbers of results (…

---

## [In which order matched\_queries are reported?](https://discuss.elastic.co/t/in-which-order-matched-queries-are-reported/200498)

<div class="topic-metadata">

**Author:** [@germax](https://discuss.elastic.co/u/germax)\
**Replies:** 0\
**Last updated:** [September 20, 2019, 9:52pm UTC](https://discuss.elastic.co/t/in-which-order-matched-queries-are-reported/200498 "2019-09-20T21:52:02Z")

</div>

Names of named queries are written to "matched\_queries" field in the search output. Is it true that the order of names corresponds to the score the named query has? After some testing it seems sorted (highest -\> lowest) …

---

## [Wildcard and filter in watcher](https://discuss.elastic.co/t/wildcard-and-filter-in-watcher/200481)

<div class="topic-metadata">

**Author:** [@t3fsx](https://discuss.elastic.co/u/t3fsx)\
**Replies:** 0\
**Last updated:** [September 20, 2019, 7:29pm UTC](https://discuss.elastic.co/t/wildcard-and-filter-in-watcher/200481 "2019-09-20T19:29:10Z")

</div>

"query": { "bool": { "filter": \[ { "term": { "event.type": "fruits" } }, { "term": { "fruit"…

---

## [Aggregations for dynamic key value pairs](https://discuss.elastic.co/t/aggregations-for-dynamic-key-value-pairs/200083)

<div class="topic-metadata">

**Author:** [@bkdavis](https://discuss.elastic.co/u/bkdavis)\
**Replies:** 1\
**Last updated:** [September 20, 2019, 6:47pm UTC](https://discuss.elastic.co/t/aggregations-for-dynamic-key-value-pairs/200083 "2019-09-20T18:47:20Z")

</div>

Trying to figure out the best way to 'count' values for aggregating dynamic data. For instance the 2 records below is a sampling of data where 'key' data is not static. Some records may have height:21 and width:28 whil…

---

## [Curator not actually deleting indexes](https://discuss.elastic.co/t/curator-not-actually-deleting-indexes/200471)

<div class="topic-metadata">

**Author:** [@erikmathis](https://discuss.elastic.co/u/erikmathis)\
**Replies:** 1\
**Last updated:** [September 20, 2019, 6:28pm UTC](https://discuss.elastic.co/t/curator-not-actually-deleting-indexes/200471 "2019-09-20T18:28:20Z")

</div>

curator it showing that it found and deleted the index, but the index isnt actually being deleted. Also this should of found two indexes, but it only found one. This is for es 7.2.0 2019-09-20 04:00:07,991 INFO P…

---

## [Best way to model documents without needing of join](https://discuss.elastic.co/t/best-way-to-model-documents-without-needing-of-join/197561)

<div class="topic-metadata">

**Author:** [@pedroe](https://discuss.elastic.co/u/pedroe)\
**Replies:** 2\
**Last updated:** [September 20, 2019, 5:29pm UTC](https://discuss.elastic.co/t/best-way-to-model-documents-without-needing-of-join/197561 "2019-09-20T17:29:54Z")

</div>

I have the following model in a traditional relational database: Restaurant \[id, name, address, phone, etc.\] RestaurantMenu \[restaurant\_id, menu\_item\_name, menu\_item\_price\] In Restaurant I store the information about …

---

## [How does geoIP for private IPaddresses work?](https://discuss.elastic.co/t/how-does-geoip-for-private-ipaddresses-work/199699)

<div class="topic-metadata">

**Author:** [@Rosho](https://discuss.elastic.co/u/Rosho)\
**Replies:** 4\
**Last updated:** [September 20, 2019, 4:58pm UTC](https://discuss.elastic.co/t/how-does-geoip-for-private-ipaddresses-work/199699 "2019-09-20T16:58:39Z")

</div>

Hi I want to understand how does the GeoIP work. I want to use it to track employees: If 1 of my private IPs is out of town then an alarm must be set. My first idea (as I am a newbie in Elastic) was of correlating the…

---

## [Elasticsearch Watcher - Publish notifications to Amazon SNS](https://discuss.elastic.co/t/elasticsearch-watcher-publish-notifications-to-amazon-sns/200297)

<div class="topic-metadata">

**Author:** [@chandra2037](https://discuss.elastic.co/u/chandra2037)\
**Replies:** 1\
**Last updated:** [September 20, 2019, 4:21pm UTC](https://discuss.elastic.co/t/elasticsearch-watcher-publish-notifications-to-amazon-sns/200297 "2019-09-20T16:21:47Z")

</div>

Has anyone tried publishing notifications to Amazon SNS from Elasticsearch Advanced Watchers? Is it even possible? If it is possible, should we use webhook action? What are the things that need to be configured? Any he…

---

## [Elastic 7.1 weird index rate behavior](https://discuss.elastic.co/t/elastic-7-1-weird-index-rate-behavior/196498)

<div class="topic-metadata">

**Author:** [@Andrii](https://discuss.elastic.co/u/Andrii)\
**Replies:** 4\
**Last updated:** [September 20, 2019, 4:21pm UTC](https://discuss.elastic.co/t/elastic-7-1-weird-index-rate-behavior/196498 "2019-09-20T16:21:03Z")

</div>

I have a cluster configured in Kubernetes by Elastic Operator. all components of version 7.1. I'm sending logs from Kafka topic to Elastic with KafkaConnect And I faced with strange behavior. When I started KafkaConnect…

---

## [Elastic cluster slow down](https://discuss.elastic.co/t/elastic-cluster-slow-down/200087)

<div class="topic-metadata">

**Author:** [@putharekulu](https://discuss.elastic.co/u/putharekulu)\
**Replies:** 5\
**Last updated:** [September 20, 2019, 3:21pm UTC](https://discuss.elastic.co/t/elastic-cluster-slow-down/200087 "2019-09-20T15:21:31Z")

</div>

Hi, I have a 6 node elastic cluster each with c5.4xlarge instances and writes to EBS volume with 5TB \[10000 IOPS\]. We only store 3 days worth of data and have a nightly job that terminates indexes older than 3 days.This…

---

## [Updating records and indices](https://discuss.elastic.co/t/updating-records-and-indices/200450)

<div class="topic-metadata">

**Author:** [@edster](https://discuss.elastic.co/u/edster)\
**Replies:** 0\
**Last updated:** [September 20, 2019, 3:16pm UTC](https://discuss.elastic.co/t/updating-records-and-indices/200450 "2019-09-20T15:16:39Z")

</div>

Is there a way to update records in indices if they don't exist. Currently I've seen that values changed within an index get updated, however, if a record doesn't exist in a file, for example, the record is not removed. …

---

## [Elasticsearch es-spark too many request](https://discuss.elastic.co/t/elasticsearch-es-spark-too-many-request/199684)

<div class="topic-metadata">

**Author:** [@Vishnu\_Singhal](https://discuss.elastic.co/u/Vishnu_Singhal)\
**Replies:** 4\
**Last updated:** [September 20, 2019, 2:52pm UTC](https://discuss.elastic.co/t/elasticsearch-es-spark-too-many-request/199684 "2019-09-20T14:52:02Z")

</div>

I'm getting continuously org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 109896.0 failed 4 times, most recent failure: Lost task 0.3 in stage 109896.0 (TID 248952, 10.244.8.28, executo…

---

## [\</\> what is wrong with my search?](https://discuss.elastic.co/t/what-is-wrong-with-my-search/200447)

<div class="topic-metadata">

**Author:** [@Mohammadamin\_gheibi](https://discuss.elastic.co/u/Mohammadamin_gheibi)\
**Replies:** 0\
**Last updated:** [September 20, 2019, 2:40pm UTC](https://discuss.elastic.co/t/what-is-wrong-with-my-search/200447 "2019-09-20T14:40:17Z")

</div>

hello, everyone. I'm new in elastic search. I have a database with almost 100000 rows (each row is one product with name) I need to check if we have the same product in our database or not. I know that I indexed all row…

---

## [Kind of roll over index through index template?](https://discuss.elastic.co/t/kind-of-roll-over-index-through-index-template/200446)

<div class="topic-metadata">

**Author:** [@Uzo](https://discuss.elastic.co/u/Uzo)\
**Replies:** 0\
**Last updated:** [September 20, 2019, 2:40pm UTC](https://discuss.elastic.co/t/kind-of-roll-over-index-through-index-template/200446 "2019-09-20T14:40:14Z")

</div>

Hello. I want to have some time based indices but with the particularity that some data could be indexed into the past. I don't see how to achieve this using roll over index. Would index template be a good solution ? I…

---

## [What is the best and fatest way to insert json data into elasticsearch](https://discuss.elastic.co/t/what-is-the-best-and-fatest-way-to-insert-json-data-into-elasticsearch/200225)

<div class="topic-metadata">

**Author:** [@NAL](https://discuss.elastic.co/u/NAL)\
**Replies:** 2\
**Last updated:** [September 20, 2019, 8:10am UTC](https://discuss.elastic.co/t/what-is-the-best-and-fatest-way-to-insert-json-data-into-elasticsearch/200225 "2019-09-20T08:10:05Z")

</div>

Hi, I have many json files (about 200 per day, each file contains more than 300 000 lines) that i need to insert into elasticsearch index. I'm looking for a way to say to elasticsearch to get each json file in a folder…

---

## [Azure snapshot missing required setting: azure.client.default.account](https://discuss.elastic.co/t/azure-snapshot-missing-required-setting-azure-client-default-account/200308)

<div class="topic-metadata">

**Author:** [@Marcus\_Simonsen](https://discuss.elastic.co/u/Marcus_Simonsen)\
**Replies:** 1\
**Last updated:** [September 20, 2019, 1:28pm UTC](https://discuss.elastic.co/t/azure-snapshot-missing-required-setting-azure-client-default-account/200308 "2019-09-20T13:28:05Z")

</div>

Hello. I'm trying to provision azure snapshot repository as described here (not gcp as in example). https://www.elastic.co/guide/en/cloud-on-k8s/current/k8s-snapshot.html I have created the kubernetes secrets and veri…

---

## [JAVA Retrieve multimatch searchterm](https://discuss.elastic.co/t/java-retrieve-multimatch-searchterm/200425)

<div class="topic-metadata">

**Author:** [@NsrWissam](https://discuss.elastic.co/u/NsrWissam)\
**Replies:** 0\
**Last updated:** [September 20, 2019, 1:04pm UTC](https://discuss.elastic.co/t/java-retrieve-multimatch-searchterm/200425 "2019-09-20T13:04:15Z")

</div>

Elasticsearch version: 7.3.0 Fresh install or upgraded from other version? Fresh Java Library: HighLevel I am trying to retrieve the original searchterm inside a complex query which is wrapped inside a MultiSearchRequ…

---

## [Connecting Elasticsearch from SQL Server](https://discuss.elastic.co/t/connecting-elasticsearch-from-sql-server/200286)

<div class="topic-metadata">

**Author:** [@lmariselvam](https://discuss.elastic.co/u/lmariselvam)\
**Replies:** 1\
**Last updated:** [September 20, 2019, 12:43pm UTC](https://discuss.elastic.co/t/connecting-elasticsearch-from-sql-server/200286 "2019-09-20T12:43:09Z")

</div>

I would like to connect my Elasticsearch instance from Microsoft SQL Server to query the JSON data present in an index and process the queried data with Native JSON functions available in SQL Server. Is there any option…

---

## [Error when I want to get an access token](https://discuss.elastic.co/t/error-when-i-want-to-get-an-access-token/200380)

<div class="topic-metadata">

**Author:** [@K29](https://discuss.elastic.co/u/K29)\
**Replies:** 1\
**Last updated:** [September 20, 2019, 11:39am UTC](https://discuss.elastic.co/t/error-when-i-want-to-get-an-access-token/200380 "2019-09-20T11:39:51Z")

</div>

Hello, I'm starting to use ElasticSearch and I try to get a token access. For this, I use postman to test this request. method : POST endpoint : https://myID.europe-west1.gcp.cloud.es.io:9243/\_security/oauth2/token bod…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1147)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1149)
