# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1323

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1324

---

## [Incongruencies between queries and slow logs](https://discuss.elastic.co/t/incongruencies-between-queries-and-slow-logs/178053)

<div class="topic-metadata">

**Author:** [@Manofwax](https://discuss.elastic.co/u/Manofwax)\
**Replies:** 0\
**Last updated:** [April 23, 2019, 2:18pm UTC](https://discuss.elastic.co/t/incongruencies-between-queries-and-slow-logs/178053 "2019-04-23T14:18:06Z")

</div>

Hello, I'm running elasticsearch 6.5.4 with only one node and I've configured slow log to log all queries. I've found some incongruencies between the query I'm running and the one that is logged in slow log. Examples: G…

---

## [How to create continuous backup on elasticsearch](https://discuss.elastic.co/t/how-to-create-continuous-backup-on-elasticsearch/178049)

<div class="topic-metadata">

**Author:** [@Sukanta\_Saha](https://discuss.elastic.co/u/Sukanta_Saha)\
**Replies:** 1\
**Last updated:** [April 23, 2019, 1:59pm UTC](https://discuss.elastic.co/t/how-to-create-continuous-backup-on-elasticsearch/178049 "2019-04-23T13:59:50Z")

</div>

Hi , We are using elasticsearch-5.4.0 with 3 master nodes and even no. of data nodes (2,4,6,8 ...). For backup we are using repository-s3 for aws environment and repository-azure for azure environment . question is ho…

---

## [No alive nodes found in cluster](https://discuss.elastic.co/t/no-alive-nodes-found-in-cluster/178032)

<div class="topic-metadata">

**Author:** [@Sulcalibur](https://discuss.elastic.co/u/Sulcalibur)\
**Replies:** 5\
**Last updated:** [April 23, 2019, 1:33pm UTC](https://discuss.elastic.co/t/no-alive-nodes-found-in-cluster/178032 "2019-04-23T13:33:44Z")

</div>

I have installed Elasticsearch on my Digital Ocean Plesk server to work with Active Collab. It all seems fine apart from after a few seconds it seems to stop. Trying to keep the Elasticsearch nodes alive but it keeps st…

---

## [Is there any solution for Index federation?](https://discuss.elastic.co/t/is-there-any-solution-for-index-federation/177234)

<div class="topic-metadata">

**Author:** [@weizijun](https://discuss.elastic.co/u/weizijun)\
**Replies:** 3\
**Last updated:** [April 23, 2019, 1:08pm UTC](https://discuss.elastic.co/t/is-there-any-solution-for-index-federation/177234 "2019-04-23T13:08:06Z")

</div>

Our Elasticsearch Nodes are more then 2000. we create some clusters for different use case. As search federation solution can use the Cross-cluster search. Is there any solution for Index federation? I think Tribe Node…

---

## [Pulling more than 10,000 records](https://discuss.elastic.co/t/pulling-more-than-10-000-records/178040)

<div class="topic-metadata">

**Author:** [@heenasxn](https://discuss.elastic.co/u/heenasxn)\
**Replies:** 1\
**Last updated:** [April 23, 2019, 12:26pm UTC](https://discuss.elastic.co/t/pulling-more-than-10-000-records/178040 "2019-04-23T12:26:37Z")

</div>

Suppose 30,000 get filtered after applying some search. Due to max limit of records I could only see 10,000 records at a time. What if I want to see records present on 15,000 number. Is there any way to see records beyo…

---

## [Java HLClient and "include\_type\_name" in migration from 6.7.1 to 7.0.0](https://discuss.elastic.co/t/java-hlclient-and-include-type-name-in-migration-from-6-7-1-to-7-0-0/178033)

<div class="topic-metadata">

**Author:** [@Vasily\_RW](https://discuss.elastic.co/u/Vasily_RW)\
**Replies:** 0\
**Last updated:** [April 23, 2019, 11:59am UTC](https://discuss.elastic.co/t/java-hlclient-and-include-type-name-in-migration-from-6-7-1-to-7-0-0/178033 "2019-04-23T11:59:15Z")

</div>

After upgrading the Java client to 7.0.0 (the database is still 6.7.1) I am getting a "\[types removal\]" warning in Java High Level REST Client. Is there a way to explicitly specify "include\_type\_name" in type-less API, …

---

## [Esrally is now report support es7?](https://discuss.elastic.co/t/esrally-is-now-report-support-es7/177412)

<div class="topic-metadata">

**Author:** [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Replies:** 8\
**Last updated:** [April 23, 2019, 10:16am UTC](https://discuss.elastic.co/t/esrally-is-now-report-support-es7/177412 "2019-04-23T10:16:48Z")

</div>

esrally is now support es7? when i use esrally report to elasticsearch esrally test with http\_logs can't put mapping in es7 log \[2019-04-18T15:44:07,457\]\[DEBUG\]\[o.e.a.a.i.t.p.TransportPutIndexTemplateAction\] \[node-3\]…

---

## [2.5 second startup time for Java elasticsearch client on AWS Lambda](https://discuss.elastic.co/t/2-5-second-startup-time-for-java-elasticsearch-client-on-aws-lambda/177674)

<div class="topic-metadata">

**Author:** [@evdh](https://discuss.elastic.co/u/evdh)\
**Replies:** 2\
**Last updated:** [April 23, 2019, 10:12am UTC](https://discuss.elastic.co/t/2-5-second-startup-time-for-java-elasticsearch-client-on-aws-lambda/177674 "2019-04-23T10:12:51Z")

</div>

We're using AWS Lambda (Java) and the elasticsearch client to connect to a hosted elasticsearch instance on AWS. I encounter a long wait on the first request of about 2.5 seconds (on top of a cold start). After that it i…

---

## [Unable to search specific email addresses](https://discuss.elastic.co/t/unable-to-search-specific-email-addresses/177475)

<div class="topic-metadata">

**Author:** [@mccrakem](https://discuss.elastic.co/u/mccrakem)\
**Replies:** 2\
**Last updated:** [April 23, 2019, 9:47am UTC](https://discuss.elastic.co/t/unable-to-search-specific-email-addresses/177475 "2019-04-23T09:47:37Z")

</div>

Hi I'm trying to search in Kibana for a users email address In the postfix logs I can see the email address FIRSTNAME.O'SURNAME@COMPANY.COM I can see a large number of emails for other users from @COMPANY.COM The on…

---

## [Upgrading elasticsearch from 6.5.1 to 7.0.0 in docker](https://discuss.elastic.co/t/upgrading-elasticsearch-from-6-5-1-to-7-0-0-in-docker/177982)

<div class="topic-metadata">

**Author:** [@SofianeB](https://discuss.elastic.co/u/SofianeB)\
**Replies:** 0\
**Last updated:** [April 23, 2019, 8:30am UTC](https://discuss.elastic.co/t/upgrading-elasticsearch-from-6-5-1-to-7-0-0-in-docker/177982 "2019-04-23T08:30:59Z")

</div>

Hi, I have elk running in docker containers (6.5.1). Is there a way to upgrade to 7.0.0 without pulling a new image?

---

## [Cluster meta-information about closed Index](https://discuss.elastic.co/t/cluster-meta-information-about-closed-index/177924)

<div class="topic-metadata">

**Author:** [@Todd](https://discuss.elastic.co/u/Todd)\
**Replies:** 2\
**Last updated:** [April 23, 2019, 7:44am UTC](https://discuss.elastic.co/t/cluster-meta-information-about-closed-index/177924 "2019-04-23T07:44:28Z")

</div>

Hi, If the indexs are closed, will the amount of meta-information data of their shards decrease in the global cluster meta data? What is included in the cluster meta information? And are there any articles about it?

---

## [How to handle dot in field names in ES 7.0](https://discuss.elastic.co/t/how-to-handle-dot-in-field-names-in-es-7-0/176511)

<div class="topic-metadata">

**Author:** [@shanky1997](https://discuss.elastic.co/u/shanky1997)\
**Replies:** 7\
**Last updated:** [April 23, 2019, 7:40am UTC](https://discuss.elastic.co/t/how-to-handle-dot-in-field-names-in-es-7-0/176511 "2019-04-23T07:40:12Z")

</div>

I was recently hit by the fieldname-with-dots issue in ES. I search on google but found the answer for ES 2.X version while for other version none of the option work for me. execution.command = /bin/bash execution.com…

---

## [How to build Elasticsearch plugin with graddle](https://discuss.elastic.co/t/how-to-build-elasticsearch-plugin-with-graddle/177117)

<div class="topic-metadata">

**Author:** [@dbakti7](https://discuss.elastic.co/u/dbakti7)\
**Replies:** 5\
**Last updated:** [April 23, 2019, 6:33am UTC](https://discuss.elastic.co/t/how-to-build-elasticsearch-plugin-with-graddle/177117 "2019-04-23T06:33:47Z")

</div>

Is there any good documentation or discussion thread with instructions on how to build Elasticsearch plugin with graddle? graddle assemble from root directory seems to be only building Elasticsearch and excludes the plu…

---

## [Prefix match phrase filter query on the keys returned from terms aggregation](https://discuss.elastic.co/t/prefix-match-phrase-filter-query-on-the-keys-returned-from-terms-aggregation/177705)

<div class="topic-metadata">

**Author:** [@Vamshi\_Sai](https://discuss.elastic.co/u/Vamshi_Sai)\
**Replies:** 3\
**Last updated:** [April 23, 2019, 6:24am UTC](https://discuss.elastic.co/t/prefix-match-phrase-filter-query-on-the-keys-returned-from-terms-aggregation/177705 "2019-04-23T06:24:28Z")

</div>

I have terms query and the result looks something like below "buckets": \[ { "key": "KEY", "count": 20 }, { "key": "LOCK", "count": 30 } \] Now the requirement is to filter those buckets whose key starts with a …

---

## [Set the cookie in elasticsearch](https://discuss.elastic.co/t/set-the-cookie-in-elasticsearch/177800)

<div class="topic-metadata">

**Author:** [@MKU](https://discuss.elastic.co/u/MKU)\
**Replies:** 3\
**Last updated:** [April 23, 2019, 6:12am UTC](https://discuss.elastic.co/t/set-the-cookie-in-elasticsearch/177800 "2019-04-23T06:12:16Z")

</div>

Hi, I modified restController.java to provide token based Oauth authentication,How do i set the cookie here . Is it Xpack specific?

---

## [Unable to Install Marvel on ES 6.6.2](https://discuss.elastic.co/t/unable-to-install-marvel-on-es-6-6-2/177950)

<div class="topic-metadata">

**Author:** [@Balmukund](https://discuss.elastic.co/u/Balmukund)\
**Replies:** 1\
**Last updated:** [April 23, 2019, 6:11am UTC](https://discuss.elastic.co/t/unable-to-install-marvel-on-es-6-6-2/177950 "2019-04-23T06:11:59Z")

</div>

I tried installing Marvel on ES 6.6.2 both the ways Online & Offline but could not succeed. Please find below logs for offline installation. Exception in thread "main" java.lang.IllegalArgumentException: Unknown proper…

---

## [Connect to Elasticsearch using Java High Level Client](https://discuss.elastic.co/t/connect-to-elasticsearch-using-java-high-level-client/177917)

<div class="topic-metadata">

**Author:** [@Kurezza](https://discuss.elastic.co/u/Kurezza)\
**Replies:** 2\
**Last updated:** [April 23, 2019, 5:31am UTC](https://discuss.elastic.co/t/connect-to-elasticsearch-using-java-high-level-client/177917 "2019-04-23T05:31:35Z")

</div>

Hi, I'm new to Elasticsearch. I'm trying to connect Java to Elasticsearch using Java High Level Client. However, I always got an IOException. I was sure that my Elasticsearch is up and running. Here is the code I used. M…

---

## [Pagination over aggregation result](https://discuss.elastic.co/t/pagination-over-aggregation-result/177935)

<div class="topic-metadata">

**Author:** [@Vamshi\_Sai](https://discuss.elastic.co/u/Vamshi_Sai)\
**Replies:** 1\
**Last updated:** [April 23, 2019, 5:46am UTC](https://discuss.elastic.co/t/pagination-over-aggregation-result/177935 "2019-04-23T05:46:24Z")

</div>

Is there a pagination support over aggregated result. For example if the terms-aggregation gives all the results in some sorted order and I need to get only 50 of them at a time as the user is issuing more requests. This…

---

## [Getting unauthorised saml user error](https://discuss.elastic.co/t/getting-unauthorised-saml-user-error/176605)

<div class="topic-metadata">

**Author:** [@Ronnie16](https://discuss.elastic.co/u/Ronnie16)\
**Replies:** 8\
**Last updated:** [April 23, 2019, 5:20am UTC](https://discuss.elastic.co/t/getting-unauthorised-saml-user-error/176605 "2019-04-23T05:20:29Z")

</div>

I'm implementing SAML for elasticsearch cluster. After hitting kibana url I get redirected to IDP saml page for login but after login I get below error in browser - \< {"statusCode":401,"error":"Unauthorized","message":"…

---

## [How to remove data, config and log folder while uninstalling elasticsearch](https://discuss.elastic.co/t/how-to-remove-data-config-and-log-folder-while-uninstalling-elasticsearch/177926)

<div class="topic-metadata">

**Author:** [@Karthik.krishnan](https://discuss.elastic.co/u/Karthik.krishnan)\
**Replies:** 2\
**Last updated:** [April 23, 2019, 3:56am UTC](https://discuss.elastic.co/t/how-to-remove-data-config-and-log-folder-while-uninstalling-elasticsearch/177926 "2019-04-23T03:56:15Z")

</div>

Hi Team, When we uninstall elasticsearch it removes from the Program Files but not from the data, log and config directories. I want to cleanup all the directories used by elasticsearch, please let us know the best op…

---

## [Open source alerting with elasticSearch data](https://discuss.elastic.co/t/open-source-alerting-with-elasticsearch-data/177845)

<div class="topic-metadata">

**Author:** [@Prakash\_Rathod](https://discuss.elastic.co/u/Prakash_Rathod)\
**Replies:** 1\
**Last updated:** [April 23, 2019, 2:22am UTC](https://discuss.elastic.co/t/open-source-alerting-with-elasticsearch-data/177845 "2019-04-23T02:22:46Z")

</div>

Hello guys, Is there any open source tools available which i can use for alerting along with elasticsearch data?

---

## [Trying to change a fields name](https://discuss.elastic.co/t/trying-to-change-a-fields-name/177773)

<div class="topic-metadata">

**Author:** [@iukea](https://discuss.elastic.co/u/iukea)\
**Replies:** 9\
**Last updated:** [April 23, 2019, 2:17am UTC](https://discuss.elastic.co/t/trying-to-change-a-fields-name/177773 "2019-04-23T02:17:45Z")

</div>

Hello I currently have in my elasticsearch index "type": "NGINX", how can I change it from "type": "NGINX", to "type": "x", in the current index.

---

## [Find age range according to Birthdate](https://discuss.elastic.co/t/find-age-range-according-to-birthdate/177691)

<div class="topic-metadata">

**Author:** [@chan\_1di](https://discuss.elastic.co/u/chan_1di)\
**Replies:** 14\
**Last updated:** [April 22, 2019, 10:35pm UTC](https://discuss.elastic.co/t/find-age-range-according-to-birthdate/177691 "2019-04-22T22:35:38Z")

</div>

My date of birth is storing as this "1995-08-10 00:00:00.314" ANd now I want to write a search query so that it can return the data according to the age of the person. My condition is I want to return data within 21-31 …

---

## [Still Getting Data after filebeat and logstash are killed](https://discuss.elastic.co/t/still-getting-data-after-filebeat-and-logstash-are-killed/177802)

<div class="topic-metadata">

**Author:** [@shrikantgulia](https://discuss.elastic.co/u/shrikantgulia)\
**Replies:** 5\
**Last updated:** [April 22, 2019, 7:54pm UTC](https://discuss.elastic.co/t/still-getting-data-after-filebeat-and-logstash-are-killed/177802 "2019-04-22T19:54:49Z")

</div>

Hello, I am still getting data in elasticsearch index after killing logstash and filebeat and when i am checking the PID of logsatsh and filebeat its showing that both are not working but i am still getting the data Ca…

---

## [Cpu usage is high](https://discuss.elastic.co/t/cpu-usage-is-high/177888)

<div class="topic-metadata">

**Author:** [@Arthi](https://discuss.elastic.co/u/Arthi)\
**Replies:** 1\
**Last updated:** [April 22, 2019, 6:37pm UTC](https://discuss.elastic.co/t/cpu-usage-is-high/177888 "2019-04-22T18:37:00Z")

</div>

Hi, We are using AWS managed Elasticsearch of instance type r4.xlarge with 4 nodes available in 2 zones and EBS storage size per node is 1000GB. Version of Elasticsearch is 6.2. Data streaming into ES is done via logs…

---

## [Curator filter to exclude system indicies](https://discuss.elastic.co/t/curator-filter-to-exclude-system-indicies/177890)

<div class="topic-metadata">

**Author:** [@Jeremy\_Foran](https://discuss.elastic.co/u/Jeremy_Foran)\
**Replies:** 0\
**Last updated:** [April 22, 2019, 6:31pm UTC](https://discuss.elastic.co/t/curator-filter-to-exclude-system-indicies/177890 "2019-04-22T18:31:05Z")

</div>

Wanted to share my filter that ignores all indexes that start with the "." character, like ".kibana" for example. filters: - filtertype: pattern kind: regex value: '^\\\\..\*$' exclude: True

---

## [What is different with Json and XContentBuilder,how to use it is currectly?](https://discuss.elastic.co/t/what-is-different-with-json-and-xcontentbuilder-how-to-use-it-is-currectly/177885)

<div class="topic-metadata">

**Author:** [@ChenSijia](https://discuss.elastic.co/u/ChenSijia)\
**Replies:** 0\
**Last updated:** [April 22, 2019, 5:12pm UTC](https://discuss.elastic.co/t/what-is-different-with-json-and-xcontentbuilder-how-to-use-it-is-currectly/177885 "2019-04-22T17:12:57Z")

</div>

First, I set mapping use kibana like this: PUT location { "mappings": { "city": { "properties": { "city":{ "type": "text" }, "polygon":{ "type":"geo\_shape" }, "time": { "type": "date" } } } } } git@github.com:SenalChen…

---

## [Join two csv file and modify the data](https://discuss.elastic.co/t/join-two-csv-file-and-modify-the-data/177742)

<div class="topic-metadata">

**Author:** [@koti](https://discuss.elastic.co/u/koti)\
**Replies:** 3\
**Last updated:** [April 22, 2019, 4:33pm UTC](https://discuss.elastic.co/t/join-two-csv-file-and-modify-the-data/177742 "2019-04-22T16:33:22Z")

</div>

I have two CSV files . I want to merge two CSV files based on common column Location and get the DEPT value in o/p . Please help me. CSV1 Location Maximum Dept High School1 25 High School2 …

---

## [Replication of cluster data](https://discuss.elastic.co/t/replication-of-cluster-data/177866)

<div class="topic-metadata">

**Author:** [@leoberbert](https://discuss.elastic.co/u/leoberbert)\
**Replies:** 1\
**Last updated:** [April 22, 2019, 4:13pm UTC](https://discuss.elastic.co/t/replication-of-cluster-data/177866 "2019-04-22T16:13:31Z")

</div>

Dear, I have 4 nodes, where node 1 is the master and the others are data type. I have noticed that the same disk space occupied by data nodes are the same, ie they all have the same information. This is correct? I have…

---

## [Elasticsearch: Geo\_spacial search in a list of nested objects](https://discuss.elastic.co/t/elasticsearch-geo-spacial-search-in-a-list-of-nested-objects/177769)

<div class="topic-metadata">

**Author:** [@rachid\_59](https://discuss.elastic.co/u/rachid_59)\
**Replies:** 2\
**Last updated:** [April 22, 2019, 3:13pm UTC](https://discuss.elastic.co/t/elasticsearch-geo-spacial-search-in-a-list-of-nested-objects/177769 "2019-04-22T15:13:10Z")

</div>

I'm using Elasticsearch 6.3 and spring-data-elasticsearch, I have the index restaurant having the mapping below : { "mapping": { "restaurant": { "properties": { "id": { "type": "keyword" …

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1322)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1324)
