# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1590

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1591

---

## [Can't get the longitude and latitude](https://discuss.elastic.co/t/cant-get-the-longitude-and-latitude/143183)

<div class="topic-metadata">

**Author:** [@sofian](https://discuss.elastic.co/u/sofian)\
**Replies:** 2\
**Last updated:** [August 6, 2018, 6:04pm UTC](https://discuss.elastic.co/t/cant-get-the-longitude-and-latitude/143183 "2018-08-06T18:04:26Z")

</div>

Hi everyone, I'm new in ELK. I created a script in python in order to generate over 100 persons with a random id , random long,lat and timestamps I stored them into mongoDB. i'm trying to generate a heatmap of the store…

---

## [Deleting only specific fields carrying PCI information from ELastic search indices](https://discuss.elastic.co/t/deleting-only-specific-fields-carrying-pci-information-from-elastic-search-indices/143199)

<div class="topic-metadata">

**Author:** [@ravish9370](https://discuss.elastic.co/u/ravish9370)\
**Replies:** 0\
**Last updated:** [August 6, 2018, 5:44pm UTC](https://discuss.elastic.co/t/deleting-only-specific-fields-carrying-pci-information-from-elastic-search-indices/143199 "2018-08-06T17:44:08Z")

</div>

HI All, I have an issue that starting 8 weeks ago , because of some code changes , PCI information start getting printed in WCS logs. Now that information is parsed into elastic search and can be seen in kibana. Our sec…

---

## [Elasticsearch Nested Aggregation](https://discuss.elastic.co/t/elasticsearch-nested-aggregation/143198)

<div class="topic-metadata">

**Author:** [@ercancavusoglu](https://discuss.elastic.co/u/ercancavusoglu)\
**Replies:** 0\
**Last updated:** [August 6, 2018, 5:24pm UTC](https://discuss.elastic.co/t/elasticsearch-nested-aggregation/143198 "2018-08-06T17:24:13Z")

</div>

I have some documents in Elasticsearch. I want to aggregate with tags equals 5 and sort by evaluationCount in aggregates data. I used min query at busEvaluationCount, but I want to aggregating for tags:5. I dont got it …

---

## [How do I query last 1 hour of data and order it based on time?](https://discuss.elastic.co/t/how-do-i-query-last-1-hour-of-data-and-order-it-based-on-time/143069)

<div class="topic-metadata">

**Author:** [@blueren](https://discuss.elastic.co/u/blueren)\
**Replies:** 1\
**Last updated:** [August 6, 2018, 5:02pm UTC](https://discuss.elastic.co/t/how-do-i-query-last-1-hour-of-data-and-order-it-based-on-time/143069 "2018-08-06T17:02:36Z")

</div>

Hello, I have data in ES such as: @timestamp --\> Timestamp field record.hostIP record.destIP record.port record.application etc... I would like to plot this on a graph in js and hence need time on the X axis and coun…

---

## [Query that Gives priority to different indexes](https://discuss.elastic.co/t/query-that-gives-priority-to-different-indexes/143194)

<div class="topic-metadata">

**Author:** [@net](https://discuss.elastic.co/u/net)\
**Replies:** 0\
**Last updated:** [August 6, 2018, 4:37pm UTC](https://discuss.elastic.co/t/query-that-gives-priority-to-different-indexes/143194 "2018-08-06T16:37:35Z")

</div>

I have four indexes: A, B, C, D Each index has a term field named "Word" i.e. Index A { "mappings": { "doc": { "properties": { "word": { "type": "keyword" } } } } }…

---

## [Hard geo query](https://discuss.elastic.co/t/hard-geo-query/143196)

<div class="topic-metadata">

**Author:** [@111126](https://discuss.elastic.co/u/111126)\
**Replies:** 0\
**Last updated:** [August 6, 2018, 4:38pm UTC](https://discuss.elastic.co/t/hard-geo-query/143196 "2018-08-06T16:38:07Z")

</div>

I have a GPS device, it moves around the country. It generates a large amount of data with coordinates that are sent and stored in the elastic. And I have a way points data (a static set of geo-coordinates). The GPS devi…

---

## [Does x-pack security support internationalization?](https://discuss.elastic.co/t/does-x-pack-security-support-internationalization/142141)

<div class="topic-metadata">

**Author:** [@Scopy](https://discuss.elastic.co/u/Scopy)\
**Replies:** 1\
**Last updated:** [August 6, 2018, 4:35pm UTC](https://discuss.elastic.co/t/does-x-pack-security-support-internationalization/142141 "2018-08-06T16:35:52Z")

</div>

As we all know, ELK is the most popular, reliable and fast search engine series at present, but does its subsidiary product kibana support internationalization?What should I set up if it is supported? And I'm very puzzl…

---

## [Watcher nested aggregations with "direction"](https://discuss.elastic.co/t/watcher-nested-aggregations-with-direction/140215)

<div class="topic-metadata">

**Author:** [@vgersh99](https://discuss.elastic.co/u/vgersh99)\
**Replies:** 17\
**Last updated:** [August 6, 2018, 4:10pm UTC](https://discuss.elastic.co/t/watcher-nested-aggregations-with-direction/140215 "2018-08-06T16:10:23Z")

</div>

Hi, need a bit of help here with the watcher aggregation. So far I've dealt with somewhat simplified aggs of the form: time-\>host-\>latency. Now I need to work on a bit of a different struct: time-\>host-\>direction(in/ou…

---

## [Length of the body of an object](https://discuss.elastic.co/t/length-of-the-body-of-an-object/143136)

<div class="topic-metadata">

**Author:** [@phia](https://discuss.elastic.co/u/phia)\
**Replies:** 1\
**Last updated:** [August 6, 2018, 3:56pm UTC](https://discuss.elastic.co/t/length-of-the-body-of-an-object/143136 "2018-08-06T15:56:10Z")

</div>

Hello guys, I have a JSON Object with the following structure: { "\_index": ... , ... , "\_source": { "JobResult": "OK", "JobSpecification": { "ColorsOfPages": { "Page1": { …

---

## [Struggling with date ranges](https://discuss.elastic.co/t/struggling-with-date-ranges/143191)

<div class="topic-metadata">

**Author:** [@brandondash](https://discuss.elastic.co/u/brandondash)\
**Replies:** 0\
**Last updated:** [August 6, 2018, 3:54pm UTC](https://discuss.elastic.co/t/struggling-with-date-ranges/143191 "2018-08-06T15:54:30Z")

</div>

I am trying to use a date range for a query using a field other than @timestamp. I can't figure out what I'm doing wrong. Here is the original query that works and uses @timestamp: { "size": 500, "query": { "bool":…

---

## [How to design ES for user-defined custom fields](https://discuss.elastic.co/t/how-to-design-es-for-user-defined-custom-fields/142663)

<div class="topic-metadata">

**Author:** [@Redkin](https://discuss.elastic.co/u/Redkin)\
**Replies:** 5\
**Last updated:** [August 6, 2018, 3:48pm UTC](https://discuss.elastic.co/t/how-to-design-es-for-user-defined-custom-fields/142663 "2018-08-06T15:48:41Z")

</div>

Let's say I have an index called "Contacts" Any contact belongs to a user, it'll have custom variables like this: { user\_id: 684498, name: "John Doe", custom\_age: 27, custom\_hobbies: \['painting'\], custom\_sour…

---

## [How to combine all tokens into one?](https://discuss.elastic.co/t/how-to-combine-all-tokens-into-one/143158)

<div class="topic-metadata">

**Author:** [@zouxiang](https://discuss.elastic.co/u/zouxiang)\
**Replies:** 10\
**Last updated:** [August 6, 2018, 3:17pm UTC](https://discuss.elastic.co/t/how-to-combine-all-tokens-into-one/143158 "2018-08-06T15:17:46Z")

</div>

Hello, I'm trying to find a token filter that can combine all the tokens into one. For example: the text "bags and shoes" ==\> 3 tokens: "bags" "and" "shoes" (use StandardTokenizer) "bags" "and" "shoes" ==\> …

---

## [Conceptual Question from a n00b - Nested documents or \_type?](https://discuss.elastic.co/t/conceptual-question-from-a-n00b-nested-documents-or-type/142988)

<div class="topic-metadata">

**Author:** [@oceannavigator](https://discuss.elastic.co/u/oceannavigator)\
**Replies:** 1\
**Last updated:** [August 6, 2018, 2:25pm UTC](https://discuss.elastic.co/t/conceptual-question-from-a-n00b-nested-documents-or-type/142988 "2018-08-06T14:25:37Z")

</div>

Hi Everyone. First post so please forgive any miscommunications and correct me if I'm doing something wrong. I have a JSON Firebase database for a social/dating app with some data that looks like this in it: +users …

---

## [No indices match pattern "filebeat-\*"](https://discuss.elastic.co/t/no-indices-match-pattern-filebeat/142938)

<div class="topic-metadata">

**Author:** [@arrigonfr](https://discuss.elastic.co/u/arrigonfr)\
**Replies:** 21\
**Last updated:** [August 6, 2018, 1:56pm UTC](https://discuss.elastic.co/t/no-indices-match-pattern-filebeat/142938 "2018-08-06T13:56:49Z")

</div>

Hello, we have installed ElasticSearch, Filebeat and Kibana 6.3.2 (No Logstash). We have them on different machines because that's how the installation was required by our boss. When I run curl /\_cat/indices?v what I ge…

---

## [How to add two \_type under same index. But both are having different Json data](https://discuss.elastic.co/t/how-to-add-two-type-under-same-index-but-both-are-having-different-json-data/143142)

<div class="topic-metadata">

**Author:** [@Sangeeth\_Kumar](https://discuss.elastic.co/u/Sangeeth_Kumar)\
**Replies:** 9\
**Last updated:** [August 6, 2018, 1:50pm UTC](https://discuss.elastic.co/t/how-to-add-two-type-under-same-index-but-both-are-having-different-json-data/143142 "2018-08-06T13:50:52Z")

</div>

I'm working on Elastic search to store and retrieve schema less json's. I have created index called "index002", I tried to create document with two different \_type. Both having different json and some keys are still exis…

---

## [Emergency, All shards failed for phase](https://discuss.elastic.co/t/emergency-all-shards-failed-for-phase/143161)

<div class="topic-metadata">

**Author:** [@ercancavusoglu](https://discuss.elastic.co/u/ercancavusoglu)\
**Replies:** 5\
**Last updated:** [August 6, 2018, 1:42pm UTC](https://discuss.elastic.co/t/emergency-all-shards-failed-for-phase/143161 "2018-08-06T13:42:12Z")

</div>

Hi, I am getting this error today. How can I handle this error? \[2018-08-06T13:22:17,640\]\[DEBUG\]\[o.e.a.s.TransportSearchAction\] \[machine\] All shards failed for phase: \[query\] org.elasticsearch.transport.RemoteTransport…

---

## [Fielddata](https://discuss.elastic.co/t/fielddata/143172)

<div class="topic-metadata">

**Author:** [@Fram\_Souza](https://discuss.elastic.co/u/Fram_Souza)\
**Replies:** 1\
**Last updated:** [August 6, 2018, 1:35pm UTC](https://discuss.elastic.co/t/fielddata/143172 "2018-08-06T13:35:32Z")

</div>

Why do fielddata still exist in new versions of Elasticsearch? Can not they be discontinued? Are doc\_values ​​currently unable to replace them? In what cases are fielddata necessary, since we can use doc\_value in a mu…

---

## [Java api index request](https://discuss.elastic.co/t/java-api-index-request/143166)

<div class="topic-metadata">

**Author:** [@ritwikkaul](https://discuss.elastic.co/u/ritwikkaul)\
**Replies:** 1\
**Last updated:** [August 6, 2018, 12:41pm UTC](https://discuss.elastic.co/t/java-api-index-request/143166 "2018-08-06T12:41:04Z")

</div>

Hi, I am using IndexRequest to send data to an elasticsearch index. I had recently set up XPACK on my ES cluster. So now sending data to the index causes an authentication error. Could anyone please guide me as to how …

---

## [Search Query Optimization](https://discuss.elastic.co/t/search-query-optimization/142482)

<div class="topic-metadata">

**Author:** [@merlinv](https://discuss.elastic.co/u/merlinv)\
**Replies:** 4\
**Last updated:** [August 6, 2018, 12:31pm UTC](https://discuss.elastic.co/t/search-query-optimization/142482 "2018-08-06T12:31:04Z")

</div>

I'm using EC with 2 nodes with 64GB ram each, number of request ~1000 per minute and CPU/Memory is in green zone. My index is about 40 millions of items and search request is taking 5-7s to finish. I use function scor…

---

## [Case insensitive nested query string](https://discuss.elastic.co/t/case-insensitive-nested-query-string/143045)

<div class="topic-metadata">

**Author:** [@nipun\_edara](https://discuss.elastic.co/u/nipun_edara)\
**Replies:** 3\
**Last updated:** [August 6, 2018, 12:23pm UTC](https://discuss.elastic.co/t/case-insensitive-nested-query-string/143045 "2018-08-06T12:23:08Z")

</div>

Hi, I haven't defined any analyzers and assume it's using the standard analyzer ES version : 5.6 Lucene\_version : 6.6.1 Normal query string results in case-insensitive search but if the query string is put inside nest…

---

## [Stop Watcher after first alert](https://discuss.elastic.co/t/stop-watcher-after-first-alert/142204)

<div class="topic-metadata">

**Author:** [@TheNmaptomyHeartBeat](https://discuss.elastic.co/u/TheNmaptomyHeartBeat)\
**Replies:** 2\
**Last updated:** [August 3, 2018, 3:27pm UTC](https://discuss.elastic.co/t/stop-watcher-after-first-alert/142204 "2018-08-03T15:27:33Z")

</div>

Is there a way to stop watcher sending alerts after the first one? so it only send alerts for new errors. I tried adding a second conditions so its not only just checking for a payload grater than 1 but for ctx.execut…

---

## [No reply from Elastic sales team](https://discuss.elastic.co/t/no-reply-from-elastic-sales-team/143103)

<div class="topic-metadata">

**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\
**Replies:** 2\
**Last updated:** [August 6, 2018, 12:19pm UTC](https://discuss.elastic.co/t/no-reply-from-elastic-sales-team/143103 "2018-08-06T12:19:12Z")

</div>

Hi, Over a week ago I contacted Elastic twice about paid technical support but I'm not getting any reply. I've been trialing Elastic for a long time and recently the project has finally moved from testing to trial prod…

---

## [How to delete the data from elastic search using ElasticSearchAdmin in 5.6.x](https://discuss.elastic.co/t/how-to-delete-the-data-from-elastic-search-using-elasticsearchadmin-in-5-6-x/143153)

<div class="topic-metadata">

**Author:** [@kguru08](https://discuss.elastic.co/u/kguru08)\
**Replies:** 0\
**Last updated:** [August 6, 2018, 11:35am UTC](https://discuss.elastic.co/t/how-to-delete-the-data-from-elastic-search-using-elasticsearchadmin-in-5-6-x/143153 "2018-08-06T11:35:23Z")

</div>

I am trying to delete the data from ElasticSearch using "BulkByScrollResponse". If I pass the Elastic search client as admin I am Null pointer exception. Instead of ElasticSearhClient, I need to pass ElasticSearchAdmin. …

---

## [Searching for umlauts](https://discuss.elastic.co/t/searching-for-umlauts/142906)

<div class="topic-metadata">

**Author:** [@cherry-wave](https://discuss.elastic.co/u/cherry-wave)\
**Replies:** 8\
**Last updated:** [August 6, 2018, 11:26am UTC](https://discuss.elastic.co/t/searching-for-umlauts/142906 "2018-08-06T11:26:58Z")

</div>

Hello, I use ES in v5.6.4 and have the following setup: DELETE telephone\_book PUT telephone\_book { "settings": { "analysis": { "filter": { "german\_stemmer": { "type": "stemmer", …

---

## [Search for terms containing hyphen (-) on AWS elasticsearch](https://discuss.elastic.co/t/search-for-terms-containing-hyphen-on-aws-elasticsearch/142864)

<div class="topic-metadata">

**Author:** [@\_Levi](https://discuss.elastic.co/u/_Levi)\
**Replies:** 4\
**Last updated:** [August 6, 2018, 10:21am UTC](https://discuss.elastic.co/t/search-for-terms-containing-hyphen-on-aws-elasticsearch/142864 "2018-08-06T10:21:48Z")

</div>

I just read the article about : How to search for terms containing hyphen (-) on \_all field?, it is required to do /\_close /\_settings /\_open operations, but when I do in AWS elasticsearch, I can't update the settings of…

---

## [Is it better to store all fields from a database in ElasticSearch or only indexed fields?](https://discuss.elastic.co/t/is-it-better-to-store-all-fields-from-a-database-in-elasticsearch-or-only-indexed-fields/143060)

<div class="topic-metadata">

**Author:** [@porunov](https://discuss.elastic.co/u/porunov)\
**Replies:** 3\
**Last updated:** [August 6, 2018, 9:25am UTC](https://discuss.elastic.co/t/is-it-better-to-store-all-fields-from-a-database-in-elasticsearch-or-only-indexed-fields/143060 "2018-08-06T09:25:33Z")

</div>

Hello, We are thinking about what data should be stored in ElasticSearch. For example, we have a database with a user table with fields like: username, age, additional\_information. We are never searching any user by a…

---

## [How to retrieve the content of Elasticsearch reverse indexes?](https://discuss.elastic.co/t/how-to-retrieve-the-content-of-elasticsearch-reverse-indexes/142758)

<div class="topic-metadata">

**Author:** [@fmind](https://discuss.elastic.co/u/fmind)\
**Replies:** 2\
**Last updated:** [August 6, 2018, 9:05am UTC](https://discuss.elastic.co/t/how-to-retrieve-the-content-of-elasticsearch-reverse-indexes/142758 "2018-08-06T09:05:45Z")

</div>

Hello, I want to run an analysis on Elasticsearch to retrieve the content of its reverse indexes. I need this information to know the list of document ID associated to combination of field/value stored in the reverse i…

---

## [Need recommendations for related data querying](https://discuss.elastic.co/t/need-recommendations-for-related-data-querying/143110)

<div class="topic-metadata">

**Author:** [@gliu](https://discuss.elastic.co/u/gliu)\
**Replies:** 3\
**Last updated:** [August 6, 2018, 9:01am UTC](https://discuss.elastic.co/t/need-recommendations-for-related-data-querying/143110 "2018-08-06T09:01:39Z")

</div>

I'm new to elastic search and are now struggling with modeling the data structure. I have many devices like device: { identifier, IP, MAC, name, provider, last\_active\_time, etc.. } and devices keep reporting t…

---

## [Java Rest High Level Client Support for Elastic 5.5 and 6.x](https://discuss.elastic.co/t/java-rest-high-level-client-support-for-elastic-5-5-and-6-x/143085)

<div class="topic-metadata">

**Author:** [@msantosh](https://discuss.elastic.co/u/msantosh)\
**Replies:** 2\
**Last updated:** [August 6, 2018, 8:46am UTC](https://discuss.elastic.co/t/java-rest-high-level-client-support-for-elastic-5-5-and-6-x/143085 "2018-08-06T08:46:16Z")

</div>

Currently we developed our application based on Elastic 6.2.1 version, however client wants to use our code against Elastic 5.5. Our application is java based, where we are using Java Rest High Level Client to connect t…

---

## [Email alert with readable body](https://discuss.elastic.co/t/email-alert-with-readable-body/142972)

<div class="topic-metadata">

**Author:** [@Sasi\_Sasivarenan](https://discuss.elastic.co/u/Sasi_Sasivarenan)\
**Replies:** 1\
**Last updated:** [August 6, 2018, 8:25am UTC](https://discuss.elastic.co/t/email-alert-with-readable-body/142972 "2018-08-06T08:25:11Z")

</div>

Hi Team, I am newbie to ELK. Trying to create sample of Threat detection using the below URL as reference. https://github.com/elastic/examples/tree/master/Security%20Analytics/ssh\_analysis I am trying create an email…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1589)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1591)
