# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1692

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1693

---

## [Replica distribution](https://discuss.elastic.co/t/replica-distribution/131407)

<div class="topic-metadata">

**Author:** [@Mojster](https://discuss.elastic.co/u/Mojster)\
**Replies:** 1\
**Last updated:** [May 11, 2018, 6:33am UTC](https://discuss.elastic.co/t/replica-distribution/131407 "2018-05-11T06:33:16Z")

</div>

I've had my index with 10 shard on a Windows server. Now I'm building a Linux ES cluster. I've started with two servers. I configured it all and moved my index here. After that I raised replicas number form 0 to 1. No…

---

## [Daily index maintenance](https://discuss.elastic.co/t/daily-index-maintenance/130902)

<div class="topic-metadata">

**Author:** [@ankitachow](https://discuss.elastic.co/u/ankitachow)\
**Replies:** 5\
**Last updated:** [May 11, 2018, 6:30am UTC](https://discuss.elastic.co/t/daily-index-maintenance/130902 "2018-05-11T06:30:10Z")

</div>

Hi, In my current application, I'm rolling over data with a doc limit. I'm planning to implement the logic of creating daily indices in my platform. I would like to know how would daily index affect below parameters: …

---

## [Persistent data storage in elasticsearch](https://discuss.elastic.co/t/persistent-data-storage-in-elasticsearch/131406)

<div class="topic-metadata">

**Author:** [@Kamaljit\_Pati](https://discuss.elastic.co/u/Kamaljit_Pati)\
**Replies:** 1\
**Last updated:** [May 11, 2018, 6:25am UTC](https://discuss.elastic.co/t/persistent-data-storage-in-elasticsearch/131406 "2018-05-11T06:25:57Z")

</div>

Hi All, I have a doubt regarding when this elasticsearch data is flushed to disk. I read that it was mentioned the translog is getting stored to disk in some interval. And after the commit point or after some commit poi…

---

## [Statistics about amount of data received from each host](https://discuss.elastic.co/t/statistics-about-amount-of-data-received-from-each-host/131398)

<div class="topic-metadata">

**Author:** [@przemolb](https://discuss.elastic.co/u/przemolb)\
**Replies:** 0\
**Last updated:** [May 11, 2018, 5:46am UTC](https://discuss.elastic.co/t/statistics-about-amount-of-data-received-from-each-host/131398 "2018-05-11T05:46:55Z")

</div>

Hello, I have just installed two small Elasticsearch stacks (6.2.\*). They receive data from our UAT and QA environments. Our QA is more active at the moment so ELK for QA "should" receive more data (measured on logstash…

---

## [Amount of data network traffic beetween Elasticsearch components](https://discuss.elastic.co/t/amount-of-data-network-traffic-beetween-elasticsearch-components/130957)

<div class="topic-metadata">

**Author:** [@przemolb](https://discuss.elastic.co/u/przemolb)\
**Replies:** 2\
**Last updated:** [May 11, 2018, 5:45am UTC](https://discuss.elastic.co/t/amount-of-data-network-traffic-beetween-elasticsearch-components/130957 "2018-05-11T05:45:09Z")

</div>

Hi, we have simple Elasticsearch installation (data + logstash + kibana). I have installed vnstat on all of them to see how much data flows between/to/from them. I expected to have logstash on top of the list (along wit…

---

## [Can I caculate data in the sorting result?](https://discuss.elastic.co/t/can-i-caculate-data-in-the-sorting-result/131391)

<div class="topic-metadata">

**Author:** [@bichdieu1011](https://discuss.elastic.co/u/bichdieu1011)\
**Replies:** 1\
**Last updated:** [May 11, 2018, 5:37am UTC](https://discuss.elastic.co/t/can-i-caculate-data-in-the-sorting-result/131391 "2018-05-11T05:37:13Z")

</div>

Hi everyone, Now I have a problem when I want to calculate data base on the result of sorting. Example, I have a data below: {Id : 1, value : 2} {Id :2 , value : 1} I wrote the query below : GET /\_search { "scrip…

---

## [Exception in thread "pool-2-thread-3" java.lang.IllegalStateException: availableProcessors is already set to \[4\], rejecting \[4\]](https://discuss.elastic.co/t/exception-in-thread-pool-2-thread-3-java-lang-illegalstateexception-availableprocessors-is-already-set-to-4-rejecting-4/131378)

<div class="topic-metadata">

**Author:** [@jackyshen](https://discuss.elastic.co/u/jackyshen)\
**Replies:** 0\
**Last updated:** [May 11, 2018, 2:54am UTC](https://discuss.elastic.co/t/exception-in-thread-pool-2-thread-3-java-lang-illegalstateexception-availableprocessors-is-already-set-to-4-rejecting-4/131378 "2018-05-11T02:54:13Z")

</div>

I start 5 threads in my Java process, in order to improve the transport performance I build TransportClient instance in each of these thread by coding \<\<TransportClient client = new PreBuiltTransportClient(Settings.EMPT…

---

## [Range on Sum Aggregation](https://discuss.elastic.co/t/range-on-sum-aggregation/131066)

<div class="topic-metadata">

**Author:** [@Vijay\_arora1](https://discuss.elastic.co/u/Vijay_arora1)\
**Replies:** 2\
**Last updated:** [May 11, 2018, 3:11am UTC](https://discuss.elastic.co/t/range-on-sum-aggregation/131066 "2018-05-11T03:11:01Z")

</div>

I am trying to write a query which would give me the count of Ids where sum total of transactions fall into a certain range. In terms of SQL query something like: Select ProductId from SaleTransactions where SalesQu…

---

## [x-Pack intsallation](https://discuss.elastic.co/t/x-pack-intsallation/131285)

<div class="topic-metadata">

**Author:** [@Nada\_I](https://discuss.elastic.co/u/Nada_I)\
**Replies:** 4\
**Last updated:** [May 11, 2018, 2:48am UTC](https://discuss.elastic.co/t/x-pack-intsallation/131285 "2018-05-11T02:48:25Z")

</div>

Hello all, I have two questions: 1- When i install logstash this error appeared \[Untitled44\] 2-I can't load filebeats into kibana i load the filebeats manually but this error appeared \[Untitled555\]

---

## [Recomendations while installing ELK+ X-Pack](https://discuss.elastic.co/t/recomendations-while-installing-elk-x-pack/131058)

<div class="topic-metadata">

**Author:** [@avboivin](https://discuss.elastic.co/u/avboivin)\
**Replies:** 5\
**Last updated:** [May 11, 2018, 2:46am UTC](https://discuss.elastic.co/t/recomendations-while-installing-elk-x-pack/131058 "2018-05-11T02:46:12Z")

</div>

Hello, I've setup an ElasticSearch instance with 1 node + an app once already but now I'm about to setup a cluster. What I'm thinking about is installing the entire ELK stack + x-pack using a basic Elastic license on u…

---

## [Will index sorting improve performance on fuzzy queries?](https://discuss.elastic.co/t/will-index-sorting-improve-performance-on-fuzzy-queries/131360)

<div class="topic-metadata">

**Author:** [@felix\_meowmeow](https://discuss.elastic.co/u/felix_meowmeow)\
**Replies:** 0\
**Last updated:** [May 10, 2018, 9:19pm UTC](https://discuss.elastic.co/t/will-index-sorting-improve-performance-on-fuzzy-queries/131360 "2018-05-10T21:19:02Z")

</div>

Hi! :smiley\_cat: I'm thinking of ways to improve my search performance, and I've been considering index sorting: https://www.elastic.co/guide/en/elasticsearch/reference/current/index-modules-index-sorting-conjunctions.h…

---

## [Top Hits Aggregation Maximum Size?](https://discuss.elastic.co/t/top-hits-aggregation-maximum-size/131350)

<div class="topic-metadata">

**Author:** [@kevybear](https://discuss.elastic.co/u/kevybear)\
**Replies:** 1\
**Last updated:** [May 10, 2018, 8:07pm UTC](https://discuss.elastic.co/t/top-hits-aggregation-maximum-size/131350 "2018-05-10T20:07:48Z")

</div>

Is there a maximum size to the number of documents returned by top hits sub aggregation? \[SearchRequest{searchType=QUERY\_THEN\_FETCH, indices=\[container, container\], indicesOptions=IndicesOptions\[id=38, ignore\_unavailab…

---

## [Elasticsearch 7 transport client changes](https://discuss.elastic.co/t/elasticsearch-7-transport-client-changes/131342)

<div class="topic-metadata">

**Author:** [@Ninad\_Pradhan](https://discuss.elastic.co/u/Ninad_Pradhan)\
**Replies:** 1\
**Last updated:** [May 10, 2018, 6:48pm UTC](https://discuss.elastic.co/t/elasticsearch-7-transport-client-changes/131342 "2018-05-10T18:48:34Z")

</div>

Ive heard in es 7 they will deprecate transport client, does anyone know if this is true?

---

## [Handling dot notated fields](https://discuss.elastic.co/t/handling-dot-notated-fields/129657)

<div class="topic-metadata">

**Author:** [@fenneh](https://discuss.elastic.co/u/fenneh)\
**Replies:** 4\
**Last updated:** [May 10, 2018, 6:12pm UTC](https://discuss.elastic.co/t/handling-dot-notated-fields/129657 "2018-05-10T18:12:46Z")

</div>

Running Elastic 6.0.0. What's the best way to handle fields which have a dot notation within them? The default behaviour seems to be to store them as strings? An example event.status = "Running" event.status.id = 33 W…

---

## [Grouping with Elasticsearch (aggs) to join a field into a list of values](https://discuss.elastic.co/t/grouping-with-elasticsearch-aggs-to-join-a-field-into-a-list-of-values/131071)

<div class="topic-metadata">

**Author:** [@TheZeke](https://discuss.elastic.co/u/TheZeke)\
**Replies:** 1\
**Last updated:** [May 10, 2018, 6:07pm UTC](https://discuss.elastic.co/t/grouping-with-elasticsearch-aggs-to-join-a-field-into-a-list-of-values/131071 "2018-05-10T18:07:06Z")

</div>

I have an index with several types. The data in each record includes fields like "Customer ID" and "Device Name", "url" etc. Elasticsearch is v5.6.8. What I'd like to end up with is one document per "Customer ID" and …

---

## [Force query on field](https://discuss.elastic.co/t/force-query-on-field/130051)

<div class="topic-metadata">

**Author:** [@lucastex](https://discuss.elastic.co/u/lucastex)\
**Replies:** 5\
**Last updated:** [May 10, 2018, 5:50pm UTC](https://discuss.elastic.co/t/force-query-on-field/130051 "2018-05-10T17:50:45Z")

</div>

Hi guys, Is there any config in ElasticSearch, any plugin, any feature in x-pack or something on elastic cloud, that forces users to have one condition on its query automatically? I'm trying to force that user add one …

---

## [Mapping Nested datatypes based on field key value](https://discuss.elastic.co/t/mapping-nested-datatypes-based-on-field-key-value/131335)

<div class="topic-metadata">

**Author:** [@Lewis\_John\_Mcgibbney](https://discuss.elastic.co/u/Lewis_John_Mcgibbney)\
**Replies:** 1\
**Last updated:** [May 10, 2018, 5:30pm UTC](https://discuss.elastic.co/t/mapping-nested-datatypes-based-on-field-key-value/131335 "2018-05-10T17:30:48Z")

</div>

Hi Folks, I am trying to correctly model the following documents... which differ slightly particularly within the "geometries" field. Document 1 { "id": "EONET\_3497", "title": "Tye River Fire", "descripti…

---

## [Unable to sort logs on the basis of timestamp](https://discuss.elastic.co/t/unable-to-sort-logs-on-the-basis-of-timestamp/131126)

<div class="topic-metadata">

**Author:** [@Ashish1234](https://discuss.elastic.co/u/Ashish1234)\
**Replies:** 2\
**Last updated:** [May 10, 2018, 5:26pm UTC](https://discuss.elastic.co/t/unable-to-sort-logs-on-the-basis-of-timestamp/131126 "2018-05-10T17:26:30Z")

</div>

grok filter: filter { grok { match =\> { "message" =\> "\[%{LOGLEVEL:Severity}\]:\[%{DATA:User\_Name}\]:\[%{TIMESTAMP\_ISO8601:event\_time}\]:\[%{DATA:Session\_ID}\]:\[%{DATA:Function\_Name}\]:\[%{DATA:Event}\]:\[%{DATA:Activity\_Status}\]…

---

## [Max\_doc\_count in terms aggragation](https://discuss.elastic.co/t/max-doc-count-in-terms-aggragation/131142)

<div class="topic-metadata">

**Author:** [@gilisade](https://discuss.elastic.co/u/gilisade)\
**Replies:** 1\
**Last updated:** [May 10, 2018, 4:43pm UTC](https://discuss.elastic.co/t/max-doc-count-in-terms-aggragation/131142 "2018-05-10T16:43:42Z")

</div>

Hi using Es 5.4 Is there a way to do a max doc count like min doc count in terms agg? i want to get back only the first 200 (size : 200) buckets that contain max of 2000 doc count . what i encountered with is this: …

---

## [Sustained 50%+ increase in heap after mapping update](https://discuss.elastic.co/t/sustained-50-increase-in-heap-after-mapping-update/129365)

<div class="topic-metadata">

**Author:** [@Dan\_Fey](https://discuss.elastic.co/u/Dan_Fey)\
**Replies:** 1\
**Last updated:** [May 10, 2018, 4:09pm UTC](https://discuss.elastic.co/t/sustained-50-increase-in-heap-after-mapping-update/129365 "2018-05-10T16:09:48Z")

</div>

TL;DR After adding mappings for 217 fields (72 of which were nested), heap increased ~50%, and much of it went to the fixed\_bit\_set memory. Is there a way to reduce this heap increase while maintaining the mapping upda…

---

## [java.lang.OutOfMemoryError: Java heap space with search action](https://discuss.elastic.co/t/java-lang-outofmemoryerror-java-heap-space-with-search-action/131296)

<div class="topic-metadata">

**Author:** [@an.secure](https://discuss.elastic.co/u/an.secure)\
**Replies:** 1\
**Last updated:** [May 10, 2018, 3:44pm UTC](https://discuss.elastic.co/t/java-lang-outofmemoryerror-java-heap-space-with-search-action/131296 "2018-05-10T15:44:08Z")

</div>

Seeing the below stack trace in elasticsearch logs. What may be the possible cause for this : \[E\] asticsearchUncaughtExceptionHandler - \[UID=\] - fatal error in thread \[elasticsearch\[node01\]\[search\]\[T#1\]\], exiting java.…

---

## [Disable order over Terms Aggregation](https://discuss.elastic.co/t/disable-order-over-terms-aggregation/130829)

<div class="topic-metadata">

**Author:** [@mjunaidmuzammil](https://discuss.elastic.co/u/mjunaidmuzammil)\
**Replies:** 2\
**Last updated:** [May 10, 2018, 3:40pm UTC](https://discuss.elastic.co/t/disable-order-over-terms-aggregation/130829 "2018-05-10T15:40:23Z")

</div>

Hi, I have been experimenting out performance of different Elasticsearch queries. I intend to fetch all the unique values for a particular field. As the number of unique values increase, the time for performing Terms ag…

---

## [Making http request inside query](https://discuss.elastic.co/t/making-http-request-inside-query/131315)

<div class="topic-metadata">

**Author:** [@Dave\_Clissold](https://discuss.elastic.co/u/Dave_Clissold)\
**Replies:** 2\
**Last updated:** [May 10, 2018, 3:12pm UTC](https://discuss.elastic.co/t/making-http-request-inside-query/131315 "2018-05-10T15:12:49Z")

</div>

Is there a way of making a http request as part of the query and returning that or using it to influence the scoring? { "query": { "match": { "some\_field":"value"}, "httprequest":"http://someaddress?parm1=value" } …

---

## [Cluster Status is Yellow](https://discuss.elastic.co/t/cluster-status-is-yellow/131116)

<div class="topic-metadata">

**Author:** [@sukeshss](https://discuss.elastic.co/u/sukeshss)\
**Replies:** 1\
**Last updated:** [May 10, 2018, 3:10pm UTC](https://discuss.elastic.co/t/cluster-status-is-yellow/131116 "2018-05-10T15:10:26Z")

</div>

I am running ES cluster with 4 Data nodes, each has 100GB free disk space. But my cluster status is Yellow. There are unassigned shards in the newly created index. is "active\_shards\_percent\_as\_number": 99.61656441717791…

---

## [Encrypted Private Keys in Keystore](https://discuss.elastic.co/t/encrypted-private-keys-in-keystore/131320)

<div class="topic-metadata">

**Author:** [@zpraxis](https://discuss.elastic.co/u/zpraxis)\
**Replies:** 0\
**Last updated:** [May 10, 2018, 2:53pm UTC](https://discuss.elastic.co/t/encrypted-private-keys-in-keystore/131320 "2018-05-10T14:53:53Z")

</div>

Hi, Is there a way I can use encrypted private keys inside a keystore? It seems the keystore is the only one that can be password-protected, but private keys need to remain unencrypted. Thanks in advance!

---

## [ES memory issue](https://discuss.elastic.co/t/es-memory-issue/131307)

<div class="topic-metadata">

**Author:** [@Dazith\_Kj](https://discuss.elastic.co/u/Dazith_Kj)\
**Replies:** 2\
**Last updated:** [May 10, 2018, 12:51pm UTC](https://discuss.elastic.co/t/es-memory-issue/131307 "2018-05-10T12:51:22Z")

</div>

When querying date from dashboards I am getting the below exception in ES log. Any idea of how to resolving the issue? ES version : { "name": "Plunderer", "cluster\_name": "elasticsearch", "cluster\_uuid": "9LjKXnnbRD-d…

---

## [Elasticsearch-head plugin on windows OS](https://discuss.elastic.co/t/elasticsearch-head-plugin-on-windows-os/131281)

<div class="topic-metadata">

**Author:** [@Hanen](https://discuss.elastic.co/u/Hanen)\
**Replies:** 3\
**Last updated:** [May 10, 2018, 12:43pm UTC](https://discuss.elastic.co/t/elasticsearch-head-plugin-on-windows-os/131281 "2018-05-10T12:43:16Z")

</div>

Hello, please how can I install ELASTICSEARCH-HEAD PLUGIN on windows OS PS: I have elasticsearch 6.2.2 installed on windows server 2008 and I would like to add a web front end for it. I try c:\\ES\\bin\>plugin.bat insta…

---

## [Not able to load data from hive to Elasticsearch using ESStorage Handler](https://discuss.elastic.co/t/not-able-to-load-data-from-hive-to-elasticsearch-using-esstorage-handler/127094)

<div class="topic-metadata">

**Author:** [@krishnaSH](https://discuss.elastic.co/u/krishnaSH)\
**Replies:** 13\
**Last updated:** [May 10, 2018, 12:20pm UTC](https://discuss.elastic.co/t/not-able-to-load-data-from-hive-to-elasticsearch-using-esstorage-handler/127094 "2018-05-10T12:20:46Z")

</div>

I am picking up data from AWS in a hive table and I am overwriting another ES-Hive table as per the steps mentioned in ES-hadoop integration steps:- https://www.elastic.co/guide/en/elasticsearch/hadoop/current/configurat…

---

## [Adding Custom GeoIP Target To Index Pattern](https://discuss.elastic.co/t/adding-custom-geoip-target-to-index-pattern/131295)

<div class="topic-metadata">

**Author:** [@F\_Terrie](https://discuss.elastic.co/u/F_Terrie)\
**Replies:** 0\
**Last updated:** [May 10, 2018, 11:27am UTC](https://discuss.elastic.co/t/adding-custom-geoip-target-to-index-pattern/131295 "2018-05-10T11:27:40Z")

</div>

Hi, I'm attempting to update the index pattern in Elasticsearch with the target geoip I've set in logstash, which is currently: geoip { source =\> "Remote" target =\> "RemoteGEOIP" …

---

## [ES 6.2.3 cluster goes down unexpectedly](https://discuss.elastic.co/t/es-6-2-3-cluster-goes-down-unexpectedly/131292)

<div class="topic-metadata">

**Author:** [@renjith\_ravindran](https://discuss.elastic.co/u/renjith_ravindran)\
**Replies:** 2\
**Last updated:** [May 10, 2018, 11:21am UTC](https://discuss.elastic.co/t/es-6-2-3-cluster-goes-down-unexpectedly/131292 "2018-05-10T11:21:04Z")

</div>

I have a cluster with 2 co-ordinate nodes and 4 data/master nodes. (1 coordinate node and 2 data/master node in each DC) I have not started indexing any data, and even index is not created yet. But still the cluster go…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1691)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1693)
