# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1595 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1596 --- ## [Elasticsearch Cross Cluster Search behind nginx proxy](https://discuss.elastic.co/t/elasticsearch-cross-cluster-search-behind-nginx-proxy/142706)
**Author:** [@kalash969](https://discuss.elastic.co/u/kalash969)\ **Replies:** 0\ **Last updated:** [August 2, 2018, 7:52am UTC](https://discuss.elastic.co/t/elasticsearch-cross-cluster-search-behind-nginx-proxy/142706 "2018-08-02T07:52:06Z")
I want to setup sort of aggregation for multiple Elasticsearch clusters based on Cross Cluster Search feature. I have the following layout: As seed for Cross Cluster Search I am using the only available via network cl… --- ## [How can I aggregation by \_count](https://discuss.elastic.co/t/how-can-i-aggregation-by-count/142314)
**Author:** [@RubinX](https://discuss.elastic.co/u/RubinX)\ **Replies:** 2\ **Last updated:** [August 2, 2018, 7:25am UTC](https://discuss.elastic.co/t/how-can-i-aggregation-by-count/142314 "2018-08-02T07:25:59Z")
I have some data like these: UID ---------------------- other terms i don not care 1001---------------------- ... 1001---------------------- ... 1001---------------------- ... 1002---------------------- ... 1002---… --- ## [No mapping found in order to sort on (Dates)](https://discuss.elastic.co/t/no-mapping-found-in-order-to-sort-on-dates/142640)
**Author:** [@Etienne\_Poulin](https://discuss.elastic.co/u/Etienne_Poulin)\ **Replies:** 1\ **Last updated:** [August 2, 2018, 7:17am UTC](https://discuss.elastic.co/t/no-mapping-found-in-order-to-sort-on-dates/142640 "2018-08-02T07:17:37Z")
So I'm trying to order my logs by date. I'm currently querying http://localhost:9200/myindex/\_search?pretty=true&sort="date" without the pretty, within a java app. When I do that, I'm getting the following error: { "e… --- ## [Primary Shards MUCH larger than Replicas](https://discuss.elastic.co/t/primary-shards-much-larger-than-replicas/142664)
**Author:** [@andrew\_rueckert](https://discuss.elastic.co/u/andrew_rueckert)\ **Replies:** 0\ **Last updated:** [August 2, 2018, 12:59am UTC](https://discuss.elastic.co/t/primary-shards-much-larger-than-replicas/142664 "2018-08-02T00:59:28Z")
For larger indices, I'm seeing a pattern where my primary shards are significantly larger than replicas. For example, using the \_cat/shards API, I'm getting: 524183765326406aba73345d470e727c-2018-07-30 … --- ## [I can´t add a second node to my cluster](https://discuss.elastic.co/t/i-can-t-add-a-second-node-to-my-cluster/142223)
**Author:** [@Diego\_Moreno](https://discuss.elastic.co/u/Diego_Moreno)\ **Replies:** 10\ **Last updated:** [August 2, 2018, 12:37am UTC](https://discuss.elastic.co/t/i-can-t-add-a-second-node-to-my-cluster/142223 "2018-08-02T00:37:39Z")
Node 1: cluster.name: my-application node.name: node-1 node.master: true node.data: true network.host: 192.168.x.xxx network.publish\_host: 192.168.x.xxx network.blind\_host: 192.168.x.xxx discovery.zen.ping.unicas… --- ## [Sharding and Performance](https://discuss.elastic.co/t/sharding-and-performance/142657)
**Author:** [@totessusan](https://discuss.elastic.co/u/totessusan)\ **Replies:** 0\ **Last updated:** [August 1, 2018, 11:25pm UTC](https://discuss.elastic.co/t/sharding-and-performance/142657 "2018-08-01T23:25:49Z")
I think I've finally gotten a grasp of the fundamental understanding of how to allocate shards for Elasticsearch. Please correct me if I'm wrong, this is what I've pieced together: Ideally, there should only exist one … --- ## [How to edit mappings](https://discuss.elastic.co/t/how-to-edit-mappings/142647)
**Author:** [@Etienne\_Poulin](https://discuss.elastic.co/u/Etienne_Poulin)\ **Replies:** 1\ **Last updated:** [August 1, 2018, 11:08pm UTC](https://discuss.elastic.co/t/how-to-edit-mappings/142647 "2018-08-01T23:08:10Z")
Hi. I'm very to elasticsearch, so please excuse my lack of knowledge. I normally insert stuff inside indices using the java api, and read them by parsing the JSON aquired by querying to http://localhost:9200/portail/\_sea… --- ## [Custom Realm Plugin install fails on jar hell error](https://discuss.elastic.co/t/custom-realm-plugin-install-fails-on-jar-hell-error/142627)
**Author:** [@gautu7](https://discuss.elastic.co/u/gautu7)\ **Replies:** 10\ **Last updated:** [August 1, 2018, 10:54pm UTC](https://discuss.elastic.co/t/custom-realm-plugin-install-fails-on-jar-hell-error/142627 "2018-08-01T22:54:23Z")
I have a custom plugin on my local elastic 6.3.2 environment. After packaging this and when I try to run the install command, it was failing to recognize the SecurityExtension class on a provided maven scope, so I includ… --- ## [Query on Java High Level Rest Client and Ingest-attachment](https://discuss.elastic.co/t/query-on-java-high-level-rest-client-and-ingest-attachment/142639)
**Author:** [@nspatil](https://discuss.elastic.co/u/nspatil)\ **Replies:** 1\ **Last updated:** [August 1, 2018, 9:55pm UTC](https://discuss.elastic.co/t/query-on-java-high-level-rest-client-and-ingest-attachment/142639 "2018-08-01T21:55:43Z")
Hi All, Is there a OSS version of following? Java High Level Rest Client ingest attachment plugin Thanks --- ## [Event emitted vs. Events received](https://discuss.elastic.co/t/event-emitted-vs-events-received/140601)
**Author:** [@Badger](https://discuss.elastic.co/u/Badger)\ **Replies:** 1\ **Last updated:** [July 30, 2018, 9:02pm UTC](https://discuss.elastic.co/t/event-emitted-vs-events-received/140601 "2018-07-30T21:02:30Z")
In 6.3.1 (and earlier) on the Monitoring page for pipelines, it shows Event emitted and Events received. These numbers are always identical, even though my most active pipelines sample data and drop over 90% of their inp… --- ## [Nested objects aggregation](https://discuss.elastic.co/t/nested-objects-aggregation/142635)
**Author:** [@ashwin.srik](https://discuss.elastic.co/u/ashwin.srik)\ **Replies:** 0\ **Last updated:** [August 1, 2018, 5:38pm UTC](https://discuss.elastic.co/t/nested-objects-aggregation/142635 "2018-08-01T17:38:56Z")
Is there a way to perform aggregation to get the document count based only the latest value of date and the date ranges below? Expected Result based on today being “2018-08-01”: Past: 1 0-1Year: 0 1-2Years: 1 3+Yea… --- ## [How to bulk load huge JSON docs from files using Java client?](https://discuss.elastic.co/t/how-to-bulk-load-huge-json-docs-from-files-using-java-client/142607)
**Author:** [@davidpel](https://discuss.elastic.co/u/davidpel)\ **Replies:** 8\ **Last updated:** [August 1, 2018, 5:47pm UTC](https://discuss.elastic.co/t/how-to-bulk-load-huge-json-docs-from-files-using-java-client/142607 "2018-08-01T17:47:19Z")
Hi. I need your help / advice / opinion: TL;DR: How do I read file from the disk for bulk loading using IndexRequest.source(BytesReference)? And the detailed question: The context: I am indexing text in a public dat… --- ## [Interpreting indexing.index\_total stat](https://discuss.elastic.co/t/interpreting-indexing-index-total-stat/142624)
**Author:** [@Akash\_Suresh](https://discuss.elastic.co/u/Akash_Suresh)\ **Replies:** 0\ **Last updated:** [August 1, 2018, 4:40pm UTC](https://discuss.elastic.co/t/interpreting-indexing-index-total-stat/142624 "2018-08-01T16:40:20Z")
Hello, I'm trying to interpret the indexing.index\_total stat documented here: https://github.com/elastic/elasticsearch/blob/master/docs/reference/cat/nodes.asciidoc. Does this metric return a cumulative count of number… --- ## [Query whether an integer is within a range of field values](https://discuss.elastic.co/t/query-whether-an-integer-is-within-a-range-of-field-values/142597)
**Author:** [@achton](https://discuss.elastic.co/u/achton)\ **Replies:** 2\ **Last updated:** [August 1, 2018, 3:21pm UTC](https://discuss.elastic.co/t/query-whether-an-integer-is-within-a-range-of-field-values/142597 "2018-08-01T15:21:52Z")
I have an index where documents contain two fields that together make up a range, ie: "office\_postal\_from" : \[ "1500", "1800", "2000" \], "office\_postal\_to" : \[ "1799", "1999", … --- ## [Elasticsearch 6.3.0 unavailable in maven repository](https://discuss.elastic.co/t/elasticsearch-6-3-0-unavailable-in-maven-repository/138782)
**Author:** [@Rick\_Cole](https://discuss.elastic.co/u/Rick_Cole)\ **Replies:** 11\ **Last updated:** [August 1, 2018, 3:20pm UTC](https://discuss.elastic.co/t/elasticsearch-6-3-0-unavailable-in-maven-repository/138782 "2018-08-01T15:20:54Z")
When attempting to download the elasticsearch distribution zip from the maven global repository, I am getting a 404. Is anyone else having this issue? https://repo1.maven.org/maven2/org/elasticsearch/distribution/zip/el… --- ## [Flush vs clear index cache](https://discuss.elastic.co/t/flush-vs-clear-index-cache/142606)
**Author:** [@saad](https://discuss.elastic.co/u/saad)\ **Replies:** 0\ **Last updated:** [August 1, 2018, 3:12pm UTC](https://discuss.elastic.co/t/flush-vs-clear-index-cache/142606 "2018-08-01T15:12:00Z")
Would you explain to me what is the difference between flush and clear index cache actions. I need more explanation and when we should use these actions. I read about it in: https://www.elastic.co/guide/en/elasticsearc… --- ## [Performance of the \_index field](https://discuss.elastic.co/t/performance-of-the-index-field/142599)
**Author:** [@Andrew\_Carter](https://discuss.elastic.co/u/Andrew_Carter)\ **Replies:** 0\ **Last updated:** [August 1, 2018, 2:45pm UTC](https://discuss.elastic.co/t/performance-of-the-index-field/142599 "2018-08-01T14:45:23Z")
I have a question which I hope is pretty easy to answer fo someone familiar with the ES internals. The documentation for the \_index field states: The \_index is exposed as a virtual field — it is not added to the Lucen… --- ## [Optimal shards: 1 or number of nodes? Considerations](https://discuss.elastic.co/t/optimal-shards-1-or-number-of-nodes-considerations/141976)
**Author:** [@cdekker](https://discuss.elastic.co/u/cdekker)\ **Replies:** 9\ **Last updated:** [August 1, 2018, 2:20pm UTC](https://discuss.elastic.co/t/optimal-shards-1-or-number-of-nodes-considerations/141976 "2018-08-01T14:20:55Z")
The question of optimal number of shards per index has been asked before and it is almost always dependent on use-case. However, I am wondering what some of the considerations should be. Imagine the following setup: E… --- ## [Clarification on Elasticsearch support for some settings](https://discuss.elastic.co/t/clarification-on-elasticsearch-support-for-some-settings/142456)
**Author:** [@srikrishna](https://discuss.elastic.co/u/srikrishna)\ **Replies:** 2\ **Last updated:** [August 1, 2018, 2:03pm UTC](https://discuss.elastic.co/t/clarification-on-elasticsearch-support-for-some-settings/142456 "2018-08-01T14:03:27Z")
In the breaking changes section in ElasticSearch documentation for 6.3 but under 6.0 it's stated: indices.store.throttle.type and indices.store.throttle.max\_bytes\_per\_sec cluster settings and the index.store.throttle.ty… --- ## [How can you verify security implementation in Elastic stack?](https://discuss.elastic.co/t/how-can-you-verify-security-implementation-in-elastic-stack/142539)
**Author:** [@UserSam](https://discuss.elastic.co/u/UserSam)\ **Replies:** 1\ **Last updated:** [August 1, 2018, 1:20pm UTC](https://discuss.elastic.co/t/how-can-you-verify-security-implementation-in-elastic-stack/142539 "2018-08-01T13:20:53Z")
I've implemented, HTTPS, Transport layer and user authentication and authorization security layers in ElasticSearch and Kibana. Now, how can I verify whether these have been implemented properly and these are in place? B… --- ## [Availability of Machine Learning in Elastic Cloud 14-day Free Trial](https://discuss.elastic.co/t/availability-of-machine-learning-in-elastic-cloud-14-day-free-trial/142525)
**Author:** [@env070](https://discuss.elastic.co/u/env070)\ **Replies:** 2\ **Last updated:** [August 1, 2018, 12:32pm UTC](https://discuss.elastic.co/t/availability-of-machine-learning-in-elastic-cloud-14-day-free-trial/142525 "2018-08-01T12:32:03Z")
Hello, I don't know if this is the correct category for this question but I couldn't find a better category. I'm interested in trying out the Machine Learning capabilities of Elastic Cloud. My question is, as the title… --- ## [How to do using Elasticsearch](https://discuss.elastic.co/t/how-to-do-using-elasticsearch/142561)
**Author:** [@Md\_Ghulam\_khaja](https://discuss.elastic.co/u/Md_Ghulam_khaja)\ **Replies:** 0\ **Last updated:** [August 1, 2018, 12:04pm UTC](https://discuss.elastic.co/t/how-to-do-using-elasticsearch/142561 "2018-08-01T12:04:10Z")
How to compare fields of two indexed document under one index with any parent child relationship between the documents? I wan to compare fields (userid, username) of doc1 from fields(dummyuserid, dummyusername) from doc… --- ## [Set up elasticsearch cluster for 2 machines](https://discuss.elastic.co/t/set-up-elasticsearch-cluster-for-2-machines/142542)
**Author:** [@Akshay\_Singhvi](https://discuss.elastic.co/u/Akshay_Singhvi)\ **Replies:** 1\ **Last updated:** [August 1, 2018, 12:02pm UTC](https://discuss.elastic.co/t/set-up-elasticsearch-cluster-for-2-machines/142542 "2018-08-01T12:02:53Z")
I am trying to cluster two system as an elastic cluster I have two system running on ubuntu where elasticsearch is set .The following are the config files with the lines that i have modified or uncommented from the defa… --- ## [Anomaly filter](https://discuss.elastic.co/t/anomaly-filter/142206)
**Author:** [@111126](https://discuss.elastic.co/u/111126)\ **Replies:** 3\ **Last updated:** [August 1, 2018, 11:57am UTC](https://discuss.elastic.co/t/anomaly-filter/142206 "2018-08-01T11:57:32Z")
Hello. I wont to detect this anomaly (high traffic): But I dont want detect anomaly with traffic for less then 1 Mbytes. How can I exclude the detection of anomalies with a small amount of traffic? I want detect anom… --- ## [Unable to open Machine Learning job](https://discuss.elastic.co/t/unable-to-open-machine-learning-job/142359)
**Author:** [@Alon\_Goldstein](https://discuss.elastic.co/u/Alon_Goldstein)\ **Replies:** 7\ **Last updated:** [August 1, 2018, 11:51am UTC](https://discuss.elastic.co/t/unable-to-open-machine-learning-job/142359 "2018-08-01T11:51:25Z")
Hi, I'm using Elasticsearch and Kibana version 6.2.4 with Platinum license. Every time I create a Machine Learning job (through API or Kibana), I'm getting the following error in ES log: \[2018-07-31T08:36:30,172\]\[WARN… --- ## [Ingest-user-agent](https://discuss.elastic.co/t/ingest-user-agent/138658)
**Author:** [@naphtali](https://discuss.elastic.co/u/naphtali)\ **Replies:** 25\ **Last updated:** [August 1, 2018, 11:31am UTC](https://discuss.elastic.co/t/ingest-user-agent/138658 "2018-08-01T11:31:06Z")
Hi, I have the elk pack version 6.3.0. One node, on windows. I'm trying to use file beat with the iis module. For that I needed to install the ingest-user-agent and the ingest-geoip plugins. I run the install of the p… --- ## [Field names in Query String syntax doesn't filter this search](https://discuss.elastic.co/t/field-names-in-query-string-syntax-doesnt-filter-this-search/142419)
**Author:** [@mohammedEssabri](https://discuss.elastic.co/u/mohammedEssabri)\ **Replies:** 4\ **Last updated:** [August 1, 2018, 11:25am UTC](https://discuss.elastic.co/t/field-names-in-query-string-syntax-doesnt-filter-this-search/142419 "2018-08-01T11:25:49Z")
Dear Elasticsearch team, I'm using Elasticsearch 1.7. Following this link, The two following queries must give the same result, but it's not the case. The first one gives expected result, but we created the second on… --- ## [Detector field "mlcategory" is not an aggregatable field](https://discuss.elastic.co/t/detector-field-mlcategory-is-not-an-aggregatable-field/142432)
**Author:** [@Badger](https://discuss.elastic.co/u/Badger)\ **Replies:** 1\ **Last updated:** [August 1, 2018, 11:10am UTC](https://discuss.elastic.co/t/detector-field-mlcategory-is-not-an-aggregatable-field/142432 "2018-08-01T11:10:37Z")
I create a job in 6.3.1, with categorization\_field\_name set to "message", and try to count by mlcategory. When I Validate Job I get the error message in the title. However, I am able to save and run the job. The job look… --- ## [Cross Cluster Search setup](https://discuss.elastic.co/t/cross-cluster-search-setup/142532)
**Author:** [@Izek](https://discuss.elastic.co/u/Izek)\ **Replies:** 0\ **Last updated:** [August 1, 2018, 10:10am UTC](https://discuss.elastic.co/t/cross-cluster-search-setup/142532 "2018-08-01T10:10:07Z")
We have a gold license for our production cluster and plan to use cross cluster search feature. Should I put the cross cluster search elk to the same cluster of the production. Or will it need to be a separate cluster? … --- ## [Enable/Disable shard allocation awareness dynamically](https://discuss.elastic.co/t/enable-disable-shard-allocation-awareness-dynamically/142523)
**Author:** [@abhibansal530](https://discuss.elastic.co/u/abhibansal530)\ **Replies:** 0\ **Last updated:** [August 1, 2018, 9:29am UTC](https://discuss.elastic.co/t/enable-disable-shard-allocation-awareness-dynamically/142523 "2018-08-01T09:29:25Z")
So I am playing around with shard allocation awareness. I currently have three nodes. For two of them I have a rack\_id attribute set to rack\_1. And third node don't has this attribute. Now for my index I have 10 shard wi… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1594) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1596)