# Elasticsearch **URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1994 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 1995 --- ## [Is there a way to process documents falling under 'sum\_other\_doc\_count'?](https://discuss.elastic.co/t/is-there-a-way-to-process-documents-falling-under-sum-other-doc-count/95276)
**Author:** [@patrickian](https://discuss.elastic.co/u/patrickian)\ **Replies:** 0\ **Last updated:** [August 1, 2017, 4:54am UTC](https://discuss.elastic.co/t/is-there-a-way-to-process-documents-falling-under-sum-other-doc-count/95276 "2017-08-01T04:54:00Z")
I have fields that I need to aggregate on documents that fall under ‘sum\_other\_doc\_count’. I think, as the field name suggests, that this is just a count of those documents. In my case, I have to do a script add on ‘fie… --- ## [Date type question : Get Documents by Year](https://discuss.elastic.co/t/date-type-question-get-documents-by-year/95274)
**Author:** [@abhikrbng](https://discuss.elastic.co/u/abhikrbng)\ **Replies:** 3\ **Last updated:** [August 1, 2017, 4:44am UTC](https://discuss.elastic.co/t/date-type-question-get-documents-by-year/95274 "2017-08-01T04:44:10Z")
I have a DATE field in an index with "type" : “date” & “format” : “strict\_date\_optional\_time||epoch\_millis” I need to get all the Documents in a mentioned year(say : return all documents whose date field has year… --- ## [Deploying elastic stack across environments](https://discuss.elastic.co/t/deploying-elastic-stack-across-environments/95261)
**Author:** [@marksarnold](https://discuss.elastic.co/u/marksarnold)\ **Replies:** 1\ **Last updated:** [August 1, 2017, 3:51am UTC](https://discuss.elastic.co/t/deploying-elastic-stack-across-environments/95261 "2017-08-01T03:51:39Z")
Hello, I am using Elastic Stack (ES, Kibana, LogStash, FileBeat) and am wondering what the best way would be to set up different environments and deploy across those. Let’s say I have the usual dev / stage / prod envir… --- ## [ESET File Security Quarantined .dim Files](https://discuss.elastic.co/t/eset-file-security-quarantined-dim-files/95258)
**Author:** [@mhasanbulli](https://discuss.elastic.co/u/mhasanbulli)\ **Replies:** 3\ **Last updated:** [August 1, 2017, 3:44am UTC](https://discuss.elastic.co/t/eset-file-security-quarantined-dim-files/95258 "2017-08-01T03:44:43Z")
Hello, I have set up a local Elasticsearch instance with two nodes. I have Logstash sending documents every 15 minutes. Today one of our IT members warned me that there are some "viruses" on the Windows server I was giv… --- ## [How to Integrate Elasticsearch with MS SQL Server](https://discuss.elastic.co/t/how-to-integrate-elasticsearch-with-ms-sql-server/94922)
**Author:** [@amitshri05](https://discuss.elastic.co/u/amitshri05)\ **Replies:** 3\ **Last updated:** [July 31, 2017, 11:47pm UTC](https://discuss.elastic.co/t/how-to-integrate-elasticsearch-with-ms-sql-server/94922 "2017-07-31T23:47:34Z")
Hi Currently i am trying to integrate Elasticsearch 5.1 with MS SQL 2014, I have gone through the following blog (http://www.j2eebrain.com/java-J2ee-how-to-use-elasticsearch-with-sql-server.html) but i wont help me much… --- ## [How document similarity works](https://discuss.elastic.co/t/how-document-similarity-works/95230)
**Author:** [@ga48](https://discuss.elastic.co/u/ga48)\ **Replies:** 1\ **Last updated:** [July 31, 2017, 11:36pm UTC](https://discuss.elastic.co/t/how-document-similarity-works/95230 "2017-07-31T23:36:11Z")
Forgive me for the beginner question but can someone explain how basic document similarity works in Elastic search. Specifically, is something like KNN used to compute the similarity score between two document vectors or… --- ## [Question about High watermark in Single Node cluster](https://discuss.elastic.co/t/question-about-high-watermark-in-single-node-cluster/95251)
**Author:** [@mbitzos](https://discuss.elastic.co/u/mbitzos)\ **Replies:** 1\ **Last updated:** [July 31, 2017, 11:01pm UTC](https://discuss.elastic.co/t/question-about-high-watermark-in-single-node-cluster/95251 "2017-07-31T23:01:49Z")
Hello I have a elastic search 5.5 single node cluster set up. I have set up the low watermark to be 30% and high watermark to be 35% (note this is just for testing, these numbers are not final). The log successfully log… --- ## [Unknown setting exception for "type"="date", "format": "year\_month\_day" in elastic search 5.5.0](https://discuss.elastic.co/t/unknown-setting-exception-for-type-date-format-year-month-day-in-elastic-search-5-5-0/93278)
**Author:** [@jayakrishnankk](https://discuss.elastic.co/u/jayakrishnankk)\ **Replies:** 2\ **Last updated:** [July 31, 2017, 10:55pm UTC](https://discuss.elastic.co/t/unknown-setting-exception-for-type-date-format-year-month-day-in-elastic-search-5-5-0/93278 "2017-07-31T22:55:06Z")
I am new to elastic search, I was going through this video : https://www.elastic.co/webinars/getting-started-elasticsearch. Installed elasticsearch-5.5.0 (linux 64 bit) and kibana 5.5.0 and xpack. When I create the i… --- ## [Simple way to reindex a field type?](https://discuss.elastic.co/t/simple-way-to-reindex-a-field-type/95212)
**Author:** [@rozling](https://discuss.elastic.co/u/rozling)\ **Replies:** 3\ **Last updated:** [July 31, 2017, 10:54pm UTC](https://discuss.elastic.co/t/simple-way-to-reindex-a-field-type/95212 "2017-07-31T22:54:42Z")
Say I have a bunch of daily log indices, created with Logstash dynamic templates, where one field has inconsistent datatypes over a span of a couple of weeks. Is there a way to: Create new indices (i.e. logstash-yy.mm… --- ## [Timestamps in Range Query](https://discuss.elastic.co/t/timestamps-in-range-query/95219)
**Author:** [@Kryten](https://discuss.elastic.co/u/Kryten)\ **Replies:** 1\ **Last updated:** [July 31, 2017, 8:22pm UTC](https://discuss.elastic.co/t/timestamps-in-range-query/95219 "2017-07-31T20:22:05Z")
Hi, Would appreciate any assistance. I’m trying to get some data using this query: POST /agents-\*/\_search { "facets": { "2": { "query": { "filtered": { "query": { "query\_strin… --- ## [Cluster Event Timeout exception](https://discuss.elastic.co/t/cluster-event-timeout-exception/95232)
**Author:** [@niraj\_kumar](https://discuss.elastic.co/u/niraj_kumar)\ **Replies:** 0\ **Last updated:** [July 31, 2017, 7:09pm UTC](https://discuss.elastic.co/t/cluster-event-timeout-exception/95232 "2017-07-31T19:09:07Z")
Hi All, I am seeing the below error on my ingest nodes. Not sure why but if someone can point me to a right direction for the fix. I would really appreciate that. 2017-07-31T12:06:05,440\]\[WARN \]\[r.suppressed … --- ## [How to post multiple records to same index via curl](https://discuss.elastic.co/t/how-to-post-multiple-records-to-same-index-via-curl/95218)
**Author:** [@KeninHouston](https://discuss.elastic.co/u/KeninHouston)\ **Replies:** 2\ **Last updated:** [July 31, 2017, 7:04pm UTC](https://discuss.elastic.co/t/how-to-post-multiple-records-to-same-index-via-curl/95218 "2017-07-31T19:04:21Z")
Hi, I am trying to write multiple records to the same index using curl. I can write one entry successfully, but I get a syntax error saying , unexpected when I try and add the second one. I found a posting which says I … --- ## [Why Am I getting this Error Message In My Advanced Job](https://discuss.elastic.co/t/why-am-i-getting-this-error-message-in-my-advanced-job/95222)
**Author:** [@ppierce01](https://discuss.elastic.co/u/ppierce01)\ **Replies:** 1\ **Last updated:** [July 31, 2017, 6:02pm UTC](https://discuss.elastic.co/t/why-am-i-getting-this-error-message-in-my-advanced-job/95222 "2017-07-31T18:02:35Z")
I am attempting to create a Machine Learning advanced job. I have selected the high\_count function, my by\_field\_name is calltype.keyword and my over\_field is agency.keyword. I use sector.keyword as an influencer. When… --- ## [Snapshot and Restore process](https://discuss.elastic.co/t/snapshot-and-restore-process/95221)
**Author:** [@kabali12345](https://discuss.elastic.co/u/kabali12345)\ **Replies:** 1\ **Last updated:** [July 31, 2017, 6:01pm UTC](https://discuss.elastic.co/t/snapshot-and-restore-process/95221 "2017-07-31T18:01:05Z")
Hi all… I understand from the documentation that the snapshot process takes a full backup for the first snapshot and there on goes with incremental backups. That being the case, I will have to retain my original snapsho… --- ## [X-Pack Monitoring screen error after ES upgrade](https://discuss.elastic.co/t/x-pack-monitoring-screen-error-after-es-upgrade/93602)
**Author:** [@Lean](https://discuss.elastic.co/u/Lean)\ **Replies:** 7\ **Last updated:** [July 31, 2017, 3:57pm UTC](https://discuss.elastic.co/t/x-pack-monitoring-screen-error-after-es-upgrade/93602 "2017-07-31T15:57:08Z")
Hello all, I upgraded from previous (5.4.1) to latest release in order to be able to use .keyword fields in building a new advanced job in machine learning. Since the upgrade, cluster monitoring screens give "Error 404… --- ## [Jvm Heap issues while indexing large data](https://discuss.elastic.co/t/jvm-heap-issues-while-indexing-large-data/94403)
**Author:** [@Siddartha\_Reddy1](https://discuss.elastic.co/u/Siddartha_Reddy1)\ **Replies:** 16\ **Last updated:** [July 31, 2017, 3:54pm UTC](https://discuss.elastic.co/t/jvm-heap-issues-while-indexing-large-data/94403 "2017-07-31T15:54:31Z")
Hi, I have been trying to index a large dataset (with about 13000 fields and thousands of documents. Each doc size= around 450kb) from Spark through ESHadoop. The indexing goes well for small number of documents (hundr… --- ## [Elasticsearch is saving decimal field as text](https://discuss.elastic.co/t/elasticsearch-is-saving-decimal-field-as-text/95051)
**Author:** [@aliyesami](https://discuss.elastic.co/u/aliyesami)\ **Replies:** 3\ **Last updated:** [July 31, 2017, 3:41pm UTC](https://discuss.elastic.co/t/elasticsearch-is-saving-decimal-field-as-text/95051 "2017-07-31T15:41:06Z")
I can not get it to work , I tried BIGINT, DOUBLE, DECIMAL(6,1) but elasticsearch is showing data type as "text" except for the first field "txn\_id" , strange ? +---------------------+------------+------------------… --- ## [Simple filter of value against range-type field](https://discuss.elastic.co/t/simple-filter-of-value-against-range-type-field/93327)
**Author:** [@davidbkemp](https://discuss.elastic.co/u/davidbkemp)\ **Replies:** 4\ **Last updated:** [July 31, 2017, 3:35pm UTC](https://discuss.elastic.co/t/simple-filter-of-value-against-range-type-field/93327 "2017-07-31T15:35:41Z")
It's nice to see that there is now a "range" data type: https://www.elastic.co/guide/en/elasticsearch/reference/current/range.html The example only shows how to do a range query against a range field. Is there a way t… --- ## [Elasticsearch for Hadoop issue](https://discuss.elastic.co/t/elasticsearch-for-hadoop-issue/95046)
**Author:** [@aliyesami](https://discuss.elastic.co/u/aliyesami)\ **Replies:** 5\ **Last updated:** [July 31, 2017, 3:20pm UTC](https://discuss.elastic.co/t/elasticsearch-for-hadoop-issue/95046 "2017-07-31T15:20:32Z")
I had fixed the issue of inserting into the Elasticsearch table by copying the elasticsearch-hadoop-5.5.0.jar to the the $HIVE\_HOME/lib folder but now I am having the same issue while selecting from the table , what cou… --- ## [How to set watcher alerts, on aggregations](https://discuss.elastic.co/t/how-to-set-watcher-alerts-on-aggregations/95196)
**Author:** [@dinaWork](https://discuss.elastic.co/u/dinaWork)\ **Replies:** 1\ **Last updated:** [July 31, 2017, 2:14pm UTC](https://discuss.elastic.co/t/how-to-set-watcher-alerts-on-aggregations/95196 "2017-07-31T14:14:36Z")
I would like to monitor my errors on elasticsearch. I would like to get a notification if a certain error occurred more than a certain number of times (lets say 2 times) in a time period of one hour. For example if the… --- ## [Can i use derived value in histogram aggregation?](https://discuss.elastic.co/t/can-i-use-derived-value-in-histogram-aggregation/95201)
**Author:** [@vaibhav\_goel](https://discuss.elastic.co/u/vaibhav_goel)\ **Replies:** 0\ **Last updated:** [July 31, 2017, 1:59pm UTC](https://discuss.elastic.co/t/can-i-use-derived-value-in-histogram-aggregation/95201 "2017-07-31T13:59:02Z")
GET urza/order/\_search { “size”: 0, “aggs”: { “by\_user”: { “terms”: { “field”: “userId.keyword” }, “aggs”: { “total\_cost”: { “sum”: { “field”: “subtotalPrice” } } } } } } Now i want to apply histogram a… --- ## [Strategy for multi-tenancy and custom fields in mapping](https://discuss.elastic.co/t/strategy-for-multi-tenancy-and-custom-fields-in-mapping/95197)
**Author:** [@FabienHenon](https://discuss.elastic.co/u/FabienHenon)\ **Replies:** 0\ **Last updated:** [July 31, 2017, 1:48pm UTC](https://discuss.elastic.co/t/strategy-for-multi-tenancy-and-custom-fields-in-mapping/95197 "2017-07-31T13:48:00Z")
Hi everyone, I’m new to Elasticsearch but I read several articles and a good part of the documentation. I learnt a lof of things but I have to admit I’m a little bit lost for my own use case. I have a SaaS application … --- ## [Slow aggregations query](https://discuss.elastic.co/t/slow-aggregations-query/95195)
**Author:** [@aburakovskiy](https://discuss.elastic.co/u/aburakovskiy)\ **Replies:** 0\ **Last updated:** [July 31, 2017, 1:32pm UTC](https://discuss.elastic.co/t/slow-aggregations-query/95195 "2017-07-31T13:32:17Z")
Hi, I have a problem with queries with aggregations on a big index. My aggregations are basically facets for students list, so I have high cardinality fields (education, skills, titles etc). My environment: CPU Coun… --- ## [Sorting with has\_child function\_score - illegal argument exception, variable is not found](https://discuss.elastic.co/t/sorting-with-has-child-function-score-illegal-argument-exception-variable-is-not-found/95072)
**Author:** [@tcollinsworth](https://discuss.elastic.co/u/tcollinsworth)\ **Replies:** 2\ **Last updated:** [July 31, 2017, 1:23pm UTC](https://discuss.elastic.co/t/sorting-with-has-child-function-score-illegal-argument-exception-variable-is-not-found/95072 "2017-07-31T13:23:01Z")
Elasticsearch 5.5.1 (out-of-the box/stock) Example nearly identical to the Elasticsearch 5.5 docs here. The only difference is the child doc index type name and the property name. Copy and paste the following curl com… --- ## [Not all settings are presented in elasticsearch.yml](https://discuss.elastic.co/t/not-all-settings-are-presented-in-elasticsearch-yml/95173)
**Author:** [@Vladyslav](https://discuss.elastic.co/u/Vladyslav)\ **Replies:** 1\ **Last updated:** [July 31, 2017, 1:18pm UTC](https://discuss.elastic.co/t/not-all-settings-are-presented-in-elasticsearch-yml/95173 "2017-07-31T13:18:30Z")
Hi, I’m a beginner with Elasticsearch. I’ve recently installed elasticsearch (2.3.1 version) on ubuntu 16.04.2 LTS without making any changes to elasticsearch.yml. I’ve noticed that there are no settings index.number\_o… --- ## [Client node in windows not connected to master in linux](https://discuss.elastic.co/t/client-node-in-windows-not-connected-to-master-in-linux/95191)
**Author:** [@Netanel\_Malka](https://discuss.elastic.co/u/Netanel_Malka)\ **Replies:** 0\ **Last updated:** [July 31, 2017, 1:16pm UTC](https://discuss.elastic.co/t/client-node-in-windows-not-connected-to-master-in-linux/95191 "2017-07-31T13:16:31Z")
I tried to add to exist cluster on Linux a node that runs on Windows, But i get errors that master detected and then left: Error \[2016-12-15T19:39:17,648\]\[INFO \]\[o.e.c.s.ClusterService \] \[node244\] removed {{node23… --- ## [Create new analyzer for Existing index in AWS(Amazon) machine](https://discuss.elastic.co/t/create-new-analyzer-for-existing-index-in-aws-amazon-machine/94456)
**Author:** [@Vinothkumar](https://discuss.elastic.co/u/Vinothkumar)\ **Replies:** 4\ **Last updated:** [July 31, 2017, 12:42pm UTC](https://discuss.elastic.co/t/create-new-analyzer-for-existing-index-in-aws-amazon-machine/94456 "2017-07-31T12:42:32Z")
Hi Everyone, How can I Create new analyzer for Existing index in AWS(Amazon) machine? All the documents which I refered so far its asking to close then update then open the index but AWS(Amazon) does not support Close an… --- ## [Is there a better way to perform this type of query?](https://discuss.elastic.co/t/is-there-a-better-way-to-perform-this-type-of-query/95185)
**Author:** [@Kevin\_Bourne](https://discuss.elastic.co/u/Kevin_Bourne)\ **Replies:** 0\ **Last updated:** [July 31, 2017, 12:40pm UTC](https://discuss.elastic.co/t/is-there-a-better-way-to-perform-this-type-of-query/95185 "2017-07-31T12:40:47Z")
I have come up with a way to perform 2 separate queries to get the data that I want but I was wondering is there a better way, specifically if there is a way I can do this query in a single query. Here is example data w… --- ## [Does rally support jdk 1.7?](https://discuss.elastic.co/t/does-rally-support-jdk-1-7/95124)
**Author:** [@liyuhui](https://discuss.elastic.co/u/liyuhui)\ **Replies:** 1\ **Last updated:** [July 31, 2017, 12:23pm UTC](https://discuss.elastic.co/t/does-rally-support-jdk-1-7/95124 "2017-07-31T12:23:28Z")
In my product environment , I have to user jdk 1.7 . So I can’t use the lastest ELK. This is my enviroments information : es: 2.4.4 logstash: 2.4.1 kibana: 4.6.4 Now I need to install esrally for test, I want to ask … --- ## [ElasticSearch 5.5.0 Highlight Using JavaAPI](https://discuss.elastic.co/t/elasticsearch-5-5-0-highlight-using-javaapi/95180)
**Author:** [@nitin](https://discuss.elastic.co/u/nitin)\ **Replies:** 0\ **Last updated:** [July 31, 2017, 11:57am UTC](https://discuss.elastic.co/t/elasticsearch-5-5-0-highlight-using-javaapi/95180 "2017-07-31T11:57:27Z")
Hi Experts, I have been trying to highlight some of my matched strings using this: HighlightBuilder highlightBuilder = new HighlightBuilder() .postTags("") .preTags("").field("\_all"); SearchRequestBuilder searchQuer… [Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1993) [Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1995)