# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1889

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1890

---

## [Elasticsearch filter plugin is not working(logstash-filter-elasticsearch)](https://discuss.elastic.co/t/elasticsearch-filter-plugin-is-not-working-logstash-filter-elasticsearch/107586)

<div class="topic-metadata">

**Author:** [@dangal](https://discuss.elastic.co/u/dangal)\
**Replies:** 0\
**Last updated:** [November 14, 2017, 4:31pm UTC](https://discuss.elastic.co/t/elasticsearch-filter-plugin-is-not-working-logstash-filter-elasticsearch/107586 "2017-11-14T16:31:16Z")

</div>

Hi, here is my logstash conf and ss1.csv file has only passengerId field and the same field had in index titanic\_kfk\_shrink....so i would like that particular field in both the inputs (i mean input file and elasticsearc…

---

## [Analyze Wildcard \_all](https://discuss.elastic.co/t/analyze-wildcard-all/107570)

<div class="topic-metadata">

**Author:** [@Kirtash](https://discuss.elastic.co/u/Kirtash)\
**Replies:** 1\
**Last updated:** [November 14, 2017, 4:24pm UTC](https://discuss.elastic.co/t/analyze-wildcard-all/107570 "2017-11-14T16:24:46Z")

</div>

Good morning, How can I search using a wildcard and \_all the fields? I have this analyzer: POST filtreclient\_caste/\_analyze { "analyzer": "full\_name", "text": "001-000009" } { "tokens": \[ { "token": "001-00000…

---

## [Parent-Child relationship using join](https://discuss.elastic.co/t/parent-child-relationship-using-join/107581)

<div class="topic-metadata">

**Author:** [@lele](https://discuss.elastic.co/u/lele)\
**Replies:** 0\
**Last updated:** [November 14, 2017, 4:08pm UTC](https://discuss.elastic.co/t/parent-child-relationship-using-join/107581 "2017-11-14T16:08:36Z")

</div>

Hi everyone, I'm using ES 5.6 and I created an index with the single\_type setting set to true with a join field as the following: "join\_field": { "type": "join", "eager\_global\_ordinals": true, "relations": …

---

## [Why Reindex API is not storing events with latest datetime?](https://discuss.elastic.co/t/why-reindex-api-is-not-storing-events-with-latest-datetime/106024)

<div class="topic-metadata">

**Author:** [@vikas\_gopal](https://discuss.elastic.co/u/vikas_gopal)\
**Replies:** 3\
**Last updated:** [November 14, 2017, 4:00pm UTC](https://discuss.elastic.co/t/why-reindex-api-is-not-storing-events-with-latest-datetime/106024 "2017-11-14T16:00:15Z")

</div>

Hi Experts, I want to reindex my static Index . Here Static means it will get new data only after a month , so for the whole month I want to reindex on daily basis using Curator , so that I can display data in kibana fo…

---

## [Change in trend detection in elasticsearch](https://discuss.elastic.co/t/change-in-trend-detection-in-elasticsearch/105881)

<div class="topic-metadata">

**Author:** [@eng.behjati](https://discuss.elastic.co/u/eng.behjati)\
**Replies:** 2\
**Last updated:** [November 14, 2017, 3:26pm UTC](https://discuss.elastic.co/t/change-in-trend-detection-in-elasticsearch/105881 "2017-11-14T15:26:35Z")

</div>

Hi everyone! I have a few questions. can you help me? I have an Elasticsearch db engine that holds posts gathered from social networks and websites contents. I use percolate these posts to match some queries and I wan…

---

## [ES Script reusing the values](https://discuss.elastic.co/t/es-script-reusing-the-values/105451)

<div class="topic-metadata">

**Author:** [@samatha\_kankipati](https://discuss.elastic.co/u/samatha_kankipati)\
**Replies:** 4\
**Last updated:** [November 14, 2017, 3:24pm UTC](https://discuss.elastic.co/t/es-script-reusing-the-values/105451 "2017-11-14T15:24:09Z")

</div>

Hi, We have script field stored in file. We need script field to display and also for sorting. Looks like script is executed two times, one for showing the field in the response and another time for sorting. Is there …

---

## [How to do elasticsearch data comparison](https://discuss.elastic.co/t/how-to-do-elasticsearch-data-comparison/107061)

<div class="topic-metadata">

**Author:** [@varun1992](https://discuss.elastic.co/u/varun1992)\
**Replies:** 2\
**Last updated:** [November 14, 2017, 3:09pm UTC](https://discuss.elastic.co/t/how-to-do-elasticsearch-data-comparison/107061 "2017-11-14T15:09:49Z")

</div>

Sir, I have index named security, where i indexed a website log. I need to create a query for calculating how many people connected to site this month and last month, then compare the count . Is there a way to do com…

---

## [Aggregating over histogram buckets](https://discuss.elastic.co/t/aggregating-over-histogram-buckets/107559)

<div class="topic-metadata">

**Author:** [@Mike\_Nielsen](https://discuss.elastic.co/u/Mike_Nielsen)\
**Replies:** 0\
**Last updated:** [November 14, 2017, 2:29pm UTC](https://discuss.elastic.co/t/aggregating-over-histogram-buckets/107559 "2017-11-14T14:29:32Z")

</div>

Hi, I'm just new to writing elastic queries. I have the following, but would like to count the number of histogram buckets, per host, that have a count of 0, and I can't quite seem to get it across the line. I'll have…

---

## [Match against another index - Domain Categorization](https://discuss.elastic.co/t/match-against-another-index-domain-categorization/107558)

<div class="topic-metadata">

**Author:** [@arnydo](https://discuss.elastic.co/u/arnydo)\
**Replies:** 0\
**Last updated:** [November 14, 2017, 2:26pm UTC](https://discuss.elastic.co/t/match-against-another-index-domain-categorization/107558 "2017-11-14T14:26:11Z")

</div>

Hey guys, I am working on a project and would like to know your thoughts on what I am thinking. In the end I am essentially trying to build a domain classification/identification system. Packetbeat will be used to pull…

---

## [Timestamp format change](https://discuss.elastic.co/t/timestamp-format-change/107539)

<div class="topic-metadata">

**Author:** [@sreejithps303](https://discuss.elastic.co/u/sreejithps303)\
**Replies:** 1\
**Last updated:** [November 14, 2017, 11:36am UTC](https://discuss.elastic.co/t/timestamp-format-change/107539 "2017-11-14T11:36:59Z")

</div>

Hello, I have a field called timestamp\_event in my index.. Currently it is in the format eg : 2017-11-14T02:38:48.301Z. I want to reindex and change the format to 14-Nov-2017 0:00:00 . How can we do it? can any one …

---

## [Allocation/re-routing of unassigned shards](https://discuss.elastic.co/t/allocation-re-routing-of-unassigned-shards/107466)

<div class="topic-metadata">

**Author:** [@Nikolay\_Petrov](https://discuss.elastic.co/u/Nikolay_Petrov)\
**Replies:** 2\
**Last updated:** [November 14, 2017, 11:29am UTC](https://discuss.elastic.co/t/allocation-re-routing-of-unassigned-shards/107466 "2017-11-14T11:29:30Z")

</div>

Hi, could you please help to solve ongoing issue with unassigned shards? The story of these sad example is that cluster with one node goes down(terminated),disk with a elastic data attached to another system with the s…

---

## [How can i merge 2 different types](https://discuss.elastic.co/t/how-can-i-merge-2-different-types/107534)

<div class="topic-metadata">

**Author:** [@sujoymondal87](https://discuss.elastic.co/u/sujoymondal87)\
**Replies:** 1\
**Last updated:** [November 14, 2017, 11:19am UTC](https://discuss.elastic.co/t/how-can-i-merge-2-different-types/107534 "2017-11-14T11:19:52Z")

</div>

I need to merge two different 'types' (or two different 'indexes', even if this is a less preferred method) in ElasticSearch 5.6 This is the first type 'flag' { "\_index": "flags", "\_type": "flag", "\_id": "1", "\_sco…

---

## [How can I add an extra field to a nested document in ElasticSearch 5.6 when searching it](https://discuss.elastic.co/t/how-can-i-add-an-extra-field-to-a-nested-document-in-elasticsearch-5-6-when-searching-it/107538)

<div class="topic-metadata">

**Author:** [@sujoymondal87](https://discuss.elastic.co/u/sujoymondal87)\
**Replies:** 1\
**Last updated:** [November 14, 2017, 11:17am UTC](https://discuss.elastic.co/t/how-can-i-add-an-extra-field-to-a-nested-document-in-elasticsearch-5-6-when-searching-it/107538 "2017-11-14T11:17:51Z")

</div>

This is our nested document mapping: { "properties" :{ "user\_id" :{"type": "integer"}, "images" : { "type": "nested", "properties": { "image\_path": {"type": "string"} } } } } How it is indexed …

---

## [Direct buffer memory problems with RestHighlevelClient](https://discuss.elastic.co/t/direct-buffer-memory-problems-with-resthighlevelclient/106647)

<div class="topic-metadata">

**Author:** [@Slomo](https://discuss.elastic.co/u/Slomo)\
**Replies:** 3\
**Last updated:** [November 14, 2017, 11:07am UTC](https://discuss.elastic.co/t/direct-buffer-memory-problems-with-resthighlevelclient/106647 "2017-11-14T11:07:35Z")

</div>

Hello We are currently running elasticsearch 5.6.2. We connect to the nodes with the Java TransportClient. With the RestHighlevelClient reaching a state where a good amount of our use-cases are covered, we tried switchi…

---

## [Restriction on amount of records returned by elasticsearch](https://discuss.elastic.co/t/restriction-on-amount-of-records-returned-by-elasticsearch/107412)

<div class="topic-metadata">

**Author:** [@bilpor](https://discuss.elastic.co/u/bilpor)\
**Replies:** 7\
**Last updated:** [November 14, 2017, 10:40am UTC](https://discuss.elastic.co/t/restriction-on-amount-of-records-returned-by-elasticsearch/107412 "2017-11-14T10:40:04Z")

</div>

Hi All, It doesn't matter what type of search I perform. (I know for example one particular search I do should return over 1000 records/entries on the index). In Kibana using the Dev Tools window, the output window may …

---

## [Settings in BulkProcessor (java)](https://discuss.elastic.co/t/settings-in-bulkprocessor-java/107527)

<div class="topic-metadata">

**Author:** [@gringogordo](https://discuss.elastic.co/u/gringogordo)\
**Replies:** 1\
**Last updated:** [November 14, 2017, 10:36am UTC](https://discuss.elastic.co/t/settings-in-bulkprocessor-java/107527 "2017-11-14T10:36:53Z")

</div>

Apologies this is a similar question to one I asked yesterday but I'm hoping I may have asked it in a slightly more focused way this time. Essentially I'm trying to understand the Settings Object that is required for th…

---

## [Updating value of nested field with update\_by\_query API](https://discuss.elastic.co/t/updating-value-of-nested-field-with-update-by-query-api/107529)

<div class="topic-metadata">

**Author:** [@Amit\_Shah](https://discuss.elastic.co/u/Amit_Shah)\
**Replies:** 0\
**Last updated:** [November 14, 2017, 10:28am UTC](https://discuss.elastic.co/t/updating-value-of-nested-field-with-update-by-query-api/107529 "2017-11-14T10:28:44Z")

</div>

Hi experts, I am looking to run \_update\_by\_query where i intend to update a field in nested object (commenter\_types.ctype) with the value of other element in same nested object (commenter\_types.commenter\_type) POST me…

---

## [Elasticsearch | Spring Data Elasticsearch | Unsupported ID type](https://discuss.elastic.co/t/elasticsearch-spring-data-elasticsearch-unsupported-id-type/107422)

<div class="topic-metadata">

**Author:** [@Rahul\_Lao](https://discuss.elastic.co/u/Rahul_Lao)\
**Replies:** 1\
**Last updated:** [November 14, 2017, 9:57am UTC](https://discuss.elastic.co/t/elasticsearch-spring-data-elasticsearch-unsupported-id-type/107422 "2017-11-14T09:57:52Z")

</div>

I am trying to create an application where i can perform elastic search capabilities via spring boot and java, but i am facing java.lang.IllegalArgumentException: Unsupported ID type class elastic.model.Identifier Here …

---

## [Aggregation on data of type array grouped by field of object](https://discuss.elastic.co/t/aggregation-on-data-of-type-array-grouped-by-field-of-object/107517)

<div class="topic-metadata">

**Author:** [@Akshay\_Jaiswal](https://discuss.elastic.co/u/Akshay_Jaiswal)\
**Replies:** 0\
**Last updated:** [November 14, 2017, 8:58am UTC](https://discuss.elastic.co/t/aggregation-on-data-of-type-array-grouped-by-field-of-object/107517 "2017-11-14T08:58:06Z")

</div>

Given an array I want to aggregate average value of rating field for all objects grouped by name field in JSON i.e quality and value. Expected output : quality - avg rating 2.5 value - avg rating 3 I have an array si…

---

## [Memlock is stopping node from starting after update](https://discuss.elastic.co/t/memlock-is-stopping-node-from-starting-after-update/107389)

<div class="topic-metadata">

**Author:** [@jannesvh](https://discuss.elastic.co/u/jannesvh)\
**Replies:** 1\
**Last updated:** [November 14, 2017, 8:19am UTC](https://discuss.elastic.co/t/memlock-is-stopping-node-from-starting-after-update/107389 "2017-11-14T08:19:44Z")

</div>

Hi, I updated from 5.5.2 to 5.6.4 and after the update my node doesn't want to start with memlock = true. getting this in my log file: Unable to lock JVM Memory: error=12, reason=Cannot allocate memory /etc/security/l…

---

## [Why use Sparksql to query elasticsesarch the result incorrect](https://discuss.elastic.co/t/why-use-sparksql-to-query-elasticsesarch-the-result-incorrect/107507)

<div class="topic-metadata">

**Author:** [@zrk](https://discuss.elastic.co/u/zrk)\
**Replies:** 0\
**Last updated:** [November 14, 2017, 8:17am UTC](https://discuss.elastic.co/t/why-use-sparksql-to-query-elasticsesarch-the-result-incorrect/107507 "2017-11-14T08:17:21Z")

</div>

I'm using sparkSql to query elasticsearch,the program can run successful,but the query result incorrect,the SQL is: select count(1) from myTableName; Every time run the program the result is inconformity.How can I guar…

---

## [What's a good strategy for getting one or as many document per group depending on the group](https://discuss.elastic.co/t/whats-a-good-strategy-for-getting-one-or-as-many-document-per-group-depending-on-the-group/107092)

<div class="topic-metadata">

**Author:** [@jkiang](https://discuss.elastic.co/u/jkiang)\
**Replies:** 5\
**Last updated:** [November 14, 2017, 7:51am UTC](https://discuss.elastic.co/t/whats-a-good-strategy-for-getting-one-or-as-many-document-per-group-depending-on-the-group/107092 "2017-11-14T07:51:50Z")

</div>

Hello, I'm new to Elasticsearch, so I apologize if this question is dumb. Say if I'm storing book pages, I want to be able to search for one page per book with the highest relevance. My first thought is to have a type …

---

## [How to connect MS Sql server in windows?](https://discuss.elastic.co/t/how-to-connect-ms-sql-server-in-windows/107357)

<div class="topic-metadata">

**Author:** [@divik](https://discuss.elastic.co/u/divik)\
**Replies:** 5\
**Last updated:** [November 14, 2017, 7:30am UTC](https://discuss.elastic.co/t/how-to-connect-ms-sql-server-in-windows/107357 "2017-11-14T07:30:05Z")

</div>

First i have one doubt im using elasticsearch 5.6.3 and jdbc is elasticsearch-jdbc-2.3.3.1.. is it fine or is it wrong?? Im using windows 7. and i installed elasticsearch 5.6.3 its shows {strong text "name" : "5uyIjly…

---

## [Replace Elasticsearch with Azure-search](https://discuss.elastic.co/t/replace-elasticsearch-with-azure-search/107492)

<div class="topic-metadata">

**Author:** [@Narmatha](https://discuss.elastic.co/u/Narmatha)\
**Replies:** 3\
**Last updated:** [November 14, 2017, 6:50am UTC](https://discuss.elastic.co/t/replace-elasticsearch-with-azure-search/107492 "2017-11-14T06:50:41Z")

</div>

The existing application is running in elasticsearch. The functionality of the application covers. MLT search synonym search stopwords multilingual search Filtered search Kibana dashboard to show the metrics using agg…

---

## [Index specific keywords instead of whole document in Elasticsearch](https://discuss.elastic.co/t/index-specific-keywords-instead-of-whole-document-in-elasticsearch/106809)

<div class="topic-metadata">

**Author:** [@vnaresh666666](https://discuss.elastic.co/u/vnaresh666666)\
**Replies:** 14\
**Last updated:** [November 14, 2017, 6:41am UTC](https://discuss.elastic.co/t/index-specific-keywords-instead-of-whole-document-in-elasticsearch/106809 "2017-11-14T06:41:38Z")

</div>

I have requirement that, I have a document(word document, text file, pdf etc..) and and I need to index only specified keywords like particular names, places, dates, and some keywords, instead of whole document. because …

---

## [Cross data center Replication support](https://discuss.elastic.co/t/cross-data-center-replication-support/107326)

<div class="topic-metadata">

**Author:** [@Anushke\_Hewawaithara](https://discuss.elastic.co/u/Anushke_Hewawaithara)\
**Replies:** 5\
**Last updated:** [November 14, 2017, 5:03am UTC](https://discuss.elastic.co/t/cross-data-center-replication-support/107326 "2017-11-14T05:03:20Z")

</div>

Kindly let me know whether elastic search supports Cross data center Replication. EX:- We need to keep one replica on our DR site

---

## [How can i get another field with sort field?](https://discuss.elastic.co/t/how-can-i-get-another-field-with-sort-field/107483)

<div class="topic-metadata">

**Author:** [@zacscoding](https://discuss.elastic.co/u/zacscoding)\
**Replies:** 0\
**Last updated:** [November 14, 2017, 4:29am UTC](https://discuss.elastic.co/t/how-can-i-get-another-field-with-sort-field/107483 "2017-11-14T04:29:31Z")

</div>

suppose mapping that "user\_access" : { "ip" : "19x.xxx.xxx.xxx", "time" : 12312112 "login\_id" : "somthing id" } So i want to make Terms aggregations with "login\_id" field. becuz i have to know multiple ip per logi…

---

## [How to delete a type from an index with all data](https://discuss.elastic.co/t/how-to-delete-a-type-from-an-index-with-all-data/107377)

<div class="topic-metadata">

**Author:** [@aneesh](https://discuss.elastic.co/u/aneesh)\
**Replies:** 2\
**Last updated:** [November 14, 2017, 2:59am UTC](https://discuss.elastic.co/t/how-to-delete-a-type-from-an-index-with-all-data/107377 "2017-11-14T02:59:54Z")

</div>

How to delete a type from an index with all data in C#

---

## [Error while sniffing nodes using ES 5.6 high level Client](https://discuss.elastic.co/t/error-while-sniffing-nodes-using-es-5-6-high-level-client/107481)

<div class="topic-metadata">

**Author:** [@varun\_kumar](https://discuss.elastic.co/u/varun_kumar)\
**Replies:** 0\
**Last updated:** [November 14, 2017, 2:52am UTC](https://discuss.elastic.co/t/error-while-sniffing-nodes-using-es-5-6-high-level-client/107481 "2017-11-14T02:52:11Z")

</div>

We have deployed ES 5.6.3 on an AWS auto Scaling Group across AZ, this group has a load balancer and that is what we use as ES host. Using new high level elastic client as follows: val sniffOnFailureListener = new Snif…

---

## [Timeout about x-pack](https://discuss.elastic.co/t/timeout-about-x-pack/107479)

<div class="topic-metadata">

**Author:** [@zqc0512](https://discuss.elastic.co/u/zqc0512)\
**Replies:** 0\
**Last updated:** [November 14, 2017, 2:15am UTC](https://discuss.elastic.co/t/timeout-about-x-pack/107479 "2017-11-14T02:15:40Z")

</div>

\[2017-11-14T09:13:49,726\]\[ERROR\]\[o.e.x.m.c.i.IndexStatsCollector\] \[xxx\] collector \[index-stats\] timed out when collecting data \[2017-11-14T09:35:29,782\]\[ERROR\]\[o.e.x.m.c.i.IndexStatsCollector\] \[xxx\] collector \[index-stat…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1888)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1890)
