# Elasticsearch

**URL:** https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1087

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1088

---

## [Combine results of multi field group by](https://discuss.elastic.co/t/combine-results-of-multi-field-group-by/208803)

<div class="topic-metadata">

**Author:** [@chethanBG](https://discuss.elastic.co/u/chethanBG)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 1:45pm UTC](https://discuss.elastic.co/t/combine-results-of-multi-field-group-by/208803 "2019-11-21T13:45:40Z")

</div>

I have created multiple field aggregation using java api below is the output, Key : name Value : \[{"doc\_count":2,"key":"bhounsley"}\] Key : id Value : \[{"doc\_count":1,"key":1},{"doc\_count":1,"key":4}\] But here I want t…

---

## [Kibana failed while upgrading](https://discuss.elastic.co/t/kibana-failed-while-upgrading/205098)

<div class="topic-metadata">

**Author:** [@Vladpov](https://discuss.elastic.co/u/Vladpov)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 1:00pm UTC](https://discuss.elastic.co/t/kibana-failed-while-upgrading/205098 "2019-11-21T13:00:54Z")

</div>

Hi guys, I started an update and upgrade commands on my Ubuntu machine with Elastic Stack and it upgraded Elasticsearch and Logstash succesfully but it failed while updating Kibana and asked me some question if I wnad t…

---

## [Query phase behavior](https://discuss.elastic.co/t/query-phase-behavior/208729)

<div class="topic-metadata">

**Author:** [@Loris](https://discuss.elastic.co/u/Loris)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 12:14pm UTC](https://discuss.elastic.co/t/query-phase-behavior/208729 "2019-11-21T12:14:49Z")

</div>

Hi, I have a doubt about the behavior of the Coordinating Node during the query phase: is there a specific criteria which leads it to choose between a primary or a replica of each shard? Considering the following scena…

---

## [Watcher email configuration](https://discuss.elastic.co/t/watcher-email-configuration/208356)

<div class="topic-metadata">

**Author:** [@faiz](https://discuss.elastic.co/u/faiz)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 12:08pm UTC](https://discuss.elastic.co/t/watcher-email-configuration/208356 "2019-11-21T12:08:55Z")

</div>

Hi, I need to enable the watcher email alert, I have added below setting in the elasticsearch.yml: xpack.watcher.enabled: true xpack.notification.email.account: \*\* gmail\_account:\*\* \*\* profile: gmail\*\* \*\* …

---

## [Uneven load onto data nodes in different AWS Availability Zones](https://discuss.elastic.co/t/uneven-load-onto-data-nodes-in-different-aws-availability-zones/208861)

<div class="topic-metadata">

**Author:** [@a06ced31bae02498a46d](https://discuss.elastic.co/u/a06ced31bae02498a46d)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 12:02pm UTC](https://discuss.elastic.co/t/uneven-load-onto-data-nodes-in-different-aws-availability-zones/208861 "2019-11-21T12:02:40Z")

</div>

We have data nodes in 3 different AWS AZs (availability zone), we have 3 separate coordinator nodes. We noticed that data nodes in one of the AZ experience less load then the nodes in the other 2 AZs. It turned out tha…

---

## [Manipulating the output of term aggregation](https://discuss.elastic.co/t/manipulating-the-output-of-term-aggregation/208525)

<div class="topic-metadata">

**Author:** [@poomdla\_sai](https://discuss.elastic.co/u/poomdla_sai)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 12:00pm UTC](https://discuss.elastic.co/t/manipulating-the-output-of-term-aggregation/208525 "2019-11-21T12:00:39Z")

</div>

After performing a term aggregation query, the output consists of different buckets where each bucket consists of doc\_count. Is it possible to get the list of doc\_count of all the buckets and manipulate their values. //…

---

## [Pushing pcap json into Kibana using BULK API](https://discuss.elastic.co/t/pushing-pcap-json-into-kibana-using-bulk-api/208856)

<div class="topic-metadata">

**Author:** [@pmal](https://discuss.elastic.co/u/pmal)\
**Replies:** 0\
**Last updated:** [November 21, 2019, 10:34am UTC](https://discuss.elastic.co/t/pushing-pcap-json-into-kibana-using-bulk-api/208856 "2019-11-21T10:34:43Z")

</div>

I am trying to create index, for pcap files. here is the request in Dev Tools console: POST /pcaptest/\_doc {"mappings": {"pcap\_file":{ "properties":{ "dynamic": "false", "index" : {"type":"nested"}, "timestamp":{…

---

## [No MultiCountRequest API Object in Java](https://discuss.elastic.co/t/no-multicountrequest-api-object-in-java/208299)

<div class="topic-metadata">

**Author:** [@ndtreviv](https://discuss.elastic.co/u/ndtreviv)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 11:35am UTC](https://discuss.elastic.co/t/no-multicountrequest-api-object-in-java/208299 "2019-11-21T11:35:08Z")

</div>

I want to perform multiple /\_count API requests in one go. There is a MultiSearchRequest that accepts multiple SearchRequests, but not an equivalent for CountRequests Dependency: compile group: 'org.elasticsearch.clie…

---

## [Watcher failed to send e-mail( via kibana)](https://discuss.elastic.co/t/watcher-failed-to-send-e-mail-via-kibana/208744)

<div class="topic-metadata">

**Author:** [@elktester](https://discuss.elastic.co/u/elktester)\
**Replies:** 4\
**Last updated:** [November 21, 2019, 11:30am UTC](https://discuss.elastic.co/t/watcher-failed-to-send-e-mail-via-kibana/208744 "2019-11-21T11:30:04Z")

</div>

Hello! well, i'm new to elasticsearch, and i'm trying to configure elasticsearch to receive alerts, so for that i use the configuration below, but I couldn't send a test email, and everytime the following msg is displ…

---

## [Elastic search bulk request API - Is the 'order' of document writing guaranteed](https://discuss.elastic.co/t/elastic-search-bulk-request-api-is-the-order-of-document-writing-guaranteed/208055)

<div class="topic-metadata">

**Author:** [@atanupanda](https://discuss.elastic.co/u/atanupanda)\
**Replies:** 5\
**Last updated:** [November 21, 2019, 10:51am UTC](https://discuss.elastic.co/t/elastic-search-bulk-request-api-is-the-order-of-document-writing-guaranteed/208055 "2019-11-21T10:51:24Z")

</div>

Hi Team, We are using bulk request API to write bulk documents into elastic search DB. As per the API documentation, we are adding documents one after another (i.e. in sequential order ) and after that we are calling ei…

---

## [Help on some query conversion from solar to elastic](https://discuss.elastic.co/t/help-on-some-query-conversion-from-solar-to-elastic/208858)

<div class="topic-metadata">

**Author:** [@santhosh\_kumar2](https://discuss.elastic.co/u/santhosh_kumar2)\
**Replies:** 0\
**Last updated:** [November 21, 2019, 10:39am UTC](https://discuss.elastic.co/t/help-on-some-query-conversion-from-solar-to-elastic/208858 "2019-11-21T10:39:17Z")

</div>

I want help on below solr function how to handle in elastic elastic. 1)group.field 2)group.sort=geodist() example: group.format=simple&sort=duration+asc&indent=on&group.limit=1&wt=json&rows=365&fl=airportname,id,Date…

---

## [How to search offline data which stored in external storage](https://discuss.elastic.co/t/how-to-search-offline-data-which-stored-in-external-storage/208432)

<div class="topic-metadata">

**Author:** [@raja.arumugam3](https://discuss.elastic.co/u/raja.arumugam3)\
**Replies:** 7\
**Last updated:** [November 21, 2019, 10:17am UTC](https://discuss.elastic.co/t/how-to-search-offline-data-which-stored-in-external-storage/208432 "2019-11-21T10:17:56Z")

</div>

by default we will read live data and maintain the data for 6 months in elastic search. In some cases we want to search 6 months data from last 5 years data(offline) which can be stored in external storage. How to searc…

---

## [\[Elasticsearch on Docker\] Can't have a dedicated master node](https://discuss.elastic.co/t/elasticsearch-on-docker-cant-have-a-dedicated-master-node/208733)

<div class="topic-metadata">

**Author:** [@Travis](https://discuss.elastic.co/u/Travis)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 10:05am UTC](https://discuss.elastic.co/t/elasticsearch-on-docker-cant-have-a-dedicated-master-node/208733 "2019-11-21T10:05:16Z")

</div>

Hello there ! On Docker, I can't succeed to have a dedicated master node in a simple 4 nodes test setup. Master is never discovered when I use : version: '2.2' services: master1: image: docker.elastic.co/elasticsear…

---

## [Calculate the processing time of algorithm](https://discuss.elastic.co/t/calculate-the-processing-time-of-algorithm/208079)

<div class="topic-metadata">

**Author:** [@Eniram](https://discuss.elastic.co/u/Eniram)\
**Replies:** 2\
**Last updated:** [November 21, 2019, 9:59am UTC](https://discuss.elastic.co/t/calculate-the-processing-time-of-algorithm/208079 "2019-11-21T09:59:30Z")

</div>

Hello everyone, I'm new at Elasticsearch and I'm currently on the 6.2.4 version, but we will soon migrate to 7.3.2. For some context : I'm monitoring a system's production and performances using ES and Kibana. The syst…

---

## [Rejecting mapping update to db as thee final mapping would have more than 1 type](https://discuss.elastic.co/t/rejecting-mapping-update-to-db-as-thee-final-mapping-would-have-more-than-1-type/208825)

<div class="topic-metadata">

**Author:** [@vatsalnarry2](https://discuss.elastic.co/u/vatsalnarry2)\
**Replies:** 4\
**Last updated:** [November 21, 2019, 9:26am UTC](https://discuss.elastic.co/t/rejecting-mapping-update-to-db-as-thee-final-mapping-would-have-more-than-1-type/208825 "2019-11-21T09:26:35Z")

</div>

I have create logstash-mysql.conf with below configuration. When i am running logstash.bat -f logstatshmysql.cong I am to see only last table is indexed. Sample Logstash configuration for creating a simple Beats -\> L…

---

## [Ctx.\_source is not up to date](https://discuss.elastic.co/t/ctx-source-is-not-up-to-date/208539)

<div class="topic-metadata">

**Author:** [@paon.m](https://discuss.elastic.co/u/paon.m)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 9:17am UTC](https://discuss.elastic.co/t/ctx-source-is-not-up-to-date/208539 "2019-11-21T09:17:54Z")

</div>

Hi All, I have a strange problem using the update Api and a script painless to update the document when I have concurrent updates on the same document. It seems to happen only on nested fields, randomly and with a frequ…

---

## [How can elasticsearch automatically index documents inside the tmp / es directory of fscrawler?](https://discuss.elastic.co/t/how-can-elasticsearch-automatically-index-documents-inside-the-tmp-es-directory-of-fscrawler/208274)

<div class="topic-metadata">

**Author:** [@Vo\_Van\_Huy](https://discuss.elastic.co/u/Vo_Van_Huy)\
**Replies:** 5\
**Last updated:** [November 21, 2019, 8:35am UTC](https://discuss.elastic.co/t/how-can-elasticsearch-automatically-index-documents-inside-the-tmp-es-directory-of-fscrawler/208274 "2019-11-21T08:35:45Z")

</div>

I frequently change data, so my json files inside fscrawler's tmp / es directory are constantly changing. may be deleting, may be changing the data inside a json file, or changing the json file name. I am currently havi…

---

## [High level REST Java Client](https://discuss.elastic.co/t/high-level-rest-java-client/208821)

<div class="topic-metadata">

**Author:** [@rajesh\_elasticsearch](https://discuss.elastic.co/u/rajesh_elasticsearch)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 8:29am UTC](https://discuss.elastic.co/t/high-level-rest-java-client/208821 "2019-11-21T08:29:19Z")

</div>

In High level REST java client we not using cluster name to get the client. But in Transport Client we used. I knew since we using REST we can access the service. But still I want to know the difference. Kindly help me …

---

## [Docker elasticsearch can't find master](https://discuss.elastic.co/t/docker-elasticsearch-cant-find-master/208102)

<div class="topic-metadata">

**Author:** [@iukea](https://discuss.elastic.co/u/iukea)\
**Replies:** 7\
**Last updated:** [November 21, 2019, 8:07am UTC](https://discuss.elastic.co/t/docker-elasticsearch-cant-find-master/208102 "2019-11-21T08:07:24Z")

</div>

Hello, Elk buds, Having an issue with my elasticsearch nodes discovering one another Elk 7.4 Running in docker the same VLan no firewalls blocking they are running on 2 separate compute nodes Elk master node docke…

---

## [Create Elastic Search Resource Processor and update Resource API](https://discuss.elastic.co/t/create-elastic-search-resource-processor-and-update-resource-api/208816)

<div class="topic-metadata">

**Author:** [@Rajendra\_Prasad](https://discuss.elastic.co/u/Rajendra_Prasad)\
**Replies:** 2\
**Last updated:** [November 21, 2019, 7:29am UTC](https://discuss.elastic.co/t/create-elastic-search-resource-processor-and-update-resource-api/208816 "2019-11-21T07:29:51Z")

</div>

Create Elastic Search Resource Processor and update Resource API Please provide me the process

---

## [Missing records when using BulkProcessor (Java High Level Rest Client)](https://discuss.elastic.co/t/missing-records-when-using-bulkprocessor-java-high-level-rest-client/208625)

<div class="topic-metadata">

**Author:** [@dawood\_abdullah](https://discuss.elastic.co/u/dawood_abdullah)\
**Replies:** 12\
**Last updated:** [November 21, 2019, 6:36am UTC](https://discuss.elastic.co/t/missing-records-when-using-bulkprocessor-java-high-level-rest-client/208625 "2019-11-21T06:36:33Z")

</div>

Hi, I use BulkProcessor to index records. I see that some of the records are missing when doing bulk indexing. I don't see any Exception or Errors, also, in afterBulk callback there are no failures. BulkProcessor is sin…

---

## [Elasticsearch - Optimising Request Time | Infrastructure | Self Hosted AWS](https://discuss.elastic.co/t/elasticsearch-optimising-request-time-infrastructure-self-hosted-aws/208721)

<div class="topic-metadata">

**Author:** [@somnath.guthula](https://discuss.elastic.co/u/somnath.guthula)\
**Replies:** 3\
**Last updated:** [November 21, 2019, 5:24am UTC](https://discuss.elastic.co/t/elasticsearch-optimising-request-time-infrastructure-self-hosted-aws/208721 "2019-11-21T05:24:57Z")

</div>

Hello Team, I am looking for some help in understanding the current state and optimising the response time of elasticsearch cluster that we are running in production. We are having High CPU utilisation and the search qu…

---

## [How to add default attribute with value in ES](https://discuss.elastic.co/t/how-to-add-default-attribute-with-value-in-es/208472)

<div class="topic-metadata">

**Author:** [@DeepakBhatt](https://discuss.elastic.co/u/DeepakBhatt)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 4:19am UTC](https://discuss.elastic.co/t/how-to-add-default-attribute-with-value-in-es/208472 "2019-11-21T04:19:05Z")

</div>

Hi Team, I want to add default attribute with default value while adding any document to the index. For example: Suppose we have index abc and we are adding 10 attribute then there is one default attribute we want to a…

---

## [Full text search for when text/document is split chunks](https://discuss.elastic.co/t/full-text-search-for-when-text-document-is-split-chunks/208487)

<div class="topic-metadata">

**Author:** [@smerchant](https://discuss.elastic.co/u/smerchant)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 4:14am UTC](https://discuss.elastic.co/t/full-text-search-for-when-text-document-is-split-chunks/208487 "2019-11-21T04:14:37Z")

</div>

We have large number of books and we would like to store each book (size of the single book itself could be very large) into small chucks/sections (let's say between 300 to 500 words). I am not sure how search would wor…

---

## [Search results behavior with boosts are different from 6.8 to 7.1](https://discuss.elastic.co/t/search-results-behavior-with-boosts-are-different-from-6-8-to-7-1/207981)

<div class="topic-metadata">

**Author:** [@Yann\_Lair](https://discuss.elastic.co/u/Yann_Lair)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 3:39am UTC](https://discuss.elastic.co/t/search-results-behavior-with-boosts-are-different-from-6-8-to-7-1/207981 "2019-11-21T03:39:11Z")

</div>

Hi, We are currently doing the ground work to migrate from ES 6.8 to latest (which is 7.1 on AWS server side). We have built a new set of environment to be able to assess the impact of that change and we are seeing sear…

---

## [Event Correlation Using ELK](https://discuss.elastic.co/t/event-correlation-using-elk/208768)

<div class="topic-metadata">

**Author:** [@AnshuPal](https://discuss.elastic.co/u/AnshuPal)\
**Replies:** 1\
**Last updated:** [November 21, 2019, 3:10am UTC](https://discuss.elastic.co/t/event-correlation-using-elk/208768 "2019-11-21T03:10:34Z")

</div>

Hello, I have installed and configured all the ELK stack and i am also able to capture all the logs. Now i need to correlate the logs coming from different sources ex. Firewall, switches, Syslog and Operating sytems In…

---

## [Nodejs elasticsearch index method insert data Error: Request error, retrying](https://discuss.elastic.co/t/nodejs-elasticsearch-index-method-insert-data-error-request-error-retrying/208799)

<div class="topic-metadata">

**Author:** [@xiaojin888](https://discuss.elastic.co/u/xiaojin888)\
**Replies:** 0\
**Last updated:** [November 21, 2019, 2:09am UTC](https://discuss.elastic.co/t/nodejs-elasticsearch-index-method-insert-data-error-request-error-retrying/208799 "2019-11-21T02:09:14Z")

</div>

I use nodejs insert data to elasticsearch！ Error: Request error, retrying POST http://192.168.2.69:9527/hexinprofit/\_doc/40153368 =\> connect ENOBUFS 192.168.2.69:9527 - Local (undefined:undefined) at Log.error (E:\\hex…

---

## [How to achieve multiple match\_phrase\_prefix queries using query\_string](https://discuss.elastic.co/t/how-to-achieve-multiple-match-phrase-prefix-queries-using-query-string/208743)

<div class="topic-metadata">

**Author:** [@ankur\_singla](https://discuss.elastic.co/u/ankur_singla)\
**Replies:** 0\
**Last updated:** [November 20, 2019, 4:48pm UTC](https://discuss.elastic.co/t/how-to-achieve-multiple-match-phrase-prefix-queries-using-query-string/208743 "2019-11-20T16:48:59Z")

</div>

Hi I have multiple match\_phrase\_prefix queries which I am trying to combine in one query. GET test/\_search { "query": { "bool": { "should": \[ { "match\_phrase\_prefix": { "test\_d…

---

## [Is it possible to use Elasticsearch to post Kibana graphs in Slack channel?](https://discuss.elastic.co/t/is-it-possible-to-use-elasticsearch-to-post-kibana-graphs-in-slack-channel/208792)

<div class="topic-metadata">

**Author:** [@EZprogramming](https://discuss.elastic.co/u/EZprogramming)\
**Replies:** 0\
**Last updated:** [November 21, 2019, 12:51am UTC](https://discuss.elastic.co/t/is-it-possible-to-use-elasticsearch-to-post-kibana-graphs-in-slack-channel/208792 "2019-11-21T00:51:32Z")

</div>

I am using Python 3.7 and Elasticsearch 7.3.2 for indexing and querying data, then I send the data to Slack as text. I was wondering if it is possible to get the data as a graph and post the picture/pdf in Slack? Also, …

---

## [Mesh Configuration](https://discuss.elastic.co/t/mesh-configuration/208609)

<div class="topic-metadata">

**Author:** [@JohnM](https://discuss.elastic.co/u/JohnM)\
**Replies:** 6\
**Last updated:** [November 20, 2019, 11:23pm UTC](https://discuss.elastic.co/t/mesh-configuration/208609 "2019-11-20T23:23:47Z")

</div>

Hi everyone, I thought this works but it seems not.. Network devices send syslog to Logstash-1 and Logstash-2 So Logstash-1 and Logstash-2 have same logs received. \< Confirmed. Logstash-1 sends logs to ES-A cluster (…

[Previous page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1086)

[Next page](https://discuss.elastic.co/c/elastic-stack/elasticsearch/6.md?page=1088)
