# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=2000

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 2001

---

## [Upgrade from 6.8 to 7.7.1 asks for re-index which was already performed](https://discuss.elastic.co/t/upgrade-from-6-8-to-7-7-1-asks-for-re-index-which-was-already-performed/237076)

<div class="topic-metadata">

**Author:** [@defalt](https://discuss.elastic.co/u/defalt)\
**Replies:** 2\
**Last updated:** [June 15, 2020, 7:09am UTC](https://discuss.elastic.co/t/upgrade-from-6-8-to-7-7-1-asks-for-re-index-which-was-already-performed/237076 "2020-06-15T07:09:04Z")

</div>

Hi, I am trying to upgrade a snapshot from 5.2 to 7.7. I did this with the help of the documentation. I restored the snapshot to 6.8 which should reindex it right? Now i performed the upgrade, moving the data to the new…

---

## [Hanging active search threads](https://discuss.elastic.co/t/hanging-active-search-threads/237079)

<div class="topic-metadata">

**Author:** [@Tibor\_Schmidt](https://discuss.elastic.co/u/Tibor_Schmidt)\
**Replies:** 0\
**Last updated:** [June 15, 2020, 7:05am UTC](https://discuss.elastic.co/t/hanging-active-search-threads/237079 "2020-06-15T07:05:38Z")

</div>

Hey, we're having issues with timeouting search queries on our 61 node es cluster. elasticsearch.exceptions.ConnectionTimeout: ConnectionTimeout caused by - ReadTimeoutError(HTTPSConnectionPool(host='XXXXXX', port=9200…

---

## [ES fatal error when applying filters in Kibana](https://discuss.elastic.co/t/es-fatal-error-when-applying-filters-in-kibana/236304)

<div class="topic-metadata">

**Author:** [@AlessandroKP](https://discuss.elastic.co/u/AlessandroKP)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 7:04am UTC](https://discuss.elastic.co/t/es-fatal-error-when-applying-filters-in-kibana/236304 "2020-06-15T07:04:03Z")

</div>

Hi all, my Elasticsearch cluster keeps crashing whenever I do the following thing: go to the "Discover" section of Kibana (or any visualization or dashboard) and apply a filter to a field of type keyword (through the "…

---

## [Using invert Iclusion of a saved Query](https://discuss.elastic.co/t/using-invert-iclusion-of-a-saved-query/235941)

<div class="topic-metadata">

**Author:** [@dzoni](https://discuss.elastic.co/u/dzoni)\
**Replies:** 2\
**Last updated:** [June 15, 2020, 7:03am UTC](https://discuss.elastic.co/t/using-invert-iclusion-of-a-saved-query/235941 "2020-06-15T07:03:24Z")

</div>

Hello there, i have an Problem by solving my use case. I created and saved a query. This query is filtering values of a String field. Then i was creating a visualization with a Invert inclusion reference to this query…

---

## [Write data event to azure blob storage from logstash conf file](https://discuss.elastic.co/t/write-data-event-to-azure-blob-storage-from-logstash-conf-file/237074)

<div class="topic-metadata">

**Author:** [@Pankaj\_Jadhav](https://discuss.elastic.co/u/Pankaj_Jadhav)\
**Replies:** 0\
**Last updated:** [June 15, 2020, 6:40am UTC](https://discuss.elastic.co/t/write-data-event-to-azure-blob-storage-from-logstash-conf-file/237074 "2020-06-15T06:40:06Z")

</div>

Hi, can someone will help me for writing data in azure blob storage from logstash. When I will get any exception inside tags on condition basis needs to send that data inside azure blob storage

---

## [Kibana statuscode-404-error-not-found-message-notFound](https://discuss.elastic.co/t/kibana-statuscode-404-error-not-found-message-notfound/236575)

<div class="topic-metadata">

**Author:** [@shanthveeresh](https://discuss.elastic.co/u/shanthveeresh)\
**Replies:** 2\
**Last updated:** [June 15, 2020, 6:38am UTC](https://discuss.elastic.co/t/kibana-statuscode-404-error-not-found-message-notfound/236575 "2020-06-15T06:38:25Z")

</div>

hi, Actually the kibana is working fine in local host but when i change the URL the server is listening but in UI getting 404 error not found. (/kibana/spaces/space\_selector) below is my elastic health status curl -ue…

---

## [Kibana doesn't show anything from elasticsearch](https://discuss.elastic.co/t/kibana-doesnt-show-anything-from-elasticsearch/236847)

<div class="topic-metadata">

**Author:** [@teooood](https://discuss.elastic.co/u/teooood)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 6:14am UTC](https://discuss.elastic.co/t/kibana-doesnt-show-anything-from-elasticsearch/236847 "2020-06-15T06:14:53Z")

</div>

Hi everyone. I am using the Filebeat service, and I have a problem. I can't see the logs in Kibana. I am on a Windows machine. I tried to config Filebeat to get data from Elasticsearch. This is my config file: #====…

---

## [Updating preinstalled Logstash gems](https://discuss.elastic.co/t/updating-preinstalled-logstash-gems/235541)

<div class="topic-metadata">

**Author:** [@Manuel\_M](https://discuss.elastic.co/u/Manuel_M)\
**Replies:** 2\
**Last updated:** [June 15, 2020, 6:09am UTC](https://discuss.elastic.co/t/updating-preinstalled-logstash-gems/235541 "2020-06-15T06:09:10Z")

</div>

Hello, I have already developed multiple logstash-filter plugins for my company, which are located in our private repository. I don't have any problems installing them and using them in our Logstash. I had to make chan…

---

## [Load balancer endpoint for pipeline](https://discuss.elastic.co/t/load-balancer-endpoint-for-pipeline/235944)

<div class="topic-metadata">

**Author:** [@shubhamshd99](https://discuss.elastic.co/u/shubhamshd99)\
**Replies:** 4\
**Last updated:** [June 15, 2020, 6:00am UTC](https://discuss.elastic.co/t/load-balancer-endpoint-for-pipeline/235944 "2020-06-15T06:00:48Z")

</div>

Hi everyone, I wanted to use jdbc plugin to ingest data in any database into logstash, and this, in turn, will require setting up a load balancer endpoint. So could anyone give me any tips on how to achieve this???

---

## [About es aggregation query index filtering, and the number of accurate aggregation results returned](https://discuss.elastic.co/t/about-es-aggregation-query-index-filtering-and-the-number-of-accurate-aggregation-results-returned/237063)

<div class="topic-metadata">

**Author:** [@NiFeng](https://discuss.elastic.co/u/NiFeng)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 5:17am UTC](https://discuss.elastic.co/t/about-es-aggregation-query-index-filtering-and-the-number-of-accurate-aggregation-results-returned/237063 "2020-06-15T05:17:02Z")

</div>

First of all, I want to accurately control the amount of large data and the number of results under multidimensional aggregation statistics. Second, I would also like to filter the results of the polymerization, similar…

---

## [Point to any machine in the cluster?](https://discuss.elastic.co/t/point-to-any-machine-in-the-cluster/236595)

<div class="topic-metadata">

**Author:** [@pszm](https://discuss.elastic.co/u/pszm)\
**Replies:** 3\
**Last updated:** [June 15, 2020, 5:03am UTC](https://discuss.elastic.co/t/point-to-any-machine-in-the-cluster/236595 "2020-06-15T05:03:18Z")

</div>

I am sure this is a basic question but I just don't see it answered in any clear way. We are running a Ruby on Rails 5 app using the elasticsearch-rails gem. We have a cluster of 3 machines for ElasticSearch. Can we po…

---

## [SQL like joins on Elastic Search](https://discuss.elastic.co/t/sql-like-joins-on-elastic-search/237056)

<div class="topic-metadata">

**Author:** [@skv325](https://discuss.elastic.co/u/skv325)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 5:03am UTC](https://discuss.elastic.co/t/sql-like-joins-on-elastic-search/237056 "2020-06-15T05:03:09Z")

</div>

Hello, Does ES support Sql like joins on different indexes? Currently I have to load indexes contents \[with some filtering\] into memory and use Linq to do the join which is very slow. Is any workaround? Thanks

---

## [How to search across multiple indices in single query?](https://discuss.elastic.co/t/how-to-search-across-multiple-indices-in-single-query/237059)

<div class="topic-metadata">

**Author:** [@Krishna\_Sai\_Nag\_G](https://discuss.elastic.co/u/Krishna_Sai_Nag_G)\
**Replies:** 1\
**Last updated:** [June 15, 2020, 5:02am UTC](https://discuss.elastic.co/t/how-to-search-across-multiple-indices-in-single-query/237059 "2020-06-15T05:02:46Z")

</div>

I want to search across multiple indices in a single query, is it possible to search in elastic search?

---

## [Nested Objects in Elastic](https://discuss.elastic.co/t/nested-objects-in-elastic/236321)

<div class="topic-metadata">

**Author:** [@Ayyappa\_P](https://discuss.elastic.co/u/Ayyappa_P)\
**Replies:** 2\
**Last updated:** [June 15, 2020, 4:15am UTC](https://discuss.elastic.co/t/nested-objects-in-elastic/236321 "2020-06-15T04:15:00Z")

</div>

Hi, I have a data in the following format. I'm trying with ELastic 7.6 and using Kibana. {"l1f1":"f1Value","l1f2":\[{"l2f1":"l1f1Value","l2f2":"l2f2Value","l2f3":"l2f3Value"}\]} I want to index this data using bulk inse…

---

## [How do i find out "stale primary" quickly](https://discuss.elastic.co/t/how-do-i-find-out-stale-primary-quickly/237049)

<div class="topic-metadata">

**Author:** [@yc1024](https://discuss.elastic.co/u/yc1024)\
**Replies:** 0\
**Last updated:** [June 15, 2020, 3:09am UTC](https://discuss.elastic.co/t/how-do-i-find-out-stale-primary-quickly/237049 "2020-06-15T03:09:43Z")

</div>

There are 50,000 shards and 70 nodes in my cluster.I have two nodes with hardware failure，I want to use allocate\_stale\_primary for recovery. How can I quickly find out the "stale primary". curl -X POST "http://localhos…

---

## [Timelion visualization is wrong](https://discuss.elastic.co/t/timelion-visualization-is-wrong/236011)

<div class="topic-metadata">

**Author:** [@sanjaysubramanian](https://discuss.elastic.co/u/sanjaysubramanian)\
**Replies:** 4\
**Last updated:** [June 15, 2020, 2:08am UTC](https://discuss.elastic.co/t/timelion-visualization-is-wrong/236011 "2020-06-15T02:08:08Z")

</div>

Hi all IMHO , Timelion displays the data incorrectly. I am using Kibana 7.7.0 My TimeZone is set through Kibana Advanced settings to UTC I am attaching 2 videos \[1\] Chart visualization of Unique Conversations per day…

---

## [Count instances of a field in Elasticsearch index](https://discuss.elastic.co/t/count-instances-of-a-field-in-elasticsearch-index/236907)

<div class="topic-metadata">

**Author:** [@gitterhh](https://discuss.elastic.co/u/gitterhh)\
**Replies:** 3\
**Last updated:** [June 15, 2020, 2:08am UTC](https://discuss.elastic.co/t/count-instances-of-a-field-in-elasticsearch-index/236907 "2020-06-15T02:08:07Z")

</div>

How to count the instances of a particular field, across all documents, in a given Elasticsearch index. For example, if I've got the following documents in index goober : { '\_id':'foo', 'field1':'a value', …

---

## [Is it possible to Snapshot ALL indices and exclude some?](https://discuss.elastic.co/t/is-it-possible-to-snapshot-all-indices-and-exclude-some/237047)

<div class="topic-metadata">

**Author:** [@AClerk](https://discuss.elastic.co/u/AClerk)\
**Replies:** 0\
**Last updated:** [June 15, 2020, 1:58am UTC](https://discuss.elastic.co/t/is-it-possible-to-snapshot-all-indices-and-exclude-some/237047 "2020-06-15T01:58:42Z")

</div>

Hey there, The use case is: I want to default snapshot all indices. But, I want to leave out a few of them. The environment I am working on is dynamic, and new indices are created daily. I want to determine with each …

---

## [Kibana Visualization Error using scripted Date field](https://discuss.elastic.co/t/kibana-visualization-error-using-scripted-date-field/235874)

<div class="topic-metadata">

**Author:** [@sanjaysubramanian](https://discuss.elastic.co/u/sanjaysubramanian)\
**Replies:** 3\
**Last updated:** [June 15, 2020, 1:58am UTC](https://discuss.elastic.co/t/kibana-visualization-error-using-scripted-date-field/235874 "2020-06-15T01:58:09Z")

</div>

I have a scripted Date field (called "yyyy\_mm\_dd") in Kibana 7.7.0 Script Date date = new Date(doc\['ts'\].value.millis); Calendar cal = Calendar.getInstance(); cal.setTime(date); cal.set(Calendar.HOUR\_OF\_DAY, 0); cal.s…

---

## [Failed to publish events caused by: write tcp X.X.X.X:36524-\>X.X.X.X:5044: write: connection reset by peer error in filebeat](https://discuss.elastic.co/t/failed-to-publish-events-caused-by-write-tcp-x-x-x-x-36524-x-x-x-x-write-connection-reset-by-peer-error-in-filebeat/237031)

<div class="topic-metadata">

**Author:** [@Aqel](https://discuss.elastic.co/u/Aqel)\
**Replies:** 2\
**Last updated:** [June 15, 2020, 1:50am UTC](https://discuss.elastic.co/t/failed-to-publish-events-caused-by-write-tcp-x-x-x-x-36524-x-x-x-x-write-connection-reset-by-peer-error-in-filebeat/237031 "2020-06-15T01:50:30Z")

</div>

I am getting this error while trying to push logs using filebeat to logstash. |filebeat | 2020-06-14T16:45:36.660318702Z 2020-06-14T16:45:36.660Z|ERROR|logstash/async.go:256|Failed to publish events caused by: wri…

---

## [Filebeat panic in Windows nano server container](https://discuss.elastic.co/t/filebeat-panic-in-windows-nano-server-container/236838)

<div class="topic-metadata">

**Author:** [@zhiweiv](https://discuss.elastic.co/u/zhiweiv)\
**Replies:** 2\
**Last updated:** [June 15, 2020, 1:49am UTC](https://discuss.elastic.co/t/filebeat-panic-in-windows-nano-server-container/236838 "2020-06-15T01:49:18Z")

</div>

Filebeat 7.7 panic in Windows nano server container, however 7.3 works. Found a useful link: https://github.com/golang/go/issues/21867, latest klog fixed it: https://github.com/kubernetes/klog/blob/master/klog\_file.go#L…

---

## [Scripted fields not working on multiline Events](https://discuss.elastic.co/t/scripted-fields-not-working-on-multiline-events/236554)

<div class="topic-metadata">

**Author:** [@amityadav](https://discuss.elastic.co/u/amityadav)\
**Replies:** 0\
**Last updated:** [June 10, 2020, 4:55pm UTC](https://discuss.elastic.co/t/scripted-fields-not-working-on-multiline-events/236554 "2020-06-10T16:55:54Z")

</div>

I am using multiline codec in my logstash config file in input section to merge few lines of log file. Lines 5,6,7,8,9 are getting merged into a single line and the same is visible in Kibana screen for message and sub\_cl…

---

## [Edit default logstash index template](https://discuss.elastic.co/t/edit-default-logstash-index-template/236682)

<div class="topic-metadata">

**Author:** [@FabioAntunes](https://discuss.elastic.co/u/FabioAntunes)\
**Replies:** 0\
**Last updated:** [June 11, 2020, 10:49am UTC](https://discuss.elastic.co/t/edit-default-logstash-index-template/236682 "2020-06-11T10:49:13Z")

</div>

Hey folks, been going back and forth on documentation and discuss topics. Unfortunately, I couldn't found a solution to my problem. I have a default index template for logstash, if I do GET /\_template/elasticsearch-temp…

---

## [Is SLM supported on Elasticsearch 6.8?](https://discuss.elastic.co/t/is-slm-supported-on-elasticsearch-6-8/236692)

<div class="topic-metadata">

**Author:** [@egibrajshori](https://discuss.elastic.co/u/egibrajshori)\
**Replies:** 1\
**Last updated:** [June 14, 2020, 11:47pm UTC](https://discuss.elastic.co/t/is-slm-supported-on-elasticsearch-6-8/236692 "2020-06-14T23:47:53Z")

</div>

Hi, We have a couple clusters on 6.8 and we're looking into implementing SLM for scheduled snapshots. I'm looking at the documentation and searching on the internet for it but I can't find anything suggesting that SLM i…

---

## [Issue with \_update command](https://discuss.elastic.co/t/issue-with-update-command/236841)

<div class="topic-metadata">

**Author:** [@Ayyappa\_P](https://discuss.elastic.co/u/Ayyappa_P)\
**Replies:** 0\
**Last updated:** [June 12, 2020, 7:27am UTC](https://discuss.elastic.co/t/issue-with-update-command/236841 "2020-06-12T07:27:39Z")

</div>

Hi, I've a data in the following format. { "uTestTokenId": "8488DA03-447F-46DF-B431-03C027674A16", "vTestTokenNumber": "", "uCycleId": "0FDDDE67-6793-4093-9790-9E3611356C8B", "uPupil…

---

## [Elasticsearch vs Oracle](https://discuss.elastic.co/t/elasticsearch-vs-oracle/236968)

<div class="topic-metadata">

**Author:** [@liron\_gofberg](https://discuss.elastic.co/u/liron_gofberg)\
**Replies:** 3\
**Last updated:** [June 14, 2020, 11:19pm UTC](https://discuss.elastic.co/t/elasticsearch-vs-oracle/236968 "2020-06-14T23:19:40Z")

</div>

Hi, I am a student and my project is about Elastic Stack. the company I work for is currently using oracle for managing its data. they want assess Elasticsearch as a replacement. according to my project success they …

---

## [Remove spaces from field names after JSON parsing from filebeat](https://discuss.elastic.co/t/remove-spaces-from-field-names-after-json-parsing-from-filebeat/236806)

<div class="topic-metadata">

**Author:** [@nmoham](https://discuss.elastic.co/u/nmoham)\
**Replies:** 2\
**Last updated:** [June 14, 2020, 11:14pm UTC](https://discuss.elastic.co/t/remove-spaces-from-field-names-after-json-parsing-from-filebeat/236806 "2020-06-14T23:14:41Z")

</div>

Sample data { "time": "2020-06-11 01:59:16.9760 -05:00", "level": "Info", "threadId": "164", "Message": "GetContactDataForCustomAutoAssignWorker", "Message": "Completed", "Call Tracker Id": "7e6a1602-6a89-4933-9329-d173…

---

## [Unable to parse date in logstash getting \_grokparsefailure in elasticsearch](https://discuss.elastic.co/t/unable-to-parse-date-in-logstash-getting-grokparsefailure-in-elasticsearch/237039)

<div class="topic-metadata">

**Author:** [@Ankit\_Goel1](https://discuss.elastic.co/u/Ankit_Goel1)\
**Replies:** 1\
**Last updated:** [June 14, 2020, 10:33pm UTC](https://discuss.elastic.co/t/unable-to-parse-date-in-logstash-getting-grokparsefailure-in-elasticsearch/237039 "2020-06-14T22:33:12Z")

</div>

I am using beats to read logs from my log file and log format is like: 2020-06-07T17:45:35.8964992Z|101|Info|136|ThreadPool|ValidationService.GetValidValueDate.LookupByCurrencyAndOwnersOfClientId I tried many patterns …

---

## [Auditbeat config - What about this config makes the CPU so high?](https://discuss.elastic.co/t/auditbeat-config-what-about-this-config-makes-the-cpu-so-high/235988)

<div class="topic-metadata">

**Author:** [@mgotechlock](https://discuss.elastic.co/u/mgotechlock)\
**Replies:** 3\
**Last updated:** [June 14, 2020, 7:59pm UTC](https://discuss.elastic.co/t/auditbeat-config-what-about-this-config-makes-the-cpu-so-high/235988 "2020-06-14T19:59:24Z")

</div>

Below is my auditbeat config. What about this is so CPU taxing? \` ###################### Auditbeat Configuration Example ######################### # This is an example configuration file highlighting only the most c…

---

## [Metricbeat to logstash parsing error: illegal\_state\_exception & Can't get text on a START\_OBJECT](https://discuss.elastic.co/t/metricbeat-to-logstash-parsing-error-illegal-state-exception-cant-get-text-on-a-start-object/237035)

<div class="topic-metadata">

**Author:** [@parthmaniar](https://discuss.elastic.co/u/parthmaniar)\
**Replies:** 1\
**Last updated:** [June 14, 2020, 7:40pm UTC](https://discuss.elastic.co/t/metricbeat-to-logstash-parsing-error-illegal-state-exception-cant-get-text-on-a-start-object/237035 "2020-06-14T19:40:39Z")

</div>

Hello, I am using the following configuration to get metrics from a Raspebrry Pi (running Raspberry OS) using Metricbeat. It works flawlessly when I send the logs directly to elasticsearch. However, I want to move my ing…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1999)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=2001)
