# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1804

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1805

---

## [Migrate data from AWS ELK service to my server](https://discuss.elastic.co/t/migrate-data-from-aws-elk-service-to-my-server/248640)

<div class="topic-metadata">

**Author:** [@vidhyadhara](https://discuss.elastic.co/u/vidhyadhara)\
**Replies:** 4\
**Last updated:** [September 16, 2020, 5:44am UTC](https://discuss.elastic.co/t/migrate-data-from-aws-elk-service-to-my-server/248640 "2020-09-16T05:44:29Z")

</div>

Hello Everyone, I have a AWS Elasticsearch service (NOTE that its a service i have not installed anything on AWS) , i have been using for 8-9 months, now that i have installed ELK on my own server, i want to move all da…

---

## [Condition fails on text field in Kibana alert and Action](https://discuss.elastic.co/t/condition-fails-on-text-field-in-kibana-alert-and-action/247820)

<div class="topic-metadata">

**Author:** [@msszafar](https://discuss.elastic.co/u/msszafar)\
**Replies:** 6\
**Last updated:** [September 16, 2020, 5:41am UTC](https://discuss.elastic.co/t/condition-fails-on-text-field-in-kibana-alert-and-action/247820 "2020-09-16T05:41:53Z")

</div>

Hi Community, Alert condition and other details are as In above screenshot, type.keyword IS ADServers (type field type is string/text in elasticsearch field mapping) I also tried it too type IS ADServers (type…

---

## [In Packetloss dropping packets](https://discuss.elastic.co/t/in-packetloss-dropping-packets/248680)

<div class="topic-metadata">

**Author:** [@pankaj0172](https://discuss.elastic.co/u/pankaj0172)\
**Replies:** 5\
**Last updated:** [September 16, 2020, 4:55am UTC](https://discuss.elastic.co/t/in-packetloss-dropping-packets/248680 "2020-09-16T04:55:50Z")

</div>

Hi, Can we see time period like at what time "In Packet loss" drop the packets?

---

## [Cannot connect to remote cluster in proxy mode](https://discuss.elastic.co/t/cannot-connect-to-remote-cluster-in-proxy-mode/248764)

<div class="topic-metadata">

**Author:** [@onhachoe](https://discuss.elastic.co/u/onhachoe)\
**Replies:** 0\
**Last updated:** [September 16, 2020, 4:45am UTC](https://discuss.elastic.co/t/cannot-connect-to-remote-cluster-in-proxy-mode/248764 "2020-09-16T04:45:53Z")

</div>

Hi, I'm trying to add remote cluster through the PUT \_cluster/settings, and was able to successfully add one. { "acknowledged": true, "persistent": { "cluster": { "remote": { …

---

## [Feasibility in joining two indexes in elasticsearch](https://discuss.elastic.co/t/feasibility-in-joining-two-indexes-in-elasticsearch/248577)

<div class="topic-metadata">

**Author:** [@Gauti](https://discuss.elastic.co/u/Gauti)\
**Replies:** 4\
**Last updated:** [September 16, 2020, 4:14am UTC](https://discuss.elastic.co/t/feasibility-in-joining-two-indexes-in-elasticsearch/248577 "2020-09-16T04:14:57Z")

</div>

Hi All, I have a index named "dev-ticket" which stores the data of all the incidents created and "dev-perf" which stores the data related to respective server performance Is there are way to join these two index into …

---

## [Heartbeat monitor auto reloading does now work](https://discuss.elastic.co/t/heartbeat-monitor-auto-reloading-does-now-work/248306)

<div class="topic-metadata">

**Author:** [@tterranigma](https://discuss.elastic.co/u/tterranigma)\
**Replies:** 4\
**Last updated:** [September 16, 2020, 1:22am UTC](https://discuss.elastic.co/t/heartbeat-monitor-auto-reloading-does-now-work/248306 "2020-09-16T01:22:19Z")

</div>

According to heartbeat documentation, heartbeat supports automatically reloading the monitor files periodically. In my installation of heartbeat, I have enabled this: heartbeat: config: monitors: path: /etc/…

---

## [Aggregation Script with ID and use it in condition](https://discuss.elastic.co/t/aggregation-script-with-id-and-use-it-in-condition/248749)

<div class="topic-metadata">

**Author:** [@saradac](https://discuss.elastic.co/u/saradac)\
**Replies:** 2\
**Last updated:** [September 16, 2020, 12:16am UTC](https://discuss.elastic.co/t/aggregation-script-with-id-and-use-it-in-condition/248749 "2020-09-16T00:16:07Z")

</div>

Hi All, I am using script in aggregation and need two things min\_doc\_count Use aggerartion in condition All I am trying is to group by outlet and statationno and if count \> 3 send alert. Below is my script: "aggs"…

---

## [Elasticsearch output hosts list](https://discuss.elastic.co/t/elasticsearch-output-hosts-list/248735)

<div class="topic-metadata">

**Author:** [@YvorL](https://discuss.elastic.co/u/YvorL)\
**Replies:** 4\
**Last updated:** [September 15, 2020, 11:58pm UTC](https://discuss.elastic.co/t/elasticsearch-output-hosts-list/248735 "2020-09-15T23:58:36Z")

</div>

Hi, Should I include all Elasticsearch nodes (there are no dedicated masters, and there's one coordinating node) when I specify the list of ES nodes in the output block? I mean in case, I'm horizontally scaling, do I ne…

---

## [Best practices on indexing/querying nested document in elasticsearch](https://discuss.elastic.co/t/best-practices-on-indexing-querying-nested-document-in-elasticsearch/248745)

<div class="topic-metadata">

**Author:** [@Deepanshu\_Gupta](https://discuss.elastic.co/u/Deepanshu_Gupta)\
**Replies:** 0\
**Last updated:** [September 15, 2020, 10:49pm UTC](https://discuss.elastic.co/t/best-practices-on-indexing-querying-nested-document-in-elasticsearch/248745 "2020-09-15T22:49:19Z")

</div>

Team, I am reaching out to you regarding best practices on indexing/querying elasticsearch in order to minimize latencies we are seeing with our cluster. We had a use-case where we needed to ingest data which is nested…

---

## [When logging on to Kibana after install, it 'hangs' on the 'Select your space' page](https://discuss.elastic.co/t/when-logging-on-to-kibana-after-install-it-hangs-on-the-select-your-space-page/248687)

<div class="topic-metadata">

**Author:** [@shvanwijlen](https://discuss.elastic.co/u/shvanwijlen)\
**Replies:** 1\
**Last updated:** [September 15, 2020, 10:25pm UTC](https://discuss.elastic.co/t/when-logging-on-to-kibana-after-install-it-hangs-on-the-select-your-space-page/248687 "2020-09-15T22:25:05Z")

</div>

Hi, I freshly installed Elasticsearch (trial license), then ran the elasticsearch-setup-passwords.bat and setup the passwords. Then I copied the Kibana zip contents and ran kibana.bat. I got all sorts of \[logical\] access…

---

## [Can ES SQL do things JSON search DSL can't?](https://discuss.elastic.co/t/can-es-sql-do-things-json-search-dsl-cant/248741)

<div class="topic-metadata">

**Author:** [@dvisz-inf](https://discuss.elastic.co/u/dvisz-inf)\
**Replies:** 1\
**Last updated:** [September 15, 2020, 9:52pm UTC](https://discuss.elastic.co/t/can-es-sql-do-things-json-search-dsl-cant/248741 "2020-09-15T21:52:00Z")

</div>

Hi all, I've been working with Elasticsearch a lot for the past two years. Although I come from a relational background, I've avoided using ES' SQL altogether, assuming that it couldn't do anything that the ES JSON sea…

---

## [Need to extract the records as per below requirement](https://discuss.elastic.co/t/need-to-extract-the-records-as-per-below-requirement/248646)

<div class="topic-metadata">

**Author:** [@Prasanth\_Kuna](https://discuss.elastic.co/u/Prasanth_Kuna)\
**Replies:** 1\
**Last updated:** [September 15, 2020, 9:38pm UTC](https://discuss.elastic.co/t/need-to-extract-the-records-as-per-below-requirement/248646 "2020-09-15T21:38:20Z")

</div>

\--------------------------------------------------------------------- Requirement is as below. please have a look: I want res…

---

## [My first attempt to export events into ELK](https://discuss.elastic.co/t/my-first-attempt-to-export-events-into-elk/248702)

<div class="topic-metadata">

**Author:** [@leostereo](https://discuss.elastic.co/u/leostereo)\
**Replies:** 3\
**Last updated:** [September 15, 2020, 9:14pm UTC](https://discuss.elastic.co/t/my-first-attempt-to-export-events-into-elk/248702 "2020-09-15T21:14:33Z")

</div>

Hi guys. I have a little application that generates a numeric result after performing some processing every 24hs. I, logging following log lines: Sep 15 15:06:30 UBUNTU-SMOKE 15 new customers created by system1 Sep 15…

---

## [Calculate time difference between 2 date fields : scripted field](https://discuss.elastic.co/t/calculate-time-difference-between-2-date-fields-scripted-field/248730)

<div class="topic-metadata">

**Author:** [@xyz2](https://discuss.elastic.co/u/xyz2)\
**Replies:** 2\
**Last updated:** [September 15, 2020, 9:04pm UTC](https://discuss.elastic.co/t/calculate-time-difference-between-2-date-fields-scripted-field/248730 "2020-09-15T21:04:28Z")

</div>

HI, I need to calculate duration using 2 date fields in watcher API. I tried using painless script and to test using scripted field. But it is errors out stating invalid syntax. What is missing in below ? if (!doc.con…

---

## [Logstash Error: Invalid FieldReference: \`\[iso-8859-1\]to\`](https://discuss.elastic.co/t/logstash-error-invalid-fieldreference-iso-8859-1-to/248712)

<div class="topic-metadata">

**Author:** [@adamzarn](https://discuss.elastic.co/u/adamzarn)\
**Replies:** 5\
**Last updated:** [September 15, 2020, 8:40pm UTC](https://discuss.elastic.co/t/logstash-error-invalid-fieldreference-iso-8859-1-to/248712 "2020-09-15T20:40:11Z")

</div>

I'm using ELK v7.9.1 and I get this error with some of records that are coming from CouchDB: logstash | \[2020-09-15T16:03:20,662\]\[ERROR\]\[logstash.javapipeline \]\[main\]\[69664fe8e111893f386d879e5cd848742ac1a327f…

---

## [Windows Service & Password-protected Keystore](https://discuss.elastic.co/t/windows-service-password-protected-keystore/248734)

<div class="topic-metadata">

**Author:** [@Coinology](https://discuss.elastic.co/u/Coinology)\
**Replies:** 0\
**Last updated:** [September 15, 2020, 8:13pm UTC](https://discuss.elastic.co/t/windows-service-password-protected-keystore/248734 "2020-09-15T20:13:59Z")

</div>

All, I see that the Elasticsearch keystore doc here advises that, if a password is used to protect the keystore, that password must be provided each time upon startup. Is there a way to provide this automatically for El…

---

## [Kibana - Hyperlink in Data Table](https://discuss.elastic.co/t/kibana-hyperlink-in-data-table/248209)

<div class="topic-metadata">

**Author:** [@subash](https://discuss.elastic.co/u/subash)\
**Replies:** 3\
**Last updated:** [September 15, 2020, 8:05pm UTC](https://discuss.elastic.co/t/kibana-hyperlink-in-data-table/248209 "2020-09-15T20:05:22Z")

</div>

Hi, Below is the data table which I have created in Kibana. In this, I want the values of the column 'User' (User 1, User 2,...) to be hyperlinks and when it is clicked the detailed graph of that particular user shoul…

---

## [If/Else comparison to add tag](https://discuss.elastic.co/t/if-else-comparison-to-add-tag/248706)

<div class="topic-metadata">

**Author:** [@vvwood](https://discuss.elastic.co/u/vvwood)\
**Replies:** 5\
**Last updated:** [September 15, 2020, 8:01pm UTC](https://discuss.elastic.co/t/if-else-comparison-to-add-tag/248706 "2020-09-15T20:01:27Z")

</div>

Hey y'all, I have been beating my head against the wall trying to accomplish something that seemed rather simple. If anyone could spot would I am missing, I would appreciate it. The seemingly simple task is to compare v…

---

## [Filebeat is running fine but no data showing in dashboard](https://discuss.elastic.co/t/filebeat-is-running-fine-but-no-data-showing-in-dashboard/248670)

<div class="topic-metadata">

**Author:** [@pankaj0172](https://discuss.elastic.co/u/pankaj0172)\
**Replies:** 1\
**Last updated:** [September 15, 2020, 7:23pm UTC](https://discuss.elastic.co/t/filebeat-is-running-fine-but-no-data-showing-in-dashboard/248670 "2020-09-15T19:23:36Z")

</div>

Hi Team, I have installed file beat service on the machine and I'm able to connect elastic search & kibana. Service is running fine but no data is coming & showing in Kibana dashboard, Can someone please help me here. A…

---

## [(Elasticsearch NEST C#) How to apply CopyTo to any field in an index](https://discuss.elastic.co/t/elasticsearch-nest-c-how-to-apply-copyto-to-any-field-in-an-index/248224)

<div class="topic-metadata">

**Author:** [@WestCoastWondering](https://discuss.elastic.co/u/WestCoastWondering)\
**Replies:** 3\
**Last updated:** [September 15, 2020, 6:56pm UTC](https://discuss.elastic.co/t/elasticsearch-nest-c-how-to-apply-copyto-to-any-field-in-an-index/248224 "2020-09-15T18:56:08Z")

</div>

Hi, My team is using Elasticsearch NEST to implement search within a .Net application. The documents in this index include static text fields, such as title and description as well as dynamic fields such as field1234. …

---

## [Fail to unpack the dns configuration: requires duration \< 1 accessing 'processors.0.dns.min\_ttl'](https://discuss.elastic.co/t/fail-to-unpack-the-dns-configuration-requires-duration-1-accessing-processors-0-dns-min-ttl/248453)

<div class="topic-metadata">

**Author:** [@dddpaul](https://discuss.elastic.co/u/dddpaul)\
**Replies:** 4\
**Last updated:** [September 15, 2020, 6:03pm UTC](https://discuss.elastic.co/t/fail-to-unpack-the-dns-configuration-requires-duration-1-accessing-processors-0-dns-min-ttl/248453 "2020-09-15T18:03:29Z")

</div>

Hi. Trying Packetbeat 7.x branch with enabled DNS processor and default config fails with fail to unpack the dns configuration: requires duration \< 1 accessing 'processors.0.dns.min\_ttl' Steps to reproduce: Config f…

---

## [Error: expected 'location' header to be set](https://discuss.elastic.co/t/error-expected-location-header-to-be-set/248025)

<div class="topic-metadata">

**Author:** [@TamiTakamiya](https://discuss.elastic.co/u/TamiTakamiya)\
**Replies:** 6\
**Last updated:** [September 15, 2020, 5:57pm UTC](https://discuss.elastic.co/t/error-expected-location-header-to-be-set/248025 "2020-09-15T17:57:44Z")

</div>

Hello, I have an issue in connecting Kibana (7.8.0 OSS) running on my local machine to our Elasticsearch (7.8.0) instance on our Kubernates cluster. The initial connection works and Kibana creates the index .kibana\_1 on…

---

## [Can Grok / dissect filter be used only the last line of the input file?](https://discuss.elastic.co/t/can-grok-dissect-filter-be-used-only-the-last-line-of-the-input-file/248718)

<div class="topic-metadata">

**Author:** [@saurabhc](https://discuss.elastic.co/u/saurabhc)\
**Replies:** 0\
**Last updated:** [September 15, 2020, 5:41pm UTC](https://discuss.elastic.co/t/can-grok-dissect-filter-be-used-only-the-last-line-of-the-input-file/248718 "2020-09-15T17:41:50Z")

</div>

Requirement: Depending on the value of a particular field in the last line of the input file, add\_field to all the matched pattern outputs with the value of the field. In the last line of the file, I have a string like …

---

## [Controls visualization hangs after some time](https://discuss.elastic.co/t/controls-visualization-hangs-after-some-time/248713)

<div class="topic-metadata">

**Author:** [@Sharma.Pranshu](https://discuss.elastic.co/u/Sharma.Pranshu)\
**Replies:** 1\
**Last updated:** [September 15, 2020, 5:41pm UTC](https://discuss.elastic.co/t/controls-visualization-hangs-after-some-time/248713 "2020-09-15T17:41:09Z")

</div>

The controls visualization hangs after some time. What can be the possible reasons.

---

## [Access \_ingest using Painless script](https://discuss.elastic.co/t/access-ingest-using-painless-script/245610)

<div class="topic-metadata">

**Author:** [@BkQc](https://discuss.elastic.co/u/BkQc)\
**Replies:** 1\
**Last updated:** [September 15, 2020, 5:33pm UTC](https://discuss.elastic.co/t/access-ingest-using-painless-script/245610 "2020-09-15T17:33:24Z")

</div>

I'm trying to populate an array during ingestion within a sub-pipeline. To do so, I'm using a painless script like the following that gives this error. What am I doing wrong? Script: { "script":{ "source":"ctx.…

---

## [The set ingest processor converts json to string](https://discuss.elastic.co/t/the-set-ingest-processor-converts-json-to-string/245625)

<div class="topic-metadata">

**Author:** [@BkQc](https://discuss.elastic.co/u/BkQc)\
**Replies:** 1\
**Last updated:** [September 15, 2020, 5:31pm UTC](https://discuss.elastic.co/t/the-set-ingest-processor-converts-json-to-string/245625 "2020-09-15T17:31:15Z")

</div>

Hello, I have an array of objecs that I create in a temporary field on my document. I then want to use the value from that temporary field in place of the actual value of another field (originally an array of string). …

---

## [Use Visualization with nested objects](https://discuss.elastic.co/t/use-visualization-with-nested-objects/248716)

<div class="topic-metadata">

**Author:** [@BkQc](https://discuss.elastic.co/u/BkQc)\
**Replies:** 0\
**Last updated:** [September 15, 2020, 5:21pm UTC](https://discuss.elastic.co/t/use-visualization-with-nested-objects/248716 "2020-09-15T17:21:11Z")

</div>

I have an index which is comprised of entries like the following. Is it possible to create Visualization that respects the nested nature of it? When I tried, with the X-Axis being SiteId and a split on Count and Distin…

---

## [Logstash Keystore doesn’t work - v7.7.1](https://discuss.elastic.co/t/logstash-keystore-doesn-t-work-v7-7-1/248711)

<div class="topic-metadata">

**Author:** [@Ashishtechnaut](https://discuss.elastic.co/u/Ashishtechnaut)\
**Replies:** 0\
**Last updated:** [September 15, 2020, 4:06pm UTC](https://discuss.elastic.co/t/logstash-keystore-doesn-t-work-v7-7-1/248711 "2020-09-15T16:06:57Z")

</div>

Hi All, We are facing an issue while using Logstash keystore. We followed the steps available at the below link. This is setup on a single node cluster with Platinum License and xpack/TLS enabled. Please find the err…

---

## [Export Elasticsearch Banchmark results](https://discuss.elastic.co/t/export-elasticsearch-banchmark-results/247353)

<div class="topic-metadata">

**Author:** [@IncioMan](https://discuss.elastic.co/u/IncioMan)\
**Replies:** 1\
**Last updated:** [September 15, 2020, 4:01pm UTC](https://discuss.elastic.co/t/export-elasticsearch-banchmark-results/247353 "2020-09-15T16:01:05Z")

</div>

Hi, I would like to export the data shown in the public nightly runs of the benchmarks (here https://elasticsearch-benchmarks.elastic.co/#tracks/geonames/nightly/default/30d) e.g as CSV, for further analysis. Is that po…

---

## [Image to kibana from local host](https://discuss.elastic.co/t/image-to-kibana-from-local-host/248633)

<div class="topic-metadata">

**Author:** [@sai92](https://discuss.elastic.co/u/sai92)\
**Replies:** 1\
**Last updated:** [September 15, 2020, 3:22pm UTC](https://discuss.elastic.co/t/image-to-kibana-from-local-host/248633 "2020-09-15T15:22:55Z")

</div>

hi i am trying to upload image to kibana from local host so that i can use it in markdown and i stored the image in usr/share/kibana/src/ui/public/assets/favicons/test.png and i point to thi sile in markdown http://127…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1803)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1805)
