# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1605

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1606

---

## [Alert and connector email context format](https://discuss.elastic.co/t/alert-and-connector-email-context-format/260927)

<div class="topic-metadata">

**Author:** [@lusynda](https://discuss.elastic.co/u/lusynda)\
**Replies:** 1\
**Last updated:** [January 13, 2021, 5:47pm UTC](https://discuss.elastic.co/t/alert-and-connector-email-context-format/260927 "2021-01-13T17:47:51Z")

</div>

Hi all I want to format to output some information regarding the detection in SIEM. For example i want to output the source.ip when some query that i have for dns log. To be more precise, i have an detection rule that…

---

## [Should filter "pin across all apps" work between Discover and APM?](https://discuss.elastic.co/t/should-filter-pin-across-all-apps-work-between-discover-and-apm/261020)

<div class="topic-metadata">

**Author:** [@A\_B](https://discuss.elastic.co/u/A_B)\
**Replies:** 1\
**Last updated:** [January 13, 2021, 5:42pm UTC](https://discuss.elastic.co/t/should-filter-pin-across-all-apps-work-between-discover-and-apm/261020 "2021-01-13T17:42:49Z")

</div>

Hello all, pretty selfexplanatory... Should filter "pin across all apps" work between Discover and APM? I'm on v 7.8.1 As Loading Kibana dashboards from APM Server is no longer supported should pinned Kibana filters s…

---

## [Filebeats not sending log file to ingest pipeline for my custom module](https://discuss.elastic.co/t/filebeats-not-sending-log-file-to-ingest-pipeline-for-my-custom-module/261027)

<div class="topic-metadata">

**Author:** [@oultimocoder](https://discuss.elastic.co/u/oultimocoder)\
**Replies:** 0\
**Last updated:** [January 13, 2021, 4:58pm UTC](https://discuss.elastic.co/t/filebeats-not-sending-log-file-to-ingest-pipeline-for-my-custom-module/261027 "2021-01-13T16:58:10Z")

</div>

I am using the official elastic helm charts for file beats. My config looks like: filebeatConfig: filebeat.yml: | setup.kibana.host: "http://kibana-kibana:80" setup.dashboards.enabled: true filebeat.modul…

---

## [Elasticsearch service not accessible from external system](https://discuss.elastic.co/t/elasticsearch-service-not-accessible-from-external-system/260892)

<div class="topic-metadata">

**Author:** [@umesh2020](https://discuss.elastic.co/u/umesh2020)\
**Replies:** 2\
**Last updated:** [January 13, 2021, 5:12pm UTC](https://discuss.elastic.co/t/elasticsearch-service-not-accessible-from-external-system/260892 "2021-01-13T17:12:49Z")

</div>

I have installed elasticsearch on CentOS and trying to start the service in a single-node mode. I see that the service is bound properly at 10.100.1.197. However, when I execute the command http://10.100.1.197:9200, …

---

## [Kbana Visualisation for Numeric data](https://discuss.elastic.co/t/kbana-visualisation-for-numeric-data/260819)

<div class="topic-metadata">

**Author:** [@ankitdevnalkar](https://discuss.elastic.co/u/ankitdevnalkar)\
**Replies:** 3\
**Last updated:** [January 13, 2021, 4:57pm UTC](https://discuss.elastic.co/t/kbana-visualisation-for-numeric-data/260819 "2021-01-13T16:57:47Z")

</div>

I have few hundreds of events having Cloudflare analytics data. For example, I want to show a line chart for bandwidth increasing and decreasing on certain dates. Cloudflare already giving the total count for each field(…

---

## [Data Correction](https://discuss.elastic.co/t/data-correction/260256)

<div class="topic-metadata">

**Author:** [@stevezemlicka](https://discuss.elastic.co/u/stevezemlicka)\
**Replies:** 6\
**Last updated:** [January 13, 2021, 4:55pm UTC](https://discuss.elastic.co/t/data-correction/260256 "2021-01-13T16:55:26Z")

</div>

I have an index that is comprised of two separate data dumps. Upon further analysis, it was discovered that one of those seems to have had a 1hr shift. This has been partially rectified by using offsets with the visual…

---

## [\[Population Job\]: port scanner](https://discuss.elastic.co/t/population-job-port-scanner/260870)

<div class="topic-metadata">

**Author:** [@TheHunter1](https://discuss.elastic.co/u/TheHunter1)\
**Replies:** 2\
**Last updated:** [January 13, 2021, 4:51pm UTC](https://discuss.elastic.co/t/population-job-port-scanner/260870 "2021-01-13T16:51:23Z")

</div>

Hello everybody, I would like to create a machine learning job to detect port scanner so I have configured my job like that: Job Type: Population Population field: destination.ip Add metric: Distinct count(destinati…

---

## [Lumberjack input vs beats input considerations (can I remove lumberjack intake altogether?)](https://discuss.elastic.co/t/lumberjack-input-vs-beats-input-considerations-can-i-remove-lumberjack-intake-altogether/260914)

<div class="topic-metadata">

**Author:** [@rmauri](https://discuss.elastic.co/u/rmauri)\
**Replies:** 0\
**Last updated:** [January 12, 2021, 10:11pm UTC](https://discuss.elastic.co/t/lumberjack-input-vs-beats-input-considerations-can-i-remove-lumberjack-intake-altogether/260914 "2021-01-12T22:11:34Z")

</div>

The elastic doc https://www.elastic.co/guide/en/logstash/current/plugins-inputs-lumberjack.html states " Consider using the Beats input plugin instead. The Beats input implements the Lumberjack protocol v1 and v2." Howe…

---

## [Can't Access a Watcher Payload Object in Action Condition](https://discuss.elastic.co/t/cant-access-a-watcher-payload-object-in-action-condition/261022)

<div class="topic-metadata">

**Author:** [@esguy](https://discuss.elastic.co/u/esguy)\
**Replies:** 0\
**Last updated:** [January 13, 2021, 4:22pm UTC](https://discuss.elastic.co/t/cant-access-a-watcher-payload-object-in-action-condition/261022 "2021-01-13T16:22:24Z")

</div>

I'm attempting to set up a condition for an action using an attribute of the current watch payload. The watch payload is defined as the following in a script transform: return \[ 'table': lessRows.stream().…

---

## [How to disable 3 dots options from dashboards](https://discuss.elastic.co/t/how-to-disable-3-dots-options-from-dashboards/260930)

<div class="topic-metadata">

**Author:** [@tahseen\_fatima](https://discuss.elastic.co/u/tahseen_fatima)\
**Replies:** 1\
**Last updated:** [January 13, 2021, 4:25pm UTC](https://discuss.elastic.co/t/how-to-disable-3-dots-options-from-dashboards/260930 "2021-01-13T16:25:07Z")

</div>

Hi, I have an ELK 7.10.0v cluster setup with 3 master + data nodes and one kibana. I have created one dashboard, and I am sharing the dashboard url by clicking on (shared -\> Embed Code -\> Copy iFrame Code) with inclu…

---

## [Merging Year and Month together](https://discuss.elastic.co/t/merging-year-and-month-together/261018)

<div class="topic-metadata">

**Author:** [@luckyluke](https://discuss.elastic.co/u/luckyluke)\
**Replies:** 1\
**Last updated:** [January 13, 2021, 4:21pm UTC](https://discuss.elastic.co/t/merging-year-and-month-together/261018 "2021-01-13T16:21:34Z")

</div>

Hey Guys, In my CVS the Year and Month are seperated. How do i merge these together so that they both used as the timestamp?

---

## [Waterfall chart with kibana](https://discuss.elastic.co/t/waterfall-chart-with-kibana/260928)

<div class="topic-metadata">

**Author:** [@chamiduz](https://discuss.elastic.co/u/chamiduz)\
**Replies:** 2\
**Last updated:** [January 13, 2021, 4:12pm UTC](https://discuss.elastic.co/t/waterfall-chart-with-kibana/260928 "2021-01-13T16:12:52Z")

</div>

Hi, I would like to know how to create a waterfall chart in kibana. is there a visualizer for that?

---

## [How to re-run failed batch updates](https://discuss.elastic.co/t/how-to-re-run-failed-batch-updates/259695)

<div class="topic-metadata">

**Author:** [@Oleg\_Ruchovets](https://discuss.elastic.co/u/Oleg_Ruchovets)\
**Replies:** 1\
**Last updated:** [January 13, 2021, 4:12pm UTC](https://discuss.elastic.co/t/how-to-re-run-failed-batch-updates/259695 "2021-01-13T16:12:45Z")

</div>

Hello, I am running a heavy load on elastic using bulk-update. esrally --pipeline=benchmark-only --track=eventdata --track-repository=eventdata --challenge=bulk-update --track-params=bulk\_size:30000,bulk\_indexing\_client…

---

## [Error Machine Learning Job in Elastic Cloud Enterprise "autodetect"](https://discuss.elastic.co/t/error-machine-learning-job-in-elastic-cloud-enterprise-autodetect/260165)

<div class="topic-metadata">

**Author:** [@pedro.andrade](https://discuss.elastic.co/u/pedro.andrade)\
**Replies:** 12\
**Last updated:** [January 13, 2021, 3:54pm UTC](https://discuss.elastic.co/t/error-machine-learning-job-in-elastic-cloud-enterprise-autodetect/260165 "2021-01-13T15:54:51Z")

</div>

I get an error creating the most basic machine learning job. In kibana it says "datafeed-teste\_2 failed to start. Unexpected job state \[failed\] while waiting for job to be opened." Im using Elastic Cloud Enterprise (2.…

---

## [Parsing using grok](https://discuss.elastic.co/t/parsing-using-grok/260916)

<div class="topic-metadata">

**Author:** [@elasticforme](https://discuss.elastic.co/u/elasticforme)\
**Replies:** 2\
**Last updated:** [January 13, 2021, 3:40pm UTC](https://discuss.elastic.co/t/parsing-using-grok/260916 "2021-01-13T15:40:11Z")

</div>

i am running jdbc and getting following data. if I run this on SQL\> prompt --backupid "2129214415\_30120163393540,2129214415\_30120163432904" --spoolpath /system1/1\_backup but on logstash output it becomes command: "--…

---

## [Format stack trace in console for elastic search](https://discuss.elastic.co/t/format-stack-trace-in-console-for-elastic-search/260711)

<div class="topic-metadata">

**Author:** [@navin1093](https://discuss.elastic.co/u/navin1093)\
**Replies:** 4\
**Last updated:** [January 13, 2021, 3:13pm UTC](https://discuss.elastic.co/t/format-stack-trace-in-console-for-elastic-search/260711 "2021-01-13T15:13:19Z")

</div>

Hi expers. Below is sample stack trace in log 2021-01011 04:23:23,455 ERROR \[beat-logstash-some-name-832-2015.11.28\] IndexNotFoundException\[no such index\] at org.elasticsearch.cluster.metadata.IndexNameExpressionRe…

---

## [Duplicate results when paging](https://discuss.elastic.co/t/duplicate-results-when-paging/260895)

<div class="topic-metadata">

**Author:** [@noah-elastic](https://discuss.elastic.co/u/noah-elastic)\
**Replies:** 2\
**Last updated:** [January 13, 2021, 2:46pm UTC](https://discuss.elastic.co/t/duplicate-results-when-paging/260895 "2021-01-13T14:46:54Z")

</div>

Hello Folks -- I'm researching an interesting situation that one of our users pointed out. We have a somewhat simple query that searches on a couple fields. We are using size/from to allow the users to step through the …

---

## [Text field to convert as date and perform math Operation](https://discuss.elastic.co/t/text-field-to-convert-as-date-and-perform-math-operation/260785)

<div class="topic-metadata">

**Author:** [@Sathish22](https://discuss.elastic.co/u/Sathish22)\
**Replies:** 3\
**Last updated:** [January 13, 2021, 2:40pm UTC](https://discuss.elastic.co/t/text-field-to-convert-as-date-and-perform-math-operation/260785 "2021-01-13T14:40:43Z")

</div>

Hi All, I need to convert a text field to date data type and perform a math operation on it something like this Process ID Process Name Start Time End Time Difference 1 Process1 2021-01-12T13:16:20.19Z 2021-01…

---

## [How can i populate/copy an event field for every event line?](https://discuss.elastic.co/t/how-can-i-populate-copy-an-event-field-for-every-event-line/261011)

<div class="topic-metadata">

**Author:** [@EHE](https://discuss.elastic.co/u/EHE)\
**Replies:** 0\
**Last updated:** [January 13, 2021, 2:36pm UTC](https://discuss.elastic.co/t/how-can-i-populate-copy-an-event-field-for-every-event-line/261011 "2021-01-13T14:36:57Z")

</div>

Hello, I am struggling with the below I multiple log line mappings and there is one specific field i would like to populate for the logline before and after, currently i am only getting it on the exact same line where t…

---

## [Kibana reporting error on windows](https://discuss.elastic.co/t/kibana-reporting-error-on-windows/260544)

<div class="topic-metadata">

**Author:** [@bering](https://discuss.elastic.co/u/bering)\
**Replies:** 2\
**Last updated:** [January 13, 2021, 2:32pm UTC](https://discuss.elastic.co/t/kibana-reporting-error-on-windows/260544 "2021-01-13T14:32:03Z")

</div>

I have Kibana v7.10.0 running on ms windows server 2019 onprem When I try to generate a PDF report from a dashboard in Kibana I get this error: I tried the Reporting Diagnostics from the stack management, but it gets…

---

## [Failed to cleanup /run/elastic-agent.sock](https://discuss.elastic.co/t/failed-to-cleanup-run-elastic-agent-sock/259809)

<div class="topic-metadata">

**Author:** [@mostlyjason](https://discuss.elastic.co/u/mostlyjason)\
**Replies:** 2\
**Last updated:** [January 13, 2021, 2:19pm UTC](https://discuss.elastic.co/t/failed-to-cleanup-run-elastic-agent-sock/259809 "2021-01-13T14:19:15Z")

</div>

I'm getting an error after installing Elastic Agent that says: 2020-12-29T15:16:12.945Z INFO application/application.go:58 Detecting execution mode 2020-12-29T15:16:12.945Z INFO application/applica…

---

## [Grok filter working in debugger but not getting parsed with Logstash](https://discuss.elastic.co/t/grok-filter-working-in-debugger-but-not-getting-parsed-with-logstash/261006)

<div class="topic-metadata">

**Author:** [@vijayakumar.cfis](https://discuss.elastic.co/u/vijayakumar.cfis)\
**Replies:** 0\
**Last updated:** [January 13, 2021, 1:52pm UTC](https://discuss.elastic.co/t/grok-filter-working-in-debugger-but-not-getting-parsed-with-logstash/261006 "2021-01-13T13:52:32Z")

</div>

Hi Team, I am trying to parse the below log entries using Grok. \<158\>Dec 03 04:50:03 AB-AWSA-01.abcd.xxxxxxxxxxxxxxx.com SIEMAccessLogs: Info: 10.0.0.1 "abcd\\abcd@abcd.xxxxxxxxxxxxxxx.com" - \[03/Dec/2020:04:50:01 +0000…

---

## [Exporting from Saved Search inside Dashboard does not have any data](https://discuss.elastic.co/t/exporting-from-saved-search-inside-dashboard-does-not-have-any-data/260763)

<div class="topic-metadata">

**Author:** [@ashryver1995](https://discuss.elastic.co/u/ashryver1995)\
**Replies:** 4\
**Last updated:** [January 13, 2021, 1:34pm UTC](https://discuss.elastic.co/t/exporting-from-saved-search-inside-dashboard-does-not-have-any-data/260763 "2021-01-13T13:34:55Z")

</div>

Hi Everyone, I recently encountered an issue with Kibana where I have created a dashboard and inside that Dashboard I have a Saved Search to view the data which is filtered by the @timestamp column using "This Week". T…

---

## [Getting this error while starting kibana](https://discuss.elastic.co/t/getting-this-error-while-starting-kibana/260791)

<div class="topic-metadata">

**Author:** [@yash\_watwani](https://discuss.elastic.co/u/yash_watwani)\
**Replies:** 3\
**Last updated:** [January 13, 2021, 1:21pm UTC](https://discuss.elastic.co/t/getting-this-error-while-starting-kibana/260791 "2021-01-13T13:21:08Z")

</div>

\\kibana-7.10.1-windows-x86\_64\\config was unexpected at this time.

---

## [Calculating event.duration not working](https://discuss.elastic.co/t/calculating-event-duration-not-working/260918)

<div class="topic-metadata">

**Author:** [@willemdh](https://discuss.elastic.co/u/willemdh)\
**Replies:** 1\
**Last updated:** [January 13, 2021, 12:12pm UTC](https://discuss.elastic.co/t/calculating-event-duration-not-working/260918 "2021-01-13T12:12:57Z")

</div>

Hello, Based on https://www.elastic.co/blog/calculating-ingest-lag-and-storing-ingest-time-in-elasticsearch-to-improve-observability I added a script processor to my pipeline with the goal to calculate the event.durati…

---

## [Merge two elasticsearch clusters](https://discuss.elastic.co/t/merge-two-elasticsearch-clusters/260678)

<div class="topic-metadata">

**Author:** [@rohitarorait82](https://discuss.elastic.co/u/rohitarorait82)\
**Replies:** 5\
**Last updated:** [January 13, 2021, 11:31am UTC](https://discuss.elastic.co/t/merge-two-elasticsearch-clusters/260678 "2021-01-13T11:31:11Z")

</div>

Hi All, Currently we have two clusters, in one we have 4 nodes(1 coordinating, 3 data nodes out of which two are master) and second cluster(1 coordinating, 5 data nodes out of which three are master). Can someone sugges…

---

## [Kubernetes How disable SSL getting Elasticsearch Unreachable: \[https://elastic:xxxxxx@myhost.elastic-namespace.svc:9200/](https://discuss.elastic.co/t/kubernetes-how-disable-ssl-getting-elasticsearch-unreachable-https-elastic-xxxxxx-myhost-elastic-namespace-svc-9200/260985)

<div class="topic-metadata">

**Author:** [@umen](https://discuss.elastic.co/u/umen)\
**Replies:** 0\
**Last updated:** [January 13, 2021, 11:18am UTC](https://discuss.elastic.co/t/kubernetes-how-disable-ssl-getting-elasticsearch-unreachable-https-elastic-xxxxxx-myhost-elastic-namespace-svc-9200/260985 "2021-01-13T11:18:11Z")

</div>

i saw a lot of problems with this issue, looks like it is impossible to disable the SSL in logstash when connecting to elasticsearch i want to disable it , i don't what to use it this is an internal app. this configura…

---

## [Monitoring issue](https://discuss.elastic.co/t/monitoring-issue/260981)

<div class="topic-metadata">

**Author:** [@Makss39](https://discuss.elastic.co/u/Makss39)\
**Replies:** 1\
**Last updated:** [January 13, 2021, 11:18am UTC](https://discuss.elastic.co/t/monitoring-issue/260981 "2021-01-13T11:18:09Z")

</div>

Hi there, I'm facing an issue with monitoring. I setted up end december and it worked like a charm with metricbeat. Now when i' going on the monitoring page in Kibana i get "No monitoring data found". No idea why... A…

---

## [No more logs in ELK](https://discuss.elastic.co/t/no-more-logs-in-elk/260314)

<div class="topic-metadata">

**Author:** [@baddack](https://discuss.elastic.co/u/baddack)\
**Replies:** 3\
**Last updated:** [January 13, 2021, 11:07am UTC](https://discuss.elastic.co/t/no-more-logs-in-elk/260314 "2021-01-13T11:07:05Z")

</div>

Hello everyone, I'm new here and I've been using the ELK stack recently. I am in apprenticeship in my company and I am asked to take over the SIEM because nobody knows how to use it. (It was implemented by a previous ap…

---

## [How to make Point In Time API request using JAVA REST High Level Client](https://discuss.elastic.co/t/how-to-make-point-in-time-api-request-using-java-rest-high-level-client/260965)

<div class="topic-metadata">

**Author:** [@Shalika](https://discuss.elastic.co/u/Shalika)\
**Replies:** 1\
**Last updated:** [January 13, 2021, 10:54am UTC](https://discuss.elastic.co/t/how-to-make-point-in-time-api-request-using-java-rest-high-level-client/260965 "2021-01-13T10:54:37Z")

</div>

It will be helpful if someone can point me to a way to execute Point In Time API request, which is newly introduced in Elasticsearch 7.10.1, from JAVA using REST high-level client or any other way in JAVA. (except Transp…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1604)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1606)
