# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1227

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1228

---

## [Response Time Report](https://discuss.elastic.co/t/response-time-report/284806)

<div class="topic-metadata">

**Author:** [@chivas](https://discuss.elastic.co/u/chivas)\
**Replies:** 3\
**Last updated:** [September 23, 2021, 2:38pm UTC](https://discuss.elastic.co/t/response-time-report/284806 "2021-09-23T14:38:42Z")

</div>

Hello, I need to generate a Visual/Report which shows the response time taken by an API/function call to my webserver from the client. Below is my data in Elasticsearch. So my question is what is the best way to gen…

---

## [Time based count in Kibana Visualization](https://discuss.elastic.co/t/time-based-count-in-kibana-visualization/284835)

<div class="topic-metadata">

**Author:** [@Anchit\_Banerjee](https://discuss.elastic.co/u/Anchit_Banerjee)\
**Replies:** 2\
**Last updated:** [September 23, 2021, 2:33pm UTC](https://discuss.elastic.co/t/time-based-count-in-kibana-visualization/284835 "2021-09-23T14:33:02Z")

</div>

Hello All, I am trying to create a pie-chart of a particular event with count in Kibana. I am fetching the data from Oracle DB through logstash JDBC input pipeline. Eg: Name Count event1 10 event2 20 I…

---

## [Customize elastic cloud UI](https://discuss.elastic.co/t/customize-elastic-cloud-ui/284890)

<div class="topic-metadata">

**Author:** [@Naveen\_Kumar\_Reddy\_S](https://discuss.elastic.co/u/Naveen_Kumar_Reddy_S)\
**Replies:** 2\
**Last updated:** [September 23, 2021, 2:26pm UTC](https://discuss.elastic.co/t/customize-elastic-cloud-ui/284890 "2021-09-23T14:26:54Z")

</div>

In standalone we can customize the elastic UI using "Elastic UI framework (EUI)", But we are looking custom changes in Elastic Cloud environment paid version. So, is there any way to customize the Elastic Cloud UI? If y…

---

## [Wrong events order if time difference is less than 1ms](https://discuss.elastic.co/t/wrong-events-order-if-time-difference-is-less-than-1ms/284983)

<div class="topic-metadata">

**Author:** [@alexandrpaliy](https://discuss.elastic.co/u/alexandrpaliy)\
**Replies:** 1\
**Last updated:** [September 23, 2021, 2:10pm UTC](https://discuss.elastic.co/t/wrong-events-order-if-time-difference-is-less-than-1ms/284983 "2021-09-23T14:10:47Z")

</div>

Hi. I use version 7.13.4 of all stack (ELK + filebeats). Filebeat grabs events (auth.log entries in this case) on remote host, then passes them to logstash to filter/modify data, then events go to Elasticsearch. Talkin…

---

## [Logstash for z/OS](https://discuss.elastic.co/t/logstash-for-z-os/284916)

<div class="topic-metadata">

**Author:** [@Akhil2](https://discuss.elastic.co/u/Akhil2)\
**Replies:** 2\
**Last updated:** [September 23, 2021, 1:57pm UTC](https://discuss.elastic.co/t/logstash-for-z-os/284916 "2021-09-23T13:57:44Z")

</div>

Hello there, Hope you are doing well! I have a few questions regarding Log monitoring on Mainframe through Logstash. My understanding here is extract and transform logs into JSON through JCL workbench and send it to th…

---

## [Search docs using month and day in birthday filed using elasticsearch SQL](https://discuss.elastic.co/t/search-docs-using-month-and-day-in-birthday-filed-using-elasticsearch-sql/284844)

<div class="topic-metadata">

**Author:** [@RAHUL\_PATEL](https://discuss.elastic.co/u/RAHUL_PATEL)\
**Replies:** 1\
**Last updated:** [September 23, 2021, 1:56pm UTC](https://discuss.elastic.co/t/search-docs-using-month-and-day-in-birthday-filed-using-elasticsearch-sql/284844 "2021-09-23T13:56:47Z")

</div>

i have a filed name birthday. which has date of birth in Date format. now using Elasticsearch SQL query, I want get "list all people who have birthdays in January" how to get all people using whose birthday is in Janu…

---

## [Filebeat output to existing index](https://discuss.elastic.co/t/filebeat-output-to-existing-index/284329)

<div class="topic-metadata">

**Author:** [@caraboy](https://discuss.elastic.co/u/caraboy)\
**Replies:** 6\
**Last updated:** [September 23, 2021, 12:47pm UTC](https://discuss.elastic.co/t/filebeat-output-to-existing-index/284329 "2021-09-23T12:47:30Z")

</div>

Hi everyone, I'm trying to configure a filebeat output to an existing index but apparently i can't correctly set the template name and pattern. output.elasticsearch.index: "sai5x" setup.template.name: "sai5x" setup.tem…

---

## [Canvas on AWS](https://discuss.elastic.co/t/canvas-on-aws/284088)

<div class="topic-metadata">

**Author:** [@Niteesh\_Hegde](https://discuss.elastic.co/u/Niteesh_Hegde)\
**Replies:** 3\
**Last updated:** [September 23, 2021, 12:40pm UTC](https://discuss.elastic.co/t/canvas-on-aws/284088 "2021-09-23T12:40:21Z")

</div>

How can I use Kibana Canvas in AWS managed ElasticSearch. I could not find it in 7.10.2. No such feature in Opensearch 1..0 as well. I do not want to self host ES/Kibana

---

## [Calculate time difference between two timestamps and filter on a field](https://discuss.elastic.co/t/calculate-time-difference-between-two-timestamps-and-filter-on-a-field/285003)

<div class="topic-metadata">

**Author:** [@marone](https://discuss.elastic.co/u/marone)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 12:25pm UTC](https://discuss.elastic.co/t/calculate-time-difference-between-two-timestamps-and-filter-on-a-field/285003 "2021-09-23T12:25:29Z")

</div>

Hey I am trying to implement a query to calculate a difference between two timestamps but filter on a field. The solution Getting duration by using bucket script works well but my use case is the following: I have, let'…

---

## [Shard Awareness Question](https://discuss.elastic.co/t/shard-awareness-question/284941)

<div class="topic-metadata">

**Author:** [@Dauni](https://discuss.elastic.co/u/Dauni)\
**Replies:** 3\
**Last updated:** [September 23, 2021, 12:11pm UTC](https://discuss.elastic.co/t/shard-awareness-question/284941 "2021-09-23T12:11:49Z")

</div>

Hello, We are running an ES 5.16 cluster in 3 DC's (total of 15 hosts, each host is 8 cpu / 32 GB ram and we have heap set to 16GB). DC1 = zone1 (1 master node, 6 data nodes) DC2 = zone2 (1 master node, 6 data nodes) …

---

## [Multiple Terms filters not working](https://discuss.elastic.co/t/multiple-terms-filters-not-working/284077)

<div class="topic-metadata">

**Author:** [@Jay2](https://discuss.elastic.co/u/Jay2)\
**Replies:** 9\
**Last updated:** [September 23, 2021, 11:48am UTC](https://discuss.elastic.co/t/multiple-terms-filters-not-working/284077 "2021-09-23T11:48:53Z")

</div>

Hi, I am new to the DSL and im using the below DSL query: {"from":0,"min\_score":0.5,"query":{"bool":{"filter":\[{"terms":{"extension":\["bmp","jpg","tif","img","png","gif","jpeg"\]}},{"terms":{"userContentType":\["webpage"\]…

---

## [Unable to use scripted field in TSVB sum aggregation..Please help](https://discuss.elastic.co/t/unable-to-use-scripted-field-in-tsvb-sum-aggregation-please-help/244026)

<div class="topic-metadata">

**Author:** [@Ashima\_Sachdeva](https://discuss.elastic.co/u/Ashima_Sachdeva)\
**Replies:** 2\
**Last updated:** [September 23, 2021, 11:32am UTC](https://discuss.elastic.co/t/unable-to-use-scripted-field-in-tsvb-sum-aggregation-please-help/244026 "2021-09-23T11:32:14Z")

</div>

unable to use scripted field in TSVB sum aggregation...only index pattern fields are coming in drop down.

---

## [Configure filebeat such that a log with variable length records can be uploaded to an index](https://discuss.elastic.co/t/configure-filebeat-such-that-a-log-with-variable-length-records-can-be-uploaded-to-an-index/284997)

<div class="topic-metadata">

**Author:** [@shi](https://discuss.elastic.co/u/shi)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 11:31am UTC](https://discuss.elastic.co/t/configure-filebeat-such-that-a-log-with-variable-length-records-can-be-uploaded-to-an-index/284997 "2021-09-23T11:31:08Z")

</div>

configure filebeat such that a log with variable length records can be uploaded to an index. The index is created by the upload a file feature provided by kibana regards shini

---

## [Allow winlogbeat to use more processing power](https://discuss.elastic.co/t/allow-winlogbeat-to-use-more-processing-power/284996)

<div class="topic-metadata">

**Author:** [@Bryan\_Hamilton](https://discuss.elastic.co/u/Bryan_Hamilton)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 11:24am UTC](https://discuss.elastic.co/t/allow-winlogbeat-to-use-more-processing-power/284996 "2021-09-23T11:24:10Z")

</div>

Hi, is there a setting to allow winlogbeat to use more CPU resources? We are currently testing a config file with about 1700 lines of filtering. We also have another config file with less filtering (about 300) currently…

---

## [Repurposing master node as data node](https://discuss.elastic.co/t/repurposing-master-node-as-data-node/284993)

<div class="topic-metadata">

**Author:** [@elastic-learner](https://discuss.elastic.co/u/elastic-learner)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 10:58am UTC](https://discuss.elastic.co/t/repurposing-master-node-as-data-node/284993 "2021-09-23T10:58:54Z")

</div>

I have a 3 node es cluster with all nodes having all roles. I want to convert these nodes to dedicated master nodes and add extra dedicated data nodes. For this the best approach is to evacuate all the shards from the no…

---

## [Migrate from standalone to cluster instances](https://discuss.elastic.co/t/migrate-from-standalone-to-cluster-instances/284991)

<div class="topic-metadata">

**Author:** [@supportth](https://discuss.elastic.co/u/supportth)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 10:48am UTC](https://discuss.elastic.co/t/migrate-from-standalone-to-cluster-instances/284991 "2021-09-23T10:48:59Z")

</div>

I have one node cluster of Elasticsearch With installed Elasticsearch, kibana, apm-server I have about 5 TB of indices my elk version is { "name" : "elk-old", "cluster\_name" : "elasticsearch", "cluster\_uuid" : …

---

## [Failed to query metric data from kibana](https://discuss.elastic.co/t/failed-to-query-metric-data-from-kibana/284598)

<div class="topic-metadata">

**Author:** [@nehasinha1807](https://discuss.elastic.co/u/nehasinha1807)\
**Replies:** 1\
**Last updated:** [September 23, 2021, 10:13am UTC](https://discuss.elastic.co/t/failed-to-query-metric-data-from-kibana/284598 "2021-09-23T10:13:44Z")

</div>

I deployed ELK Lite and metricbeat on linux in order to observe metrics for my application. but when I open kibana UI and click metric, it shows this error: Error while fetching resource Error Internal Server Error (5…

---

## [Logstash SNMP input plugin: no data extracted](https://discuss.elastic.co/t/logstash-snmp-input-plugin-no-data-extracted/284982)

<div class="topic-metadata">

**Author:** [@daniele.saccon](https://discuss.elastic.co/u/daniele.saccon)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 9:31am UTC](https://discuss.elastic.co/t/logstash-snmp-input-plugin-no-data-extracted/284982 "2021-09-23T09:31:06Z")

</div>

Hi, I am using the SNMP input plugin with the following configurations: input { snmp { walk =\> \["1.3.6.1.2.1.1"\] hosts =\> \[{host =\> "udp:XXXXXXXX/161" community =\> "public" version =\> "2c" retries =\> 2 time…

---

## [Understand the use of certificate requirements while adding a New Agent](https://discuss.elastic.co/t/understand-the-use-of-certificate-requirements-while-adding-a-new-agent/284981)

<div class="topic-metadata">

**Author:** [@Mann\_Mehta](https://discuss.elastic.co/u/Mann_Mehta)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 9:30am UTC](https://discuss.elastic.co/t/understand-the-use-of-certificate-requirements-while-adding-a-new-agent/284981 "2021-09-23T09:30:02Z")

</div>

Here we see, in the production deployment it provide the certificate-based configuration command. Wanted to understand the use of certificate authorities, ES certificate, fleet server certificate, and fleet server ce…

---

## [How to filter in filebeat yml file](https://discuss.elastic.co/t/how-to-filter-in-filebeat-yml-file/284978)

<div class="topic-metadata">

**Author:** [@bae\_park](https://discuss.elastic.co/u/bae_park)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 9:25am UTC](https://discuss.elastic.co/t/how-to-filter-in-filebeat-yml-file/284978 "2021-09-23T09:25:07Z")

</div>

While using kafka input, I want to output only when json data contains a specific string. I tried setting "include\_lines" in filebeat.yml, but it was not filtered properly. When the filebit.yml setting is as follows an…

---

## [Kibana Drilldown - URL auth](https://discuss.elastic.co/t/kibana-drilldown-url-auth/284950)

<div class="topic-metadata">

**Author:** [@johnwood](https://discuss.elastic.co/u/johnwood)\
**Replies:** 1\
**Last updated:** [September 23, 2021, 9:23am UTC](https://discuss.elastic.co/t/kibana-drilldown-url-auth/284950 "2021-09-23T09:23:27Z")

</div>

Hi Kibana-brains, I am looking at using the URL drilldown in kibana to kick off some actions in an external site. I need to authenticate/authorise these calls in the external system and was wondering if, assuming we hav…

---

## [Upgrade from 7.9.2 to 7.13](https://discuss.elastic.co/t/upgrade-from-7-9-2-to-7-13/284976)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 9:22am UTC](https://discuss.elastic.co/t/upgrade-from-7-9-2-to-7-13/284976 "2021-09-23T09:22:55Z")

</div>

Is there anything we need to be aware of while upgrading from Elasticsearch 7.9.2 to 7.13? I do understand that minor version releases will not be having the breaking changes, and includes patches and bugfixes.

---

## [Logstash 7.13 and Elasticsearch 7.9.2 compatibility](https://discuss.elastic.co/t/logstash-7-13-and-elasticsearch-7-9-2-compatibility/284962)

<div class="topic-metadata">

**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\
**Replies:** 2\
**Last updated:** [September 23, 2021, 9:15am UTC](https://discuss.elastic.co/t/logstash-7-13-and-elasticsearch-7-9-2-compatibility/284962 "2021-09-23T09:15:15Z")

</div>

I do understand that we need to have the same version of components for elastic stack, but would like to know whether 7.13 version of logstash can run with 7.9.2 version of Elasticsearch.

---

## [CentOS 7: Metadata file does not match checksum during yum update](https://discuss.elastic.co/t/centos-7-metadata-file-does-not-match-checksum-during-yum-update/284913)

<div class="topic-metadata">

**Author:** [@Daniel\_S](https://discuss.elastic.co/u/Daniel_S)\
**Replies:** 21\
**Last updated:** [September 23, 2021, 9:10am UTC](https://discuss.elastic.co/t/centos-7-metadata-file-does-not-match-checksum-during-yum-update/284913 "2021-09-23T09:10:27Z")

</div>

Hi, I am getting an error message: elasticsearch-7.x/primary FAILED https://artifacts.elastic.co/packages/7.x/yum/repodata/primary.xml.gz: \[Errno -1\] Metadata file does no…

---

## [Filebeat installed on EulerOS server and trying to start the service but its failing. Please advise](https://discuss.elastic.co/t/filebeat-installed-on-euleros-server-and-trying-to-start-the-service-but-its-failing-please-advise/283427)

<div class="topic-metadata">

**Author:** [@Amit\_Johari](https://discuss.elastic.co/u/Amit_Johari)\
**Replies:** 4\
**Last updated:** [September 23, 2021, 8:50am UTC](https://discuss.elastic.co/t/filebeat-installed-on-euleros-server-and-trying-to-start-the-service-but-its-failing-please-advise/283427 "2021-09-23T08:50:25Z")

</div>

OS version: EulerOS release 2.0 (SP8) ARCH: Linux HOBB14-RK01-PROD-CN-01 4.19.36-vhulk1905.1.0.h276.eulerosv2r8.aarch64 #1 SMP Mon Apr 1 00:00:00 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux Error: \[root@HOBB14-RK01-PRO…

---

## [Save discover search results, view deleted documents](https://discuss.elastic.co/t/save-discover-search-results-view-deleted-documents/284973)

<div class="topic-metadata">

**Author:** [@Tadija](https://discuss.elastic.co/u/Tadija)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 8:41am UTC](https://discuss.elastic.co/t/save-discover-search-results-view-deleted-documents/284973 "2021-09-23T08:41:56Z")

</div>

We have setup ILM for our test environments so logs are deleted after 2 days. Our QA workflow includes testing stuff on test branches and creating tickets for issues they encounter. They sometime put a link to Kibana wh…

---

## [Sudden spike in CPU](https://discuss.elastic.co/t/sudden-spike-in-cpu/284972)

<div class="topic-metadata">

**Author:** [@kehers](https://discuss.elastic.co/u/kehers)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 8:41am UTC](https://discuss.elastic.co/t/sudden-spike-in-cpu/284972 "2021-09-23T08:41:24Z")

</div>

I noticed a sudden spike in CPU (then response times) in our Elasticsearch instance this morning. Surprisingly, the health was green through this. Is there a way to properly investigate what could be the cause?

---

## [Grok parsing and skipping lines](https://discuss.elastic.co/t/grok-parsing-and-skipping-lines/284864)

<div class="topic-metadata">

**Author:** [@Mira\_9](https://discuss.elastic.co/u/Mira_9)\
**Replies:** 2\
**Last updated:** [September 23, 2021, 8:38am UTC](https://discuss.elastic.co/t/grok-parsing-and-skipping-lines/284864 "2021-09-23T08:38:42Z")

</div>

Hey! i have to parse the output of a command linux,extract specific fields and skip some lines.I'm trying but its not working. SSID: "#SOMB-875-LY5C" Mode: Managed RSSI: 1 dBm SNR: 0 dB noise: -89 dBm Chann…

---

## [Pulling data from a statsd server](https://discuss.elastic.co/t/pulling-data-from-a-statsd-server/284625)

<div class="topic-metadata">

**Author:** [@humartinez](https://discuss.elastic.co/u/humartinez)\
**Replies:** 2\
**Last updated:** [September 23, 2021, 7:39am UTC](https://discuss.elastic.co/t/pulling-data-from-a-statsd-server/284625 "2021-09-23T07:39:45Z")

</div>

Hi, I need to pull data from a statsd server,whats the best approach to do this? Im trying to import the statsd metrics from a spark jobs using metricbeats but metricbeat is getting the following error ... spark-5a9…

---

## [Elastic cluster is unreachable - Logstash with docker](https://discuss.elastic.co/t/elastic-cluster-is-unreachable-logstash-with-docker/284964)

<div class="topic-metadata">

**Author:** [@Rashmika\_Gamage](https://discuss.elastic.co/u/Rashmika_Gamage)\
**Replies:** 0\
**Last updated:** [September 23, 2021, 7:02am UTC](https://discuss.elastic.co/t/elastic-cluster-is-unreachable-logstash-with-docker/284964 "2021-09-23T07:02:25Z")

</div>

I have created a ELK cluster with 3 elastic nodes with docker compose. I am getting an error from logstash. I have been trying with several ways. Appreciate you help. My docker-compose.yml version: '2.2' services: es…

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1226)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1228)
