# Elastic Stack

**URL:** https://discuss.elastic.co/c/elastic-stack/81.md?page=1993

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 1994

---

## [Why logstash is not considering my ports?](https://discuss.elastic.co/t/why-logstash-is-not-considering-my-ports/237443)

<div class="topic-metadata">

**Author:** [@AngeloM](https://discuss.elastic.co/u/AngeloM)\
**Replies:** 2\
**Last updated:** [June 17, 2020, 10:25am UTC](https://discuss.elastic.co/t/why-logstash-is-not-considering-my-ports/237443 "2020-06-17T10:25:57Z")

</div>

Getting crazy here ! The idea is to import different log from different port and import then in different indexes. I got two different configuration files on "etc/logtash/init.d". The two configuration files has two d…

---

## [Extract hour and weekday from custom date time field](https://discuss.elastic.co/t/extract-hour-and-weekday-from-custom-date-time-field/237286)

<div class="topic-metadata">

**Author:** [@Rushabh\_Doshi](https://discuss.elastic.co/u/Rushabh_Doshi)\
**Replies:** 5\
**Last updated:** [June 17, 2020, 10:22am UTC](https://discuss.elastic.co/t/extract-hour-and-weekday-from-custom-date-time-field/237286 "2020-06-17T10:22:25Z")

</div>

for extracting hour and weekday from Activity-Time field the logstash snippet is as below: date{ match =\> \[ "Activity-Time", "yyyy-MM-dd HH:mm:ss" \] target =\> "Activity-Time-New" add\_field =\> {"hour" =\> "%{+HH}"} ad…

---

## [Filebeat log collection stops when the container is restarted](https://discuss.elastic.co/t/filebeat-log-collection-stops-when-the-container-is-restarted/236596)

<div class="topic-metadata">

**Author:** [@Negi700](https://discuss.elastic.co/u/Negi700)\
**Replies:** 5\
**Last updated:** [June 17, 2020, 10:11am UTC](https://discuss.elastic.co/t/filebeat-log-collection-stops-when-the-container-is-restarted/236596 "2020-06-17T10:11:18Z")

</div>

We collect the logs of the container of Tomcat on Kubernetes with the container of Filebeat. After restarting the Tomcat container, the log collection instance is updated, but the log collection instance is It seems th…

---

## [Kibana visualizations broken after deleting index pattern - modifying object does not work](https://discuss.elastic.co/t/kibana-visualizations-broken-after-deleting-index-pattern-modifying-object-does-not-work/237088)

<div class="topic-metadata">

**Author:** [@mujina93](https://discuss.elastic.co/u/mujina93)\
**Replies:** 6\
**Last updated:** [June 17, 2020, 10:11am UTC](https://discuss.elastic.co/t/kibana-visualizations-broken-after-deleting-index-pattern-modifying-object-does-not-work/237088 "2020-06-17T10:11:11Z")

</div>

Hello, I had a dashboard in Kibana that was relying on an index pattern. I set a lifetime policy on the index and my index got deleted (I thought the "deletion time" was a retention window, i.e. documents older than X …

---

## [Elasticsearch 7.7 : field expansion matches too many fields, limit: 1024, got: 1139](https://discuss.elastic.co/t/elasticsearch-7-7-field-expansion-matches-too-many-fields-limit-1024-got-1139/237425)

<div class="topic-metadata">

**Author:** [@pappukhode](https://discuss.elastic.co/u/pappukhode)\
**Replies:** 0\
**Last updated:** [June 17, 2020, 9:00am UTC](https://discuss.elastic.co/t/elasticsearch-7-7-field-expansion-matches-too-many-fields-limit-1024-got-1139/237425 "2020-06-17T09:00:06Z")

</div>

Hi, I am using ES 7.7 and indexed around 70K data. I also verified index has around 540 fields by invokinghttp://es\_host:port/2/\_mapping. While performing simple search query I am getting query\_shard\_exception. GE…

---

## [Timing of Backup and composition shards and indices](https://discuss.elastic.co/t/timing-of-backup-and-composition-shards-and-indices/237223)

<div class="topic-metadata">

**Author:** [@jact](https://discuss.elastic.co/u/jact)\
**Replies:** 11\
**Last updated:** [June 17, 2020, 9:48am UTC](https://discuss.elastic.co/t/timing-of-backup-and-composition-shards-and-indices/237223 "2020-06-17T09:48:57Z")

</div>

Hi , Please provide an explanation: If I want to focus on data log security, I currently do a daily backup to avoid any problems with the server. Can monthly backups cover data before server problems? or is there ano…

---

## ["Incorrect HTTP method for uri" when PUTting \_index\_template](https://discuss.elastic.co/t/incorrect-http-method-for-uri-when-putting-index-template/237299)

<div class="topic-metadata">

**Author:** [@mujina93](https://discuss.elastic.co/u/mujina93)\
**Replies:** 3\
**Last updated:** [June 17, 2020, 9:46am UTC](https://discuss.elastic.co/t/incorrect-http-method-for-uri-when-putting-index-template/237299 "2020-06-17T09:46:36Z")

</div>

I am trying to create an index template. Following the examples in getting-started-index-lifecycle-management and indices-templates I'm trying with a PUT request that looks like: http://\<elasticsearch\_ip\>:9200/\_index\_t…

---

## [Office 365 Filebeat Module Error](https://discuss.elastic.co/t/office-365-filebeat-module-error/237158)

<div class="topic-metadata">

**Author:** [@khaag](https://discuss.elastic.co/u/khaag)\
**Replies:** 5\
**Last updated:** [June 17, 2020, 8:44am UTC](https://discuss.elastic.co/t/office-365-filebeat-module-error/237158 "2020-06-17T08:44:40Z")

</div>

Hello We're trying to setup the office 365 module in filebeat. After editing the o365.yml file we are getting the following error: ERROR instance/beat.go:932 Exiting: Error while initializing input: o365audit: reading…

---

## [Metricbeat Not Outputting to Logstash](https://discuss.elastic.co/t/metricbeat-not-outputting-to-logstash/236412)

<div class="topic-metadata">

**Author:** [@uklipse](https://discuss.elastic.co/u/uklipse)\
**Replies:** 2\
**Last updated:** [June 17, 2020, 8:44am UTC](https://discuss.elastic.co/t/metricbeat-not-outputting-to-logstash/236412 "2020-06-17T08:44:01Z")

</div>

I have Metricbeat installed on a new server and can't get it to output to Logstash. I can configure it to output directly to Elasticsearch. I even can get Filebeat running on the same server to output to Logstash but not…

---

## [Metricbeat elb and lambda metricset of aws module](https://discuss.elastic.co/t/metricbeat-elb-and-lambda-metricset-of-aws-module/237170)

<div class="topic-metadata">

**Author:** [@Rahul12](https://discuss.elastic.co/u/Rahul12)\
**Replies:** 1\
**Last updated:** [June 17, 2020, 8:42am UTC](https://discuss.elastic.co/t/metricbeat-elb-and-lambda-metricset-of-aws-module/237170 "2020-06-17T08:42:11Z")

</div>

Hi, I am trying to fetch elb and lambda metricset of aws module but I am getting error - Error creating runner from config: 1 error: metricset 'aws/elb' not found I am using Metricbeat 7.1.1 version. Please see the b…

---

## [How to Setup custom alerting in kibana for logs](https://discuss.elastic.co/t/how-to-setup-custom-alerting-in-kibana-for-logs/233103)

<div class="topic-metadata">

**Author:** [@Rahul\_Ravichandran](https://discuss.elastic.co/u/Rahul_Ravichandran)\
**Replies:** 8\
**Last updated:** [June 17, 2020, 8:37am UTC](https://discuss.elastic.co/t/how-to-setup-custom-alerting-in-kibana-for-logs/233103 "2020-06-17T08:37:14Z")

</div>

Hey Guys, I have setup an Alert for my backup Monitoring where in message Field if it says "Network related issue" with a threshold reached it gives me an alert. The alert contains the contents severity and the messag…

---

## [Visualize Average Response Time of the system using metricbeat data](https://discuss.elastic.co/t/visualize-average-response-time-of-the-system-using-metricbeat-data/236836)

<div class="topic-metadata">

**Author:** [@Mayank\_Damani](https://discuss.elastic.co/u/Mayank_Damani)\
**Replies:** 1\
**Last updated:** [June 17, 2020, 8:35am UTC](https://discuss.elastic.co/t/visualize-average-response-time-of-the-system-using-metricbeat-data/236836 "2020-06-17T08:35:00Z")

</div>

Hello, I want to visualize Average Response Time of my System using MetricBeat data. I am just going through all the system fields in the metricbeat documentation but not getting any idea how to achieve my objective. Th…

---

## [Suport for wait stats/spin locks/latch waits](https://discuss.elastic.co/t/suport-for-wait-stats-spin-locks-latch-waits/237209)

<div class="topic-metadata">

**Author:** [@Brett\_Shearer](https://discuss.elastic.co/u/Brett_Shearer)\
**Replies:** 1\
**Last updated:** [June 17, 2020, 8:33am UTC](https://discuss.elastic.co/t/suport-for-wait-stats-spin-locks-latch-waits/237209 "2020-06-17T08:33:37Z")

</div>

It seems that metric beat is currently playing catchup on more mature Microsoft SQL monitoring tools. Are you working on building out capabilities such as monitoring wait stats, or are you hoping for pull requests that …

---

## [Filter duplicate record of log in kibana dashboard](https://discuss.elastic.co/t/filter-duplicate-record-of-log-in-kibana-dashboard/237016)

<div class="topic-metadata">

**Author:** [@anand27889](https://discuss.elastic.co/u/anand27889)\
**Replies:** 10\
**Last updated:** [June 17, 2020, 8:21am UTC](https://discuss.elastic.co/t/filter-duplicate-record-of-log-in-kibana-dashboard/237016 "2020-06-17T08:21:03Z")

</div>

Hi Friends, I want to remove the duplicate record of log file which is displaying in kibana dashboard, for example: {TransactionID: 23750 , Status: failed, Time: 14/06/2020 11:20:25} {TransactionID: 23750 , Status: …

---

## [Read a CSV in Logstash level and filter on basis of the extracted data](https://discuss.elastic.co/t/read-a-csv-in-logstash-level-and-filter-on-basis-of-the-extracted-data/237420)

<div class="topic-metadata">

**Author:** [@Gurkeerat\_Sondhi](https://discuss.elastic.co/u/Gurkeerat_Sondhi)\
**Replies:** 0\
**Last updated:** [June 17, 2020, 8:15am UTC](https://discuss.elastic.co/t/read-a-csv-in-logstash-level-and-filter-on-basis-of-the-extracted-data/237420 "2020-06-17T08:15:42Z")

</div>

I am using Metricbeat to get process-level data and push it to Elastic Search using Logstash. Now, the aim is to categorize the processes into 2 tags i.e the process running is either a browser or it is something else. …

---

## [How to Build a FileBeat "Cluster"](https://discuss.elastic.co/t/how-to-build-a-filebeat-cluster/237419)

<div class="topic-metadata">

**Author:** [@zchaistudy](https://discuss.elastic.co/u/zchaistudy)\
**Replies:** 0\
**Last updated:** [June 17, 2020, 8:09am UTC](https://discuss.elastic.co/t/how-to-build-a-filebeat-cluster/237419 "2020-06-17T08:09:24Z")

</div>

I am planning to make a log storage system. At present, log information is reported to Kafka through http reporting (the logs are all in json format). I plan to read data from Kafka through Logstash or Filebeat and push …

---

## [Adding second Y-axis to stacked bar graph](https://discuss.elastic.co/t/adding-second-y-axis-to-stacked-bar-graph/236119)

<div class="topic-metadata">

**Author:** [@Rgvr\_S](https://discuss.elastic.co/u/Rgvr_S)\
**Replies:** 8\
**Last updated:** [June 17, 2020, 7:52am UTC](https://discuss.elastic.co/t/adding-second-y-axis-to-stacked-bar-graph/236119 "2020-06-17T07:52:58Z")

</div>

I have a stacked bar graph made for the following data, The bar graph looks like this, I'd like to add another Y-axis to divide the graph based on months. How do I do this ? I use elasticsearch7.3.2 and kibana7.3…

---

## [Its possible integrating canvas into a website?](https://discuss.elastic.co/t/its-possible-integrating-canvas-into-a-website/234576)

<div class="topic-metadata">

**Author:** [@David\_Oceans](https://discuss.elastic.co/u/David_Oceans)\
**Replies:** 1\
**Last updated:** [June 17, 2020, 7:51am UTC](https://discuss.elastic.co/t/its-possible-integrating-canvas-into-a-website/234576 "2020-06-17T07:51:32Z")

</div>

Hi, I have a canvas dashboard and I would like to know if exist some way to put it in my website, or some part of this dashboard. I saw that was existed a github feature but its done. Has anyone heard something ab…

---

## [\[Metricbeat\]\[Prometheus\] Metricbeat 7.7 rate not stored when use\_types and rate\_counters option is set to true](https://discuss.elastic.co/t/metricbeat-prometheus-metricbeat-7-7-rate-not-stored-when-use-types-and-rate-counters-option-is-set-to-true/236251)

<div class="topic-metadata">

**Author:** [@Jose\_Vargas](https://discuss.elastic.co/u/Jose_Vargas)\
**Replies:** 3\
**Last updated:** [June 17, 2020, 7:49am UTC](https://discuss.elastic.co/t/metricbeat-prometheus-metricbeat-7-7-rate-not-stored-when-use-types-and-rate-counters-option-is-set-to-true/236251 "2020-06-17T07:49:15Z")

</div>

Hi all, I am trying out the Metricbeat Prometheus collector module with the two new options in 7.7; use\_types and rate\_counters; https://www.elastic.co/guide/en/beats/metricbeat/7.7/metricbeat-metricset-prometheus-colle…

---

## [Kibana unable to find Elasticsearch Indexes, even though they exist in Index Management](https://discuss.elastic.co/t/kibana-unable-to-find-elasticsearch-indexes-even-though-they-exist-in-index-management/235096)

<div class="topic-metadata">

**Author:** [@AlanMark](https://discuss.elastic.co/u/AlanMark)\
**Replies:** 1\
**Last updated:** [June 17, 2020, 7:37am UTC](https://discuss.elastic.co/t/kibana-unable-to-find-elasticsearch-indexes-even-though-they-exist-in-index-management/235096 "2020-06-17T07:37:29Z")

</div>

I've set up an ELK server for a client for testing purposes. It's running on an Ubuntu 18.04 server. Current setup: ElasticSearch, Logstash, FileBeat, Kibana all running latest versions. Elasticsearch is set to netw…

---

## [Is my data really replicated across the cluster? How to know?](https://discuss.elastic.co/t/is-my-data-really-replicated-across-the-cluster-how-to-know/237382)

<div class="topic-metadata">

**Author:** [@pszm](https://discuss.elastic.co/u/pszm)\
**Replies:** 7\
**Last updated:** [June 17, 2020, 7:32am UTC](https://discuss.elastic.co/t/is-my-data-really-replicated-across-the-cluster-how-to-know/237382 "2020-06-17T07:32:38Z")

</div>

We used to have just a single node in our cluster. In the past 2 weeks, we added 2 more nodes. Now we want to switch off the old node because the machine is old. But I am doubtful that all our data has actually been spr…

---

## [Can you give me an advice to make the elasticsearch query?](https://discuss.elastic.co/t/can-you-give-me-an-advice-to-make-the-elasticsearch-query/237274)

<div class="topic-metadata">

**Author:** [@hyungsun\_lim](https://discuss.elastic.co/u/hyungsun_lim)\
**Replies:** 1\
**Last updated:** [June 17, 2020, 7:28am UTC](https://discuss.elastic.co/t/can-you-give-me-an-advice-to-make-the-elasticsearch-query/237274 "2020-06-17T07:28:55Z")

</div>

Hello, I try to make elasticsearch query to perform below action I have 4 documents like this \_id : 1 user\_id : 12345 number : 1 \_id : 2 user\_id : 12345 number : 2 \_id : 3 user\_id : 12345 number : 3 \_id : 4 user\_…

---

## [Set 2 shard and 1 replica for filebeat template](https://discuss.elastic.co/t/set-2-shard-and-1-replica-for-filebeat-template/237411)

<div class="topic-metadata">

**Author:** [@David\_Oceans](https://discuss.elastic.co/u/David_Oceans)\
**Replies:** 0\
**Last updated:** [June 17, 2020, 7:25am UTC](https://discuss.elastic.co/t/set-2-shard-and-1-replica-for-filebeat-template/237411 "2020-06-17T07:25:23Z")

</div>

Hi! By default when I use the filebeat installation in my kubernetes clusters it automatically creates a 1 shard and 1 replica template for me, is it possible to change that to use 2 shards and 1 replica in filebeat con…

---

## [Whether es.net.ssl.truststore.location can be setted as hdfs url](https://discuss.elastic.co/t/whether-es-net-ssl-truststore-location-can-be-setted-as-hdfs-url/237407)

<div class="topic-metadata">

**Author:** [@ForgotLove](https://discuss.elastic.co/u/ForgotLove)\
**Replies:** 0\
**Last updated:** [June 17, 2020, 7:09am UTC](https://discuss.elastic.co/t/whether-es-net-ssl-truststore-location-can-be-setted-as-hdfs-url/237407 "2020-06-17T07:09:52Z")

</div>

I have trustore.jks and keystore.jks generated and putted on hdfs.I set spark.es.net.ssl.truststore.location and spark.es.net.ssl.keystore.location with value hdfs://mycluster/keystore.jks. When i create an external es…

---

## [Kibana active but not loading on host browser](https://discuss.elastic.co/t/kibana-active-but-not-loading-on-host-browser/233992)

<div class="topic-metadata">

**Author:** [@sydjunaidshah](https://discuss.elastic.co/u/sydjunaidshah)\
**Replies:** 1\
**Last updated:** [June 17, 2020, 7:02am UTC](https://discuss.elastic.co/t/kibana-active-but-not-loading-on-host-browser/233992 "2020-06-17T07:02:34Z")

</div>

Hello all , I just started learning ossec wazuh elastic stack for HIDS and siem . I just download OVA from https://documentation.wazuh.com/3.12/installation-guide/virtual-machine.html and then check my elastic manage…

---

## [How to store bar chart data?](https://discuss.elastic.co/t/how-to-store-bar-chart-data/237160)

<div class="topic-metadata">

**Author:** [@Jenni](https://discuss.elastic.co/u/Jenni)\
**Replies:** 5\
**Last updated:** [June 17, 2020, 7:02am UTC](https://discuss.elastic.co/t/how-to-store-bar-chart-data/237160 "2020-06-17T07:02:19Z")

</div>

Hello, we are in the middle of restructuring one of our products to use ES instead of MySQL as its data storage. Now we are not sure what would be the best way to model the following data: Each element has a bar chart …

---

## [\[Logstash\] Replace the @timestamp with a rsyslog ISO8691 timestamp from Filebeat log lines](https://discuss.elastic.co/t/logstash-replace-the-timestamp-with-a-rsyslog-iso8691-timestamp-from-filebeat-log-lines/237344)

<div class="topic-metadata">

**Author:** [@Kuo\_Hugo](https://discuss.elastic.co/u/Kuo_Hugo)\
**Replies:** 8\
**Last updated:** [June 17, 2020, 6:53am UTC](https://discuss.elastic.co/t/logstash-replace-the-timestamp-with-a-rsyslog-iso8691-timestamp-from-filebeat-log-lines/237344 "2020-06-17T06:53:18Z")

</div>

Hi Elastic users, I'm forwarding logs from host to an ELK's logstash instance via filebeat. I'm using @timestamp as the time for the index pattern for my logs. The original @timestamp from filebeat while processing the …

---

## [Generate certificates](https://discuss.elastic.co/t/generate-certificates/237403)

<div class="topic-metadata">

**Author:** [@Aayush\_Agrawal](https://discuss.elastic.co/u/Aayush_Agrawal)\
**Replies:** 0\
**Last updated:** [June 17, 2020, 6:27am UTC](https://discuss.elastic.co/t/generate-certificates/237403 "2020-06-17T06:27:16Z")

</div>

Trying to generate certificates using below command bin/elasticsearch-certutil ca --pem Getting below error Exception in thread "main" java.lang.IllegalArgumentException: Could not resolve placeholder 'FQDN' at org.e…

---

## [I didn't understand the Elastic Snapshot properly Please help](https://discuss.elastic.co/t/i-didnt-understand-the-elastic-snapshot-properly-please-help/237260)

<div class="topic-metadata">

**Author:** [@111349](https://discuss.elastic.co/u/111349)\
**Replies:** 10\
**Last updated:** [June 17, 2020, 6:14am UTC](https://discuss.elastic.co/t/i-didnt-understand-the-elastic-snapshot-properly-please-help/237260 "2020-06-17T06:14:14Z")

</div>

My configuration is to run each elastic on 3 different servers. Elastic that works as a master node (also a data node) on the 1st server. Elastic No. 2 and No. 3 operate as data nodes. I know that I have to specify th…

---

## [Unable to reach Elasticsearch 7.7 on network.host: \_global\_. YML works for previous versions](https://discuss.elastic.co/t/unable-to-reach-elasticsearch-7-7-on-network-host-global-yml-works-for-previous-versions/237398)

<div class="topic-metadata">

**Author:** [@Saadan](https://discuss.elastic.co/u/Saadan)\
**Replies:** 1\
**Last updated:** [June 17, 2020, 6:10am UTC](https://discuss.elastic.co/t/unable-to-reach-elasticsearch-7-7-on-network-host-global-yml-works-for-previous-versions/237398 "2020-06-17T06:10:58Z")

</div>

I have set the value of network.host to '0.0.0.0' , 'global' , 'machine ip address' but nothing seems to work when I try to access Elasticsearch from network. I have tried some solutions available online but the problem …

[Previous page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1992)

[Next page](https://discuss.elastic.co/c/elastic-stack/81.md?page=1994)
