# Beats **URL:** https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=457 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 458 --- ## [Drop\_fields not working](https://discuss.elastic.co/t/drop-fields-not-working/128615)
**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\ **Replies:** 1\ **Last updated:** [April 19, 2018, 9:04am UTC](https://discuss.elastic.co/t/drop-fields-not-working/128615 "2018-04-19T09:04:52Z")
Hi, The config below doesn't drop fields. - module: system period: 10m metricsets: - process - process\_summary #- core - diskio #- socket processes: \['.\*'\] process.include\_top\_n: by\_cpu:… --- ## [Metricbeat unable to connect to elasticsearch](https://discuss.elastic.co/t/metricbeat-unable-to-connect-to-elasticsearch/127933)
**Author:** [@Invictus](https://discuss.elastic.co/u/Invictus)\ **Replies:** 4\ **Last updated:** [April 19, 2018, 6:55am UTC](https://discuss.elastic.co/t/metricbeat-unable-to-connect-to-elasticsearch/127933 "2018-04-19T06:55:09Z")
Hi, i have a problem with metricbeat collecting container-data and send them to elasticsearch. Why does metricbeat try to connect to elasticsearch via http://elasticsearch:9200 even though I set the output to the conta… --- ## [ELK 6 Dashboards and Customizations](https://discuss.elastic.co/t/elk-6-dashboards-and-customizations/128532)
**Author:** [@mmethe](https://discuss.elastic.co/u/mmethe)\ **Replies:** 5\ **Last updated:** [April 18, 2018, 5:37pm UTC](https://discuss.elastic.co/t/elk-6-dashboards-and-customizations/128532 "2018-04-18T17:37:09Z")
Hello All, I am strugling to load visualizations and dashboards in ELK 6.x. This is running on Centos 7. It seems from the docs that the load of winlogbeat dashboards come from the windows beat client. I cant get thi… --- ## [NGINX logs - Provided Grok expressions do not match field value](https://discuss.elastic.co/t/nginx-logs-provided-grok-expressions-do-not-match-field-value/128518)
**Author:** [@astropanic](https://discuss.elastic.co/u/astropanic)\ **Replies:** 6\ **Last updated:** [April 18, 2018, 2:16pm UTC](https://discuss.elastic.co/t/nginx-logs-provided-grok-expressions-do-not-match-field-value/128518 "2018-04-18T14:16:53Z")
I'm trying to write a grok filter for my nginx log. the filter: filter { if \[fileset\]\[module\] == "nginx" { if \[fileset\]\[name\] == "access" { grok { match =\> { "message" =\> '%{IPV4} - - \\\[%{HTTPDATE:t… --- ## [An error in Logstash with Beats tagged](https://discuss.elastic.co/t/an-error-in-logstash-with-beats-tagged/128506)
**Author:** [@Roshan\_r](https://discuss.elastic.co/u/Roshan_r)\ **Replies:** 17\ **Last updated:** [April 18, 2018, 2:05pm UTC](https://discuss.elastic.co/t/an-error-in-logstash-with-beats-tagged/128506 "2018-04-18T14:05:07Z")
Im getting an error in logstash but it comes from Beats , i guess looking at the logs. \[\[main\]\ **Author:** [@Juan\_Andres\_Ramirez](https://discuss.elastic.co/u/Juan_Andres_Ramirez)\ **Replies:** 2\ **Last updated:** [April 18, 2018, 1:10pm UTC](https://discuss.elastic.co/t/harvester-limit-over-directory-with-more-1m-files/128412 "2018-04-18T13:10:25Z") hello guys, I have a directory with around 1M files, so I tried added in the filebeat.yml a harvester\_limit: filebeat.prospectors: - type: log enabled: true paths: - /logs/\*\* harvester\_limit: 400000 But file… --- ## [Metricbeat NOT getting cpu, diskio, memory, network data for Windows Containers](https://discuss.elastic.co/t/metricbeat-not-getting-cpu-diskio-memory-network-data-for-windows-containers/128536)
**Author:** [@andyliddle](https://discuss.elastic.co/u/andyliddle)\ **Replies:** 1\ **Last updated:** [April 18, 2018, 12:55pm UTC](https://discuss.elastic.co/t/metricbeat-not-getting-cpu-diskio-memory-network-data-for-windows-containers/128536 "2018-04-18T12:55:04Z")
Hi their, I'm trying to monitor my Windows Containers, and it seems that Metricbeat is not gathering the stats for CPU, memory, disk and network for Windows Containers. Elasticsearch Version: 6.2.3 Operating System: … --- ## [Filebeat collect log file exists delay](https://discuss.elastic.co/t/filebeat-collect-log-file-exists-delay/128291)
**Author:** [@asdfzjs](https://discuss.elastic.co/u/asdfzjs)\ **Replies:** 1\ **Last updated:** [April 18, 2018, 12:26pm UTC](https://discuss.elastic.co/t/filebeat-collect-log-file-exists-delay/128291 "2018-04-18T12:26:33Z")
i use filebeat to collect log file to kafka, but when i monitor the registry file ,i find filebeat collect log file exists delay, filebeat will collect file long time ago. so i want to know , how i can fix it , an… --- ## [Packetbeat and Kibana](https://discuss.elastic.co/t/packetbeat-and-kibana/128221)
**Author:** [@learnnovice](https://discuss.elastic.co/u/learnnovice)\ **Replies:** 1\ **Last updated:** [April 18, 2018, 12:17pm UTC](https://discuss.elastic.co/t/packetbeat-and-kibana/128221 "2018-04-18T12:17:39Z")
Hi all After spending few days trying to get logstash working for codec =\> netflow { versions =\> \[5,9,10\] } I gave up because although tcpdump was able to see the flow data being received. Logstash was listening but… --- ## [Metricbeat process regexp](https://discuss.elastic.co/t/metricbeat-process-regexp/128486)
**Author:** [@bayerb](https://discuss.elastic.co/u/bayerb)\ **Replies:** 4\ **Last updated:** [April 18, 2018, 12:16pm UTC](https://discuss.elastic.co/t/metricbeat-process-regexp/128486 "2018-04-18T12:16:34Z")
Hi, I would like to see the metrics of only the processes ps -ef | grep ".\*java.DJENKINS\_HOME." I tried with the followings: processes: \['java'\] processors: drop\_event: not: regexp: system.process.cmdline: '.\*j… --- ## [No data moving into elasticsearch](https://discuss.elastic.co/t/no-data-moving-into-elasticsearch/127651)
**Author:** [@jarnold](https://discuss.elastic.co/u/jarnold)\ **Replies:** 21\ **Last updated:** [April 18, 2018, 11:11am UTC](https://discuss.elastic.co/t/no-data-moving-into-elasticsearch/127651 "2018-04-18T11:11:20Z")
Hello all, it was suggested I post this on the filebeat page instead of the elasticsearch page. I've installed elastic stack (elasticsearch, kibana, logstash, filebeat) and everything appears to be configured correctly,… --- ## [Network usage per process & question about network usage](https://discuss.elastic.co/t/network-usage-per-process-question-about-network-usage/128464)
**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\ **Replies:** 1\ **Last updated:** [April 18, 2018, 10:10am UTC](https://discuss.elastic.co/t/network-usage-per-process-question-about-network-usage/128464 "2018-04-18T10:10:50Z")
Hi, Is it possible to use metricbeat (or another beat) to monitor traffic per service/application on a host to quickly discover any strange data & which application is generating it? Also, how does metricbeat record in… --- ## [Winlogbeat forward](https://discuss.elastic.co/t/winlogbeat-forward/128325)
**Author:** [@Felix\_Kutscher](https://discuss.elastic.co/u/Felix_Kutscher)\ **Replies:** 4\ **Last updated:** [April 18, 2018, 9:49am UTC](https://discuss.elastic.co/t/winlogbeat-forward/128325 "2018-04-18T09:49:58Z")
Hi, it is possible to send windlogbeat to logstash and then logstash send via tcp or syslog to an other logstash. Winlogbeat --\> Logstash -tcp/syslog-\> Logstash --\> Elasticsearch regards Felix --- ## [Measure system temperature](https://discuss.elastic.co/t/measure-system-temperature/128475)
**Author:** [@ionutzp](https://discuss.elastic.co/u/ionutzp)\ **Replies:** 1\ **Last updated:** [April 18, 2018, 9:34am UTC](https://discuss.elastic.co/t/measure-system-temperature/128475 "2018-04-18T09:34:04Z")
Hello all, I've successfully run metricbeat on a raspberryPI and I'm wondering what's the best way of adding the system temperature to the metricbeat data collection? The system temperature can be retrieved using this … --- ## [Dashboard not showing data & request failed](https://discuss.elastic.co/t/dashboard-not-showing-data-request-failed/128305)
**Author:** [@Sjaak01](https://discuss.elastic.co/u/Sjaak01)\ **Replies:** 3\ **Last updated:** [April 18, 2018, 6:26am UTC](https://discuss.elastic.co/t/dashboard-not-showing-data-request-failed/128305 "2018-04-18T06:26:30Z")
Hi, I imported the dashboard and mapping as explained in the docs. I have a simple logstash config for importing the data. Data shows up just fine in discovery but for some reason visualbuilder is having another one of… --- ## [Dockerized Filebeat & NGINX Logs](https://discuss.elastic.co/t/dockerized-filebeat-nginx-logs/128299)
**Author:** [@Matthew\_Zeemann](https://discuss.elastic.co/u/Matthew_Zeemann)\ **Replies:** 2\ **Last updated:** [April 18, 2018, 4:16am UTC](https://discuss.elastic.co/t/dockerized-filebeat-nginx-logs/128299 "2018-04-18T04:16:17Z")
Does anyone know how to use filebeat.autodiscover with the nginx module? I have filebeat.autodiscover working with nginx, e.g. filebeat.autodiscover: providers: - type: docker templates: - condition… --- ## [Elasticsearch not processing log lines?](https://discuss.elastic.co/t/elasticsearch-not-processing-log-lines/128265)
**Author:** [@exwizzard](https://discuss.elastic.co/u/exwizzard)\ **Replies:** 3\ **Last updated:** [April 17, 2018, 9:56pm UTC](https://discuss.elastic.co/t/elasticsearch-not-processing-log-lines/128265 "2018-04-17T21:56:39Z")
I have filebeat version 6.2.3 and I have configured the output to elasticsearch and set the default prospector to "enabled: true". I have enabled the system module, when I go to discover tab I only see the default field… --- ## [Docker module on metricbeat](https://discuss.elastic.co/t/docker-module-on-metricbeat/127908)
**Author:** [@Gaurav\_Agarwal](https://discuss.elastic.co/u/Gaurav_Agarwal)\ **Replies:** 14\ **Last updated:** [April 17, 2018, 7:00pm UTC](https://discuss.elastic.co/t/docker-module-on-metricbeat/127908 "2018-04-17T19:00:34Z")
The docker module on metric beat shows error when I try to put it in the conf file. Please let me know if i m wrong with the configuration for the docker module, This is the error I m getting when I try to run with th… --- ## [Disable filebeat console output](https://discuss.elastic.co/t/disable-filebeat-console-output/128352)
**Author:** [@terminaattori](https://discuss.elastic.co/u/terminaattori)\ **Replies:** 1\ **Last updated:** [April 17, 2018, 1:25pm UTC](https://discuss.elastic.co/t/disable-filebeat-console-output/128352 "2018-04-17T13:25:03Z")
Hey! I'm having trouble disabling my filebeat's console output. I have stated in my filebeat.yml that console output should be enabled but it doesn't work. Do I need to configure it somewhere else as well as to the file… --- ## [Elasticsearch filebeat index name](https://discuss.elastic.co/t/elasticsearch-filebeat-index-name/128274)
**Author:** [@hoangvnit](https://discuss.elastic.co/u/hoangvnit)\ **Replies:** 1\ **Last updated:** [April 17, 2018, 12:44pm UTC](https://discuss.elastic.co/t/elasticsearch-filebeat-index-name/128274 "2018-04-17T12:44:12Z")
Hi Currently i'm using filebeat & logstash forward nginx log to elasticsearch. this is my config in logstash for output to elastic output { elasticsearch { hosts =\> "https://search-member-recipes-i6pcn3evnwfokr… --- ## [Can a scheduler be setup for filebeat to push logs only at midnight](https://discuss.elastic.co/t/can-a-scheduler-be-setup-for-filebeat-to-push-logs-only-at-midnight/128286)
**Author:** [@Kamal\_Raj](https://discuss.elastic.co/u/Kamal_Raj)\ **Replies:** 2\ **Last updated:** [April 17, 2018, 11:19am UTC](https://discuss.elastic.co/t/can-a-scheduler-be-setup-for-filebeat-to-push-logs-only-at-midnight/128286 "2018-04-17T11:19:07Z")
Wanted to try ES on one of our servers, where the load/CPU utilization is already high. Hence, can I schedule Filebeat to push logs only at midnight I am aware that scan\_frequency:86400 setting in Filebeat config, will … --- ## [The live\_reloading wouldn't caused the original prospector stopped?](https://discuss.elastic.co/t/the-live-reloading-wouldnt-caused-the-original-prospector-stopped/128105)
**Author:** [@jackyshen](https://discuss.elastic.co/u/jackyshen)\ **Replies:** 2\ **Last updated:** [April 17, 2018, 3:39am UTC](https://discuss.elastic.co/t/the-live-reloading-wouldnt-caused-the-original-prospector-stopped/128105 "2018-04-17T03:39:53Z")
I found the information about filebeat live\_reloading in the following URL: https://www.elastic.co/guide/en/beats/filebeat/current/\_live\_reloading.html And it states "When the files found by the Glob change, new prosp… --- ## [Mysql slow log cannot parse](https://discuss.elastic.co/t/mysql-slow-log-cannot-parse/128170)
**Author:** [@zeroliuhuang](https://discuss.elastic.co/u/zeroliuhuang)\ **Replies:** 1\ **Last updated:** [April 17, 2018, 2:47am UTC](https://discuss.elastic.co/t/mysql-slow-log-cannot-parse/128170 "2018-04-17T02:47:46Z")
filebeat version is 6.2.3 mysql version is 5.6.38 I install filebeat filebeat-6.2.3-linux-x86\_64.tar.gz. and start mysql modules. when I start filebeat with mysql 5.1.73 and parse mysql slow log , it can parse the slo… --- ## [Issue with filebeat 6.1.2 and elasticsearch](https://discuss.elastic.co/t/issue-with-filebeat-6-1-2-and-elasticsearch/127102)
**Author:** [@marcandre](https://discuss.elastic.co/u/marcandre)\ **Replies:** 4\ **Last updated:** [April 16, 2018, 8:14pm UTC](https://discuss.elastic.co/t/issue-with-filebeat-6-1-2-and-elasticsearch/127102 "2018-04-16T20:14:44Z")
Hello, I updated elasticsearch to version 6.1.2 I also have two version of filebeat in my infrastructure 5.6.2 and 6.1.2 I see this message in the filebeat log and the log never reach elasticsearc 2018-04-06T12:54:26.… --- ## [Filebeat not sending JSON to file](https://discuss.elastic.co/t/filebeat-not-sending-json-to-file/128009)
**Author:** [@analog\_memories](https://discuss.elastic.co/u/analog_memories)\ **Replies:** 7\ **Last updated:** [April 16, 2018, 7:52pm UTC](https://discuss.elastic.co/t/filebeat-not-sending-json-to-file/128009 "2018-04-16T19:52:37Z")
Hello everyone, I am trying to send a JSON formatted file to file for troubleshooting. I can see in the filebeat log that the file is being harvested, but nothing is being outputed to file. Here is my filebeat.yml: fi… --- ## [Filebeat memory leak associated with failure to open harvesters](https://discuss.elastic.co/t/filebeat-memory-leak-associated-with-failure-to-open-harvesters/123100)
**Author:** [@jeffkirk1](https://discuss.elastic.co/u/jeffkirk1)\ **Replies:** 14\ **Last updated:** [April 16, 2018, 6:05pm UTC](https://discuss.elastic.co/t/filebeat-memory-leak-associated-with-failure-to-open-harvesters/123100 "2018-04-16T18:05:42Z")
Hi folks, We recently began having problem with runaway memory leaks in Filebeats (observed on versions 6.1.3 and above) on various versions of Scientific Linux 6.x and CentOS 7.x. It appears to be associated with a pe… --- ## [RabbitMQ module path\_prefix](https://discuss.elastic.co/t/rabbitmq-module-path-prefix/127292)
**Author:** [@aokhotnikov](https://discuss.elastic.co/u/aokhotnikov)\ **Replies:** 10\ **Last updated:** [April 16, 2018, 4:51pm UTC](https://discuss.elastic.co/t/rabbitmq-module-path-prefix/127292 "2018-04-16T16:51:13Z")
Hi. I configured rabbitmq with option: management.path\_prefix = /rabbit I would like to collect metrics with rabbitmq module, but it allows me configure endpoint and user/password only. Is it possible to made a new op… --- ## [%{\[@metadata\]\[beat\]}-%{\[@metadata\]\[version\]}-%{+YYYY.MM.dd}](https://discuss.elastic.co/t/metadata-beat-metadata-version-yyyy-mm-dd/127360)
**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\ **Replies:** 15\ **Last updated:** [April 16, 2018, 3:40pm UTC](https://discuss.elastic.co/t/metadata-beat-metadata-version-yyyy-mm-dd/127360 "2018-04-16T15:40:24Z")
I'm trying to follow Configure the Logstash output | Metricbeat Reference (Accessing metadata fields) # curl --silent --request GET $ELASTICSEARCH\_URI/\_cat/indices | grep metadata green open %{\[@metadata\]\[beat\]}-%{\[@met… --- ## [Collecting Java logs from a dockerised application?](https://discuss.elastic.co/t/collecting-java-logs-from-a-dockerised-application/127783)
**Author:** [@TimWard](https://discuss.elastic.co/u/TimWard)\ **Replies:** 7\ **Last updated:** [April 16, 2018, 2:51pm UTC](https://discuss.elastic.co/t/collecting-java-logs-from-a-dockerised-application/127783 "2018-04-16T14:51:12Z")
I currently have a Java application which generates a set of Log4j2 log files (RollingFile appender) which is harvested by Filebeat (and sent on to Logstash and ES in the usual way). This all works fine. But now there i… --- ## [Metric beat not running on docker](https://discuss.elastic.co/t/metric-beat-not-running-on-docker/127457)
**Author:** [@Gaurav\_Agarwal](https://discuss.elastic.co/u/Gaurav_Agarwal)\ **Replies:** 15\ **Last updated:** [April 16, 2018, 12:40pm UTC](https://discuss.elastic.co/t/metric-beat-not-running-on-docker/127457 "2018-04-16T12:40:49Z")
Was trying to install metricbeat on docker to analyse docker containers. But I am getting this error. 2018/04/10 09:51:13.057126 beat.go:297: INFO Home path: \[/usr/share/metricbeat\] Config path: \[/usr/share/metricbeat\]… [Previous page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=456) [Next page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=458)