# Beats **URL:** https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=465 [Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md) **Page:** 466 --- ## [Set up the Kibana dashboards for Metricbeat](https://discuss.elastic.co/t/set-up-the-kibana-dashboards-for-metricbeat/124950)
**Author:** [@Bit\_Addict](https://discuss.elastic.co/u/Bit_Addict)\ **Replies:** 2\ **Last updated:** [March 21, 2018, 2:45pm UTC](https://discuss.elastic.co/t/set-up-the-kibana-dashboards-for-metricbeat/124950 "2018-03-21T14:45:45Z")
Hi all... I am very new to ELK and still learning, so please be forbearing with my probably stupid questions. I tried to find my issue within the search here, did not find it, so I guess it might be a very small issue. … --- ## [Filebeat fails to send monitoring stats to Elasticsearch](https://discuss.elastic.co/t/filebeat-fails-to-send-monitoring-stats-to-elasticsearch/124635)
**Author:** [@mn\_dev](https://discuss.elastic.co/u/mn_dev)\ **Replies:** 3\ **Last updated:** [March 21, 2018, 1:55pm UTC](https://discuss.elastic.co/t/filebeat-fails-to-send-monitoring-stats-to-elasticsearch/124635 "2018-03-21T13:55:38Z")
I cannot seem to setup the xpack monitoring of Filebeats successfully. Filebeats keeps logging error messages similar to: 2018-03-19T12:29:20.396-0700 ERROR pipeline/output.go:92 Failed to publish events: 500 Internal … --- ## [Heartbeat fatal error: concurrent map iteration and map write](https://discuss.elastic.co/t/heartbeat-fatal-error-concurrent-map-iteration-and-map-write/124716)
**Author:** [@Flavio\_Fortes](https://discuss.elastic.co/u/Flavio_Fortes)\ **Replies:** 4\ **Last updated:** [March 21, 2018, 12:13pm UTC](https://discuss.elastic.co/t/heartbeat-fatal-error-concurrent-map-iteration-and-map-write/124716 "2018-03-21T12:13:52Z")
Hello, I'm trying to run Heartbeat version 6.1.1 up to 6.1.3 all failing, normally after 20 minutes running due to the following error: 2018/03/19 23:56:00.640256 scheduler.go:170: DBG \[scheduler\] Next wakeup time: 20… --- ## [Filebeats is re-processing logs once it restarts](https://discuss.elastic.co/t/filebeats-is-re-processing-logs-once-it-restarts/124292)
**Author:** [@aniketkk](https://discuss.elastic.co/u/aniketkk)\ **Replies:** 5\ **Last updated:** [March 21, 2018, 8:28am UTC](https://discuss.elastic.co/t/filebeats-is-re-processing-logs-once-it-restarts/124292 "2018-03-21T08:28:22Z")
Hi, I am using Nginx as my app server. I have installed filebeat where Nginx is installed. Filebeat pushes these logs to Logstash. Then logstash pushes forward to elasticsearch. But whenever I do a deployment the previ… --- ## [Filebeat: filebeat.config.prospectors is not working in 6.2.1](https://discuss.elastic.co/t/filebeat-filebeat-config-prospectors-is-not-working-in-6-2-1/122867)
**Author:** [@mruthyu](https://discuss.elastic.co/u/mruthyu)\ **Replies:** 4\ **Last updated:** [March 21, 2018, 8:08am UTC](https://discuss.elastic.co/t/filebeat-filebeat-config-prospectors-is-not-working-in-6-2-1/122867 "2018-03-21T08:08:28Z")
I see the following message when the config\_dir is used. So when I configured filebeat.config.prospectors it is not working and I have to revert back to config\_dir itslef to get it working. DEPRECATED: config\_dir is dep… --- ## [Filebeat in kubernetes can't create index](https://discuss.elastic.co/t/filebeat-in-kubernetes-cant-create-index/124576)
**Author:** [@McElroy](https://discuss.elastic.co/u/McElroy)\ **Replies:** 2\ **Last updated:** [March 21, 2018, 7:20am UTC](https://discuss.elastic.co/t/filebeat-in-kubernetes-cant-create-index/124576 "2018-03-21T07:20:35Z")
Hi, I tried to run filebeat in docker/kubernetes according to this documentation: But everything I get is: 2018/03/19 14:26:15.109861 client.go:465: WARN Can not index event (status=400): {"type":"mapper\_parsing\_exc… --- ## [Issue with Kafka Module](https://discuss.elastic.co/t/issue-with-kafka-module/124356)
**Author:** [@ryan.dyer](https://discuss.elastic.co/u/ryan.dyer)\ **Replies:** 2\ **Last updated:** [March 21, 2018, 7:05am UTC](https://discuss.elastic.co/t/issue-with-kafka-module/124356 "2018-03-21T07:05:23Z")
I am having an issue with the kafka module not appear to process the lines properly. I have enabled debugging of filebeat and see the following: 2018-03-16T18:36:54Z DBG \[publish\] Publish event: { "@timestamp": "2018-0… --- ## [Set Timestamp of multiple events by one specific event](https://discuss.elastic.co/t/set-timestamp-of-multiple-events-by-one-specific-event/124527)
**Author:** [@Robert\_D](https://discuss.elastic.co/u/Robert_D)\ **Replies:** 1\ **Last updated:** [March 21, 2018, 7:00am UTC](https://discuss.elastic.co/t/set-timestamp-of-multiple-events-by-one-specific-event/124527 "2018-03-21T07:00:48Z")
Hello I have an application log file, containing one json-object per line. The schema of the file is this. { "step": "text", "msg": "text", "tags": "array", "keyValues": "object" } The problem I have is, that ther… --- ## [Retrying problems - bandwidth increase](https://discuss.elastic.co/t/retrying-problems-bandwidth-increase/124644)
**Author:** [@rsk0](https://discuss.elastic.co/u/rsk0)\ **Replies:** 1\ **Last updated:** [March 21, 2018, 12:01am UTC](https://discuss.elastic.co/t/retrying-problems-bandwidth-increase/124644 "2018-03-21T00:01:08Z")
I've got a setup of a couple hundred Filebeats sending in to Redis -\> Logstash -\> Elasticsearch, and when Redis fills up and rejects publications the bandwidth being used starts increasing. I'm guessing this is because … --- ## [Filebeat: secure/messages for centos](https://discuss.elastic.co/t/filebeat-secure-messages-for-centos/124496)
**Author:** [@eureka](https://discuss.elastic.co/u/eureka)\ **Replies:** 5\ **Last updated:** [March 20, 2018, 11:39pm UTC](https://discuss.elastic.co/t/filebeat-secure-messages-for-centos/124496 "2018-03-20T23:39:32Z")
Hello, I'm new to the stack. I have a bunch of logs I wanted to try out, I was only able to get auditd module working (commented out below) filebeat.yml filebeat.modules: - module: system syslog: enabled: t… --- ## [Comand line Filebeat](https://discuss.elastic.co/t/comand-line-filebeat/124323)
**Author:** [@franco.federico](https://discuss.elastic.co/u/franco.federico)\ **Replies:** 2\ **Last updated:** [March 20, 2018, 10:38pm UTC](https://discuss.elastic.co/t/comand-line-filebeat/124323 "2018-03-20T22:38:09Z")
Hi all I'm using the filebeat command line and I'm searching a mode in order to create a different name of index instead of filebeat-\*. I'm using this command sudo filebeat -e --module apache2 -M "apache2.access.var.p… --- ## [Data going into wrong index](https://discuss.elastic.co/t/data-going-into-wrong-index/124653)
**Author:** [@chandukreddi](https://discuss.elastic.co/u/chandukreddi)\ **Replies:** 3\ **Last updated:** [March 20, 2018, 10:13pm UTC](https://discuss.elastic.co/t/data-going-into-wrong-index/124653 "2018-03-20T22:13:36Z")
Hello Experts, Different type of logs going into single index, technically it should go to different new (defined) indexes. I am differentiating 2 different log files with TAG and then applying filter on TAG in logstas… --- ## [Sending filebeat data to AWS es](https://discuss.elastic.co/t/sending-filebeat-data-to-aws-es/124363)
**Author:** [@hobakill](https://discuss.elastic.co/u/hobakill)\ **Replies:** 1\ **Last updated:** [March 20, 2018, 8:59pm UTC](https://discuss.elastic.co/t/sending-filebeat-data-to-aws-es/124363 "2018-03-20T20:59:41Z")
I am trying to use AWS ES with very little success. I'm trying a very basic test by using Filebeat to send data to it and so far as I can tell nothing is going over. I have DEBUG log level on and I'm getting nothing back… --- ## [Filebeat on windows](https://discuss.elastic.co/t/filebeat-on-windows/124714)
**Author:** [@kanchan\_pingale](https://discuss.elastic.co/u/kanchan_pingale)\ **Replies:** 1\ **Last updated:** [March 20, 2018, 8:55pm UTC](https://discuss.elastic.co/t/filebeat-on-windows/124714 "2018-03-20T20:55:27Z")
hello! My logs are not getting harvested. The command used is: filebeat.exe -e -v -c filebeat.yml The output is: \[filebeat\] And my filebeat.yml is: ###################### Filebeat Configuration Example #############… --- ## [Is it possible metricbeat can fetch the VDI's information](https://discuss.elastic.co/t/is-it-possible-metricbeat-can-fetch-the-vdis-information/124849)
**Author:** [@vaishali1](https://discuss.elastic.co/u/vaishali1)\ **Replies:** 0\ **Last updated:** [March 20, 2018, 7:34pm UTC](https://discuss.elastic.co/t/is-it-possible-metricbeat-can-fetch-the-vdis-information/124849 "2018-03-20T19:34:18Z")
Hi, Is it possible metricbeat can fetch the VDI's information (eg. VDI's cpu performance,Memory Usuage, etc) --- ## [What is the memory.size metric?](https://discuss.elastic.co/t/what-is-the-memory-size-metric/124609)
**Author:** [@wwalker](https://discuss.elastic.co/u/wwalker)\ **Replies:** 2\ **Last updated:** [March 20, 2018, 7:04pm UTC](https://discuss.elastic.co/t/what-is-the-memory-size-metric/124609 "2018-03-20T19:04:04Z")
Have an issue where Elasticsearch, installed as a service, stopped with Windows Event Logs reporting resource exhaustion. Elasticsearch is configured to use only 5GB of RAM but MetricBeat is saying something related to … --- ## [Filebeat not sending logs to kafka](https://discuss.elastic.co/t/filebeat-not-sending-logs-to-kafka/124845)
**Author:** [@huangdihu](https://discuss.elastic.co/u/huangdihu)\ **Replies:** 0\ **Last updated:** [March 20, 2018, 6:56pm UTC](https://discuss.elastic.co/t/filebeat-not-sending-logs-to-kafka/124845 "2018-03-20T18:56:51Z")
Hi Below are my filebeat.yml and filebeat logs, I could not see logs output to Kafka topics (3 topics configured here), and also filebeat registry file didn't change. Could you help to check what went wrong? Also in the… --- ## [Metricbeat Metrics Don't Match Windows 10 Task Manager](https://discuss.elastic.co/t/metricbeat-metrics-dont-match-windows-10-task-manager/124552)
**Author:** [@Vincent\_Maury](https://discuss.elastic.co/u/Vincent_Maury)\ **Replies:** 2\ **Last updated:** [March 20, 2018, 6:03pm UTC](https://discuss.elastic.co/t/metricbeat-metrics-dont-match-windows-10-task-manager/124552 "2018-03-20T18:03:47Z")
Hi, I'm using metricbeat 6.2.1, sending data to ES 6.2.1. I see metrics that are different than the ones provided in my Windows system (task manager), see screenshots attached for RAM data. Thanks in advance for your … --- ## [Win2k3 & perfmon module](https://discuss.elastic.co/t/win2k3-perfmon-module/124649)
**Author:** [@bitva77](https://discuss.elastic.co/u/bitva77)\ **Replies:** 2\ **Last updated:** [March 20, 2018, 5:03pm UTC](https://discuss.elastic.co/t/win2k3-perfmon-module/124649 "2018-03-20T17:03:32Z")
Hi! Running metricbeat 6.2.1 and we're trying to capture perfmon stats regarding CPU from an old a## Windows 2003 server and nothing seems to be coming through. First, can Metricbeat and this version of beat even scrap… --- ## [Makefile:294: recipe for target 'update' failed](https://discuss.elastic.co/t/makefile-294-recipe-for-target-update-failed/124728)
**Author:** [@thro](https://discuss.elastic.co/u/thro)\ **Replies:** 7\ **Last updated:** [March 20, 2018, 3:50pm UTC](https://discuss.elastic.co/t/makefile-294-recipe-for-target-update-failed/124728 "2018-03-20T15:50:38Z")
Hi, new to beats here. I am trying to build the beats project straight out of github and I need some help. user@ubuntu17:~/code/beats$ make The problem seems to be related to \_meta/beat.yml not being in the place expe… --- ## [Changing the Metricbeat template](https://discuss.elastic.co/t/changing-the-metricbeat-template/124335)
**Author:** [@TimWard](https://discuss.elastic.co/u/TimWard)\ **Replies:** 2\ **Last updated:** [March 20, 2018, 3:39pm UTC](https://discuss.elastic.co/t/changing-the-metricbeat-template/124335 "2018-03-20T15:39:47Z")
How do I override bits of the usual metricbeat template? - I want beat.hostname to be treated as both text and keyword, but all my attempts so far to hack around in the default generated template fail with errors when I … --- ## [Beats nightlies not updated](https://discuss.elastic.co/t/beats-nightlies-not-updated/121201)
**Author:** [@hilt86](https://discuss.elastic.co/u/hilt86)\ **Replies:** 3\ **Last updated:** [March 20, 2018, 2:59pm UTC](https://discuss.elastic.co/t/beats-nightlies-not-updated/121201 "2018-03-20T14:59:35Z")
A plethora of beats used to be available at https://beats-nightlies.s3.amazonaws.com/index.html?prefix=metricbeat/ however there has been no update of that bucket for 7 months - is there a new location for these builds? --- ## [Hosts output target using AD Sites Services](https://discuss.elastic.co/t/hosts-output-target-using-ad-sites-services/124670)
**Author:** [@PandKing](https://discuss.elastic.co/u/PandKing)\ **Replies:** 2\ **Last updated:** [March 20, 2018, 2:59pm UTC](https://discuss.elastic.co/t/hosts-output-target-using-ad-sites-services/124670 "2018-03-20T14:59:07Z")
What happens when hosts is a domain record that returns multiple addresses ? Does it use the first, all of them, only the ones that work, load balance.. ? The goal was to use sites and services to always return the clo… --- ## [\[kafka.output\] Do I need to give filebeat DESCRIBE access to \_\_consumer\_offsets](https://discuss.elastic.co/t/kafka-output-do-i-need-to-give-filebeat-describe-access-to-consumer-offsets/124554)
**Author:** [@JohanRask](https://discuss.elastic.co/u/JohanRask)\ **Replies:** 0\ **Last updated:** [March 19, 2018, 12:17pm UTC](https://discuss.elastic.co/t/kafka-output-do-i-need-to-give-filebeat-describe-access-to-consumer-offsets/124554 "2018-03-19T12:17:19Z")
Hi, we are securing our kafka cluster but are seeing this in logs like every 10 minutes. \[2018-03-19 11:16:32,622\] INFO Principal = User:ANONYMOUS is Denied Operation = Describe from host = 10.133.225.9 on resource = To… --- ## [Best practice for using file beats and indexing](https://discuss.elastic.co/t/best-practice-for-using-file-beats-and-indexing/124599)
**Author:** [@David\_Gidony](https://discuss.elastic.co/u/David_Gidony)\ **Replies:** 2\ **Last updated:** [March 20, 2018, 10:35am UTC](https://discuss.elastic.co/t/best-practice-for-using-file-beats-and-indexing/124599 "2018-03-20T10:35:38Z")
hi, i configed beats to read log files from a certain dir and output it to logstash, in logstash i have a config that listens to beats , do some filtering and outputs to elastic search. the index name is dynamically g… --- ## [\[solved\] \[kubernetes module\] unable to enable ssl](https://discuss.elastic.co/t/solved-kubernetes-module-unable-to-enable-ssl/124603)
**Author:** [@hamelg](https://discuss.elastic.co/u/hamelg)\ **Replies:** 6\ **Last updated:** [March 20, 2018, 9:45am UTC](https://discuss.elastic.co/t/solved-kubernetes-module-unable-to-enable-ssl/124603 "2018-03-20T09:45:33Z")
Hello according to the documentation, kubernetes module supports ssl connection \[1\]. But despite ssl setting enabled, it still talks http to the kubelet service. Any ideas ? \[1\] https://www.elastic.co/guide/en/beats/… --- ## [Disk usage missing from kibana dashboard](https://discuss.elastic.co/t/disk-usage-missing-from-kibana-dashboard/124360)
**Author:** [@Alex\_Mendez](https://discuss.elastic.co/u/Alex_Mendez)\ **Replies:** 1\ **Last updated:** [March 20, 2018, 9:15am UTC](https://discuss.elastic.co/t/disk-usage-missing-from-kibana-dashboard/124360 "2018-03-20T09:15:00Z")
The disk usage is empty for all clients on kibana, below is the metric beat config. If someone could explain how to troubleshoot this, where to begin to even look. I would appreciate it and a fix would be awesome too. … --- ## [Timestamp error](https://discuss.elastic.co/t/timestamp-error/124412)
**Author:** [@space.iitr](https://discuss.elastic.co/u/space.iitr)\ **Replies:** 1\ **Last updated:** [March 20, 2018, 9:13am UTC](https://discuss.elastic.co/t/timestamp-error/124412 "2018-03-20T09:13:01Z")
I am getting wrong value in @timestamp field for elasticsearch/filebeat. My filebeat pipeline definition curl -H 'Content-Type: application/json' -XPUT "logger:9200/\_ingest/pipeline/app\_log" -d' { "description" : "Ing… --- ## [Filebeat not starting at startup](https://discuss.elastic.co/t/filebeat-not-starting-at-startup/124679)
**Author:** [@lfk](https://discuss.elastic.co/u/lfk)\ **Replies:** 1\ **Last updated:** [March 20, 2018, 8:58am UTC](https://discuss.elastic.co/t/filebeat-not-starting-at-startup/124679 "2018-03-20T08:58:05Z")
I've installed Filebeat on an Ubuntu 16.04 server (AWS EC2) according to the instructions here, including running sudo update-rc.d filebeat defaults 95 10 However, I still have to run sudo service filebeat start to s… --- ## [Why Filebeat resend previous log when I add new content in log file?](https://discuss.elastic.co/t/why-filebeat-resend-previous-log-when-i-add-new-content-in-log-file/124500)
**Author:** [@leyi1002](https://discuss.elastic.co/u/leyi1002)\ **Replies:** 2\ **Last updated:** [March 20, 2018, 7:13am UTC](https://discuss.elastic.co/t/why-filebeat-resend-previous-log-when-i-add-new-content-in-log-file/124500 "2018-03-20T07:13:53Z")
I hava no idea why filebeat send all content of log,but not new content.Thanks for your help! filebeat.yml filebeat.prospectors: - type: log enabled: true paths: - /usr/local/logstash/sample/line.log fie… [Previous page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=464) [Next page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=466)