# Beats

**URL:** https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=582

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 583

---

## [Doese a 'local' filebeat installation makes sense?](https://discuss.elastic.co/t/doese-a-local-filebeat-installation-makes-sense/47353)

<div class="topic-metadata">

**Author:** [@pat7](https://discuss.elastic.co/u/pat7)\
**Replies:** 5\
**Last updated:** [May 3, 2016, 11:14am UTC](https://discuss.elastic.co/t/doese-a-local-filebeat-installation-makes-sense/47353 "2016-05-03T11:14:11Z")

</div>

hi, i got a windows server on which i have a network share mounted with several logfiles I want to send to logstash. logstash (and actualy the whole elasticstack) is installed on that same server. I can use file input in…

---

## [Filebeat multiline by Queue ID](https://discuss.elastic.co/t/filebeat-multiline-by-queue-id/47406)

<div class="topic-metadata">

**Author:** [@Joey](https://discuss.elastic.co/u/Joey)\
**Replies:** 10\
**Last updated:** [May 3, 2016, 5:59am UTC](https://discuss.elastic.co/t/filebeat-multiline-by-queue-id/47406 "2016-05-03T05:59:13Z")

</div>

Hello Community, I want to filter Postfix log lines and tie them together by Postfix Queue ID. Currently for this purpose I am using Logstash multiline filter in combination with its parameter "stream\_identity". %{que…

---

## [Add set\_real\_ip\_from working with real\_ip\_header just like the nginx way](https://discuss.elastic.co/t/add-set-real-ip-from-working-with-real-ip-header-just-like-the-nginx-way/48496)

<div class="topic-metadata">

**Author:** [@hnlq715](https://discuss.elastic.co/u/hnlq715)\
**Replies:** 2\
**Last updated:** [May 3, 2016, 2:34am UTC](https://discuss.elastic.co/t/add-set-real-ip-from-working-with-real-ip-header-just-like-the-nginx-way/48496 "2016-05-03T02:34:11Z")

</div>

http://nginx.org/en/docs/http/ngx\_http\_realip\_module.html We nedd to define trusted addresses that are known to send correct replacement addresses.

---

## [Running multiple filebeat instances](https://discuss.elastic.co/t/running-multiple-filebeat-instances/48995)

<div class="topic-metadata">

**Author:** [@reinier](https://discuss.elastic.co/u/reinier)\
**Replies:** 2\
**Last updated:** [May 2, 2016, 11:55pm UTC](https://discuss.elastic.co/t/running-multiple-filebeat-instances/48995 "2016-05-02T23:55:36Z")

</div>

Hi, I am currently using Filebeat to send both NGINX and Syslog towards an ELK stack, which works perfectly. Nice! Now I am trying to add OSSEC to the equation. The OSSEC files are in JSON format, while the other logs …

---

## [Can filebeat buffer data for a second?](https://discuss.elastic.co/t/can-filebeat-buffer-data-for-a-second/48941)

<div class="topic-metadata">

**Author:** [@mathias](https://discuss.elastic.co/u/mathias)\
**Replies:** 2\
**Last updated:** [May 2, 2016, 11:03pm UTC](https://discuss.elastic.co/t/can-filebeat-buffer-data-for-a-second/48941 "2016-05-02T23:03:18Z")

</div>

Hi, I believe my performance problems with filebeat and logstash are due too many events in short time. I have notice in other systems that performance is improved when I buffer my events and upload the buffer once per…

---

## [Packet beat eats up 3GB of ram when running for a while](https://discuss.elastic.co/t/packet-beat-eats-up-3gb-of-ram-when-running-for-a-while/48333)

<div class="topic-metadata">

**Author:** [@MikeC](https://discuss.elastic.co/u/MikeC)\
**Replies:** 4\
**Last updated:** [May 2, 2016, 10:50pm UTC](https://discuss.elastic.co/t/packet-beat-eats-up-3gb-of-ram-when-running-for-a-while/48333 "2016-05-02T22:50:39Z")

</div>

Hi, i've got packetbeat installed on a server and it sends its measurements to an elastic cluster (4 nodes, 12GB ram). After a while (and on one particular server) packetbeat consumes 2-3GB RAM of memory and it makes t…

---

## [Pachetbeat: not deterministic src/dst assignment](https://discuss.elastic.co/t/pachetbeat-not-deterministic-src-dst-assignment/48851)

<div class="topic-metadata">

**Author:** [@kofemann](https://discuss.elastic.co/u/kofemann)\
**Replies:** 2\
**Last updated:** [May 2, 2016, 7:01pm UTC](https://discuss.elastic.co/t/pachetbeat-not-deterministic-src-dst-assignment/48851 "2016-05-02T19:01:04Z")

</div>

Hi folks, With NFS beat we have notice that some time client and server ip addresses are mixed up. My understanding is that roles are assigned when a first packet is seen btypacketbeat. If you are in the middle of th…

---

## [Mysterious 'offset' and 'count' fields](https://discuss.elastic.co/t/mysterious-offset-and-count-fields/48981)

<div class="topic-metadata">

**Author:** [@CraigFoote](https://discuss.elastic.co/u/CraigFoote)\
**Replies:** 3\
**Last updated:** [May 2, 2016, 5:18pm UTC](https://discuss.elastic.co/t/mysterious-offset-and-count-fields/48981 "2016-05-02T17:18:39Z")

</div>

I'm getting these two fields in my data but I don't know where they're coming from. Are they put there by filebeat? How can I get rid of them?

---

## [Calculating delay of sending/processing delay of events](https://discuss.elastic.co/t/calculating-delay-of-sending-processing-delay-of-events/48799)

<div class="topic-metadata">

**Author:** [@hartfordfive](https://discuss.elastic.co/u/hartfordfive)\
**Replies:** 3\
**Last updated:** [May 2, 2016, 4:53pm UTC](https://discuss.elastic.co/t/calculating-delay-of-sending-processing-delay-of-events/48799 "2016-05-02T16:53:19Z")

</div>

We currently have an ELK cluster which supports multiple tenants and each tenant sends their logs to our Logstash cluster via the Filebeat shipper. We try to provide our tenants with stats of what the average processin…

---

## [Reliability of Packetbeat Logs](https://discuss.elastic.co/t/reliability-of-packetbeat-logs/48880)

<div class="topic-metadata">

**Author:** [@Mohannad\_Saeed](https://discuss.elastic.co/u/Mohannad_Saeed)\
**Replies:** 2\
**Last updated:** [May 2, 2016, 4:46pm UTC](https://discuss.elastic.co/t/reliability-of-packetbeat-logs/48880 "2016-05-02T16:46:07Z")

</div>

Greetings, There is a setting in the configuration template of Packetbeat on Github, where one can instruct Packetbeat to output logs to a local file. Two questions regarding this setting: Is it guaranteed to have…

---

## [Introducing mysqlbeat](https://discuss.elastic.co/t/introducing-mysqlbeat/48890)

<div class="topic-metadata">

**Author:** [@adi.b](https://discuss.elastic.co/u/adi.b)\
**Replies:** 5\
**Last updated:** [May 2, 2016, 9:25am UTC](https://discuss.elastic.co/t/introducing-mysqlbeat/48890 "2016-05-02T09:25:17Z")

</div>

Hi Guys, I looked for something to expand the MySQL packetbeat dashboard with no luck so I decided to do it myself :grin: I wrote a new beat that can connect to a MySQL server and ship any result from the queries define…

---

## [Windows - packetbeat service failed to start](https://discuss.elastic.co/t/windows-packetbeat-service-failed-to-start/29523)

<div class="topic-metadata">

**Author:** [@inlikefletch](https://discuss.elastic.co/u/inlikefletch)\
**Replies:** 14\
**Last updated:** [May 2, 2016, 8:12am UTC](https://discuss.elastic.co/t/windows-packetbeat-service-failed-to-start/29523 "2016-05-02T08:12:33Z")

</div>

Hi, I am having trouble starting the packetbeat service on my application servers and local elk stack. Even if I install on my local elasticsearch server, windows server, keep the default yml file because those configura…

---

## [Filebeat harvesting issue](https://discuss.elastic.co/t/filebeat-harvesting-issue/48859)

<div class="topic-metadata">

**Author:** [@Ramesh\_Narasimhan](https://discuss.elastic.co/u/Ramesh_Narasimhan)\
**Replies:** 1\
**Last updated:** [May 2, 2016, 7:24am UTC](https://discuss.elastic.co/t/filebeat-harvesting-issue/48859 "2016-05-02T07:24:41Z")

</div>

My filebeat configuration has been working fine. But it suddenly stopped working now. I have updated to the latest version of filebeat, restarted filebeat instance, restarted my application instance. but still no luck.f…

---

## [Custom beat - re-use Filebeat log readers?](https://discuss.elastic.co/t/custom-beat-re-use-filebeat-log-readers/48868)

<div class="topic-metadata">

**Author:** [@jason26](https://discuss.elastic.co/u/jason26)\
**Replies:** 3\
**Last updated:** [April 30, 2016, 9:18pm UTC](https://discuss.elastic.co/t/custom-beat-re-use-filebeat-log-readers/48868 "2016-04-30T21:18:52Z")

</div>

I'm creating a new beat application, primarily to remove the logstash requirements for getting this data into Elastic Search. The file being read is new line delimited JSON, and gets rotated by logrotate. Anyone reusi…

---

## [Docker\[ELK+Filebeat\] =\> No logs](https://discuss.elastic.co/t/docker-elk-filebeat-no-logs/40946)

<div class="topic-metadata">

**Author:** [@Ragnar](https://discuss.elastic.co/u/Ragnar)\
**Replies:** 10\
**Last updated:** [April 29, 2016, 2:48pm UTC](https://discuss.elastic.co/t/docker-elk-filebeat-no-logs/40946 "2016-04-29T14:48:42Z")

</div>

Hi everyone, I'm learning how to use ELK so I decided to do my own Hello world. I planned to make some graph with my syslog/auth.log I also decided to put every services in a Docker's container. I set up everything…

---

## [Warning on Packetbeats](https://discuss.elastic.co/t/warning-on-packetbeats/48754)

<div class="topic-metadata">

**Author:** [@Kennedy\_Kan](https://discuss.elastic.co/u/Kennedy_Kan)\
**Replies:** 1\
**Last updated:** [April 29, 2016, 9:25am UTC](https://discuss.elastic.co/t/warning-on-packetbeats/48754 "2016-04-29T09:25:27Z")

</div>

up vote 0 down vote favorite I have set up packetbeats in grepping MYSQL server but it keeps prompt up warning when running packetbeats. Does anyone have any measures for it? Here is the warning: 2016/04/29 01:20:41.…

---

## [Flowbeats fails in go build](https://discuss.elastic.co/t/flowbeats-fails-in-go-build/48601)

<div class="topic-metadata">

**Author:** [@tbernhardson](https://discuss.elastic.co/u/tbernhardson)\
**Replies:** 4\
**Last updated:** [April 28, 2016, 10:11pm UTC](https://discuss.elastic.co/t/flowbeats-fails-in-go-build/48601 "2016-04-28T22:11:51Z")

</div>

working on getting flowbeats installed to collect sflow data. working through the install steps listed in github when I get to the step of "go build" it returns: beater/flowbeat.go:52: b.Events undefined (type \*beat.Beat…

---

## [PacketBeat: responsetime is being set 0](https://discuss.elastic.co/t/packetbeat-responsetime-is-being-set-0/48194)

<div class="topic-metadata">

**Author:** [@Rachit\_Puri](https://discuss.elastic.co/u/Rachit_Puri)\
**Replies:** 6\
**Last updated:** [April 28, 2016, 9:47pm UTC](https://discuss.elastic.co/t/packetbeat-responsetime-is-being-set-0/48194 "2016-04-28T21:47:40Z")

</div>

Hi, I am using packetbeat to dump mysql,http and redis request using a port mirror. I can see a lot of variation in the response time being set and many of my packets are getting lost. Can, some one guide me to use the…

---

## [Specify a Reverse proxy endpoint in FileBeat configuration](https://discuss.elastic.co/t/specify-a-reverse-proxy-endpoint-in-filebeat-configuration/48652)

<div class="topic-metadata">

**Author:** [@ramkchirra](https://discuss.elastic.co/u/ramkchirra)\
**Replies:** 2\
**Last updated:** [April 28, 2016, 1:09pm UTC](https://discuss.elastic.co/t/specify-a-reverse-proxy-endpoint-in-filebeat-configuration/48652 "2016-04-28T13:09:53Z")

</div>

Hi, I am very new to ELK stack. Actually i want to configure Filebeat(Client) in a way that it can directly talk to ElasticSearch present on a WebServer and whose endpoint is exposed through a Reverse proxy. If i…

---

## [Multiple beats input ports](https://discuss.elastic.co/t/multiple-beats-input-ports/48589)

<div class="topic-metadata">

**Author:** [@tbernhardson](https://discuss.elastic.co/u/tbernhardson)\
**Replies:** 3\
**Last updated:** [April 27, 2016, 9:31pm UTC](https://discuss.elastic.co/t/multiple-beats-input-ports/48589 "2016-04-27T21:31:00Z")

</div>

due to needing to support some old systems that do not support TLS 1.1 or 1.2, I would like to have 2 separate Ports defined for beats (1 for SSL/TLS, 1 with no encryption). I have tried a couple of things (2 inputs de…

---

## [Certificate issue for filebeat](https://discuss.elastic.co/t/certificate-issue-for-filebeat/48556)

<div class="topic-metadata">

**Author:** [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\
**Replies:** 1\
**Last updated:** [April 27, 2016, 2:33pm UTC](https://discuss.elastic.co/t/certificate-issue-for-filebeat/48556 "2016-04-27T14:33:16Z")

</div>

Hi, I am migrating from LSF to filebeat. In LSF, I used to put only my-issuing.cer.pem file. However in FB, there are three options given under TLS prospector in output-logsatsh. Which is required?

---

## [Unable to filter more than 22 eventIDs](https://discuss.elastic.co/t/unable-to-filter-more-than-22-eventids/48358)

<div class="topic-metadata">

**Author:** [@Alreanaes](https://discuss.elastic.co/u/Alreanaes)\
**Replies:** 2\
**Last updated:** [April 27, 2016, 12:53pm UTC](https://discuss.elastic.co/t/unable-to-filter-more-than-22-eventids/48358 "2016-04-27T12:53:08Z")

</div>

The relevant output from -e -d "\*" DBG WinEventLog\[ForwardedEvents\] using subscription query=\<QueryList\> \<Query Id="0"\> \<Select Path="ForwardedEvents"\>\*\[System\[(EventID=1 or EventID=2 or EventID=3 or EventID=4 o…

---

## [Nightly build shows no CPU usage](https://discuss.elastic.co/t/nightly-build-shows-no-cpu-usage/48357)

<div class="topic-metadata">

**Author:** [@renevdm](https://discuss.elastic.co/u/renevdm)\
**Replies:** 4\
**Last updated:** [April 27, 2016, 8:22am UTC](https://discuss.elastic.co/t/nightly-build-shows-no-cpu-usage/48357 "2016-04-27T08:22:13Z")

</div>

I used a nightly build of topbeat from here (ARM architecture) on my Raspberry Pi. It nicely shows the memory usage, however, no CPU usage is being shown. I already played around with toggleing cpu\_per\_core between true …

---

## [Filebeat missing log lines](https://discuss.elastic.co/t/filebeat-missing-log-lines/46991)

<div class="topic-metadata">

**Author:** [@paritosh](https://discuss.elastic.co/u/paritosh)\
**Replies:** 15\
**Last updated:** [April 27, 2016, 6:30am UTC](https://discuss.elastic.co/t/filebeat-missing-log-lines/46991 "2016-04-27T06:30:45Z")

</div>

I have filebeat up and running. FileBeat version : 1.2.0 Operating System : Ubuntu My configuration looks something like filebeat: prospectors: - paths: - /home/abc/access.log.2016\* input…

---

## [Report a bug of winlogbeat-5.0.0-alpha1-windows-32](https://discuss.elastic.co/t/report-a-bug-of-winlogbeat-5-0-0-alpha1-windows-32/47550)

<div class="topic-metadata">

**Author:** [@tuankun](https://discuss.elastic.co/u/tuankun)\
**Replies:** 4\
**Last updated:** [April 26, 2016, 11:04pm UTC](https://discuss.elastic.co/t/report-a-bug-of-winlogbeat-5-0-0-alpha1-windows-32/47550 "2016-04-26T23:04:35Z")

</div>

@andrewkroh Hi andrew, I ran winlogbeat-5.0.0-alpha1-windows-32 on windows server 2003 R2 SP2 32bit and encountered some error, need your verification. thanks.

---

## [Access Denied reading from Security log on Windows 2012](https://discuss.elastic.co/t/access-denied-reading-from-security-log-on-windows-2012/48445)

<div class="topic-metadata">

**Author:** [@xiaozhuqq48](https://discuss.elastic.co/u/xiaozhuqq48)\
**Replies:** 4\
**Last updated:** [April 27, 2016, 12:45am UTC](https://discuss.elastic.co/t/access-denied-reading-from-security-log-on-windows-2012/48445 "2016-04-27T00:45:55Z")

</div>

winlogbeat 1.2.1 windows 2012 configuration : most are the defaults. just the output for logstash. \[ winlogbeat: registry\_file: C:/ProgramData/winlogbeat/.winlogbeat.yml event\_logs: - name: Application igno…

---

## [How to control the filebeat read file sequence](https://discuss.elastic.co/t/how-to-control-the-filebeat-read-file-sequence/43973)

<div class="topic-metadata">

**Author:** [@szcountryboy](https://discuss.elastic.co/u/szcountryboy)\
**Replies:** 7\
**Last updated:** [April 26, 2016, 3:54pm UTC](https://discuss.elastic.co/t/how-to-control-the-filebeat-read-file-sequence/43973 "2016-04-26T15:54:14Z")

</div>

The was log is stored in the order, but the order of the filebeat is changed, as shown below: Time Message March 10th 2016, 11:43:41.721 \[16-2-3 0:01:04:356 CST\] 00000026 Sys…

---

## [Filebeat Stops sending logs once logstash stops responding for sometime](https://discuss.elastic.co/t/filebeat-stops-sending-logs-once-logstash-stops-responding-for-sometime/39001)

<div class="topic-metadata">

**Author:** [@naga1](https://discuss.elastic.co/u/naga1)\
**Replies:** 4\
**Last updated:** [April 26, 2016, 7:38am UTC](https://discuss.elastic.co/t/filebeat-stops-sending-logs-once-logstash-stops-responding-for-sometime/39001 "2016-04-26T07:38:34Z")

</div>

Filebeat stops sending logs if logstash goes down for sometime and comes back eventually. It doesnt start sending logs until we bounce the filebeat server. Any idea why its stops sending logs. Any help other than adding …

---

## [Winlogbeat ignores CA certificates in windows certificate store?](https://discuss.elastic.co/t/winlogbeat-ignores-ca-certificates-in-windows-certificate-store/48209)

<div class="topic-metadata">

**Author:** [@JPvRiel](https://discuss.elastic.co/u/JPvRiel)\
**Replies:** 1\
**Last updated:** [April 26, 2016, 1:01am UTC](https://discuss.elastic.co/t/winlogbeat-ignores-ca-certificates-in-windows-certificate-store/48209 "2016-04-26T01:01:47Z")

</div>

My first concern is winlogbeat doesn't notify of any TLS or Certificate Errors, even when I set the log level to 'info'. This is poor form! 2016-04-22T22:34:11+02:00 INFO winlogbeat sucessfully setup. Start running. 20…

---

## [Understanding DEBUG lines - Tuning Opportunity?](https://discuss.elastic.co/t/understanding-debug-lines-tuning-opportunity/48345)

<div class="topic-metadata">

**Author:** [@gcherneski](https://discuss.elastic.co/u/gcherneski)\
**Replies:** 1\
**Last updated:** [April 25, 2016, 10:19pm UTC](https://discuss.elastic.co/t/understanding-debug-lines-tuning-opportunity/48345 "2016-04-25T22:19:03Z")

</div>

I have debug turned up on my filebeat (1.2.0-x86-64) and wanted to know if the following log lines are an indication of a tuning opportunity: 2016-04-25T18:34:13Z DBG output worker: publish 2048 events 2016-04-25T18:34:…

[Previous page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=581)

[Next page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=583)
