# Beats

**URL:** https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=601

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 602

---

## [Config Redis - Logstash - ElasticSearch](https://discuss.elastic.co/t/config-redis-logstash-elasticsearch/33006)

<div class="topic-metadata">

**Author:** [@Brian\_KITHEN](https://discuss.elastic.co/u/Brian_KITHEN)\
**Replies:** 5\
**Last updated:** [October 30, 2015, 4:13pm UTC](https://discuss.elastic.co/t/config-redis-logstash-elasticsearch/33006 "2015-10-30T16:13:04Z")

</div>

Hello, After testing the Logstash output for PacketBeat, I went to try the Redis output. I think the Redis output might still be the best option for production since it can give a lot of buffering. I could integrate pa…

---

## [Is a restart required to see new log files matching glob?](https://discuss.elastic.co/t/is-a-restart-required-to-see-new-log-files-matching-glob/33192)

<div class="topic-metadata">

**Author:** [@bryan](https://discuss.elastic.co/u/bryan)\
**Replies:** 4\
**Last updated:** [October 29, 2015, 7:53am UTC](https://discuss.elastic.co/t/is-a-restart-required-to-see-new-log-files-matching-glob/33192 "2015-10-29T07:53:16Z")

</div>

If I use, e.g., '/var/logs/\*.log' as a prospector path, and only 'a.log' and 'b.log' exist at startup, is a restart required to begin harvesting a new file 'c.log'? IOW, will the system periodically re-run the search a…

---

## [High rate Remote Syslog into filebeat](https://discuss.elastic.co/t/high-rate-remote-syslog-into-filebeat/33092)

<div class="topic-metadata">

**Author:** [@matt.koivisto](https://discuss.elastic.co/u/matt.koivisto)\
**Replies:** 9\
**Last updated:** [October 29, 2015, 7:35am UTC](https://discuss.elastic.co/t/high-rate-remote-syslog-into-filebeat/33092 "2015-10-29T07:35:40Z")

</div>

I had a setup working, using logstash with udp input and rabbitmq output, to consume a high rate of remote syslog messages and publish it into elastic search (with another logstash instance using rabbitmq as input, and o…

---

## [Is it possible to write to /dev/stdout using file output?](https://discuss.elastic.co/t/is-it-possible-to-write-to-dev-stdout-using-file-output/32935)

<div class="topic-metadata">

**Author:** [@mrkschan](https://discuss.elastic.co/u/mrkschan)\
**Replies:** 7\
**Last updated:** [October 28, 2015, 12:18pm UTC](https://discuss.elastic.co/t/is-it-possible-to-write-to-dev-stdout-using-file-output/32935 "2015-10-28T12:18:52Z")

</div>

I was trying to use /dev/stdout as the beats output but failed to do so. The config is like ... ### File as output file: # Enabling file output. enabled: true # Path to the directory where to save the…

---

## [Monitoring local database access(not via ethernet)](https://discuss.elastic.co/t/monitoring-local-database-access-not-via-ethernet/32733)

<div class="topic-metadata">

**Author:** [@MingchunZhao](https://discuss.elastic.co/u/MingchunZhao)\
**Replies:** 6\
**Last updated:** [October 28, 2015, 12:37am UTC](https://discuss.elastic.co/t/monitoring-local-database-access-not-via-ethernet/32733 "2015-10-28T00:37:07Z")

</div>

Would you have any plan for Packetbeat to deal with local access to a database? Sorry for the question that might be a bit off-topic.

---

## [Is it intended to log errors to stdout while calling the option in the code stderr?](https://discuss.elastic.co/t/is-it-intended-to-log-errors-to-stdout-while-calling-the-option-in-the-code-stderr/33082)

<div class="topic-metadata">

**Author:** [@mrkschan](https://discuss.elastic.co/u/mrkschan)\
**Replies:** 2\
**Last updated:** [October 27, 2015, 5:00pm UTC](https://discuss.elastic.co/t/is-it-intended-to-log-errors-to-stdout-while-calling-the-option-in-the-code-stderr/33082 "2015-10-27T17:00:55Z")

</div>

As far as I know, errors and logging outputs are typically sent to stderr instead of stdout and stdout is "reserved" for program output (golang stdlib "log" package sends log line to stderr as well). At https://github.…

---

## [Topbeat with Go 1.3](https://discuss.elastic.co/t/topbeat-with-go-1-3/33036)

<div class="topic-metadata">

**Author:** [@spynxo](https://discuss.elastic.co/u/spynxo)\
**Replies:** 1\
**Last updated:** [October 27, 2015, 7:25am UTC](https://discuss.elastic.co/t/topbeat-with-go-1-3/33036 "2015-10-27T07:25:20Z")

</div>

Hi All, Would it be possible to compile topbeat with Go 1.3 on RedHat 5.10? I tried it and it didn't work. This is the error I got: # github.com/elastic/libbeat/outputs Godeps/\_workspace/src/github.com/elastic/libbea…

---

## [How to check python test coverage against go lang code](https://discuss.elastic.co/t/how-to-check-python-test-coverage-against-go-lang-code/33010)

<div class="topic-metadata">

**Author:** [@Prerna\_Manaktala](https://discuss.elastic.co/u/Prerna_Manaktala)\
**Replies:** 2\
**Last updated:** [October 27, 2015, 4:53am UTC](https://discuss.elastic.co/t/how-to-check-python-test-coverage-against-go-lang-code/33010 "2015-10-27T04:53:05Z")

</div>

Hi I am able to generate the \*.test files in the go lang code and also run the ./value.test -systemTest -test.coverprofile coverage.cov to generate various coverage.cov files and unit.cov files separately. But I did…

---

## [Problem with config.yml](https://discuss.elastic.co/t/problem-with-config-yml/32849)

<div class="topic-metadata">

**Author:** [@Nubber](https://discuss.elastic.co/u/Nubber)\
**Replies:** 4\
**Last updated:** [October 26, 2015, 11:00am UTC](https://discuss.elastic.co/t/problem-with-config-yml/32849 "2015-10-26T11:00:22Z")

</div>

Hi, I hope that my problem could be solved. I want to output topbeat to a file. But it is not possible for me to use file output. Please see configuration file: input: period: 10 procs: \[".\*"\] output: file: …

---

## [Unable to specify index](https://discuss.elastic.co/t/unable-to-specify-index/32927)

<div class="topic-metadata">

**Author:** [@erikstephens](https://discuss.elastic.co/u/erikstephens)\
**Replies:** 1\
**Last updated:** [October 25, 2015, 4:47pm UTC](https://discuss.elastic.co/t/unable-to-specify-index/32927 "2015-10-25T16:47:53Z")

</div>

The timestamp used for the index is always the current time instead of the @timestamp I parse from the event. I've tried various workarounds such as trying to remove/redefine \[@metadata\]\[index\] but can't get filebeat or…

---

## [Testing filebeat+logstash](https://discuss.elastic.co/t/testing-filebeat-logstash/32811)

<div class="topic-metadata">

**Author:** [@erikstephens](https://discuss.elastic.co/u/erikstephens)\
**Replies:** 2\
**Last updated:** [October 23, 2015, 3:59pm UTC](https://discuss.elastic.co/t/testing-filebeat-logstash/32811 "2015-10-23T15:59:19Z")

</div>

Is there a way to have filebeat exit once it reaches end-of-file for all prospectors? The use case I'm trying to support is to launch filebeat with a known set of payloads, send to a test instance of logstash, and then c…

---

## [Generating the Binary](https://discuss.elastic.co/t/generating-the-binary/32526)

<div class="topic-metadata">

**Author:** [@Prerna\_Manaktala](https://discuss.elastic.co/u/Prerna_Manaktala)\
**Replies:** 28\
**Last updated:** [October 23, 2015, 8:04am UTC](https://discuss.elastic.co/t/generating-the-binary/32526 "2015-10-23T08:04:34Z")

</div>

Hello I am new to golang and elasticsearch. I installed golang on mac and cloned the packetbeat repo.Trying to run the commang to execute step 1. Generating the Binary, but am unsuccesful. Can you please guide me as to…

---

## [Beat for Nginx](https://discuss.elastic.co/t/beat-for-nginx/32687)

<div class="topic-metadata">

**Author:** [@mrkschan](https://discuss.elastic.co/u/mrkschan)\
**Replies:** 1\
**Last updated:** [October 21, 2015, 5:16pm UTC](https://discuss.elastic.co/t/beat-for-nginx/32687 "2015-10-21T17:16:45Z")

</div>

Hey, I just started this beat for Nginx - https://github.com/mrkschan/nginxbeat. Would it be possible to be included on Elastic? And things should I need to do so?

---

## [Is there interest in something like a MonitBeat?](https://discuss.elastic.co/t/is-there-interest-in-something-like-a-monitbeat/32316)

<div class="topic-metadata">

**Author:** [@kkirsche](https://discuss.elastic.co/u/kkirsche)\
**Replies:** 1\
**Last updated:** [October 15, 2015, 10:40pm UTC](https://discuss.elastic.co/t/is-there-interest-in-something-like-a-monitbeat/32316 "2015-10-15T22:40:53Z")

</div>

Hey Guys, I was curious if there was interest in something like a MonitBeat which forwards Monit data over to Elasticsearch. Monit exposes an undocumented XML API locally which can be used to retrieve data from Monit w…

---

## [DNS Protocol and reading PCAP files](https://discuss.elastic.co/t/dns-protocol-and-reading-pcap-files/31868)

<div class="topic-metadata">

**Author:** [@Brian\_KITHEN](https://discuss.elastic.co/u/Brian_KITHEN)\
**Replies:** 8\
**Last updated:** [October 13, 2015, 3:12pm UTC](https://discuss.elastic.co/t/dns-protocol-and-reading-pcap-files/31868 "2015-10-13T15:12:07Z")

</div>

Hello, I'm currently working in a company where we intend to use PacketBeat with ELK. It will initially only deal with DNS packets. We don't have any real experience with ELK, so its kind of a challenge. I'm testing th…

---

## [Timeout Connection are not being monitored by packetbeat](https://discuss.elastic.co/t/timeout-connection-are-not-being-monitored-by-packetbeat/31581)

<div class="topic-metadata">

**Author:** [@5uraj](https://discuss.elastic.co/u/5uraj)\
**Replies:** 7\
**Last updated:** [October 11, 2015, 1:41pm UTC](https://discuss.elastic.co/t/timeout-connection-are-not-being-monitored-by-packetbeat/31581 "2015-10-11T13:41:40Z")

</div>

I have noticed one more issue where packetbeat is not sending data for connection timeouts on nginx running on application servers. So whenever there is any 504 on nginx logs there is no corresponding log in packetbeats. …

---

## [ResponceTime data discrepancy in packetbeats records](https://discuss.elastic.co/t/responcetime-data-discrepancy-in-packetbeats-records/31912)

<div class="topic-metadata">

**Author:** [@5uraj](https://discuss.elastic.co/u/5uraj)\
**Replies:** 1\
**Last updated:** [October 9, 2015, 3:15pm UTC](https://discuss.elastic.co/t/responcetime-data-discrepancy-in-packetbeats-records/31912 "2015-10-09T15:15:19Z")

</div>

We are monitoring nginx traffic using packetbeats we are getting lots of information which is helping in figuring out what are the bottle necks in our applications but the response time to serve a request is different in…

---

## [Diamond system metrics collector is now Beats compatible!](https://discuss.elastic.co/t/diamond-system-metrics-collector-is-now-beats-compatible/31477)

<div class="topic-metadata">

**Author:** [@imre](https://discuss.elastic.co/u/imre)\
**Replies:** 1\
**Last updated:** [October 4, 2015, 7:54pm UTC](https://discuss.elastic.co/t/diamond-system-metrics-collector-is-now-beats-compatible/31477 "2015-10-04T19:54:01Z")

</div>

Hi folks, I have written a Beats compatible ElasticSearch metrics shipper plugin for the popular Diamond system metrics collector. Until it gets accepted into Diamond's master repo, you can find my branch here: https…

---

## [Metrics format recommendations?](https://discuss.elastic.co/t/metrics-format-recommendations/28882)

<div class="topic-metadata">

**Author:** [@imre](https://discuss.elastic.co/u/imre)\
**Replies:** 5\
**Last updated:** [September 29, 2015, 9:03am UTC](https://discuss.elastic.co/t/metrics-format-recommendations/28882 "2015-09-29T09:03:11Z")

</div>

Hi folks, do you have a writeup on metrics formatting conventions? I have looked at the topbeat and packetbeat entries in ES and it wasn't clear how it was decided that some information should have: - their own fiel…

---

## [Topbeat with ES2.0?](https://discuss.elastic.co/t/topbeat-with-es2-0/31281)

<div class="topic-metadata">

**Author:** [@imre](https://discuss.elastic.co/u/imre)\
**Replies:** 2\
**Last updated:** [September 28, 2015, 10:02pm UTC](https://discuss.elastic.co/t/topbeat-with-es2-0/31281 "2015-09-28T22:02:48Z")

</div>

Is anyone using Topbeat with ES2.0? It's failing on me because of the commas in the field names: status:400 reason: Field name \[proc.cpu\] cannot contain '.'

---

## [Input Filtering on fields or bpf filter before sending to elastic](https://discuss.elastic.co/t/input-filtering-on-fields-or-bpf-filter-before-sending-to-elastic/26716)

<div class="topic-metadata">

**Author:** [@Alexandre\_Derumier](https://discuss.elastic.co/u/Alexandre_Derumier)\
**Replies:** 7\
**Last updated:** [September 25, 2015, 10:11am UTC](https://discuss.elastic.co/t/input-filtering-on-fields-or-bpf-filter-before-sending-to-elastic/26716 "2015-09-25T10:11:49Z")

</div>

Hi, I would like to known if it's possible to filter data in packetbeat, based on protocol fields. For example, I would like to exclude some ips from client\_ip or host from http.request\_headers.host. Also, is it poss…

---

## [New protocol: FTP](https://discuss.elastic.co/t/new-protocol-ftp/27057)

<div class="topic-metadata">

**Author:** [@Aymeric\_Caroff](https://discuss.elastic.co/u/Aymeric_Caroff)\
**Replies:** 5\
**Last updated:** [September 25, 2015, 9:20am UTC](https://discuss.elastic.co/t/new-protocol-ftp/27057 "2015-09-25T09:20:26Z")

</div>

Hi, is there any plan to support FTP protocol in a not too distant future? Best regards

---

## [Unable to get mysql stats using packet beats](https://discuss.elastic.co/t/unable-to-get-mysql-stats-using-packet-beats/29719)

<div class="topic-metadata">

**Author:** [@tarunsapra](https://discuss.elastic.co/u/tarunsapra)\
**Replies:** 8\
**Last updated:** [September 22, 2015, 11:26am UTC](https://discuss.elastic.co/t/unable-to-get-mysql-stats-using-packet-beats/29719 "2015-09-22T11:26:07Z")

</div>

I can't seem to get packet beat shipper to send mysql stats to ES. I went through this thread - https://discuss.elastic.co/t/unable-to-get-mysql-performance-in-packetbeat/1450 and tried the following steps https://d…

---

## [Set the Packetbeat config from enviornment variables](https://discuss.elastic.co/t/set-the-packetbeat-config-from-enviornment-variables/29525)

<div class="topic-metadata">

**Author:** [@manojbadam](https://discuss.elastic.co/u/manojbadam)\
**Replies:** 1\
**Last updated:** [September 22, 2015, 8:07am UTC](https://discuss.elastic.co/t/set-the-packetbeat-config-from-enviornment-variables/29525 "2015-09-22T08:07:13Z")

</div>

Hi Team, Im trying to run Packetbeat on a docker container and ship the metrics to ES. Since i have multiple docker containers running on same host, all these are logs are carrying the same shipper name (hostname). As …

---

## [CPU usage numbers](https://discuss.elastic.co/t/cpu-usage-numbers/29556)

<div class="topic-metadata">

**Author:** [@elvarb](https://discuss.elastic.co/u/elvarb)\
**Replies:** 5\
**Last updated:** [September 18, 2015, 5:06pm UTC](https://discuss.elastic.co/t/cpu-usage-numbers/29556 "2015-09-18T17:06:34Z")

</div>

Maybe a dumb question, but I posted this screenshot of my tests of Topbeat on twitter The CPU usage on the process I picked the perc value expecing it to be 0-100, but the number on the graph goes much higher, to 18…

---

## [CA location configuration missing for ElasticSearch output](https://discuss.elastic.co/t/ca-location-configuration-missing-for-elasticsearch-output/29462)

<div class="topic-metadata">

**Author:** [@owulff](https://discuss.elastic.co/u/owulff)\
**Replies:** 1\
**Last updated:** [September 17, 2015, 9:04am UTC](https://discuss.elastic.co/t/ca-location-configuration-missing-for-elasticsearch-output/29462 "2015-09-17T09:04:23Z")

</div>

Hi there In logstash-forwarder you could configure the location of the CA in the configuration. I've run some tests with topbeat and noticed that you have to rely on the OS settings to establish an SSL connection which i…

---

## [Unable to start packetbeat](https://discuss.elastic.co/t/unable-to-start-packetbeat/25676)

<div class="topic-metadata">

**Author:** [@Pradeep\_Gowda](https://discuss.elastic.co/u/Pradeep_Gowda)\
**Replies:** 15\
**Last updated:** [September 15, 2015, 2:53pm UTC](https://discuss.elastic.co/t/unable-to-start-packetbeat/25676 "2015-09-15T14:53:45Z")

</div>

I am unable to start packetbeat and getting below error /packetbeat: error while loading shared libraries: libpcap.so.0.8: cannot open shared object file: No such file or directory but I am using different version of…

---

## [Support for TCP/UDP Unknown Packets](https://discuss.elastic.co/t/support-for-tcp-udp-unknown-packets/28259)

<div class="topic-metadata">

**Author:** [@thehybridtech](https://discuss.elastic.co/u/thehybridtech)\
**Replies:** 2\
**Last updated:** [September 11, 2015, 7:04pm UTC](https://discuss.elastic.co/t/support-for-tcp-udp-unknown-packets/28259 "2015-09-11T19:04:22Z")

</div>

Hi all... We are using packetbeat to review pcaps from multiple environments and like how it is setup. I realize that the primary focus of packetbeat is to review the protocol and streams. Is there plans in the future …

---

## [FileBeat availability](https://discuss.elastic.co/t/filebeat-availability/24634)

<div class="topic-metadata">

**Author:** [@tudor](https://discuss.elastic.co/u/tudor)\
**Replies:** 2\
**Last updated:** [September 11, 2015, 11:31am UTC](https://discuss.elastic.co/t/filebeat-availability/24634 "2015-09-11T11:31:28Z")

</div>

Continuing the discussion from About the Beats category: FileBeat doesn't exist yet. It will be the successor of the logstash-forwarder and our plan is to start from that code base and improved on it. So you can start …

---

## [Packetbeat.yml with\_vlans](https://discuss.elastic.co/t/packetbeat-yml-with-vlans/28420)

<div class="topic-metadata">

**Author:** [@omeroner](https://discuss.elastic.co/u/omeroner)\
**Replies:** 13\
**Last updated:** [September 11, 2015, 6:33am UTC](https://discuss.elastic.co/t/packetbeat-yml-with-vlans/28420 "2015-09-11T06:33:06Z")

</div>

Hello there, How do I enable the option to packetbeat with\_vlans. Can you help?

[Previous page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=600)

[Next page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=602)
