# Beats

**URL:** https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=512

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 513

---

## [Delimiter for FILEBEAT?](https://discuss.elastic.co/t/delimiter-for-filebeat/92074)

<div class="topic-metadata">

**Author:** [@ahongyun](https://discuss.elastic.co/u/ahongyun)\
**Replies:** 5\
**Last updated:** [July 14, 2017, 2:56pm UTC](https://discuss.elastic.co/t/delimiter-for-filebeat/92074 "2017-07-14T14:56:31Z")

</div>

I have been using logstash to ship logs using the following config file { path =\> "/appdir/logs/\*\\.log\\.xml" type =\> "log.xml" delimiter =\> "\</LogRoot\>" I am trying to shift to use Filebeat but i have issues…

---

## [Is there a way to change the filebeat.prospectors paths from command line?](https://discuss.elastic.co/t/is-there-a-way-to-change-the-filebeat-prospectors-paths-from-command-line/93015)

<div class="topic-metadata">

**Author:** [@Truesight](https://discuss.elastic.co/u/Truesight)\
**Replies:** 2\
**Last updated:** [July 14, 2017, 7:26am UTC](https://discuss.elastic.co/t/is-there-a-way-to-change-the-filebeat-prospectors-paths-from-command-line/93015 "2017-07-14T07:26:55Z")

</div>

Hello, i am fairly new to Filebeat and would like to do change the filebeat.yml entry "- input\_type: log # Paths that should be crawled and fetched. Glob based paths. paths: - D:\\whatever\\here.log " upon sta…

---

## [Filebeat redis output doesn't support redis cluster mode](https://discuss.elastic.co/t/filebeat-redis-output-doesnt-support-redis-cluster-mode/93108)

<div class="topic-metadata">

**Author:** [@cjuroz](https://discuss.elastic.co/u/cjuroz)\
**Replies:** 0\
**Last updated:** [July 14, 2017, 3:50am UTC](https://discuss.elastic.co/t/filebeat-redis-output-doesnt-support-redis-cluster-mode/93108 "2017-07-14T03:50:00Z")

</div>

I am using filebeat 5.4.0 with redis output and I noticed filebeat doesn't support access to redis cluster configuration endpoint. I am using AWS redis cluster mode on (engine 3.2.4) and filebeat is not able to handle MO…

---

## [Custom Module Issue - Ingest Pipeline Alpha Sorted?](https://discuss.elastic.co/t/custom-module-issue-ingest-pipeline-alpha-sorted/92845)

<div class="topic-metadata">

**Author:** [@DangMA](https://discuss.elastic.co/u/DangMA)\
**Replies:** 1\
**Last updated:** [July 13, 2017, 8:59pm UTC](https://discuss.elastic.co/t/custom-module-issue-ingest-pipeline-alpha-sorted/92845 "2017-07-13T20:59:42Z")

</div>

I have created a custom module using make create-fileset. I've populated the various files, run make collect, and copied the results into my filebeat module directory. ALMOST everything is working as expected. When fi…

---

## [Packet decode failed with: TCP data offset greater than packet length](https://discuss.elastic.co/t/packet-decode-failed-with-tcp-data-offset-greater-than-packet-length/92487)

<div class="topic-metadata">

**Author:** [@kartalkoushik123](https://discuss.elastic.co/u/kartalkoushik123)\
**Replies:** 3\
**Last updated:** [July 13, 2017, 6:03pm UTC](https://discuss.elastic.co/t/packet-decode-failed-with-tcp-data-offset-greater-than-packet-length/92487 "2017-07-13T18:03:43Z")

</div>

When trying to start packetbeat on the host servers, a new packetbeat index is not getting created. This is what i get at the host logs INFO Connected to Elasticsearch version 5.5.0 INFO Trying to load template for c…

---

## [Building Libbeat without docker-compose?](https://discuss.elastic.co/t/building-libbeat-without-docker-compose/92865)

<div class="topic-metadata">

**Author:** [@Grigory\_Shamov](https://discuss.elastic.co/u/Grigory_Shamov)\
**Replies:** 1\
**Last updated:** [July 13, 2017, 5:36pm UTC](https://discuss.elastic.co/t/building-libbeat-without-docker-compose/92865 "2017-07-13T17:36:59Z")

</div>

Hi All, I have been trying to build elastic/beats from Github on a CentOS 6 host. I had to update virtualenv and golang; but then, it looks like make depends on docker-compose to proceed. Is it possible to supress it s…

---

## [Any way to get the table data from PostgreSQL to Metricbeat?](https://discuss.elastic.co/t/any-way-to-get-the-table-data-from-postgresql-to-metricbeat/92957)

<div class="topic-metadata">

**Author:** [@mahadevaprasadap](https://discuss.elastic.co/u/mahadevaprasadap)\
**Replies:** 0\
**Last updated:** [July 13, 2017, 8:00am UTC](https://discuss.elastic.co/t/any-way-to-get-the-table-data-from-postgresql-to-metricbeat/92957 "2017-07-13T08:00:12Z")

</div>

I want PostgreSQL table data in the Metricbeat. Kindly suggest how can I do this. Note: We have plugin to get the PostgreSQL stats into Metricbeat but I want PostgreSQL table to Metricbeat

---

## [Recommended number of workers](https://discuss.elastic.co/t/recommended-number-of-workers/92168)

<div class="topic-metadata">

**Author:** [@hding](https://discuss.elastic.co/u/hding)\
**Replies:** 8\
**Last updated:** [July 12, 2017, 1:44pm UTC](https://discuss.elastic.co/t/recommended-number-of-workers/92168 "2017-07-12T13:44:55Z")

</div>

I'm using ElasticSearch ingest node as output. I didn't set worker in filebeat.yml at first. The indexing rate was around 3k doc/sec. Then I set worker to 4. The indexing rate doubled to 6k doc/sec. What is the def…

---

## [Packetbeat error](https://discuss.elastic.co/t/packetbeat-error/92755)

<div class="topic-metadata">

**Author:** [@pgyggi](https://discuss.elastic.co/u/pgyggi)\
**Replies:** 0\
**Last updated:** [July 12, 2017, 5:26am UTC](https://discuss.elastic.co/t/packetbeat-error/92755 "2017-07-12T05:26:36Z")

</div>

hello everyone, I run packetbeat with pf\_ring or af\_packet,both throw error: 2017-07-12T13:23:04+08:00 INFO Non-zero metrics in the last 30s: http.unmatchedresponses=4059 tcp.dropped\_because\_of\_gaps=16516\_ 2017-07-12T13:…

---

## [Filebeat not starting](https://discuss.elastic.co/t/filebeat-not-starting/92474)

<div class="topic-metadata">

**Author:** [@John\_Clarke](https://discuss.elastic.co/u/John_Clarke)\
**Replies:** 5\
**Last updated:** [July 12, 2017, 8:51am UTC](https://discuss.elastic.co/t/filebeat-not-starting/92474 "2017-07-12T08:51:50Z")

</div>

Hi, Having some issues with filebeat on Ubuntu 16.04. I followed this tutorial https://www.howtoforge.com/tutorial/how-to-install-elastic-stack-on-ubuntu-16-04/ I cannot figure out why filbeat is not starting. Any he…

---

## [Can't create new metricset](https://discuss.elastic.co/t/cant-create-new-metricset/91601)

<div class="topic-metadata">

**Author:** [@noamblu1](https://discuss.elastic.co/u/noamblu1)\
**Replies:** 2\
**Last updated:** [July 12, 2017, 7:40am UTC](https://discuss.elastic.co/t/cant-create-new-metricset/91601 "2017-07-12T07:40:01Z")

</div>

Hi, I have tried to create new metricset on a Windows server r2 with the command "make create-metricset" at the metricbeat directory and I receive an output of " 'make' is not recognized as an internal command or externa…

---

## [Make setup command throws error](https://discuss.elastic.co/t/make-setup-command-throws-error/92466)

<div class="topic-metadata">

**Author:** [@paul1243](https://discuss.elastic.co/u/paul1243)\
**Replies:** 4\
**Last updated:** [July 12, 2017, 4:17am UTC](https://discuss.elastic.co/t/make-setup-command-throws-error/92466 "2017-07-12T04:17:08Z")

</div>

Hi - Am trying to build a own beat, which would make a rest calls to a server and will have to send the output to Elastic Search. Am hitting the below error, when I enter the 'make setup' command. Could someone please …

---

## [How to use one Filebeat directly with ES to process multiple applications log files](https://discuss.elastic.co/t/how-to-use-one-filebeat-directly-with-es-to-process-multiple-applications-log-files/92673)

<div class="topic-metadata">

**Author:** [@sezanawa](https://discuss.elastic.co/u/sezanawa)\
**Replies:** 1\
**Last updated:** [July 12, 2017, 2:14am UTC](https://discuss.elastic.co/t/how-to-use-one-filebeat-directly-with-es-to-process-multiple-applications-log-files/92673 "2017-07-12T02:14:20Z")

</div>

Hallo Everybody i am using filebeat directly with ES. I have installed filebeat on my Web Frontend Server where multiple applications are deployed. Each application wirte its own log. I want to use filebeat to parse th…

---

## [Multiple Multiline Options](https://discuss.elastic.co/t/multiple-multiline-options/92171)

<div class="topic-metadata">

**Author:** [@StivOstenberg](https://discuss.elastic.co/u/StivOstenberg)\
**Replies:** 6\
**Last updated:** [July 12, 2017, 1:45am UTC](https://discuss.elastic.co/t/multiple-multiline-options/92171 "2017-07-12T01:45:34Z")

</div>

Running into a problem caused by our developers not using consistent data/time format. Jul 06, 2017 6:24:58 PM org.apache.catalina.startup.HostConfig undeploy INFO: Undeploying context 2017-07-06 18:24:59.103 \[Contai…

---

## [Will configurations be reloaded when an environment variable changes?](https://discuss.elastic.co/t/will-configurations-be-reloaded-when-an-environment-variable-changes/92689)

<div class="topic-metadata">

**Author:** [@Bobby](https://discuss.elastic.co/u/Bobby)\
**Replies:** 1\
**Last updated:** [July 11, 2017, 5:33pm UTC](https://discuss.elastic.co/t/will-configurations-be-reloaded-when-an-environment-variable-changes/92689 "2017-07-11T17:33:12Z")

</div>

The current release (5.5) of Filebeat and Metricbeat contain a beta feature that has the beat reload its configuration file when it changes. It's possible to have these yml files reference environment variables. Will …

---

## [Unable to fetch mapping while configuring an index pattern](https://discuss.elastic.co/t/unable-to-fetch-mapping-while-configuring-an-index-pattern/92284)

<div class="topic-metadata">

**Author:** [@amakarenkov](https://discuss.elastic.co/u/amakarenkov)\
**Replies:** 9\
**Last updated:** [July 11, 2017, 9:58am UTC](https://discuss.elastic.co/t/unable-to-fetch-mapping-while-configuring-an-index-pattern/92284 "2017-07-11T09:58:42Z")

</div>

Greetings, guys! Recently installed Elastic stack on CentOS and faced the problem that a cannot get data pattern in Kibana. Basically I have kibana elastic logstash and filebeat that is installed locally. netstat -pl…

---

## [Can we get geographical location by hosted IP address from Beats?](https://discuss.elastic.co/t/can-we-get-geographical-location-by-hosted-ip-address-from-beats/92584)

<div class="topic-metadata">

**Author:** [@mahadevaprasadap](https://discuss.elastic.co/u/mahadevaprasadap)\
**Replies:** 5\
**Last updated:** [July 11, 2017, 8:59am UTC](https://discuss.elastic.co/t/can-we-get-geographical-location-by-hosted-ip-address-from-beats/92584 "2017-07-11T08:59:04Z")

</div>

I have a requirement to get the Geographical location of the servers using IP address. Kindly help me.

---

## [Failed connection to Logstash machine](https://discuss.elastic.co/t/failed-connection-to-logstash-machine/92055)

<div class="topic-metadata">

**Author:** [@erion](https://discuss.elastic.co/u/erion)\
**Replies:** 4\
**Last updated:** [July 6, 2017, 1:48pm UTC](https://discuss.elastic.co/t/failed-connection-to-logstash-machine/92055 "2017-07-06T13:48:36Z")

</div>

Hi, i have filebeat.yml: filebeat.prospectors: -input\_type: log path: /mnt/analisilog/www.access\_log output.logstash: hosts: \["52.24.17.29:5044"\] and logstash.conf input { beats { port =\> 5044 host =\> "54…

---

## [Creating Own Beat](https://discuss.elastic.co/t/creating-own-beat/92565)

<div class="topic-metadata">

**Author:** [@paul1243](https://discuss.elastic.co/u/paul1243)\
**Replies:** 0\
**Last updated:** [July 11, 2017, 3:40am UTC](https://discuss.elastic.co/t/creating-own-beat/92565 "2017-07-11T03:40:19Z")

</div>

Hi- We have got to create a own Beat, which would make the REST API calls from different servers and would like to see that data on the Dashboard. I've got stuck while running the 'Make Setup' Command. Just wanted to let…

---

## [Sending data from CSV to Elasticsearch](https://discuss.elastic.co/t/sending-data-from-csv-to-elasticsearch/92405)

<div class="topic-metadata">

**Author:** [@jogoinar10](https://discuss.elastic.co/u/jogoinar10)\
**Replies:** 4\
**Last updated:** [July 11, 2017, 2:24am UTC](https://discuss.elastic.co/t/sending-data-from-csv-to-elasticsearch/92405 "2017-07-11T02:24:55Z")

</div>

I have several logs in my windows machine which must be send to my elasticsearch server. Right now I am using nxlog and td-agent for transporting data. But I want to learn on Beats. I already installed beats with def…

---

## [Unable send logs from filebeat to logstash](https://discuss.elastic.co/t/unable-send-logs-from-filebeat-to-logstash/92556)

<div class="topic-metadata">

**Author:** [@P\_Kumar](https://discuss.elastic.co/u/P_Kumar)\
**Replies:** 0\
**Last updated:** [July 11, 2017, 1:54am UTC](https://discuss.elastic.co/t/unable-send-logs-from-filebeat-to-logstash/92556 "2017-07-11T01:54:17Z")

</div>

filebeat: prospectors: - paths: - "/was/AppServer/profiles/Dmgr01/logs/dmgr/SystemOut.log" input\_type: log document\_type: SystemOut output: ### Logstash as output logstash: # The Logstash …

---

## [Multiline codec in Filebeat is not working](https://discuss.elastic.co/t/multiline-codec-in-filebeat-is-not-working/92313)

<div class="topic-metadata">

**Author:** [@aswinkumart](https://discuss.elastic.co/u/aswinkumart)\
**Replies:** 4\
**Last updated:** [July 10, 2017, 1:22pm UTC](https://discuss.elastic.co/t/multiline-codec-in-filebeat-is-not-working/92313 "2017-07-10T13:22:28Z")

</div>

I am trying to parse catalina.out file using Logstash. All my logs starts with an timestamp field like : 2017-06-20 07:12:55.226 I tried couple of multiline patterns in filebeat yml but nothing seems to be working: pat…

---

## [Drop\_event when up is false](https://discuss.elastic.co/t/drop-event-when-up-is-false/92046)

<div class="topic-metadata">

**Author:** [@alkuzad](https://discuss.elastic.co/u/alkuzad)\
**Replies:** 5\
**Last updated:** [July 10, 2017, 8:44am UTC](https://discuss.elastic.co/t/drop-event-when-up-is-false/92046 "2017-07-10T08:44:46Z")

</div>

I can't get drop\_event to work with up field. I'm using heartbeat version 5.4.3 Up is simple boolean field and it seems equals condition do not support booleans. So neither "false" or "False" or 0, 1 works. Range fi…

---

## [Configuring fields.yml for custom Beat](https://discuss.elastic.co/t/configuring-fields-yml-for-custom-beat/92358)

<div class="topic-metadata">

**Author:** [@Russell\_Seymour](https://discuss.elastic.co/u/Russell_Seymour)\
**Replies:** 2\
**Last updated:** [July 10, 2017, 7:23am UTC](https://discuss.elastic.co/t/configuring-fields-yml-for-custom-beat/92358 "2017-07-10T07:23:13Z")

</div>

I am writing a custom beat to read temperature. I have created the Beat using this, https://www.elastic.co/blog/build-your-own-beat, as an example. However I am confused as to how to modify the fields.yml file so tha…

---

## [Will metricbeat 5.6 support the http module?](https://discuss.elastic.co/t/will-metricbeat-5-6-support-the-http-module/92289)

<div class="topic-metadata">

**Author:** [@owulff](https://discuss.elastic.co/u/owulff)\
**Replies:** 1\
**Last updated:** [July 10, 2017, 7:06am UTC](https://discuss.elastic.co/t/will-metricbeat-5-6-support-the-http-module/92289 "2017-07-10T07:06:08Z")

</div>

Hi there I'm looking for the module "http" in metricbeat. Will it be part of release 5.6? Thanks Oli

---

## [Multiline section?](https://discuss.elastic.co/t/multiline-section/92330)

<div class="topic-metadata">

**Author:** [@jxm0983](https://discuss.elastic.co/u/jxm0983)\
**Replies:** 1\
**Last updated:** [July 7, 2017, 9:41pm UTC](https://discuss.elastic.co/t/multiline-section/92330 "2017-07-07T21:41:18Z")

</div>

I'm wanting to prepend one line onto each future line, each of which should be shipped separately to Logstash. I haven't been able to find anything that looked like this in the documentation. The "log" that I'm parsing…

---

## [New winlogbeat seutp](https://discuss.elastic.co/t/new-winlogbeat-seutp/91580)

<div class="topic-metadata">

**Author:** [@waterwalker23](https://discuss.elastic.co/u/waterwalker23)\
**Replies:** 10\
**Last updated:** [July 7, 2017, 4:44pm UTC](https://discuss.elastic.co/t/new-winlogbeat-seutp/91580 "2017-07-07T16:44:07Z")

</div>

All, Recently I've configured my first ELK server. It's capturing it's own logs fine. I want to use winlogbeat to send logs from my windows servers to my ELK server. Maybe i've missed something, but I've followed th…

---

## [Feed HTTP response body to Elasticsearch](https://discuss.elastic.co/t/feed-http-response-body-to-elasticsearch/92288)

<div class="topic-metadata">

**Author:** [@owulff](https://discuss.elastic.co/u/owulff)\
**Replies:** 3\
**Last updated:** [July 7, 2017, 3:41pm UTC](https://discuss.elastic.co/t/feed-http-response-body-to-elasticsearch/92288 "2017-07-07T15:41:25Z")

</div>

Hi there Is it planned to support sending the http response body to Elasticsearch if it is in JSON format? Thanks Oli

---

## [Can beats pick data from database and send to elasticsearch](https://discuss.elastic.co/t/can-beats-pick-data-from-database-and-send-to-elasticsearch/92211)

<div class="topic-metadata">

**Author:** [@vinod\_hy](https://discuss.elastic.co/u/vinod_hy)\
**Replies:** 1\
**Last updated:** [July 7, 2017, 2:41pm UTC](https://discuss.elastic.co/t/can-beats-pick-data-from-database-and-send-to-elasticsearch/92211 "2017-07-07T14:41:42Z")

</div>

Hi All, Right now i am using filebeat which forwards the content of a particular log file to logstash. I want to know is there any support from beats where i can forward content from database to logstash.

---

## [ELK using Docker, 5044 with no reply](https://discuss.elastic.co/t/elk-using-docker-5044-with-no-reply/92178)

<div class="topic-metadata">

**Author:** [@Weber](https://discuss.elastic.co/u/Weber)\
**Replies:** 1\
**Last updated:** [July 7, 2017, 2:29pm UTC](https://discuss.elastic.co/t/elk-using-docker-5044-with-no-reply/92178 "2017-07-07T14:29:06Z")

</div>

Hi, I am following this tutorial 'https://elk-docker.readthedocs.io/' to configure ELK using docker. Everything goes well except when I do curl localhost:5044, I get 'Empty reply from server'. My machine is a VM with Ubu…

[Previous page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=511)

[Next page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=513)
