# Beats

**URL:** https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=477

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 478

---

## [Avro data format convert into json format](https://discuss.elastic.co/t/avro-data-format-convert-into-json-format/116873)

<div class="topic-metadata">

**Author:** [@vamsikrishna](https://discuss.elastic.co/u/vamsikrishna)\
**Replies:** 3\
**Last updated:** [January 25, 2018, 7:48pm UTC](https://discuss.elastic.co/t/avro-data-format-convert-into-json-format/116873 "2018-01-25T19:48:44Z")

</div>

Hiii, The data comming from kafka by using kafkastream s ,It s avro format then i will try to convert json but it s not work,Please can help me

---

## [Apache Dashboards blank for Docker containers](https://discuss.elastic.co/t/apache-dashboards-blank-for-docker-containers/116931)

<div class="topic-metadata">

**Author:** [@castle9mm](https://discuss.elastic.co/u/castle9mm)\
**Replies:** 3\
**Last updated:** [January 25, 2018, 6:42pm UTC](https://discuss.elastic.co/t/apache-dashboards-blank-for-docker-containers/116931 "2018-01-25T18:42:25Z")

</div>

Hello, I'm really struggling and could use some help. I really don't even know where to begin. I'm trying to setup Elasticsearch and Kibana with Filebeat, all as docker containers, to read apache logs inside different …

---

## [How to write filebeat prospectors with different layers for folders](https://discuss.elastic.co/t/how-to-write-filebeat-prospectors-with-different-layers-for-folders/116756)

<div class="topic-metadata">

**Author:** [@Robert\_Chen](https://discuss.elastic.co/u/Robert_Chen)\
**Replies:** 2\
**Last updated:** [January 25, 2018, 5:38pm UTC](https://discuss.elastic.co/t/how-to-write-filebeat-prospectors-with-different-layers-for-folders/116756 "2018-01-25T17:38:27Z")

</div>

my logs folder is as this: /logs/tomcat/\*.log /logs/job1/a1/a.log /logs/job1/a2/a2.log ... /logs/job2/b.log /logs/jobn/jobn.log I want one prospector for tomcat, then another prospector for jobs logs which should …

---

## [Filebeat blocking generation of new log files by IIS](https://discuss.elastic.co/t/filebeat-blocking-generation-of-new-log-files-by-iis/116903)

<div class="topic-metadata">

**Author:** [@gasparuben](https://discuss.elastic.co/u/gasparuben)\
**Replies:** 1\
**Last updated:** [January 25, 2018, 5:17pm UTC](https://discuss.elastic.co/t/filebeat-blocking-generation-of-new-log-files-by-iis/116903 "2018-01-25T17:17:22Z")

</div>

From time to time we are noting that filebeat some how is blocking generation of new log files by IIS process (w3wp.exe). We follow a very standard ELK stack. Filebeat version 5.6.3 (64bits) runs on a WIndows 2008 R2 En…

---

## [Nested Jason with Filebeat](https://discuss.elastic.co/t/nested-jason-with-filebeat/116930)

<div class="topic-metadata">

**Author:** [@Michael\_U](https://discuss.elastic.co/u/Michael_U)\
**Replies:** 1\
**Last updated:** [January 25, 2018, 4:59pm UTC](https://discuss.elastic.co/t/nested-jason-with-filebeat/116930 "2018-01-25T16:59:53Z")

</div>

Dear all, recently I used logz.io to do my logging. My log-entries are nested .net objects, that I serialize to Json using NLog. With logz.io it just works fine - I can model any log-message and it will show up as a n…

---

## [Kibana monitoring data is different as on server](https://discuss.elastic.co/t/kibana-monitoring-data-is-different-as-on-server/116053)

<div class="topic-metadata">

**Author:** [@Pankaj\_Chamoli](https://discuss.elastic.co/u/Pankaj_Chamoli)\
**Replies:** 1\
**Last updated:** [January 25, 2018, 4:51pm UTC](https://discuss.elastic.co/t/kibana-monitoring-data-is-different-as-on-server/116053 "2018-01-25T16:51:06Z")

</div>

Dear All, Can any one help me out that in kibana monitoring, kibana is showing different data as the server. like in server there is 44% disk is used but in kibana monitoring it is showing 39% is used. as same case net…

---

## [Make Setup Fails In Windows 10](https://discuss.elastic.co/t/make-setup-fails-in-windows-10/116995)

<div class="topic-metadata">

**Author:** [@alokpandeyrc](https://discuss.elastic.co/u/alokpandeyrc)\
**Replies:** 1\
**Last updated:** [January 25, 2018, 4:29pm UTC](https://discuss.elastic.co/t/make-setup-fails-in-windows-10/116995 "2018-01-25T16:29:01Z")

</div>

Hi All, Is there a fix for windows , i have Python 2.7.13 and virual env-15.1.0.

---

## [Redundant fields in elsatic](https://discuss.elastic.co/t/redundant-fields-in-elsatic/117066)

<div class="topic-metadata">

**Author:** [@80c1141eb6d0c564dd90](https://discuss.elastic.co/u/80c1141eb6d0c564dd90)\
**Replies:** 1\
**Last updated:** [January 25, 2018, 3:56pm UTC](https://discuss.elastic.co/t/redundant-fields-in-elsatic/117066 "2018-01-25T15:56:59Z")

</div>

I have redundant field in Kibana, what can I make not to show them? Fields are like "beat": { "hostname": "preprod-api.example.com", \<-- (host, where from logs go to logstash) "name": "preprod-api.example.com", …

---

## [Filebeat output file - Safe to delete or nullify that file?](https://discuss.elastic.co/t/filebeat-output-file-safe-to-delete-or-nullify-that-file/116711)

<div class="topic-metadata">

**Author:** [@FreddyRaj](https://discuss.elastic.co/u/FreddyRaj)\
**Replies:** 2\
**Last updated:** [January 25, 2018, 1:36pm UTC](https://discuss.elastic.co/t/filebeat-output-file-safe-to-delete-or-nullify-that-file/116711 "2018-01-25T13:36:54Z")

</div>

Hi Team, We start FB in our application servers using nohup command. So the results are stored in nohup.out file. Is it safe to delete this file or should we stop FB process --\> remove nohup.out file --\> start FB agai…

---

## [Starting frontend GLOBAL: cannot bind socket \[127.0.0.1:14567\]](https://discuss.elastic.co/t/starting-frontend-global-cannot-bind-socket-127-0-0-1-14567/116715)

<div class="topic-metadata">

**Author:** [@alexus](https://discuss.elastic.co/u/alexus)\
**Replies:** 5\
**Last updated:** [January 25, 2018, 1:18pm UTC](https://discuss.elastic.co/t/starting-frontend-global-cannot-bind-socket-127-0-0-1-14567/116715 "2018-01-25T13:18:34Z")

</div>

I'm trying to follow HAProxy module | Metricbeat Reference \[6.1\] | Elastic, specifically part: place this statement under the global or default section of the haproxy config: stats socket 127.0.0.1:14567 I've tried …

---

## [No matching indices found](https://discuss.elastic.co/t/no-matching-indices-found/116649)

<div class="topic-metadata">

**Author:** [@Hari\_Baskar](https://discuss.elastic.co/u/Hari_Baskar)\
**Replies:** 3\
**Last updated:** [January 25, 2018, 1:11pm UTC](https://discuss.elastic.co/t/no-matching-indices-found/116649 "2018-01-25T13:11:15Z")

</div>

Hi, I'm getting this error when discovering the data in Kibana for Metricbeat. No matching indices found: No indices match pattern "metricbeat-\*"

---

## [Failed to understand HTTP response](https://discuss.elastic.co/t/failed-to-understand-http-response/117036)

<div class="topic-metadata">

**Author:** [@mbudnick](https://discuss.elastic.co/u/mbudnick)\
**Replies:** 1\
**Last updated:** [January 25, 2018, 12:18pm UTC](https://discuss.elastic.co/t/failed-to-understand-http-response/117036 "2018-01-25T12:18:13Z")

</div>

I use packetbeat 6.1.2 to log http traffic with tomcat 8. Many servlet request shows a warning "Failed to understand HTTP response". What can I do? Snipped from Loggin: 2018-01-25T10:50:48Z DBG \[sniffer\] Packet numb…

---

## [Why file always get this error ,it makes puzzle two day](https://discuss.elastic.co/t/why-file-always-get-this-error-it-makes-puzzle-two-day/117008)

<div class="topic-metadata">

**Author:** [@ericchuhong](https://discuss.elastic.co/u/ericchuhong)\
**Replies:** 4\
**Last updated:** [January 25, 2018, 11:02am UTC](https://discuss.elastic.co/t/why-file-always-get-this-error-it-makes-puzzle-two-day/117008 "2018-01-25T11:02:06Z")

</div>

\[IMG20180125\_170102\] I just simply cofigure logstash and filebeat like follow: filebeat : #output.logstash: The Logstash hosts hosts: \["localhost:5043"\], and logstash : input { beats { host =\> "localhost" port =\>…

---

## [Two timezones in JSON log](https://discuss.elastic.co/t/two-timezones-in-json-log/116877)

<div class="topic-metadata">

**Author:** [@davidsoler95](https://discuss.elastic.co/u/davidsoler95)\
**Replies:** 7\
**Last updated:** [January 25, 2018, 9:19am UTC](https://discuss.elastic.co/t/two-timezones-in-json-log/116877 "2018-01-25T09:19:58Z")

</div>

Hi, New doubt... We are using Filebeat \> ElasticSearch \> Kibana 5.6.4 to visualize JSON log files like... {"@timestamp":"2018-01-21T23:50:18.000Z","EMP":"ARA","INST":"PRI","TIPO":"T2","MSG":"\*\*\* FPS COV: \[PCW\](E 14661…

---

## [Metricbeat installation in HP Unix](https://discuss.elastic.co/t/metricbeat-installation-in-hp-unix/116658)

<div class="topic-metadata">

**Author:** [@rkshprb](https://discuss.elastic.co/u/rkshprb)\
**Replies:** 4\
**Last updated:** [January 25, 2018, 6:54am UTC](https://discuss.elastic.co/t/metricbeat-installation-in-hp-unix/116658 "2018-01-25T06:54:40Z")

</div>

HI, I want to install metricbeats HP-unix OS , Is there any other option please let me know.

---

## [Filebeat 6.x could not support running under OS alpine](https://discuss.elastic.co/t/filebeat-6-x-could-not-support-running-under-os-alpine/116195)

<div class="topic-metadata">

**Author:** [@lauea](https://discuss.elastic.co/u/lauea)\
**Replies:** 11\
**Last updated:** [January 25, 2018, 1:04am UTC](https://discuss.elastic.co/t/filebeat-6-x-could-not-support-running-under-os-alpine/116195 "2018-01-25T01:04:15Z")

</div>

Hi guys, During filebeat 5.x, I built a very tiny weight docker image for filebeat with alpine. But for filebeat 6.x later, seems not support running based OS alpine. Anyone advise? Thanks.

---

## [Filebeat does not loadbalance if hosts are from same subnet and a different subnet](https://discuss.elastic.co/t/filebeat-does-not-loadbalance-if-hosts-are-from-same-subnet-and-a-different-subnet/116846)

<div class="topic-metadata">

**Author:** [@Ihjaz](https://discuss.elastic.co/u/Ihjaz)\
**Replies:** 1\
**Last updated:** [January 24, 2018, 5:01pm UTC](https://discuss.elastic.co/t/filebeat-does-not-loadbalance-if-hosts-are-from-same-subnet-and-a-different-subnet/116846 "2018-01-24T17:01:20Z")

</div>

Hi, I have the following configuration in my filebeat.yml . #----------------------------- Logstash output -------------------------------- output.logstash: # The Logstash hosts hosts: \["10.133.132.xxx:5044", "10.1…

---

## [Packetloss - is this number bad or not?](https://discuss.elastic.co/t/packetloss-is-this-number-bad-or-not/116883)

<div class="topic-metadata">

**Author:** [@rdehuyss](https://discuss.elastic.co/u/rdehuyss)\
**Replies:** 1\
**Last updated:** [January 24, 2018, 4:19pm UTC](https://discuss.elastic.co/t/packetloss-is-this-number-bad-or-not/116883 "2018-01-24T16:19:05Z")

</div>

We have installed metricbeat on our virtual windows elastic servers and are measuring network traffic (customer decision to work on virtual windows servers). We have the following packet loss on one machine: \[2018-01-2…

---

## [Make create-fields index out of range error](https://discuss.elastic.co/t/make-create-fields-index-out-of-range-error/116131)

<div class="topic-metadata">

**Author:** [@Zachary\_Buckholz](https://discuss.elastic.co/u/Zachary_Buckholz)\
**Replies:** 7\
**Last updated:** [January 24, 2018, 3:12pm UTC](https://discuss.elastic.co/t/make-create-fields-index-out-of-range-error/116131 "2018-01-24T15:12:10Z")

</div>

I am attempting to remake a haproxy filebeat module I did last year manually using the recommended process from https://www.elastic.co/guide/en/beats/devguide/current/filebeat-modules-devguide.html make create-fileset M…

---

## [Missing packets of packetbeat?](https://discuss.elastic.co/t/missing-packets-of-packetbeat/116025)

<div class="topic-metadata">

**Author:** [@foxfire881](https://discuss.elastic.co/u/foxfire881)\
**Replies:** 6\
**Last updated:** [January 24, 2018, 2:12pm UTC](https://discuss.elastic.co/t/missing-packets-of-packetbeat/116025 "2018-01-24T14:12:26Z")

</div>

hi，in our network we use packetbeat with 'af\_packet' mode on readhat 6.5 (22 core CPU, 768G memory, 16 SATA disks, 10Gbs NIC) to analyze HTTP traffic which is about 4Gbps, and we find that it does not work very well, too…

---

## [Avro data format convert into json](https://discuss.elastic.co/t/avro-data-format-convert-into-json/116720)

<div class="topic-metadata">

**Author:** [@vamsikrishna](https://discuss.elastic.co/u/vamsikrishna)\
**Replies:** 2\
**Last updated:** [January 24, 2018, 1:24pm UTC](https://discuss.elastic.co/t/avro-data-format-convert-into-json/116720 "2018-01-24T13:24:02Z")

</div>

Hiiii, The data comming from kafka by using kafkastream s ,It s avro format i will try to convert json but it s not work,Please can help me

---

## [Filebeat 6.1.1 multiline is not working](https://discuss.elastic.co/t/filebeat-6-1-1-multiline-is-not-working/114259)

<div class="topic-metadata">

**Author:** [@tamoraes](https://discuss.elastic.co/u/tamoraes)\
**Replies:** 12\
**Last updated:** [January 24, 2018, 1:23pm UTC](https://discuss.elastic.co/t/filebeat-6-1-1-multiline-is-not-working/114259 "2018-01-24T13:23:37Z")

</div>

As mentioned, I'm not being capable of making multiline work on filebeat. The message is getting received on logstash without considering the multiline. I've made it work on debbugers, but not on the real deal. What am i…

---

## [Filebeat connect kafka failed over ssl](https://discuss.elastic.co/t/filebeat-connect-kafka-failed-over-ssl/116664)

<div class="topic-metadata">

**Author:** [@kevin\_zheng](https://discuss.elastic.co/u/kevin_zheng)\
**Replies:** 3\
**Last updated:** [January 24, 2018, 9:50am UTC](https://discuss.elastic.co/t/filebeat-connect-kafka-failed-over-ssl/116664 "2018-01-24T09:50:28Z")

</div>

I have a working Filebeat 6.1.2-linux-x86\_64 and Kafka 0.10 setup. I am trying to set them up to use SSL(TLS) instead of PLAINTEXT. my filebeat.yml ... output.kafka: enabled: true hosts: \["kafkabroker:9092"\] topi…

---

## [ELK LATEST - illegal\_argument\_exception during loading template manually](https://discuss.elastic.co/t/elk-latest-illegal-argument-exception-during-loading-template-manually/116724)

<div class="topic-metadata">

**Author:** [@Krishna\_Sharma](https://discuss.elastic.co/u/Krishna_Sharma)\
**Replies:** 3\
**Last updated:** [January 24, 2018, 9:46am UTC](https://discuss.elastic.co/t/elk-latest-illegal-argument-exception-during-loading-template-manually/116724 "2018-01-24T09:46:53Z")

</div>

Hi Team, I am getting error while configuring filebeat: {"error":{"root\_cause":\[{"type":"remote\_transport\_exception","reason":"\[servername\]\[ESIP:9300\]\[indices:admin/template/put\]"}\],"type":"illegal\_argument\_exception",…

---

## [Filebeat cant send data to logstash](https://discuss.elastic.co/t/filebeat-cant-send-data-to-logstash/116341)

<div class="topic-metadata">

**Author:** [@dorinand](https://discuss.elastic.co/u/dorinand)\
**Replies:** 10\
**Last updated:** [January 23, 2018, 4:36pm UTC](https://discuss.elastic.co/t/filebeat-cant-send-data-to-logstash/116341 "2018-01-23T16:36:48Z")

</div>

I have problem to send data from \*.log file to logstash. This is filebeat configuration: filebeat.prospectors: - type: log enabled: true paths: - /home/centos/logs/\*.log filebeat.config.modules: path: ${path…

---

## [Can we use fileBeat to send jSON logs?](https://discuss.elastic.co/t/can-we-use-filebeat-to-send-json-logs/116563)

<div class="topic-metadata">

**Author:** [@jpereira](https://discuss.elastic.co/u/jpereira)\
**Replies:** 3\
**Last updated:** [January 23, 2018, 10:37pm UTC](https://discuss.elastic.co/t/can-we-use-filebeat-to-send-json-logs/116563 "2018-01-23T22:37:07Z")

</div>

Hi folks, I have some logs on my system that are jSON payload and I would like to know if can I use the "beat" to handle/ship the logs to the ES. e.g: fileBeat can do that? I have tried, but non-success. filebeat.pros…

---

## [Custom filebeat template for JSON log lines](https://discuss.elastic.co/t/custom-filebeat-template-for-json-log-lines/114761)

<div class="topic-metadata">

**Author:** [@vopsec](https://discuss.elastic.co/u/vopsec)\
**Replies:** 6\
**Last updated:** [January 23, 2018, 10:07pm UTC](https://discuss.elastic.co/t/custom-filebeat-template-for-json-log-lines/114761 "2018-01-23T22:07:45Z")

</div>

Greetings, I'm trying to use filebeat to ingest a log file full of JSON objects. I've gotten it to work and it will ingest the data and I can discover the data in Kibana almost correctly. My problem is that the data tha…

---

## [ERR " write: broken pipe"](https://discuss.elastic.co/t/err-write-broken-pipe/115071)

<div class="topic-metadata">

**Author:** [@hidogs](https://discuss.elastic.co/u/hidogs)\
**Replies:** 8\
**Last updated:** [January 23, 2018, 7:42pm UTC](https://discuss.elastic.co/t/err-write-broken-pipe/115071 "2018-01-23T19:42:40Z")

</div>

Publish event to logstash. Error info: 2018/01/11 11:24:03.470328 async.go:235: ERR Failed to publish events caused by: write tcp 127.0.0.1:57017-\>127.0.0.1:5044: write: broken pipe 2018/01/11 11:24:04.471483 output.g…

---

## [Filebeat 6.1.1 not connecting to logstash over ssl](https://discuss.elastic.co/t/filebeat-6-1-1-not-connecting-to-logstash-over-ssl/116291)

<div class="topic-metadata">

**Author:** [@GSCully](https://discuss.elastic.co/u/GSCully)\
**Replies:** 9\
**Last updated:** [January 23, 2018, 7:24pm UTC](https://discuss.elastic.co/t/filebeat-6-1-1-not-connecting-to-logstash-over-ssl/116291 "2018-01-23T19:24:25Z")

</div>

I am having an issue with my ssl connection to logstash, Filebeat says everything is ok, C:\\filebeat\>filebeat test output logstash: logstash:5044... connection... parse host... OK dns lookup... OK addres…

---

## [Performance of Packetbeat?](https://discuss.elastic.co/t/performance-of-packetbeat/116022)

<div class="topic-metadata">

**Author:** [@foxfire881](https://discuss.elastic.co/u/foxfire881)\
**Replies:** 1\
**Last updated:** [January 23, 2018, 4:35pm UTC](https://discuss.elastic.co/t/performance-of-packetbeat/116022 "2018-01-23T16:35:27Z")

</div>

hi，in our network we use packetbeat with 'af\_packet' mode on readhat 6.5 (22 core CPU, 768G memory, 16 SATA disks, 10Gbs NIC) to analyze HTTP traffic which is about 4Gbps, and we find that it does not work very well, t…

[Previous page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=476)

[Next page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=478)
