# Beats

**URL:** https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=550

[Latest](https://discuss.elastic.co/latest.md) · [Categories](https://discuss.elastic.co/categories.md) · [Tags](https://discuss.elastic.co/tags.md)

**Page:** 551

---

## [How to check the CPU number from metricbeat?](https://discuss.elastic.co/t/how-to-check-the-cpu-number-from-metricbeat/68803)

<div class="topic-metadata">

**Author:** [@sitanxin](https://discuss.elastic.co/u/sitanxin)\
**Replies:** 3\
**Last updated:** [December 13, 2016, 10:23am UTC](https://discuss.elastic.co/t/how-to-check-the-cpu-number-from-metricbeat/68803 "2016-12-13T10:23:57Z")

</div>

Hi All, it maybe a strange question. But how to get the number of CPU via metricbeat?

---

## [MySQL num\_fields as string?](https://discuss.elastic.co/t/mysql-num-fields-as-string/68722)

<div class="topic-metadata">

**Author:** [@aros](https://discuss.elastic.co/u/aros)\
**Replies:** 1\
**Last updated:** [December 12, 2016, 11:28pm UTC](https://discuss.elastic.co/t/mysql-num-fields-as-string/68722 "2016-12-12T23:28:16Z")

</div>

Hi, I was wondering why the packetbeat template declares mysql.num\_fields and mysql.num\_rows as keywords, as it has number in its name already. I am sure there is an explanation but calculating an average or getting th…

---

## [How to remove Metricbeat default fields](https://discuss.elastic.co/t/how-to-remove-metricbeat-default-fields/68026)

<div class="topic-metadata">

**Author:** [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\
**Replies:** 5\
**Last updated:** [December 12, 2016, 9:14pm UTC](https://discuss.elastic.co/t/how-to-remove-metricbeat-default-fields/68026 "2016-12-12T21:14:43Z")

</div>

Hi, I am using metricbeat for system monitoring. However, that gives some default fields beat.hostname, beat.name etc, which I dont want. How to remove those? br, Sunil

---

## [Can metricbeat monitor the jms applicaiton](https://discuss.elastic.co/t/can-metricbeat-monitor-the-jms-applicaiton/68145)

<div class="topic-metadata">

**Author:** [@sitanxin](https://discuss.elastic.co/u/sitanxin)\
**Replies:** 4\
**Last updated:** [December 12, 2016, 2:40pm UTC](https://discuss.elastic.co/t/can-metricbeat-monitor-the-jms-applicaiton/68145 "2016-12-12T14:40:54Z")

</div>

Hi Team, Is is possible to make the metricbeat to monitor the jms applicaiton? Like WebMethods Broker, or other JMS application?

---

## [Output specific input to specific pipelines](https://discuss.elastic.co/t/output-specific-input-to-specific-pipelines/68686)

<div class="topic-metadata">

**Author:** [@dwjvaughan](https://discuss.elastic.co/u/dwjvaughan)\
**Replies:** 2\
**Last updated:** [December 12, 2016, 2:29pm UTC](https://discuss.elastic.co/t/output-specific-input-to-specific-pipelines/68686 "2016-12-12T14:29:37Z")

</div>

I have a filebeat on a server with multiple files to be ingested into a single Elasticsearch cluster. The issue I have is the files are very different, and as such, require very different ingest pipelines. So the ques…

---

## [How can I export packet beat data?](https://discuss.elastic.co/t/how-can-i-export-packet-beat-data/68662)

<div class="topic-metadata">

**Author:** [@Gurram\_Vinay](https://discuss.elastic.co/u/Gurram_Vinay)\
**Replies:** 4\
**Last updated:** [December 12, 2016, 12:09pm UTC](https://discuss.elastic.co/t/how-can-i-export-packet-beat-data/68662 "2016-12-12T12:09:15Z")

</div>

Hello everyone, I am able to export in csv format(both raw and formatted )in xls view.But I am only getting time stamp only - not the entire data what I have seen in the packet beats(like src ip,dest.ip,ports.etc.). H…

---

## [Restore the sequence of the events](https://discuss.elastic.co/t/restore-the-sequence-of-the-events/67766)

<div class="topic-metadata">

**Author:** [@ginger](https://discuss.elastic.co/u/ginger)\
**Replies:** 9\
**Last updated:** [December 12, 2016, 11:45am UTC](https://discuss.elastic.co/t/restore-the-sequence-of-the-events/67766 "2016-12-12T11:45:29Z")

</div>

Hi, I use EKB to process log data, and FileBeat sends data to ElasticSearch directly. The objective is to have some way to render the sequence of events in the same order they were read out of the log file. With t…

---

## [Packetbeat compatibable with Elastic 2.4](https://discuss.elastic.co/t/packetbeat-compatibable-with-elastic-2-4/68595)

<div class="topic-metadata">

**Author:** [@eperry](https://discuss.elastic.co/u/eperry)\
**Replies:** 8\
**Last updated:** [December 9, 2016, 8:54pm UTC](https://discuss.elastic.co/t/packetbeat-compatibable-with-elastic-2-4/68595 "2016-12-09T20:54:40Z")

</div>

Is any of the versions of packetbeat compatible with Elasticsearch 2.4 I am getting a lot of "can't contain '." in the field name" I am running the de\_dot filter but was hoping I am just running the wrong version of p…

---

## [Mapping Metricbeat to Elasticsearch](https://discuss.elastic.co/t/mapping-metricbeat-to-elasticsearch/68599)

<div class="topic-metadata">

**Author:** [@CodyCarey](https://discuss.elastic.co/u/CodyCarey)\
**Replies:** 1\
**Last updated:** [December 9, 2016, 8:06pm UTC](https://discuss.elastic.co/t/mapping-metricbeat-to-elasticsearch/68599 "2016-12-09T20:06:39Z")

</div>

Hi there, I am currently using metricbeat to monitor the health and metrics of our servers and application on those servers. I then upload that to elasticsearch and then pull it from elasticsearch using .NET and NEST.…

---

## [ELK Filebeat Offline and Online Processing](https://discuss.elastic.co/t/elk-filebeat-offline-and-online-processing/68375)

<div class="topic-metadata">

**Author:** [@Nastooh](https://discuss.elastic.co/u/Nastooh)\
**Replies:** 6\
**Last updated:** [December 9, 2016, 4:39pm UTC](https://discuss.elastic.co/t/elk-filebeat-offline-and-online-processing/68375 "2016-12-09T16:39:55Z")

</div>

Hi Have an all in one ELK setup, where Filebeat, Logstash and Elasticsearch reside on the same machine. Currently, I am able process live changes on designated log files, process them and display them through Kibana. To…

---

## [ERR Failed to publish events caused by: EOF (no tls)](https://discuss.elastic.co/t/err-failed-to-publish-events-caused-by-eof-no-tls/68462)

<div class="topic-metadata">

**Author:** [@lolo67](https://discuss.elastic.co/u/lolo67)\
**Replies:** 5\
**Last updated:** [December 9, 2016, 4:38pm UTC](https://discuss.elastic.co/t/err-failed-to-publish-events-caused-by-eof-no-tls/68462 "2016-12-09T16:38:12Z")

</div>

Hello, In filebeat.log I have many : ERR Failed to publish events caused by: EOF I checked that my filebeat.yml is valid : http://www.yamllint.com/ I checked that ssl is used and not tls. I checked the logstash lo…

---

## [Strange behavior in redis load balancing](https://discuss.elastic.co/t/strange-behavior-in-redis-load-balancing/68573)

<div class="topic-metadata">

**Author:** [@dshmatov](https://discuss.elastic.co/u/dshmatov)\
**Replies:** 1\
**Last updated:** [December 9, 2016, 4:35pm UTC](https://discuss.elastic.co/t/strange-behavior-in-redis-load-balancing/68573 "2016-12-09T16:35:41Z")

</div>

I have current logging delivery flow: Filebeat -\> Redis -\> Logstash -\> Elasticsearch Redis and Logstash are deployed in the same server. So I have array of (Redis + Logstash) servers and I whant to load balance my file…

---

## [Have Beats to include authentication token in header](https://discuss.elastic.co/t/have-beats-to-include-authentication-token-in-header/68341)

<div class="topic-metadata">

**Author:** [@susanhua](https://discuss.elastic.co/u/susanhua)\
**Replies:** 4\
**Last updated:** [December 9, 2016, 12:56pm UTC](https://discuss.elastic.co/t/have-beats-to-include-authentication-token-in-header/68341 "2016-12-09T12:56:52Z")

</div>

We want to have Beats installed on thousands of client machine and have Beats send data to Logstash. Can we have Beats make API call to get an authentication token and include in header? Then proxy on Logstash will proce…

---

## [Can FileBeat parse csv file and send the data in fields to elastic search directly?](https://discuss.elastic.co/t/can-filebeat-parse-csv-file-and-send-the-data-in-fields-to-elastic-search-directly/68507)

<div class="topic-metadata">

**Author:** [@dnafication](https://discuss.elastic.co/u/dnafication)\
**Replies:** 4\
**Last updated:** [December 9, 2016, 8:37am UTC](https://discuss.elastic.co/t/can-filebeat-parse-csv-file-and-send-the-data-in-fields-to-elastic-search-directly/68507 "2016-12-09T08:37:32Z")

</div>

I am listening to a log file (which is a CSV file) using FileBeat and sending the data to elasticsearch instance. I am using the default configurations for FileBeat as well as elasticsearch. It works but my data is shown…

---

## [Hourly index for filebeat](https://discuss.elastic.co/t/hourly-index-for-filebeat/68299)

<div class="topic-metadata">

**Author:** [@lolo67](https://discuss.elastic.co/u/lolo67)\
**Replies:** 12\
**Last updated:** [December 8, 2016, 1:59pm UTC](https://discuss.elastic.co/t/hourly-index-for-filebeat/68299 "2016-12-08T13:59:29Z")

</div>

Hello, I want hourly Filebeat indices. In the doc for filebeat.yml, I only see : index =\> "%{\[@metadata\]\[beat\]}-%{+YYYY.MM.dd}" I tried with output: logstash: hosts: \["elk-docker:5044"\] index: 'filebeat-%{+…

---

## [Filebeat Redis](https://discuss.elastic.co/t/filebeat-redis/68315)

<div class="topic-metadata">

**Author:** [@romanr](https://discuss.elastic.co/u/romanr)\
**Replies:** 3\
**Last updated:** [December 8, 2016, 1:48pm UTC](https://discuss.elastic.co/t/filebeat-redis/68315 "2016-12-08T13:48:39Z")

</div>

Hey, I'm using filebeat 5.0.2 with output to 2 redis (3.2.5) standalones and logstash (2.3.1) which pulls data from both redis servers. We were trying to check unexpected cases in our setup, for example - if redis cras…

---

## [Multiple logstash ouputs for Filebeats](https://discuss.elastic.co/t/multiple-logstash-ouputs-for-filebeats/68427)

<div class="topic-metadata">

**Author:** [@apkruger](https://discuss.elastic.co/u/apkruger)\
**Replies:** 1\
**Last updated:** [December 8, 2016, 1:43pm UTC](https://discuss.elastic.co/t/multiple-logstash-ouputs-for-filebeats/68427 "2016-12-08T13:43:18Z")

</div>

One of our Business Application was developed and still supported by an external company, what we would like to do is use Filebeats to send this application logs to our own instance of Logstash as well as the External Co…

---

## [Filebeat to logstash using proxy\_url](https://discuss.elastic.co/t/filebeat-to-logstash-using-proxy-url/68159)

<div class="topic-metadata">

**Author:** [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\
**Replies:** 5\
**Last updated:** [December 8, 2016, 4:27am UTC](https://discuss.elastic.co/t/filebeat-to-logstash-using-proxy-url/68159 "2016-12-08T04:27:02Z")

</div>

Hi, Can somebody provide practical use case to use proxy\_url when connecting logstash using filbeat output.logstash plugin? br, Sunil

---

## [How to translate the format from byte to MB/GB in Metricbeat?](https://discuss.elastic.co/t/how-to-translate-the-format-from-byte-to-mb-gb-in-metricbeat/68388)

<div class="topic-metadata">

**Author:** [@sitanxin](https://discuss.elastic.co/u/sitanxin)\
**Replies:** 2\
**Last updated:** [December 8, 2016, 2:50am UTC](https://discuss.elastic.co/t/how-to-translate-the-format-from-byte-to-mb-gb-in-metricbeat/68388 "2016-12-08T02:50:25Z")

</div>

Hi All, In metricbeat, we find there are too many byte format data. But we hope to display it in MB or GB, since the byte is too long and not good to show. Do you have any idea we should do? E.g.: system.memory.swap.…

---

## [Moving from Logstash to Filebeat =\> no duplicate log](https://discuss.elastic.co/t/moving-from-logstash-to-filebeat-no-duplicate-log/68278)

<div class="topic-metadata">

**Author:** [@Nicolas\_Guyomar](https://discuss.elastic.co/u/Nicolas_Guyomar)\
**Replies:** 2\
**Last updated:** [December 7, 2016, 1:02pm UTC](https://discuss.elastic.co/t/moving-from-logstash-to-filebeat-no-duplicate-log/68278 "2016-12-07T13:02:14Z")

</div>

Hi everyone, I would like to move from logstash as a log shipper, to filebeat. I'm using the logstash file input plugin to collect logs, same thing with filebeat, to send everything to a centralized logstash-shipper …

---

## [Enrich filebeat content using ingest pipeline](https://discuss.elastic.co/t/enrich-filebeat-content-using-ingest-pipeline/68182)

<div class="topic-metadata">

**Author:** [@dwjvaughan](https://discuss.elastic.co/u/dwjvaughan)\
**Replies:** 3\
**Last updated:** [December 7, 2016, 12:42pm UTC](https://discuss.elastic.co/t/enrich-filebeat-content-using-ingest-pipeline/68182 "2016-12-07T12:42:27Z")

</div>

I want to use filebeat to send Oracle alert logs to Elasticsearch. So far I've managed to get the data in (using some multiline magic). Ideally I want to use a pipeline on the ES side to extract the date, errors (ORA-), …

---

## [How to calculate web page load times?](https://discuss.elastic.co/t/how-to-calculate-web-page-load-times/67945)

<div class="topic-metadata">

**Author:** [@oil](https://discuss.elastic.co/u/oil)\
**Replies:** 6\
**Last updated:** [December 7, 2016, 12:33pm UTC](https://discuss.elastic.co/t/how-to-calculate-web-page-load-times/67945 "2016-12-07T12:33:57Z")

</div>

Hi everyone, I'm using Packetbeat to capture traffic from an Internet access network. How can I calculate and chart the times taken by individual users' devices to load web pages, over some time period? As you can see, …

---

## [Code Coverage for System Tests](https://discuss.elastic.co/t/code-coverage-for-system-tests/66233)

<div class="topic-metadata">

**Author:** [@imharishd](https://discuss.elastic.co/u/imharishd)\
**Replies:** 27\
**Last updated:** [December 7, 2016, 11:36am UTC](https://discuss.elastic.co/t/code-coverage-for-system-tests/66233 "2016-12-07T11:36:46Z")

</div>

I followed the elastic beats blog for finding coverage for the system tests. However my coverage.cov is not getting generated when i run the binary. Need help.

---

## [Filebeat not detecting new entries in a log file](https://discuss.elastic.co/t/filebeat-not-detecting-new-entries-in-a-log-file/68215)

<div class="topic-metadata">

**Author:** [@romspacenut](https://discuss.elastic.co/u/romspacenut)\
**Replies:** 3\
**Last updated:** [December 7, 2016, 9:05am UTC](https://discuss.elastic.co/t/filebeat-not-detecting-new-entries-in-a-log-file/68215 "2016-12-07T09:05:09Z")

</div>

So we have a service that has an hourly log rotate because the volume of log entries. Filebeat for the most part recognizes that a new file has been created and correctly sees the new entries logged to the log file. Ther…

---

## [How to add current timestamp to winlogbeat](https://discuss.elastic.co/t/how-to-add-current-timestamp-to-winlogbeat/68230)

<div class="topic-metadata">

**Author:** [@lin-zhao](https://discuss.elastic.co/u/lin-zhao)\
**Replies:** 1\
**Last updated:** [December 7, 2016, 1:43am UTC](https://discuss.elastic.co/t/how-to-add-current-timestamp-to-winlogbeat/68230 "2016-12-07T01:43:54Z")

</div>

winlogbeat uses the log parsed time as @timestamp. I have requirement to add a field to index the time the log gets gathered by the beat. Is there a way to do so?

---

## [Filebeat 5.0 output to Kafka multiple topics](https://discuss.elastic.co/t/filebeat-5-0-output-to-kafka-multiple-topics/67934)

<div class="topic-metadata">

**Author:** [@gearoid](https://discuss.elastic.co/u/gearoid)\
**Replies:** 4\
**Last updated:** [December 6, 2016, 1:03pm UTC](https://discuss.elastic.co/t/filebeat-5-0-output-to-kafka-multiple-topics/67934 "2016-12-06T13:03:17Z")

</div>

I installed Filebeat 5.0 on my app server and have 3 Filebeat prospectors, each of the prospector are pointing to different log paths and output to one kafka topic called myapp\_applog and everything works fine. My File…

---

## [Filebeat output logtsah protocol?](https://discuss.elastic.co/t/filebeat-output-logtsah-protocol/68125)

<div class="topic-metadata">

**Author:** [@sunilmchaudhari](https://discuss.elastic.co/u/sunilmchaudhari)\
**Replies:** 2\
**Last updated:** [December 6, 2016, 12:40pm UTC](https://discuss.elastic.co/t/filebeat-output-logtsah-protocol/68125 "2016-12-06T12:40:18Z")

</div>

Hi, Its known thing that filebeat doesn't use http protocol when it uses logstash as an output plugin. Then what protocol does it use? Is it lumberjack only? br, Sunil

---

## [Filebeat Error: ERR Failed to publish events caused by: read tcp i/o timeout](https://discuss.elastic.co/t/filebeat-error-err-failed-to-publish-events-caused-by-read-tcp-i-o-timeout/68023)

<div class="topic-metadata">

**Author:** [@jinal.shah](https://discuss.elastic.co/u/jinal.shah)\
**Replies:** 3\
**Last updated:** [December 6, 2016, 9:44am UTC](https://discuss.elastic.co/t/filebeat-error-err-failed-to-publish-events-caused-by-read-tcp-i-o-timeout/68023 "2016-12-06T09:44:05Z")

</div>

Hello I recently upgraded to filebeat v5 (and the rest of the ELK components). However, I am now seeing the following error on filebeat when shipping the logs across: 2016-12-05T10:42:05Z ERR Failed to publish events…

---

## [ES 2.3 -\> 5.x metricbeat index field limit](https://discuss.elastic.co/t/es-2-3-5-x-metricbeat-index-field-limit/66821)

<div class="topic-metadata">

**Author:** [@gregoryo](https://discuss.elastic.co/u/gregoryo)\
**Replies:** 11\
**Last updated:** [December 6, 2016, 8:44am UTC](https://discuss.elastic.co/t/es-2-3-5-x-metricbeat-index-field-limit/66821 "2016-12-06T08:44:55Z")

</div>

I'm migrating ES 2.3 -\> 5.x. Using the migration plugin I get a Cluster Checkup warning for my logstash-metricbeat-\* indices (all from metricbeat): "New indices may not have more than 1000 fields. This index has 1719." …

---

## [Filebeat 5.0 doesn't work for large files](https://discuss.elastic.co/t/filebeat-5-0-doesnt-work-for-large-files/66964)

<div class="topic-metadata">

**Author:** [@yiju](https://discuss.elastic.co/u/yiju)\
**Replies:** 8\
**Last updated:** [December 6, 2016, 8:37am UTC](https://discuss.elastic.co/t/filebeat-5-0-doesnt-work-for-large-files/66964 "2016-12-06T08:37:17Z")

</div>

Hi, I'm trying Filebeat 5.0 with Logstash 2.4. Here is my configuration. filebeat.prospectors: - input\_type: log paths: - /home/spark/\*.log ignore\_older: 24h clean\_inactive: 25h multiline.pattern: '^\\\[0…

[Previous page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=549)

[Next page](https://discuss.elastic.co/c/elastic-stack/beats/28.md?page=551)
