# Get pprof from filebeat,and "publish.events" is not equals to "libbeat.publisher.published\_events"

**URL:** <https://discuss.elastic.co/t/get-pprof-from-filebeat-and-publish-events-is-not-equals-to-libbeat-publisher-published-events/82094>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [April 12, 2017, 6:22am UTC](https://discuss.elastic.co/t/get-pprof-from-filebeat-and-publish-events-is-not-equals-to-libbeat-publisher-published-events/82094 "2017-04-12T06:22:20Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![yingqin678](https://avatars.discourse-cdn.com/v4/letter/y/eb8c5e/32.png) [@yingqin678](https://discuss.elastic.co/u/yingqin678)\
**Post date:** [April 12, 2017, 6:22am UTC](https://discuss.elastic.co/t/get-pprof-from-filebeat-and-publish-events-is-not-equals-to-libbeat-publisher-published-events/82094/1 "2017-04-12T06:22:20Z")

</div>

i got somet metrics from filebeat by httpprof,and some of them are confusing me.  
filebeat version:5.3.0  
I got three times of metrics:  
i want to know:what`s the meaning of publish.event? Why publish.event is smaller than libbeat.publisher.published\_events in some condition while in other condition is bigger than libbeat.publisher.published\_events?  
{  
"libbeat.output.kafka.bytes\_write": 134,  
"libbeat.output.kafka.bytes\_read": 300,  
"libbeat.kafka.call\_count.PublishEvents": 199791,  
"libbeat.kafka.published\_and\_acked\_events": 0,  
"libbeat.kafka.published\_but\_not\_acked\_events": 121672110,  
"libbeat.outputs.messages\_dropped": 0,  
"libbeat.publisher.messages\_in\_worker\_queues": 0,  
"libbeat.publisher.published\_events": 609,  
"publish.events": 0,  
}

{  
"libbeat.kafka.call\_count.PublishEvents": 82,  
"libbeat.kafka.published\_and\_acked\_events": 50380,  
"libbeat.kafka.published\_but\_not\_acked\_events": 0,  
"libbeat.outputs.messages\_dropped": 0,  
"libbeat.publisher.messages\_in\_worker\_queues": 0,  
"libbeat.publisher.published\_events": 50380,  
"publish.events": 165888,  
}

{  
"libbeat.kafka.call\_count.PublishEvents": 2,  
"libbeat.kafka.published\_and\_acked\_events": 1225,  
"libbeat.kafka.published\_but\_not\_acked\_events": 0,  
"libbeat.outputs.messages\_dropped": 0,  
"libbeat.publisher.messages\_in\_worker\_queues": 0,  
"libbeat.publisher.published\_events": 1225,  
"publish.events": 2048,  
}

---

<div class="post-metadata">

**Author:** ![steffens](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/steffens/32/79630_2.png) [@steffens](https://discuss.elastic.co/u/steffens)\
**Post date:** [April 12, 2017, 10:19am UTC](https://discuss.elastic.co/t/get-pprof-from-filebeat-and-publish-events-is-not-equals-to-libbeat-publisher-published-events/82094/2 "2017-04-12T10:19:28Z")

</div>

`publish.events` is # events forwarded from filebeat to libbeat. Have you enabled `publish_async`? checking the code, it seems `publish.events` is only used if `publish_async: false` (btw. it's not recommended to use `publish_async: true`)

`libbeat.publisher.published_events` is # of events after filtering

`call_count.PublishEvents` is # of batches of events being processed by kafka output

`published_and_acked_events` is # of events being ACKed by kafka

`published_but_not_acked_events` is # of events failed when sending to kafka.

Due to resends on failure the call count and not acked events can be much bigger then total number of events being published to libbeat.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [May 10, 2017, 10:34am UTC](https://discuss.elastic.co/t/get-pprof-from-filebeat-and-publish-events-is-not-equals-to-libbeat-publisher-published-events/82094/3 "2017-05-10T10:34:01Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.