# Whether the filebeat enabled mysql module supports direct pass to kafka

**URL:** <https://discuss.elastic.co/t/whether-the-filebeat-enabled-mysql-module-supports-direct-pass-to-kafka/162389>\
**Category:** Beats\
**Tags:** filebeat\
**Created:** [December 29, 2018, 2:16am UTC](https://discuss.elastic.co/t/whether-the-filebeat-enabled-mysql-module-supports-direct-pass-to-kafka/162389 "2018-12-29T02:16:24Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![ytc301](https://avatars.discourse-cdn.com/v4/letter/y/cdc98d/32.png) [@ytc301](https://discuss.elastic.co/u/ytc301)\
**Post date:** [December 29, 2018, 2:16am UTC](https://discuss.elastic.co/t/whether-the-filebeat-enabled-mysql-module-supports-direct-pass-to-kafka/162389/1 "2018-12-29T02:16:24Z")

</div>

I want to use the filebeat mysql module to directly pass the stream to the kafka cluster through the own pipeline, but found that the delivery is unsuccessful, the kafka cluster consumer does not generate logs, I try to pass directly to es is normal. So I want to confirm whether the mysql module is passed directly to kafka or not.

---

<div class="post-metadata">

**Author:** ![ytc301](https://avatars.discourse-cdn.com/v4/letter/y/cdc98d/32.png) [@ytc301](https://discuss.elastic.co/u/ytc301)\
**Post date:** [January 2, 2019, 3:12am UTC](https://discuss.elastic.co/t/whether-the-filebeat-enabled-mysql-module-supports-direct-pass-to-kafka/162389/2 "2019-01-02T03:12:39Z")

</div>

Did you know that BUG or did not support it?  
filebeat log

 ![BF272C5C_recompress](https://us1.discourse-cdn.com/elastic/original/3X/6/c/6c758235f0c9a3ff38efb3c6adce1634eefb8754.jpeg)

---

<div class="post-metadata">

**Author:** ![Mario\_Castro](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/mario_castro/32/35107_2.png) [@Mario\_Castro](https://discuss.elastic.co/u/Mario_Castro)\
**Post date:** [January 2, 2019, 11:10am UTC](https://discuss.elastic.co/t/whether-the-filebeat-enabled-mysql-module-supports-direct-pass-to-kafka/162389/3 "2019-01-02T11:10:45Z")

</div>

Hi @ytc301

It will be useful if you can provide the version of Filebeat, Kafka and your configuration file. Maybe your output is not configured properly.

Thanks

---

<div class="post-metadata">

**Author:** ![ytc301](https://avatars.discourse-cdn.com/v4/letter/y/cdc98d/32.png) [@ytc301](https://discuss.elastic.co/u/ytc301)\
**Post date:** [January 3, 2019, 2:45am UTC](https://discuss.elastic.co/t/whether-the-filebeat-enabled-mysql-module-supports-direct-pass-to-kafka/162389/4 "2019-01-03T02:45:19Z")

</div>

Filebeat configuration should be correct, my kafka output can be output directly to es can be normal, and mysql slow is normal serialization, then the output of the ES is closed on the configuration of kafka output, kafka consumer has no data produce. In addition, Kafka is normal, because other businesses are also using that kafka cluster, and I have already created the corresponding topic in the kafka cluster in advance.

filebeat version: 6.5.4  
kafka version: kafka\_2.11-0.10.1.0

 ![filebeat](https://us1.discourse-cdn.com/elastic/original/3X/7/7/77f7a60a5ad0e500053656233fbb3258063f0784.png)

---

<div class="post-metadata">

**Author:** ![ytc301](https://avatars.discourse-cdn.com/v4/letter/y/cdc98d/32.png) [@ytc301](https://discuss.elastic.co/u/ytc301)\
**Post date:** [January 9, 2019, 7:46am UTC](https://discuss.elastic.co/t/whether-the-filebeat-enabled-mysql-module-supports-direct-pass-to-kafka/162389/5 "2019-01-09T07:46:00Z")

</div>

Is there any progress?

---

<div class="post-metadata">

**Author:** ![ytc301](https://avatars.discourse-cdn.com/v4/letter/y/cdc98d/32.png) [@ytc301](https://discuss.elastic.co/u/ytc301)\
**Post date:** [January 14, 2019, 7:17am UTC](https://discuss.elastic.co/t/whether-the-filebeat-enabled-mysql-module-supports-direct-pass-to-kafka/162389/6 "2019-01-14T07:17:14Z")

</div>

What's the problem?

---

<div class="post-metadata">

**Author:** ![ytc301](https://avatars.discourse-cdn.com/v4/letter/y/cdc98d/32.png) [@ytc301](https://discuss.elastic.co/u/ytc301)\
**Post date:** [January 14, 2019, 7:18am UTC](https://discuss.elastic.co/t/whether-the-filebeat-enabled-mysql-module-supports-direct-pass-to-kafka/162389/7 "2019-01-14T07:18:12Z")

</div>

@Mario_Castro ？？？？

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [February 11, 2019, 7:18am UTC](https://discuss.elastic.co/t/whether-the-filebeat-enabled-mysql-module-supports-direct-pass-to-kafka/162389/8 "2019-02-11T07:18:36Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
