# Do we loose backpressure-sensitive protocol by inserting Kafka between Filebeat and Elasticsearch

**URL:** https://discuss.elastic.co/t/do-we-loose-backpressure-sensitive-protocol-by-inserting-kafka-between-filebeat-and-elasticsearch/239644
**Category:** Beats
**Tags:** docker, filebeat
**Created:** [July 2, 2020, 1:34pm UTC](https://discuss.elastic.co/t/do-we-loose-backpressure-sensitive-protocol-by-inserting-kafka-between-filebeat-and-elasticsearch/239644 "2020-07-02T13:34:19Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![yguubiqube](https://avatars.discourse-cdn.com/v4/letter/y/4bbf92/32.png) [@yguubiqube](https://discuss.elastic.co/u/yguubiqube)
#### Post date: [July 2, 2020, 1:34pm UTC](https://discuss.elastic.co/t/do-we-loose-backpressure-sensitive-protocol-by-inserting-kafka-between-filebeat-and-elasticsearch/239644/1 "2020-07-02T13:34:20Z")

</div>

Hi,  
this is a design investigation.  
On many docker containers, we will have **Filebeat** that reads logs (generated by many services).  
On one docker container we will have **Elasticsearch** that receives and indexes the logs.

We will have **Kafka** in one docker container for other purpose.

1. Do we have advantages to let **Kafka** collect logs from the docker containers with **Filebeat** and forward them to the **Elasticsearch** container ?
2. The **Filebeat** uses a backpressure-sensitive protocol when sending data to Elasticsearch. Won't we loose this advantage by putting **Kafka** in the middle ?

Thanks for your answers,  
Yves

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [July 30, 2020, 3:34pm UTC](https://discuss.elastic.co/t/do-we-loose-backpressure-sensitive-protocol-by-inserting-kafka-between-filebeat-and-elasticsearch/239644/2 "2020-07-30T15:34:35Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.
