# Kafka to Elastic search through Logstash for add, delete, update actions

**URL:** <https://discuss.elastic.co/t/kafka-to-elastic-search-through-logstash-for-add-delete-update-actions/150406>\
**Category:** Logstash\
**Created:** [September 29, 2018, 4:11am UTC](https://discuss.elastic.co/t/kafka-to-elastic-search-through-logstash-for-add-delete-update-actions/150406 "2018-09-29T04:11:08Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![vipindwivedi](https://avatars.discourse-cdn.com/v4/letter/v/c68b51/32.png) [@vipindwivedi](https://discuss.elastic.co/u/vipindwivedi)\
**Post date:** [September 29, 2018, 4:11am UTC](https://discuss.elastic.co/t/kafka-to-elastic-search-through-logstash-for-add-delete-update-actions/150406/1 "2018-09-29T04:11:08Z")

</div>

Hi,  
I am looking a solution for loading data in form of messages with Add, Update, Delete actions from Kafka stream to Elastic search, some of the options I have explored and found simple way is through Logstash but have some questions if eom experience member can answer..

1. How can we do add, update, delete action based on message parameter value.
2. Performance will be based on kafka stream throughput, or should be do some buffering to manage or some Batching option is available.  
Any reference with some logstash config will be very helpful.  
thanks  
vipin

---

<div class="post-metadata">

**Author:** ![vipindwivedi](https://avatars.discourse-cdn.com/v4/letter/v/c68b51/32.png) [@vipindwivedi](https://discuss.elastic.co/u/vipindwivedi)\
**Post date:** [October 1, 2018, 2:12pm UTC](https://discuss.elastic.co/t/kafka-to-elastic-search-through-logstash-for-add-delete-update-actions/150406/2 "2018-10-01T14:12:34Z")

</div>

Any help on this topic please, this will help us to decide if can use Logstash or need to explore some other options ..

---

<div class="post-metadata">

**Author:** ![magnusbaeck](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/magnusbaeck/32/44943_2.png) [@magnusbaeck](https://discuss.elastic.co/u/magnusbaeck)\
**Post date:** [October 3, 2018, 5:51pm UTC](https://discuss.elastic.co/t/kafka-to-elastic-search-through-logstash-for-add-delete-update-actions/150406/3 "2018-10-03T17:51:23Z")

</div>

> How can we do add, update, delete action based on message parameter value.

See [Accessing event data and fields | Logstash Reference [8.11] | Elastic](https://www.elastic.co/guide/en/logstash/current/event-dependent-configuration.html).

> Performance will be based on kafka stream throughput, or should be do some buffering to manage or some Batching option is available.

Not sure exactly what you mean. Logstash is going to be slower than Kafka.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [October 31, 2018, 5:58pm UTC](https://discuss.elastic.co/t/kafka-to-elastic-search-through-logstash-for-add-delete-update-actions/150406/4 "2018-10-31T17:58:50Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.