Kafka to Elastic search through Logstash for add, delete, update actions

[vipindwivedi]

Hi,
I am looking a solution for loading data in form of messages with Add, Update, Delete actions from Kafka stream to Elastic search, some of the options I have explored and found simple way is through Logstash but have some questions if eom experience member can answer..

1. How can we do add, update, delete action based on message parameter value.
2. Performance will be based on kafka stream throughput, or should be do some buffering to manage or some Batching option is available.
   Any reference with some logstash config will be very helpful.
   thanks
   vipin

[vipindwivedi]

Any help on this topic please, this will help us to decide if can use Logstash or need to explore some other options ..

[magnusbaeck (Magnus Bäck)]

How can we do add, update, delete action based on message parameter value.

See Accessing event data and fields | Logstash Reference [8.11] | Elastic.

Performance will be based on kafka stream throughput, or should be do some buffering to manage or some Batching option is available.

Not sure exactly what you mean. Logstash is going to be slower than Kafka.