Hello all, I am working on something I have never worked on before and I really do not know where to go from here and I am hoping someone might have some direction for me to attempt trying to get this parsed to Elasticsearch properly. The application team sending logs to kafka topics with base64 e…

Badger December 20, 2023, 4:16am 2

You will probably need a ruby filter. See these two threads.

Topic		Replies	Views
How to read GZIP and encoding with UTF-8 logs from kafka topic through logstash pipeline Logstash	6	203	January 31, 2024
Base64 decode issue Logstash	3	981	December 26, 2022
Filter decode from Base64 Logstash	4	4396	July 13, 2017
Base64 decode Logstash	4	7043	July 18, 2019
Not able to process binary data (coming from kafka) in logstash custom ruby filter Logstash	1	380	April 8, 2020

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

How to read base64 encoded logs from kafka through logstash pipeline

Related topics