Hi, I sometimes receive messages that are huge... (719939 bytes) and indexation to elasticsearch failed with a max_bytes_length_exceeded_exception (max limit is 32766 bytes). I want to detect those messages in kibana, so I would like to do with logstash something like that: if len(message) > 1000…

Any way to limit field length?

warkolm (Mark Walkom) July 5, 2016, 8:46pm 3

You can do this in ES via the mappings too, see https://www.elastic.co/guide/en/elasticsearch/reference/2.3/ignore-above.html

Topic		Replies	Views
Checking Field Length Logstash	8	8789	November 4, 2022
How to increase byte size in processing in logstash? Logstash	5	6261	February 9, 2017
Field - Limit length Logstash	4	1504	July 25, 2017
Filter out Large Messages and Add Tag Logstash	3	2184	July 6, 2017
Getting Maximum Bytes length Exception in Logstash Indexer Logstash	4	2528	January 12, 2017

Elasticsearch is a trademark of Elasticsearch BV, registered in the U.S. and in other countries
Trademarks
Terms
Privacy
Brand
Code of Conduct

Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant logo are trademarks of the Apache Software Foundation in the United States and/or other countries.

Any way to limit field length?

Related topics