I am getting this warning message and I believe it is because some of the events do not have a [layers][fix].
[WARN ] 2021-05-06 23:01:18.054 [[marketdata_fix_pipeline]>worker0] split - Only String and Array types are splittable. field:[layers][fix] is of type = Hash
Here is what I have in my logstash.config and I am trying to understand why events would continue through this conditional if they don't have a [layers][fix].
if [msg_count] > 1 and [layers][fix] {
split {
field => "[layers][fix]"
add_tag => [ "multi-message" ]
}
}
you are correct Badger. there are multiple fix under the layer and i am trying to split them by the [layer][fix]. I see the split_failure tag on the events that don’t have the [layer][fix] present and am wondering how i can skip the split on those. Shouldn’t my conditional work?
I found the issue. I was counting the number of occurrences of _Begin and lo' and behold this particular event actually had two even though it only had one [layer][fix] which caused by split failure.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.