From your formats listed, I assume that the first 3 fields are definitely CSV and the fourth field is either a value or a KV set.
You have a few options.
Use the CSV filter, defining 4 columns. Then in an if block test whether the fourth field contains a : colon (presuming that a non KV type fourth field does cannot have a colon in it). Then in the if block use the KV filter to split the keys and values on the colon.
If the first three field's values can never have a , comma in them (even in quotes), use the Dissect filter to split the 4 fields. Then use the if block and KV filter as above.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.