Forwarding data from Extended log file format from using filebeat to ES


(Aravind Kamath) #1

I have a sample log format which looks similar the one shown below

key1=value1,
key2=value2,
key3=value3
EOF

key1=value4
key2=value5
key3=value6
EOF

....
and so on

how can I configure file beat to harvest such log file and push data to elasticsearch
or there is any other work arround


(Tudor Golubenco) #2

I'd recommend using multiline in Filebeat to group everything between the EOF lines. Then you could use the kv filter in Logstash to parse the values.

If you don't want to use Logstash, and only use Elasticsearch, you can also use the Ingest Node kv processor.


(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.