Export only custom JSON to elasticsearch


(Yonatan Omer) #1

When providing Filebeat with text file containing rows with JSON , Filebeat export to Elasticsearch server meta info such as log.offset , log.file.path ect.
Even commenting these lines in filebeat.yaml did not help:
#- add_host_metadata: ~
#- add_cloud_metadata: ~

how can we export the JSON to create the entire document ( including custom _id)?


(Shaunak Kashyap) #2

I think you might be looking for the decode_json_fields processor: https://www.elastic.co/guide/en/beats/filebeat/current/decode-json-fields.html.