I hope this messages finds the community member's safe and healthy. I am trying to ingest around 600 GB of logs spread across multiple JSON files. Here are few lings of logs (these are scrubbed DNS logs) {"timestamp":"1632164841","name":"*.pima.iii.com","type":"a","value":"52.11.181.87"} {"timesta…

you need to use filter for any modification date { match => ["timestamp", "UNIX"] target => "timestamp" } mutate { rename => {"name" => "dns_request" } } and your output would look like this timestamp and @timestamp is two different thing here. one is your record one is ingestion …

Ingesting JSON logs with filebeat and logstash

Elastic Stack Beats

parthmaniar (Parth D. Maniar) October 19, 2021, 4:47am 9

Thank you very much for giving that guidance. I've followed your advise and carried out the changes.

Would you be able to help me with this one: Dynamic input (file hashes) for HTTP JSON data collection

Thank you once again.

Topic		Replies	Views
Problem with JSON logs Beats filebeat	3	558	March 9, 2019
How to send Json logs to Elastic Search using File Beats without extra fields Beats filebeat	5	4016	August 6, 2020
Use logstash or filebeat for sending azure JSON logs? Beats filebeat	16	3666	March 29, 2017
Filebeat 5.4.2 not processing JSON file Beats	3	689	July 15, 2017
Filebeats, unable to read all the data from log file Beats filebeat	9	591	November 10, 2022

Ingesting JSON logs with filebeat and logstash

Related Topics