@Badger I'm outputting on the terminal every time it sends to elasticsearch
stdout { codec => rubydebug }
file {
path => "/usr/share/output/output.json"
codec => "json_lines"
}
and also the time, 11-13 mins for 500k json document pushed to ES