Input file plugin not reading bigger json events

Elastic Stack Logstash
1

Hi,
I am trying to process JSON logs using input-file plugin. Log is written to a json file. Input file plugin reads small JSON object without any issue (I don't know the exact size). When the JSON objects gets bigger it ignores the event altogether. (Approximately the size of JSON is 3KB). Only one event of size 3KB is available in the file. Please let me know what is the best way to process bigger logs using file input plugin.

Thanks,
Satheesh

2

Found a workaround by splitting the logs and upserting multiple logs with same id. Please check this issue related to upsert. It could save you some time. https://github.com/logstash-plugins/logstash-output-elasticsearch/issues/383

3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.