Application log file integration

Sivaprakash_Shanmuga · January 30, 2016, 1:07pm

Hi

I'm looking for solutions for 2 use cases

Is there any plugin for mongo db to logstash? I want to import data into logstash and analyze it.
My application written in Python/Django, now Im writing log files into files into local disk. Is there any way to move them to logstash?

magnusbaeck · January 30, 2016, 2:13pm

There's no official MongoDB input plugin, but see https://github.com/phutchins/logstash-input-mongodb.
Yes, use a file input. I'd use a custom JSON formatter on the Python side so that the logs can be ingested by Logstash without additional parsing.

Sivaprakash_Shanmuga · February 1, 2016, 4:17am

Thank You

I believe file input will read from Log file hence there wont be any performance hit to my application. Is my understanding correct?

magnusbaeck · February 1, 2016, 6:32am

Correct, although Filebeat or Logstash itself will require some system resources but unless you're logging a lot it'll be negligible.

Sivaprakash_Shanmuga · February 1, 2016, 7:17am

Thank you.