Well that had some effect. I reduced the scan_frequency and it doubled the thoroughput. Thanks for the help @thiago.
If possible have a look at another issue that i've been facing. Here is the link
Filebeat in windows is unable to send logs to logstash in Ubuntu server
Thanks in advance.