1.0.1 is quite old now. Can you upgrade to a more recent version, please? You can go for 1.3.1 or even 5.0.0-rc1 which will soon become the stable version.
the contents of the registry file (normally it's found under /var/lib/filebeat/registry)
a stat on the /home/deployer/datascience-djangoservices/datascience/logs/datascience_apis.log file, taken at approximately the same time as when you snapshot the registry file.
Filebeat has full permissions. Here is the log from the log file:
Oct 24 08:38:07 python-app2 /usr/bin/filebeat[15737]: client.go:124: 0 events out of 2048 events sent to logstash. Continue sending ...
Oct 24 08:38:07 python-app2 /usr/bin/filebeat[15737]: client.go:146: Try to publish 2048 events to logstash with window size 1
Oct 24 08:38:13 python-app2 /usr/bin/filebeat[15737]: prospector.go:185: Start next scan
Oct 24 08:38:13 python-app2 /usr/bin/filebeat[15737]: prospector.go:261: scan path /var/log/uwsgi/*.log
Oct 24 08:38:13 python-app2 /usr/bin/filebeat[15737]: prospector.go:261: scan path /home/deployer/datascience-djangoservices/datascience/logs/*.log
Oct 24 08:38:13 python-app2 /usr/bin/filebeat[15737]: prospector.go:275: Check file for harvesting: /home/deployer/datascience-djangoservices/datascience/logs/datascience_apis.log
Oct 24 08:38:13 python-app2 /usr/bin/filebeat[15737]: registrar.go:175: Same file as before found. Fetch the state.
Oct 24 08:38:13 python-app2 /usr/bin/filebeat[15737]: prospector.go:418: Update existing file for harvesting: /home/deployer/datascience-djangoservices/datascience/logs/datascience_apis.log
Oct 24 08:38:13 python-app2 /usr/bin/filebeat[15737]: prospector.go:465: Not harvesting, file didn't change: /home/deployer/datascience-djangoservices/datascience/logs/datascience_apis.log
It seems like there is an issue with the connection to Logstash as in the above log it states 0 out of 1024 messages sent to logstash. Can you share some more details on your LS setup?
Do you see any errors or more information in the logstash log? Is there some more information in the filebeat log messages especially on startup on why the connection to LS does not work?
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.