We have recently started to setup centralized logging for our projects using Elastic stack. The projects are built with Angular as the frontend framework & NodeJS as the middleware. Please suggest on how to send the application logs, from both Angular & NodeJS layer, to elasticsearch.
Log to a file and then use Filebeat to send it to Elasticsearch
Send it to something like a message broker/queue (kafka etc)
Send it to Elasticsearch directly
I'd say that the first one makes the most sense, as the file will act as a buffer, in case Filebeat cannot talk to Elasticsearch, and as a backup in case you want to reprocess.
With regard to approach 3 i.e. sending the log directly to elastic - is there any impact on the elastic search performance due to continuous API POST requests?
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.