I am planning to implement ELK to one of my application for log analysis. i would like to know what will be stored in elastic storage ? how to estimate the elastic storage capacity requirement? does the log files make a copy from client server(where the file beat installed and logs exists) to ELK server (where elastic search, kibana, logstash installed) and store in elastic search space(path.data)?
the file is not stored as is, rather it is parsed and indexed to allow fast searches. Also, a deployment would typically have replicas of data for high availability. On the other hand, data is compressed when stored in Elasticsearch.
I would recommend doing a prototype to find out the approximate storage needs.
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.