Some blogs say that Elasticsearch is reliable enough to be used as a primary database and some say that Elasticsearch has issues and can loose data.
In order to implement a new project , we have as requirements:
- store of a large amount of sensitive data with retention period
- create dashboard Kibana to perform querying and visualizing data
A pre-calculation of data volume gives:
- About 35 million records each year with 5KB.
- Assuming we store data over a 10 year period, we can reach 5T (due to data growth).
We chose Elasticsearch as a data storage, indexing and analysis tool.
Could Elasticsearch be used as a primary database without data loss risk or we should use another database to store data?