I would like to ask a question related to usage of elasctic search. I wonder that What your experiences are when you are storing large amounts of data in Elastic Search? Do you suggest this usage for me? Did you face any issue etc...
We have to store our payload message on a disk. Currently, we are writing 1TB data without format on a Isilon disk. If we need to find these data on the disk, it takes so much time and sometimes we are not able to find it by using our script.
I can format the data which we produce and store it with Json format in Elasctic Search and I can find the data by using Rest API of Elastic Search easily. However, I have some fears whether any issue occurs in production.
I would be so glad when you are answering my questions in the following lines.
Can we use Elactic Search with 30TB capacity? Have you experienced this usage?
If we archive the data older than 30 days in an Isilon disk daily, can we reactivate to search the data on Elastic Search. For example, if we need data which stored six months ago on Elastic Search, I am not sure that we can find it easily. Do you have any suggestions?
Thank you in advance,