I have the following usecase and I want to find out if I can use elasticsearch for it. If yes, then how can I implement it.
I want to search log archives for any kind of string.
I have log archives from different servers. There is a directory for each server, containing zipped files of logs. Each zipped file contains exactly one type of log file. There are different kind of log types, but essentially all the log files are text files.
Each server directory can contain anywhere from 1000 to 50K zipped files. Size of the archive is in access of 2TB.
Currently I have the log paths hosted on apache and can download individual zipfiles, but cannot search for a string across the zipped files.
Could you please suggest if elastic search can be implemented for this scenario. If so, how to go about it.