We are doing a project to use ElasticSearch as searching engine for the large amount of text content. The goal is to offer Full text search capacity to retrieve first 10 document based on phrases user provides within 30M documents with index data size around 50GB. Is it possible in theory we can achieve 100ms per query by using whatever the features ElasticSearch can offer, such as pre-caching to allow almost all time in-memory data access, clusters so query can be split into multiple servers with each server searching on < 10M documents?
Initial testing we did on 4GB trial cloud server gave us 3s per query, which is way too slow.
Anyone has any use case like this ? The best performance you have achieved?
Thanks in advance.