I am having about 10 millians of new documents for a day to be realtime
searching. Is elasticsearch a good choice to do this?
Yes
Actually, it depends on how complex are your documents and your
searches, how you configure Elasticsearch and what hardware you throw
at it.
Just to give you some real data, I'm using it for searching log files,
so documents are ~1k and have only a few fields. My "inserting" script
uses pyes (python client for ES) and I constantly get above 10K
inserts per second on my laptop. So it could index 10M logs in well
under 3 hours.
As for searches, I'm doing simple term queries but I'm sorting the
results by date, which is quite expensive. And my laptop (i7, 8GB of
RAM) could get decent query times (few seconds) with up to 50M
documents or so.
On Apr 9, 5:59 pm, LiMac cnwangy...@gmail.com wrote:
I am having about 10 millians of new documents for a day to be realtime
searching. Is elasticsearch a good choice to do this?