I am currently evaluating a set of technologies we hope to use in order to
drive real-time analytic queries on a large dataset, I came across
ElasticSearch and was wondering on its appropriateness for our use cases.
Consider a dataset of ~100 Million records, where each record is
represented as followed:
"Business Type": "Retailer",
"Store Name": "Costco",
"Owners Name": "John",
"Owners Age": 57,
"Store Opened": "06/05/1999",
"Store Shut": "10/06/2013",
"Avg Daily Customers": "1,300",
"Avg Daily Sales": "252,000"
The values of *'Avg Daily Customers' *and 'Avg Daily Sales' are
the ones by which all queries need to be aggregated. It might be useful to
share some of the flexible style queries our product is expected to address
in near real-time (< 2 seconds) response times:
- Calculate the total sum of Daily Customers and Sales for any store in
Toronto which has less than 80 Employees and which Opened after 01/01/2000
- *Calculate the *total sum of Daily Customers and Sales grouped by
Business Type for any store in Canada, Mexico, USA
- *Calculate the **total sum of Daily Customers and Sales *for any store
in *Toronto *grouped by nEmployees *and sorted by Owners Age *
This is all new land for me and the members of our team meaning we have
been hitting our heads hard with various technologies trying to get this
queries to perform. Based on your practical experience with ElasticSearch,
are these sort of queries something you consider the technology to be a
good fit for?
It would be fantastic if you could also share some assumptions such as the
type of hardware I might need to satisfy such times. While I understand
ElasticSearch is infinitely scalable horizontally, having 100 server
instances might not be the right move for us, please keep that in mind
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to email@example.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b56c6727-dbc3-4066-890c-3528aa909844%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.