I am new to Elasticsearch and researching on to see if it can fit my needs.
Requirement - To be able to log data into datastore and generate metrics
out of it. The data would be huge around 50K recrods per hour (each row of
few hundred bytes/KB).
We are seeing how we can utilize elasticsearch for this. By going over
various threads, looks like this is possible to use elastic search for this
need and also use it as a datastore, however could not clarify few items
given below :
Can we use Elasticsearch to only for search capabilities while the
actual data is stored in another database? (i.e., Elasticsearch shall
maintain only 'indexed' (index in Database terminology) data which are
searchable while the actual data would be stored in different store..say
mongodb.). So if have 50K records (~ 5GB) of data, of which there are 10-20
properties of interest in each record which we expect elasticsearch to
search/index. Then can we make elasticsearch to store only these searchable
properties in its index (size of which we expect to be around few MBs),
while the actual data is stored in a separate store and then link it
(In otherwords, elasticsearch just has the properties data which is
searchable (nothing more) and has a pointer to actual data in Mongo).
What are the memory requirements of elasticsearch? (From what i
understood, elasticsearch loads all relevant indexed data into memory while
searching. So in my earlier example, if i want 20 properties (each 50 bytes
approx) in each record to be searchable, then for searching 50K records,
elasticsearch approximately would need 1.2GB of RAM to search over a days
data) Is my understanding correct?
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to email@example.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f82df903-0fb7-4eaa-9fd2-4d990f8685d2%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.