It doesn't sound like Cassandra adds any value. You could have asked the
same question, but substituting Cassandra with HBase or HDFS or MySQL, or
any other type of storage. But if your main goal is to search it, ES will
do just fine. You can always do snapshots to make backups, feed ES through
Kafka and rely on its TTL and ability to reindex recent data from Kafka if
you need to, etc.
Performance Monitoring * Log Analytics * Search Analytics
Solr & Elasticsearch Support * http://sematext.com/
On Wednesday, July 16, 2014 10:25:54 AM UTC-4, pranav amin wrote:
We have 300 TB of data, average size of document stored is 512KB. Just
want to make sure that using ES as primary data store I'm not missing
From your response it looks to me like durability isn't a concern with ES.
On Wednesday, July 16, 2014 6:53:52 AM UTC-4, mooky wrote:
What do you mean by "durability"?
Its highly likely that elastic has the same storage guarantees that
That said, some people like to have the flexibility of having the golden
source elsewhere and the ability to blow away the index & re-index at a
There are a number of elastic users, however, where this is not viable -
where reindexing their volume of data would take a week or 2.
How much data are you looking at storing/indexing? Mb? Gb? Tb? Pb?
On Tuesday, 15 July 2014 15:27:15 UTC+1, pranav amin wrote:
Does that mean i can't get durability if i store my data in ES as a
primary data store?
On Monday, July 14, 2014 11:57:23 PM UTC-4, Tim Uckun wrote:
I'm just confused if Cassandra can really make a difference here,
since looks to me ES can suffice here.
If you are not going to be using Cassandra for indexing then there is
no reason to have it. If you want durability in case something goes wrong
with ES you can just store your data in a log file before pumping it into
ES. If for whatever reason something happens to your ES cluster you can
reconstruct it using the log files.
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to firstname.lastname@example.org.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/2b6985f0-0351-419c-b9ef-789ba613f415%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.