ES with Hadoop

Elastic Stack Elasticsearch
1

Hi,

I have one question related to performance of ES with Hadoop.
Our Architecture:

  1. use hadoop for storage big data as we have millions of data.
  2. Feed to ES from Hadoop via API.
  3. Search will work through ES.

Will this architecture have performance issue ?

OR We simple use ES for millions storage and search.

Thanks.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f0ce54e5-2120-4c34-8cdb-b542ff7bea82%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

I'm not sure whether you have one or multiple questions but it's perfectly fine to use ES for both storage and search.
You can use HDFS as a snapshot/backup store to further improve the resilience of your system.

Millions of documents is not an issue for ES

On 1/29/15 4:29 PM, Manoj Singh wrote:

Hi,

I have one question related to performance of ES with Hadoop.
Our Architecture:

  1. use hadoop for storage big data as we have millions of data.
  2. Feed to ES from Hadoop via API.
  3. Search will work through ES.

Will this architecture have performance issue ?

OR We simple use ES for millions storage and search.

Thanks.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to
elasticsearch+unsubscribe@googlegroups.com mailto:elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/f0ce54e5-2120-4c34-8cdb-b542ff7bea82%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/f0ce54e5-2120-4c34-8cdb-b542ff7bea82%40googlegroups.com?utm_medium=email&utm_source=footer.
For more options, visit https://groups.google.com/d/optout.

--
Costin

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/54CA4D83.3030007%40gmail.com.
For more options, visit https://groups.google.com/d/optout.