# Good candidate for a gateway?

**URL:** <https://discuss.elastic.co/t/good-candidate-for-a-gateway/3176>\
**Category:** Elasticsearch\
**Created:** [July 31, 2010, 7:58pm UTC](https://discuss.elastic.co/t/good-candidate-for-a-gateway/3176 "2010-07-31T19:58:43Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Lukas\_Vlcek1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lukas_vlcek1/32/819_2.png) [@Lukas\_Vlcek1](https://discuss.elastic.co/u/Lukas_Vlcek1)\
**Post date:** [July 31, 2010, 7:58pm UTC](https://discuss.elastic.co/t/good-candidate-for-a-gateway/3176/1 "2010-07-31T19:58:43Z")

</div>

Hi,

what kind of features must have the system that is good candidate for the  
gateway storage? With all those distributed and replicated key value stores  
these days how can I learn that specific product is good for ES gateway? As  
far as I understand the traffic is not critical (ES stores into gateway  
asynchronously and not "very often"), however, ability to store blobs is  
critical (system which can handle a lot of small key-value entities but can  
not handle large binary entities is probably not good candidate). Once data  
is stored in gateway it should be reliable (system that can not cope with  
crashes is not a good candidate). Are there any other requirements?

Regards,  
Lukas

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [August 1, 2010, 11:10am UTC](https://discuss.elastic.co/t/good-candidate-for-a-gateway/3176/2 "2010-08-01T11:10:48Z")

</div>

Basically, this is it. Note that key value stores like cassandra also make  
sense since you can always represent a blob as chunks of bytes. Actually,  
since this is so common scenario, in elasticsearch there is built in support  
for chunking blobs.

-shay.banon

On Sat, Jul 31, 2010 at 10:58 PM, Lukáš Vlček [lukas.vlcek@gmail.com](mailto:lukas.vlcek@gmail.com) wrote:

> Hi,
> 
> what kind of features must have the system that is good candidate for the  
> gateway storage? With all those distributed and replicated key value stores  
> these days how can I learn that specific product is good for ES gateway? As  
> far as I understand the traffic is not critical (ES stores into gateway  
> asynchronously and not "very often"), however, ability to store blobs is  
> critical (system which can handle a lot of small key-value entities but can  
> not handle large binary entities is probably not good candidate). Once data  
> is stored in gateway it should be reliable (system that can not cope with  
> crashes is not a good candidate). Are there any other requirements?
> 
> Regards,  
> Lukas

---

<div class="post-metadata">

**Author:** ![Lukas\_Vlcek1](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/lukas_vlcek1/32/819_2.png) [@Lukas\_Vlcek1](https://discuss.elastic.co/u/Lukas_Vlcek1)\
**Post date:** [August 1, 2010, 11:19am UTC](https://discuss.elastic.co/t/good-candidate-for-a-gateway/3176/3 "2010-08-01T11:19:29Z")

</div>

What would be the best way if I want to evaluate some key-value store or  
distributed cache if it plays nice as a ES gateway? Is there any simple  
gateway interface I have to implement and any other ES API I need to  
consider when implementing it?

Lukas

On Sun, Aug 1, 2010 at 1:10 PM, Shay Banon [shay.banon@elasticsearch.com](mailto:shay.banon@elasticsearch.com)wrote:

> Basically, this is it. Note that key value stores like cassandra also make  
> sense since you can always represent a blob as chunks of bytes. Actually,  
> since this is so common scenario, in elasticsearch there is built in support  
> for chunking blobs.
> 
> -shay.banon
> 
> On Sat, Jul 31, 2010 at 10:58 PM, Lukáš Vlček [lukas.vlcek@gmail.com](mailto:lukas.vlcek@gmail.com)wrote:
> 
> > Hi,
> > 
> > what kind of features must have the system that is good candidate for the  
> > gateway storage? With all those distributed and replicated key value stores  
> > these days how can I learn that specific product is good for ES gateway? As  
> > far as I understand the traffic is not critical (ES stores into gateway  
> > asynchronously and not "very often"), however, ability to store blobs is  
> > critical (system which can handle a lot of small key-value entities but can  
> > not handle large binary entities is probably not good candidate). Once data  
> > is stored in gateway it should be reliable (system that can not cope with  
> > crashes is not a good candidate). Are there any other requirements?
> > 
> > Regards,  
> > Lukas

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [August 1, 2010, 11:21am UTC](https://discuss.elastic.co/t/good-candidate-for-a-gateway/3176/4 "2010-08-01T11:21:08Z")

</div>

You can have a look at the Hadoop and S3 gateways. There is a common  
abstraction on top of blob store (very simple) and a built in base classes  
for gateway that uses this blob store.

-shay.banon

On Sun, Aug 1, 2010 at 2:19 PM, Lukáš Vlček [lukas.vlcek@gmail.com](mailto:lukas.vlcek@gmail.com) wrote:

> What would be the best way if I want to evaluate some key-value store or  
> distributed cache if it plays nice as a ES gateway? Is there any simple  
> gateway interface I have to implement and any other ES API I need to  
> consider when implementing it?
> 
> Lukas
> 
> On Sun, Aug 1, 2010 at 1:10 PM, Shay Banon [shay.banon@elasticsearch.com](mailto:shay.banon@elasticsearch.com)wrote:
> 
> > Basically, this is it. Note that key value stores like cassandra also make  
> > sense since you can always represent a blob as chunks of bytes. Actually,  
> > since this is so common scenario, in elasticsearch there is built in support  
> > for chunking blobs.
> > 
> > -shay.banon
> > 
> > On Sat, Jul 31, 2010 at 10:58 PM, Lukáš Vlček [lukas.vlcek@gmail.com](mailto:lukas.vlcek@gmail.com)wrote:
> > 
> > > Hi,
> > > 
> > > what kind of features must have the system that is good candidate for the  
> > > gateway storage? With all those distributed and replicated key value stores  
> > > these days how can I learn that specific product is good for ES gateway? As  
> > > far as I understand the traffic is not critical (ES stores into gateway  
> > > asynchronously and not "very often"), however, ability to store blobs is  
> > > critical (system which can handle a lot of small key-value entities but can  
> > > not handle large binary entities is probably not good candidate). Once data  
> > > is stored in gateway it should be reliable (system that can not cope with  
> > > crashes is not a good candidate). Are there any other requirements?
> > > 
> > > Regards,  
> > > Lukas

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:21am UTC](https://discuss.elastic.co/t/good-candidate-for-a-gateway/3176/5 "2017-07-06T04:21:17Z")

</div>

Closed on July 6, 2017, 4:21am UTC


