# Current or planned usage in production **URL:** \ **Category:** Elasticsearch\ **Created:** [June 28, 2010, 6:52pm UTC](https://discuss.elastic.co/t/current-or-planned-usage-in-production/3048 "2010-06-28T18:52:20Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![David\_Jensen\_2](https://avatars.discourse-cdn.com/v4/letter/d/bc79bd/32.png) [@David\_Jensen\_2](https://discuss.elastic.co/u/David_Jensen_2)\ **Post date:** [June 28, 2010, 6:52pm UTC](https://discuss.elastic.co/t/current-or-planned-usage-in-production/3048/1 "2010-06-28T18:52:20Z")
I'm posting this again because I got only one response. It was a good response but still only one data point. Who has Elastic Search in production or plans to deploy it into production soon? Any Web 2.0 companies? How many documents do you have in the index? How large are each document? How many nodes are you running? Thanks, David Jensen ---
**Author:** ![Grant\_Rodgers](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/grant_rodgers/32/3204_2.png) [@Grant\_Rodgers](https://discuss.elastic.co/u/Grant_Rodgers)\ **Post date:** [June 28, 2010, 9:39pm UTC](https://discuss.elastic.co/t/current-or-planned-usage-in-production/3048/2 "2010-06-28T21:39:35Z")
GoTime has Elasticsearch in production. We are currently using it to index pageview analytics as a trial while we prepare other code that uses it. Our current index has 6.5 million documents with around 25 fields each. Future plans are for multiple indices each with 4-5 million complex nested documents. We have 3 c1.xlarge instances on ec2 running both cassandra and elasticsearch. Cpu usage is very low but load stays around the 6-8 range, so we are using the 8-core instances for now. We are using the S3 gateway but haven't had any restore scenarios yet. In our testing, recovery of large indices from S3 has not been promising, so we are looking forward to the reuse of work directories feature that is being worked on. To be fair, the recovery testing was done with 0.7.2, and I understand the gateway format has changed since then. Another feature that we're looking forward to is the enhanced facet support, especially histogram facets. Overall I've been very impressed with Elasticsearch and the pace of development. Keep up the good work Shay! Grant On Jun 28, 11:52 am, David Jensen [djense...@gmail.com](mailto:djense...@gmail.com) wrote: > I'm posting this again because I got only one response. It was a good > response but still only one data point. > > Who has Elastic Search in production or plans to deploy it into > production soon? Any Web 2.0 companies? > > How many documents do you have in the index? How large are each > document? How many nodes are you running? > > Thanks, > David Jensen ---
**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\ **Post date:** [June 28, 2010, 11:01pm UTC](https://discuss.elastic.co/t/current-or-planned-usage-in-production/3048/3 "2010-06-28T23:01:33Z")
Hi Grant (and all), Is there a chance that you can add it to the wiki page: [http://wiki.github.com/elasticsearch/elasticsearch/powered-by](http://wiki.github.com/elasticsearch/elasticsearch/powered-by)? The more people using and stating that they use it, the better other users will feel about it. Currently, it only lists a link to the site / company that uses it, but I think the below description you gave is great info as well, so maybe, if you are going to update the wiki, also add the description? -shay.banon On Tue, Jun 29, 2010 at 12:39 AM, Grant Rodgers [grantr@gmail.com](mailto:grantr@gmail.com) wrote: > GoTime has Elasticsearch in production. We are currently using it to > index pageview analytics as a trial while we prepare other code that > uses it. > > Our current index has 6.5 million documents with around 25 fields > each. Future plans are for multiple indices each with 4-5 million > complex nested documents. > > We have 3 c1.xlarge instances on ec2 running both cassandra and > elasticsearch. Cpu usage is very low but load stays around the 6-8 > range, so we are using the 8-core instances for now. We are using the > S3 gateway but haven't had any restore scenarios yet. In our testing, > recovery of large indices from S3 has not been promising, so we are > looking forward to the reuse of work directories feature that is being > worked on. To be fair, the recovery testing was done with 0.7.2, and I > understand the gateway format has changed since then. > > Another feature that we're looking forward to is the enhanced facet > support, especially histogram facets. > > Overall I've been very impressed with Elasticsearch and the pace of > development. Keep up the good work Shay! > > Grant > > On Jun 28, 11:52 am, David Jensen [djense...@gmail.com](mailto:djense...@gmail.com) wrote: > > > I'm posting this again because I got only one response. It was a good > > response but still only one data point. > > > > Who has Elastic Search in production or plans to deploy it into > > production soon? Any Web 2.0 companies? > > > > How many documents do you have in the index? How large are each > > document? How many nodes are you running? > > > > Thanks, > > David Jensen ---
**Author:** ![Grant\_Rodgers](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/grant_rodgers/32/3204_2.png) [@Grant\_Rodgers](https://discuss.elastic.co/u/Grant_Rodgers)\ **Post date:** [June 29, 2010, 1:07am UTC](https://discuss.elastic.co/t/current-or-planned-usage-in-production/3048/4 "2010-06-29T01:07:14Z")
Added! On Jun 28, 4:01 pm, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote: > Hi Grant (and all), > > Is there a chance that you can add it to the wiki page:[http://wiki.github.com/elasticsearch/elasticsearch/powered-by?The](http://wiki.github.com/elasticsearch/elasticsearch/powered-by?The) more > people using and stating that they use it, the better other users will feel > about it. > > Currently, it only lists a link to the site / company that uses it, but I > think the below description you gave is great info as well, so maybe, if you > are going to update the wiki, also add the description? > > -shay.banon > > On Tue, Jun 29, 2010 at 12:39 AM, Grant Rodgers [gra...@gmail.com](mailto:gra...@gmail.com) wrote: > > > GoTime has Elasticsearch in production. We are currently using it to > > index pageview analytics as a trial while we prepare other code that > > uses it. > > > Our current index has 6.5 million documents with around 25 fields > > each. Future plans are for multiple indices each with 4-5 million > > complex nested documents. > > > We have 3 c1.xlarge instances on ec2 running both cassandra and > > elasticsearch. Cpu usage is very low but load stays around the 6-8 > > range, so we are using the 8-core instances for now. We are using the > > S3 gateway but haven't had any restore scenarios yet. In our testing, > > recovery of large indices from S3 has not been promising, so we are > > looking forward to the reuse of work directories feature that is being > > worked on. To be fair, the recovery testing was done with 0.7.2, and I > > understand the gateway format has changed since then. > > > Another feature that we're looking forward to is the enhanced facet > > support, especially histogram facets. > > > Overall I've been very impressed with Elasticsearch and the pace of > > development. Keep up the good work Shay! > > > Grant > > > On Jun 28, 11:52 am, David Jensen [djense...@gmail.com](mailto:djense...@gmail.com) wrote: > > > > > I'm posting this again because I got only one response. It was a good > > > response but still only one data point. > > > > Who has Elastic Search in production or plans to deploy it into > > > production soon? Any Web 2.0 companies? > > > > How many documents do you have in the index? How large are each > > > document? How many nodes are you running? > > > > Thanks, > > > David Jensen ---
**Author:** ![David\_Jensen\_2](https://avatars.discourse-cdn.com/v4/letter/d/bc79bd/32.png) [@David\_Jensen\_2](https://discuss.elastic.co/u/David_Jensen_2)\ **Post date:** [July 6, 2010, 11:43pm UTC](https://discuss.elastic.co/t/current-or-planned-usage-in-production/3048/5 "2010-07-06T23:43:03Z")
I'm going to bump this thread because every time I post this topic I get one new person saying they use it. I've already started testing Elasticsearch and I'm going to try to index 30M+ documents. We'll see how it goes. On Jun 28, 6:07 pm, Grant Rodgers [gra...@gmail.com](mailto:gra...@gmail.com) wrote: > Added! > > On Jun 28, 4:01 pm, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote: > > > Hi Grant (and all), > > > Is there a chance that you can add it to the wiki page:[http://wiki.github.com/elasticsearch/elasticsearch/powered-by?Themore](http://wiki.github.com/elasticsearch/elasticsearch/powered-by?Themore) > > people using and stating that they use it, the better other users will feel > > about it. > > > Currently, it only lists a link to the site / company that uses it, but I > > think the below description you gave is great info as well, so maybe, if you > > are going to update the wiki, also add the description? > > > -shay.banon > > > On Tue, Jun 29, 2010 at 12:39 AM, Grant Rodgers [gra...@gmail.com](mailto:gra...@gmail.com) wrote: > > > > > GoTime has Elasticsearch in production. We are currently using it to > > > index pageview analytics as a trial while we prepare other code that > > > uses it. > > > > Our current index has 6.5 million documents with around 25 fields > > > each. Future plans are for multiple indices each with 4-5 million > > > complex nested documents. > > > > We have 3 c1.xlarge instances on ec2 running both cassandra and > > > elasticsearch. Cpu usage is very low but load stays around the 6-8 > > > range, so we are using the 8-core instances for now. We are using the > > > S3 gateway but haven't had any restore scenarios yet. In our testing, > > > recovery of large indices from S3 has not been promising, so we are > > > looking forward to the reuse of work directories feature that is being > > > worked on. To be fair, the recovery testing was done with 0.7.2, and I > > > understand the gateway format has changed since then. > > > > Another feature that we're looking forward to is the enhanced facet > > > support, especially histogram facets. > > > > Overall I've been very impressed with Elasticsearch and the pace of > > > development. Keep up the good work Shay! > > > > Grant > > > > On Jun 28, 11:52 am, David Jensen [djense...@gmail.com](mailto:djense...@gmail.com) wrote: > > > > > > > I'm posting this again because I got only one response. It was a good > > > > response but still only one data point. > > > > > Who has Elastic Search in production or plans to deploy it into > > > > production soon? Any Web 2.0 companies? > > > > > How many documents do you have in the index? How large are each > > > > document? How many nodes are you running? > > > > > Thanks, > > > > David Jensen ---
**Author:** ![otisg](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/otisg/32/492_2.png) [@otisg](https://discuss.elastic.co/u/otisg)\ **Post date:** [July 7, 2010, 8:35pm UTC](https://discuss.elastic.co/t/current-or-planned-usage-in-production/3048/6 "2010-07-07T20:35:56Z")
Keep bumping it 😉 We are about to use ES in a "multi-hundred-millions" docs environment. 🙂 ## Otis Sematext :: [http://sematext.com/](http://sematext.com/) :: Solr - Lucene - Nutch Lucene ecosystem search :: [http://search-lucene.com/](http://search-lucene.com/) On Jul 6, 7:43 pm, David Jensen [djense...@gmail.com](mailto:djense...@gmail.com) wrote: > I'm going to bump this thread because every time I post this topic I > get one new person saying they use it. > > I've already started testing Elasticsearch and I'm going to try to > index 30M+ documents. We'll see how it goes. > > On Jun 28, 6:07 pm, Grant Rodgers [gra...@gmail.com](mailto:gra...@gmail.com) wrote: > > > Added! > > > On Jun 28, 4:01 pm, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote: > > > > Hi Grant (and all), > > > > Is there a chance that you can add it to the wiki page:[http://wiki.github.com/elasticsearch/elasticsearch/powered-by?Themore](http://wiki.github.com/elasticsearch/elasticsearch/powered-by?Themore) > > > people using and stating that they use it, the better other users will feel > > > about it. > > > > Currently, it only lists a link to the site / company that uses it, but I > > > think the below description you gave is great info as well, so maybe, if you > > > are going to update the wiki, also add the description? > > > > -shay.banon > > > > On Tue, Jun 29, 2010 at 12:39 AM, Grant Rodgers [gra...@gmail.com](mailto:gra...@gmail.com) wrote: > > > > > > > GoTime has Elasticsearch in production. We are currently using it to > > > > index pageview analytics as a trial while we prepare other code that > > > > uses it. > > > > > Our current index has 6.5 million documents with around 25 fields > > > > each. Future plans are for multiple indices each with 4-5 million > > > > complex nested documents. > > > > > We have 3 c1.xlarge instances on ec2 running both cassandra and > > > > elasticsearch. Cpu usage is very low but load stays around the 6-8 > > > > range, so we are using the 8-core instances for now. We are using the > > > > S3 gateway but haven't had any restore scenarios yet. In our testing, > > > > recovery of large indices from S3 has not been promising, so we are > > > > looking forward to the reuse of work directories feature that is being > > > > worked on. To be fair, the recovery testing was done with 0.7.2, and I > > > > understand the gateway format has changed since then. > > > > > Another feature that we're looking forward to is the enhanced facet > > > > support, especially histogram facets. > > > > > Overall I've been very impressed with Elasticsearch and the pace of > > > > development. Keep up the good work Shay! > > > > > Grant > > > > > On Jun 28, 11:52 am, David Jensen [djense...@gmail.com](mailto:djense...@gmail.com) wrote: > > > > > > > > > I'm posting this again because I got only one response. It was a good > > > > > response but still only one data point. > > > > > > Who has Elastic Search in production or plans to deploy it into > > > > > production soon? Any Web 2.0 companies? > > > > > > How many documents do you have in the index? How large are each > > > > > document? How many nodes are you running? > > > > > > Thanks, > > > > > David Jensen ---
**Author:** ![David\_Jensen\_2](https://avatars.discourse-cdn.com/v4/letter/d/bc79bd/32.png) [@David\_Jensen\_2](https://discuss.elastic.co/u/David_Jensen_2)\ **Post date:** [July 30, 2010, 5:27pm UTC](https://discuss.elastic.co/t/current-or-planned-usage-in-production/3048/7 "2010-07-30T17:27:39Z")
Bump. Who else is using Elasticsearch in production or soon in production. Post it on the wiki ... [http://wiki.github.com/elasticsearch/elasticsearch/powered-by](http://wiki.github.com/elasticsearch/elasticsearch/powered-by)? On Jul 7, 1:35 pm, Otis [otis.gospodne...@gmail.com](mailto:otis.gospodne...@gmail.com) wrote: > Keep bumping it 😉 > We are about to use ES in a "multi-hundred-millions" docs > environment. 🙂 > > ## Otis > > Sematext ::[http://sematext.com/::](http://sematext.com/::) Solr - Lucene - Nutch > Lucene ecosystem search ::[http://search-lucene.com/](http://search-lucene.com/) > > On Jul 6, 7:43 pm, David Jensen [djense...@gmail.com](mailto:djense...@gmail.com) wrote: > > > I'm going to bump this thread because every time I post this topic I > > get one new person saying they use it. > > > I've already started testing Elasticsearch and I'm going to try to > > index 30M+ documents. We'll see how it goes. > > > On Jun 28, 6:07 pm, Grant Rodgers [gra...@gmail.com](mailto:gra...@gmail.com) wrote: > > > > Added! > > > > On Jun 28, 4:01 pm, Shay Banon [shay.ba...@elasticsearch.com](mailto:shay.ba...@elasticsearch.com) wrote: > > > > > Hi Grant (and all), > > > > > Is there a chance that you can add it to the wiki page:[http://wiki.github.com/elasticsearch/elasticsearch/powered-by?Themore](http://wiki.github.com/elasticsearch/elasticsearch/powered-by?Themore) > > > > people using and stating that they use it, the better other users will feel > > > > about it. > > > > > Currently, it only lists a link to the site / company that uses it, but I > > > > think the below description you gave is great info as well, so maybe, if you > > > > are going to update the wiki, also add the description? > > > > > -shay.banon > > > > > On Tue, Jun 29, 2010 at 12:39 AM, Grant Rodgers [gra...@gmail.com](mailto:gra...@gmail.com) wrote: > > > > > > > > > GoTime has Elasticsearch in production. We are currently using it to > > > > > index pageview analytics as a trial while we prepare other code that > > > > > uses it. > > > > > > Our current index has 6.5 million documents with around 25 fields > > > > > each. Future plans are for multiple indices each with 4-5 million > > > > > complex nested documents. > > > > > > We have 3 c1.xlarge instances on ec2 running both cassandra and > > > > > elasticsearch. Cpu usage is very low but load stays around the 6-8 > > > > > range, so we are using the 8-core instances for now. We are using the > > > > > S3 gateway but haven't had any restore scenarios yet. In our testing, > > > > > recovery of large indices from S3 has not been promising, so we are > > > > > looking forward to the reuse of work directories feature that is being > > > > > worked on. To be fair, the recovery testing was done with 0.7.2, and I > > > > > understand the gateway format has changed since then. > > > > > > Another feature that we're looking forward to is the enhanced facet > > > > > support, especially histogram facets. > > > > > > Overall I've been very impressed with Elasticsearch and the pace of > > > > > development. Keep up the good work Shay! > > > > > > Grant > > > > > > On Jun 28, 11:52 am, David Jensen [djense...@gmail.com](mailto:djense...@gmail.com) wrote: > > > > > > > > > > > I'm posting this again because I got only one response. It was a good > > > > > > response but still only one data point. > > > > > > > Who has Elastic Search in production or plans to deploy it into > > > > > > production soon? Any Web 2.0 companies? > > > > > > > How many documents do you have in the index? How large are each > > > > > > document? How many nodes are you running? > > > > > > > Thanks, > > > > > > David Jensen ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 4:21am UTC](https://discuss.elastic.co/t/current-or-planned-usage-in-production/3048/8 "2017-07-06T04:21:20Z")