# Usage in production **URL:** \ **Category:** Elasticsearch\ **Created:** [June 7, 2010, 9:48pm UTC](https://discuss.elastic.co/t/usage-in-production/3000 "2010-06-07T21:48:00Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![David\_Jensen\_2](https://avatars.discourse-cdn.com/v4/letter/d/bc79bd/32.png) [@David\_Jensen\_2](https://discuss.elastic.co/u/David_Jensen_2)\ **Post date:** [June 7, 2010, 9:48pm UTC](https://discuss.elastic.co/t/usage-in-production/3000/1 "2010-06-07T21:48:00Z")
I was just wondering who out there is using Elastic Search in production. Thanks, David ---
**Author:** ![Clinton\_Gormley](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@Clinton\_Gormley](https://discuss.elastic.co/u/Clinton_Gormley)\ **Post date:** [June 7, 2010, 10:03pm UTC](https://discuss.elastic.co/t/usage-in-production/3000/2 "2010-06-07T22:03:02Z")
On Mon, 2010-06-07 at 14:48 -0700, David Jensen wrote: > I was just wondering who out there is using Elastic Search in > production. We are - we're the biggest provider of family announcements hosting to newspapers in Europe: - [http://www.iannounce.co.uk/](http://www.iannounce.co.uk/) - [http://announce.jpress.co.uk/](http://announce.jpress.co.uk/) - [http://www.familynotices24.co.uk/](http://www.familynotices24.co.uk/) - [http://www.yourannouncement.co.uk/](http://www.yourannouncement.co.uk/) These are some of our UK sites Clint > Thanks, > David > -- > Web Announcements Limited is a company registered in England and Wales, > with company number 05608868, with registered address at 10 Arvon Road, > London, N5 1PR. ---
**Author:** ![David\_Jensen\_2](https://avatars.discourse-cdn.com/v4/letter/d/bc79bd/32.png) [@David\_Jensen\_2](https://discuss.elastic.co/u/David_Jensen_2)\ **Post date:** [June 8, 2010, 1:11am UTC](https://discuss.elastic.co/t/usage-in-production/3000/3 "2010-06-08T01:11:08Z")
Roughly how much data do you manage in your search indexes? If you're allowed to share that information, of course. On Jun 7, 3:03 pm, Clinton Gormley [clin...@iannounce.co.uk](mailto:clin...@iannounce.co.uk) wrote: > On Mon, 2010-06-07 at 14:48 -0700, David Jensen wrote: > > > I was just wondering who out there is using Elastic Search in > > production. > > We are - we're the biggest provider of family announcements hosting to > newspapers in Europe: > > - [http://www.iannounce.co.uk/](http://www.iannounce.co.uk/) > -[http://announce.jpress.co.uk/](http://announce.jpress.co.uk/) > -[http://www.familynotices24.co.uk/](http://www.familynotices24.co.uk/) > -[http://www.yourannouncement.co.uk/](http://www.yourannouncement.co.uk/) > > These are some of our UK sites > > Clint > > > Thanks, > > David > > -- > Web Announcements Limited is a company registered in England and Wales, > with company number 05608868, with registered address at 10 Arvon Road, > London, N5 1PR. ---
**Author:** ![Clinton\_Gormley](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@Clinton\_Gormley](https://discuss.elastic.co/u/Clinton_Gormley)\ **Post date:** [June 8, 2010, 10:12am UTC](https://discuss.elastic.co/t/usage-in-production/3000/4 "2010-06-08T10:12:13Z")
On Mon, 2010-06-07 at 18:11 -0700, David Jensen wrote: > Roughly how much data do you manage in your search indexes? We've got about 6 million docs indexed, average size about 0.5kB - anywhere from 8 to 20 fields per doc clint > If you're allowed to share that information, of course. > > On Jun 7, 3:03 pm, Clinton Gormley [clin...@iannounce.co.uk](mailto:clin...@iannounce.co.uk) wrote: > > > On Mon, 2010-06-07 at 14:48 -0700, David Jensen wrote: > > > > > I was just wondering who out there is using Elastic Search in > > > production. > > > > We are - we're the biggest provider of family announcements hosting to > > newspapers in Europe: > > > > - [http://www.iannounce.co.uk/](http://www.iannounce.co.uk/) > > -[http://announce.jpress.co.uk/](http://announce.jpress.co.uk/) > > -[http://www.familynotices24.co.uk/](http://www.familynotices24.co.uk/) > > -[http://www.yourannouncement.co.uk/](http://www.yourannouncement.co.uk/) > > > > These are some of our UK sites > > > > Clint > > > > > Thanks, > > > David > > > > -- > > Web Announcements Limited is a company registered in England and Wales, > > with company number 05608868, with registered address at 10 Arvon Road, > > London, N5 1PR. > > -- > > Web Announcements Limited is a company registered in England and Wales, > > with company number 05608868, with registered address at 10 Arvon Road, > > London, N5 1PR. ---
**Author:** ![nfo](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/nfo/32/1849_2.png) [@nfo](https://discuss.elastic.co/u/nfo)\ **Post date:** [June 9, 2010, 8:07am UTC](https://discuss.elastic.co/t/usage-in-production/3000/5 "2010-06-09T08:07:24Z")
Nice, do you use "niofs" or "memory" ? How many nodes do you need for that amount of docs ? On Jun 8, 12:12 pm, Clinton Gormley [clin...@iannounce.co.uk](mailto:clin...@iannounce.co.uk) wrote: > On Mon, 2010-06-07 at 18:11 -0700, David Jensen wrote: > > > Roughly how much data do you manage in your search indexes? > > We've got about 6 million docs indexed, average size about 0.5kB - > anywhere from 8 to 20 fields per doc > > clint > > > If you're allowed to share that information, of course. > > > On Jun 7, 3:03 pm, Clinton Gormley [clin...@iannounce.co.uk](mailto:clin...@iannounce.co.uk) wrote: > > > > > On Mon, 2010-06-07 at 14:48 -0700, David Jensen wrote: > > > > > > > I was just wondering who out there is using Elastic Search in > > > > production. > > > > We are - we're the biggest provider of family announcements hosting to > > > newspapers in Europe: > > > > - [http://www.iannounce.co.uk/](http://www.iannounce.co.uk/) > > > -[http://announce.jpress.co.uk/](http://announce.jpress.co.uk/) > > > -[http://www.familynotices24.co.uk/](http://www.familynotices24.co.uk/) > > > -[http://www.yourannouncement.co.uk/](http://www.yourannouncement.co.uk/) > > > > These are some of our UK sites > > > > Clint > > > > > Thanks, > > > > David > > > > -- > > > Web Announcements Limited is a company registered in England and Wales, > > > with company number 05608868, with registered address at 10 Arvon Road, > > > London, N5 1PR. > > -- > Web Announcements Limited is a company registered in England and Wales, > with company number 05608868, with registered address at 10 Arvon Road, > London, N5 1PR. ---
**Author:** ![Clinton\_Gormley](https://avatars.discourse-cdn.com/v4/letter/c/50afbb/32.png) [@Clinton\_Gormley](https://discuss.elastic.co/u/Clinton_Gormley)\ **Post date:** [June 9, 2010, 8:58am UTC](https://discuss.elastic.co/t/usage-in-production/3000/6 "2010-06-09T08:58:31Z")
On Wed, 2010-06-09 at 01:07 -0700, nfo wrote: > Nice, do you use "niofs" or "memory" ? How many nodes do you need for > that amount of docs ? We're using niofs - the gateway and niofs work directories are both about 10GB in size. I'm running just two nodes at the moment, more for availability than performance. A single node handles our load easily. Our main node has 4 x quad cores and 12 GB of mem. On this node, I'm giving the JVM 6GB of memory, and the rest is used by linux for caching. The backup node has one dual core and 10GB of memory. I've assigned 3GB of memory to the JVM, as I'm also running a slave DB server on that node. The gateway is shared over NFSv4 (the main node is also the NFS server) and the NFS shares are mounted with the default settings. The only other changes I made were to set the ulimit on the number of open files to 20,000 for the elasticsearch user, and to add these lines to /etc/sysctl.conf: net.core.wmem\_max = 655360 net.core.rmem\_max = 26214400 These setting were recommended by jgroups - although we're now using Zen, I thought they may still be relevant, so I left them in. Note: it is much better for your elasticsearch nodes to be on dedicated boxes, rather than shared with other services (like my backup DB). When the DB suddenly requires a lot of resources, it can slow ES right down, and cause timeouts. We're using the Perl client (Elasticsearch.pm) and with the above setup and data, we can index 400 - 500 docs per second. This is considerably slower than the Java client, but I'm working on improving this. A lot of the fault is in the standard HTTP module used in Perl, which is very accurate, but doesn't perform terribly well. Switching to a lighter HTTP module increased performance by about 30%, and the memcached interface almost doubled performance (with the downside that you don't get nearly as much visibility of what is happening in the server). Of course, this latency matters less with searches than with indexing, as it forms a smaller percentage of total time taken. hth clint ---
**Author:** ![Erwan\_Arzur\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/erwan_arzur_2/32/3331_2.png) [@Erwan\_Arzur\_2](https://discuss.elastic.co/u/Erwan_Arzur_2)\ **Post date:** [June 9, 2010, 9:23am UTC](https://discuss.elastic.co/t/usage-in-production/3000/7 "2010-06-09T09:23:19Z")
2010/6/9 Clinton Gormley [clinton@iannounce.co.uk](mailto:clinton@iannounce.co.uk): > On Wed, 2010-06-09 at 01:07 -0700, nfo wrote: > > > Nice, do you use "niofs" or "memory" ? How many nodes do you need for > > that amount of docs ? > > We're using niofs - the gateway and niofs work directories are both > about 10GB in size. Very helpful ! thanks a lot for sharing your findings. We are in the process of evaluating elasticsearch for a database (~500GB) that will contain a total of about ten times the number of documents (60M), and multiple indexes containing between 10k and 500k documents. Quite a big workload. Currently my main concern is to find what share of the index needs to reside in memory, in order to find out how many nodes we'll need to deploy. Thanks again, Erwan ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 4:23am UTC](https://discuss.elastic.co/t/usage-in-production/3000/8 "2017-07-06T04:23:29Z")