# 3G/s reads with fusion

**URL:** <https://discuss.elastic.co/t/3g-s-reads-with-fusion/25165>\
**Category:** Elasticsearch\
**Created:** [July 8, 2015, 3:47pm UTC](https://discuss.elastic.co/t/3g-s-reads-with-fusion/25165 "2015-07-08T15:47:49Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![javadevmtl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/javadevmtl/32/45613_2.png) [@javadevmtl](https://discuss.elastic.co/u/javadevmtl)\
**Post date:** [July 8, 2015, 3:47pm UTC](https://discuss.elastic.co/t/3g-s-reads-with-fusion/25165/1 "2015-07-08T15:47:49Z")

</div>

Just for fun and search! 🙂

Testing with 1.6.0 and Linux

4 Nodes 1.5 billion documents 7 indexes. 1 query with simple "user id" filter and 20 aggregations using doc values.

Unofficial number by eyeballing iotop about 3G/s reads per node. Takes about 20 seconds to calculate all the 20 aggregations.

The cards are capable of 6G/s but that could just be the nature of the query and why it's not any faster.

Also Linux seems to be performing allot better then Windows and mmapfs and all that swap business.

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [July 8, 2015, 10:15pm UTC](https://discuss.elastic.co/t/3g-s-reads-with-fusion/25165/2 "2015-07-08T22:15:44Z")

</div>

It'd be nice to have some snazzy graphs to go with this 😉

---

<div class="post-metadata">

**Author:** ![eperry](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/eperry/32/551_2.png) [@eperry](https://discuss.elastic.co/u/eperry)\
**Post date:** [July 9, 2015, 12:09am UTC](https://discuss.elastic.co/t/3g-s-reads-with-fusion/25165/3 "2015-07-09T00:09:09Z")

</div>

Is this with default configs or have you set it up with any tunnings, JVM, masters/data ....

---

<div class="post-metadata">

**Author:** ![javadevmtl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/javadevmtl/32/45613_2.png) [@javadevmtl](https://discuss.elastic.co/u/javadevmtl)\
**Post date:** [July 9, 2015, 8:35pm UTC](https://discuss.elastic.co/t/3g-s-reads-with-fusion/25165/4 "2015-07-09T20:35:25Z")

</div>

What would you liek to see if I am allowed from work to provide it...

---

<div class="post-metadata">

**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\
**Post date:** [July 9, 2015, 11:38pm UTC](https://discuss.elastic.co/t/3g-s-reads-with-fusion/25165/5 "2015-07-09T23:38:22Z")

</div>

Some throughput would be nice! For both query times and IO.

---

<div class="post-metadata">

**Author:** ![javadevmtl](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/javadevmtl/32/45613_2.png) [@javadevmtl](https://discuss.elastic.co/u/javadevmtl)\
**Post date:** [July 10, 2015, 3:37pm UTC](https://discuss.elastic.co/t/3g-s-reads-with-fusion/25165/6 "2015-07-10T15:37:11Z")

</div>

This is all default settings.

Running 4 dedicated data nodes, 1 master (this is test environment).  
Data nodes are each: 32core (16 hyperthreaded), 128GB RAM. Java 1.8\_45 ES\_HEAP=30G  
Did some minor tweaks to recovery settings but nothing else.

8 "monthly" indexes with 8 shards + 1 replica, with about 250,000,000 documents each. So total is now 1.8 billion documents.  
18TB on disk including replicas.  
Use doc values as much as possible.

The query is executed as follows...

```
GET /my-index*/my-type/_search
{
  "size": 0,
  "query": {
    "filtered": {
      "filter": {
        "bool": {
          "must": [
            {
              "term": {
                "my user": {
                  "value": "john.smith@gmail.com"
                }
              }
            }
          ]
        }
      }
    }
  },
  "aggs": {
  // 20 aggregations here...
  }
}
```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:02am UTC](https://discuss.elastic.co/t/3g-s-reads-with-fusion/25165/7 "2017-07-06T00:02:18Z")

</div>


