Suspect GC sync'ed between nodes cause simultaneous performance hit

On Wednesday, March 16, 2011 at 5:54 AM, David Taylor wrote:
Hi Shay,

Filters are used by our web application. They are only available to authenticated users, so they can't be triggered by search crawlers.
This sounds reasonable.

We're using filtered facets.
Which filters?

Cheers,
David.

On Wed, Mar 16, 2011 at 11:16 AM, Shay Banon shay.banon@elasticsearch.com wrote:

Right. Information on where you use filters and what type of filters will help. The fact that its the master node, btw, has no affect. Its just shards allocated on nodes, and search being executed on them, the master plays no specific role here.
On Wednesday, March 16, 2011 at 2:09 AM, David Taylor wrote:

On Wed, Mar 16, 2011 at 9:35 AM, David Taylor david.taylor@assistly.com wrote:

There are a high number of evictions on the master node. However, I checked these stats yesterday and today, more than 12 hours apart, and the evictions have not changed (4,605 yesterday and still 4,605 today):

"nodes" : {
"UMi0Q32TTNOt14Fjwd-oUA" : {
"name" : "Black Tom Cassidy",
"indices" : {
"store_size" : "3.4gb",
"store_size_in_bytes" : 3709373643,
"field_cache_evictions" : 4605,
"field_cache_size" : "190.4mb",
"field_cache_size_in_bytes" : 199713560,
"filter_cache_size" : "6.5gb",
"filter_cache_size_in_bytes" : 7019021448
},

. . .
"nb_CvB7wTSqrEt928agjnA" : {
"name" : "X-Man",
"indices" : {
"store_size" : "4.7gb",
"store_size_in_bytes" : 5063162525,
"field_cache_evictions" : 0,
"field_cache_size" : "247.1mb",
"field_cache_size_in_bytes" : 259161452,
"filter_cache_size" : "2.5gb",
"filter_cache_size_in_bytes" : 2788778984
},

Some additional info on the above. The filter cache size on the master has increased by a factor of 10 since yesterday (it was approximately 640mb yesterday, not it's 6.5gb).

Cheers,
David.