Hi Mark,
Thanks for the reply. We are using ES 0.90 on Java 7
The stats are as under :
"ok" : true,
"_shards" : {
"total" : 300,
"successful" : 300,
"failed" : 0
},
"_all" : {
"primaries" : {
"docs" : {
"count" : 28403397,
"deleted" : 1385142
},
"store" : {
"size" : "465.4gb",
"size_in_bytes" : 499761991425,
"throttle_time" : "0s",
"throttle_time_in_millis" : 0
},
"indexing" : {
"index_total" : 2343265,
"index_time" : "13.9d",
"index_time_in_millis" : 1204844492,
"index_current" : 0,
"delete_total" : 5,
"delete_time" : "659ms",
"delete_time_in_millis" : 659,
"delete_current" : 0
},
"get" : {
"total" : 9,
"get_time" : "3.2s",
"time_in_millis" : 3277,
"exists_total" : 6,
"exists_time" : "3.2s",
"exists_time_in_millis" : 3277,
"missing_total" : 3,
"missing_time" : "0s",
"missing_time_in_millis" : 0,
"current" : 0
},
"search" : {
"open_contexts" : 32,
"query_total" : 262779551,
"query_time" : "430.4d",
"query_time_in_millis" : 37193583386,
"query_current" : 3,
"fetch_total" : 115208512,
"fetch_time" : "541.6d",
"fetch_time_in_millis" : 46798459635,
"fetch_current" : 9
}
},
"total" : {
"docs" : {
"count" : 56806794,
"deleted" : 2770284
},
"store" : {
"size" : "930.8gb",
"size_in_bytes" : 999509417525,
"throttle_time" : "0s",
"throttle_time_in_millis" : 0
},
"indexing" : {
"index_total" : 4682044,
"index_time" : "34.6d",
"index_time_in_millis" : 2993312068,
"index_current" : 2232,
"delete_total" : 10,
"delete_time" : "2.4s",
"delete_time_in_millis" : 2404,
"delete_current" : 0
},
"get" : {
"total" : 24,
"get_time" : "9.8s",
"time_in_millis" : 9855,
"exists_total" : 15,
"exists_time" : "9.8s",
"exists_time_in_millis" : 9855,
"missing_total" : 9,
"missing_time" : "0s",
"missing_time_in_millis" : 0,
"current" : 0
},
"search" : {
"open_contexts" : 64,
"query_total" : 525308020,
"query_time" : "816.1d",
"query_time_in_millis" : 70519558277,
"query_current" : 6,
"fetch_total" : 230215915,
"fetch_time" : "939.6d",
"fetch_time_in_millis" : 81182884575,
"fetch_current" : 10
}
}
}
I am attaching along the hot_threads output, though I couldn't make much
sense of it. Pardon me if I sound N00Bish, because I am pretty new to ES.
On Wednesday, May 14, 2014 11:27:07 AM UTC+5:30, Mark Walkom wrote:
ES will use descriptors to open files it needs for general operations and
it can have a lot of those open at one time. But the level you've set and
the level you're using are not related to your slow queries.
How much data do you have in your cluster? What version of ES, what
version of java? You should also check your slow log
(/var/log/elasticsearch/*_index_search_slowlog.log) and hot threads (GET
/_cluster/nodes/hot_threads) to see what is happening.
Also try installing a plugin like Marvel or ElasticHQ to give you a better
idea of what your resource usage is like on a cluster level. Bigdesk is
good but it limited to a node only view.
Regards,
Mark Walkom
Infrastructure Engineer
Campaign Monitor
email: ma...@campaignmonitor.com <javascript:>
web: www.campaignmonitor.com
On 14 May 2014 15:47, Tamanjit Bindra <bindra....@gmail.com <javascript:>>wrote:
Hi,
I have read herehttp://www.elasticsearch.org/tutorials/too-many-open-files/,
that we should set the soft and hard values of nooffiles for ES to utilise.
I have done that, but somehow my BigDesk console shows that even though
the upper limit is 65535, ES is only using about 2K+ file descriptors at
any given moment.
I have set the ulimit -Hn and ulimit -Sn to 32000.
Why is this so?
I ask this because my queries are performing slow.
We are using 2 nodes. Both servers have 16G RAM with 10G dedicated to ES.
Please Help!
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/c27bd6d3-28a4-470b-96db-08117f554b7d%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/d854a1e6-20a0-4424-86b0-2322f18b6047%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
