Elastic Search Node Stats


(Meeez) #1

"qpvNNHpcQ3i1Bz8BWvq4oA" : {
"name" : "es_node_67",
"transport_address" : "inet[/172.29.181.67:9300]",
"hostname" : "01hw400248",
"attributes" : {
"tag" : "es_node_67"
},
"indices" : {
"store" : {
"size" : "8gb",
"size_in_bytes" : 8615814550
},
"docs" : {
"count" : 1121886,
"deleted" : 65007
},

Can someone tell me what is this deleted docs count in the node status? And
how to recover that space?


(Lukáš Vlček) #2

Hi,

it is at the Lucene level (the IR library that ES is built on top of). You
can read more about it here (see 'only_expunge_deletes'):
http://www.elasticsearch.org/guide/reference/api/admin-indices-optimize.html

Simple answer would be that in most cases you do not need to care about it,
it is treated automatically under the hood.

Regards,
Lukas

On Tue, Jul 31, 2012 at 9:58 PM, Mercy mercyusha@gmail.com wrote:

"qpvNNHpcQ3i1Bz8BWvq4oA" : {
"name" : "es_node_67",
"transport_address" : "inet[/172.29.181.67:9300]",
"hostname" : "01hw400248",
"attributes" : {
"tag" : "es_node_67"
},
"indices" : {
"store" : {
"size" : "8gb",
"size_in_bytes" : 8615814550
},
"docs" : {
"count" : 1121886,
"deleted" : 65007
},

Can someone tell me what is this deleted docs count in the node status?
And how to recover that space?


(Meeez) #3

Thanks for your quick response.

But in my case, the index size is too big than its supposed to be and
throwing OOM while importing. That's when I figured out the deleted docs
count which counts to more than 450K for all the nodes in the cluster.

Is there a way where we can get rid of those deleted ones and reclaim the
space?

On Tuesday, July 31, 2012 1:11:41 PM UTC-7, Lukáš Vlček wrote:

Hi,

it is at the Lucene level (the IR library that ES is built on top of). You
can read more about it here (see 'only_expunge_deletes'):

http://www.elasticsearch.org/guide/reference/api/admin-indices-optimize.html

Simple answer would be that in most cases you do not need to care about
it, it is treated automatically under the hood.

Regards,
Lukas

On Tue, Jul 31, 2012 at 9:58 PM, Mercy mercyusha@gmail.com wrote:

"qpvNNHpcQ3i1Bz8BWvq4oA" : {
"name" : "es_node_67",
"transport_address" : "inet[/172.29.181.67:9300]",
"hostname" : "01hw400248",
"attributes" : {
"tag" : "es_node_67"
},
"indices" : {
"store" : {
"size" : "8gb",
"size_in_bytes" : 8615814550
},
"docs" : {
"count" : 1121886,
"deleted" : 65007
},

Can someone tell me what is this deleted docs count in the node status?
And how to recover that space?


(system) #4