Does manual refresh flush indices too?


(Mustafa Sener) #1

Hi,
I want to use disabling auto flush to backup ES data. I want to learn
whether manual refresh operations flush indices or not?

--
Mustafa Sener
www.ifountain.com


(Shay Banon) #2

Refresh does not causes the transaction log to be affected. Internally in
Lucene it does write some index files, but they are not "officially" part
of the index (until a "flush" in elasticsearch, which results in a Lucene
commit).

On Thu, Nov 10, 2011 at 4:19 PM, Mustafa Sener mustafa.sener@gmail.comwrote:

Hi,
I want to use disabling auto flush to backup ES data. I want to learn
whether manual refresh operations flush indices or not?

--
Mustafa Sener
www.ifountain.com


(Mustafa Sener) #3

So When I disabled auto flushing, I can backup all data directory. I have
another question. Assume this backup took too much time. How will this
effect ES memory usage? may it cause OOM exception or etc?

On Sun, Nov 13, 2011 at 9:08 AM, Shay Banon kimchy@gmail.com wrote:

Refresh does not causes the transaction log to be affected. Internally in
Lucene it does write some index files, but they are not "officially" part
of the index (until a "flush" in elasticsearch, which results in a Lucene
commit).

On Thu, Nov 10, 2011 at 4:19 PM, Mustafa Sener mustafa.sener@gmail.comwrote:

Hi,
I want to use disabling auto flush to backup ES data. I want to learn
whether manual refresh operations flush indices or not?

--
Mustafa Sener
www.ifountain.com

--
Mustafa Sener
www.ifountain.com
WebRep
Overall rating


(Shay Banon) #4

By disabling flush, a small amount of information will be stored in memory
per operation, so yes, you will eventually run into memory problems, but it
will take time.

On Tue, Nov 15, 2011 at 3:19 PM, Mustafa Sener mustafa.sener@gmail.comwrote:

So When I disabled auto flushing, I can backup all data directory. I have
another question. Assume this backup took too much time. How will this
effect ES memory usage? may it cause OOM exception or etc?

On Sun, Nov 13, 2011 at 9:08 AM, Shay Banon kimchy@gmail.com wrote:

Refresh does not causes the transaction log to be affected. Internally in
Lucene it does write some index files, but they are not "officially" part
of the index (until a "flush" in elasticsearch, which results in a Lucene
commit).

On Thu, Nov 10, 2011 at 4:19 PM, Mustafa Sener mustafa.sener@gmail.comwrote:

Hi,
I want to use disabling auto flush to backup ES data. I want to learn
whether manual refresh operations flush indices or not?

--
Mustafa Sener
www.ifountain.com

--
Mustafa Sener
www.ifountain.com
WebRep
Overall rating


(system) #5