There are two ways to configure ES for persistence (for the data to survive
full cluster restart)
- Local gateway, where the data persists on the servers
- Shared or central gateway (S3, Hadoop, or shared file system) where data
is stored elsewhere.
In either case, data is still stored locally. With the shared gateway, data
is restored from that data store when a node restarts. For more
information, highly recommend reading the docs thoroughly.
mberkay on yahoo, google and skype
On Mon, May 14, 2012 at 6:36 PM, Mohit Anchlia firstname.lastname@example.org:
I have hadoop plugin with hdfs gateway but what I am seeing is that
indexes are still being written locally. Can you please help me understand
why it's being written locally?
ls -ltr data/elasticsearch/nodes/0/indices/twitter/0/index/
-rw-r--r-- 1 root root 0 May 14 15:33 write.lock
-rw-r--r-- 1 root root 20 May 14 15:33 segments.gen
-rw-r--r-- 1 root root 58 May 14 15:33 segments_1
-rw-r--r-- 1 root root 8 May 14 15:33 _checksums-1337034789114
hadoop fs -ls /elasticsearch