I cannot find any info on where Elasticsearch is storing it's data.
I would like to manage this potentially valuable information.
Where, how big, how to back it up, restore it, etc.
Then on to clusters, etc..
I cannot find any info on where Elasticsearch is storing it's data.
I would like to manage this potentially valuable information.
Where, how big, how to back it up, restore it, etc.
Then on to clusters, etc..
I cannot find any info on where Elasticsearch is storing it's data.
I would like to manage this potentially valuable information.
Where, how big, how to back it up, restore it, etc.
Then on to clusters, etc..
I similarly can't find where the data is stored. We have it running with
ES-yarn though. This article says that the data is only stored in
container storage by default (we haven't changed any settings):
However, the data is definitely persisting somehow between restarts so it
has to be stored somewhere. We just can't find where. There is no
"path.data" dir and also there's no "/var/lib/elasticsearch/data" dir like
I've seen on other posts. And we can't find it in hdfs either.
So can anyone please point me to where we might be able to find the data?
If it helps, we are loading indexes from both hive and from logstash
directly.
Thanks,
Jim
On Wednesday, May 27, 2015 at 6:56:54 PM UTC-4, Mark Walkom wrote:
Le 27 mai 2015 à 17:25, John Adams <jada...@gmail.com <javascript:>> a
écrit :
I cannot find any info on where Elasticsearch is storing it's data.
I would like to manage this potentially valuable information.
Where, how big, how to back it up, restore it, etc.
Then on to clusters, etc..
Le 27 mai 2015 à 17:25, John Adams <jada...@gmail.com <javascript:>> a
écrit :
I cannot find any info on where Elasticsearch is storing it's data.
I would like to manage this potentially valuable information.
Where, how big, how to back it up, restore it, etc.
Then on to clusters, etc..
I similarly can't find where the data is stored. We have it running with
ES-yarn though. This article says that the data is only stored in
container storage by default (we haven't changed any settings):
However, the data is definitely persisting somehow between restarts so it
has to be stored somewhere. We just can't find where. There is no
"path.data" dir and also there's no "/var/lib/elasticsearch/data" dir
like I've seen on other posts. And we can't find it in hdfs either.
So can anyone please point me to where we might be able to find the data?
If it helps, we are loading indexes from both hive and from logstash
directly.
Thanks,
Jim
On Wednesday, May 27, 2015 at 6:56:54 PM UTC-4, Mark Walkom wrote:
I cannot find any info on where Elasticsearch is storing it's data.
I would like to manage this potentially valuable information.
Where, how big, how to back it up, restore it, etc.
Then on to clusters, etc..
Thank you, that little query is very helpful. Although there isn't any
actual "data" property anywhere in the response. I'm guessing it's cause
our data is still just cached, and it appears to be in the "home"
directory. Now we just have to figure out how to set the data dir using
es-yarn so that it's stored on the local nodes permanently. Haven't had
luck finding that yet.
And I will use the new forum going forward, just wanted to continue on this
thread instead of starting a new one.
Jim
On Thursday, May 28, 2015 at 6:10:49 PM UTC-4, Mark Walkom wrote:
If you query "_nodes?pretty | grep data" you will see a value, that's
where the data is.
On 29 May 2015 at 00:31, Jim Malone <malo...@gmail.com <javascript:>>
wrote:
I similarly can't find where the data is stored. We have it running with
ES-yarn though. This article says that the data is only stored in
container storage by default (we haven't changed any settings):
However, the data is definitely persisting somehow between restarts so
it has to be stored somewhere. We just can't find where. There is no
"path.data" dir and also there's no "/var/lib/elasticsearch/data" dir
like I've seen on other posts. And we can't find it in hdfs either.
So can anyone please point me to where we might be able to find the data?
If it helps, we are loading indexes from both hive and from logstash
directly.
Thanks,
Jim
On Wednesday, May 27, 2015 at 6:56:54 PM UTC-4, Mark Walkom wrote:
I cannot find any info on where Elasticsearch is storing it's data.
I would like to manage this potentially valuable information.
Where, how big, how to back it up, restore it, etc.
Then on to clusters, etc..
Thank you, that little query is very helpful. Although there isn't any actual "data" property anywhere in the response. I'm guessing it's cause our data is still just cached, and it appears to be in the "home" directory. Now we just have to figure out how to set the data dir using es-yarn so that it's stored on the local nodes permanently. Haven't had luck finding that yet.
And I will use the new forum going forward, just wanted to continue on this thread instead of starting a new one.
Jim
On Thursday, May 28, 2015 at 6:10:49 PM UTC-4, Mark Walkom wrote:
If you query "_nodes?pretty | grep data" you will see a value, that's where the data is.
On 29 May 2015 at 00:31, Jim Malone malo...@gmail.com wrote:
I similarly can't find where the data is stored. We have it running with ES-yarn though. This article says that the data is only stored in container storage by default (we haven't changed any settings):
However, the data is definitely persisting somehow between restarts so it has to be stored somewhere. We just can't find where. There is no "path.data" dir and also there's no "/var/lib/elasticsearch/data" dir like I've seen on other posts. And we can't find it in hdfs either.
So can anyone please point me to where we might be able to find the data? If it helps, we are loading indexes from both hive and from logstash directly.
I cannot find any info on where Elasticsearch is storing it's data.
I would like to manage this potentially valuable information.
Where, how big, how to back it up, restore it, etc.
Then on to clusters, etc..
Apache, Apache Lucene, Apache Hadoop, Hadoop, HDFS and the yellow elephant
logo are trademarks of the
Apache Software Foundation
in the United States and/or other countries.