# Where is Elasticsearch storing data **URL:** \ **Category:** Elasticsearch\ **Created:** [May 27, 2015, 3:25pm UTC](https://discuss.elastic.co/t/where-is-elasticsearch-storing-data/23698 "2015-05-27T15:25:14Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![John\_Adams](https://avatars.discourse-cdn.com/v4/letter/j/e47c2d/32.png) [@John\_Adams](https://discuss.elastic.co/u/John_Adams)\ **Post date:** [May 27, 2015, 3:25pm UTC](https://discuss.elastic.co/t/where-is-elasticsearch-storing-data/23698/1 "2015-05-27T15:25:14Z")
I cannot find any info on where Elasticsearch is storing it's data. I would like to manage this potentially valuable information. Where, how big, how to back it up, restore it, etc. Then on to clusters, etc.. Thanks, John ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [May 27, 2015, 3:27pm UTC](https://discuss.elastic.co/t/where-is-elasticsearch-storing-data/23698/2 "2015-05-27T15:27:07Z")
by default in path.data dir. In zip or tar.gz distribution, it’s in "data" dir -- David Pilato - Developer | Evangelist > **[Elastic — The Search AI Company](https://www.elastic.co/)** > > Power insights and outcomes with The Elastic Search AI Platform. See into your data and find answers that matter with enterprise solutions designed to help you accelerate time to insight. Try Elastic ... @dadoonet [https://twitter.com/dadoonet](https://twitter.com/dadoonet) | @elasticsearchfr [https://twitter.com/elasticsearchfr](https://twitter.com/elasticsearchfr) | @scrutmydocs [https://twitter.com/scrutmydocs](https://twitter.com/scrutmydocs) > Le 27 mai 2015 à 17:25, John Adams [jadams007@gmail.com](mailto:jadams007@gmail.com) a écrit : > > I cannot find any info on where Elasticsearch is storing it's data. > I would like to manage this potentially valuable information. > Where, how big, how to back it up, restore it, etc. > Then on to clusters, etc.. > > Thanks, > John > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) [https://discuss.elastic.co/](https://discuss.elastic.co/) > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com) [mailto:elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com) [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm_medium=email&utm_source=footer). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout) [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [May 27, 2015, 10:56pm UTC](https://discuss.elastic.co/t/where-is-elasticsearch-storing-data/23698/3 "2015-05-27T22:56:21Z")
Check out > **[Configure Elasticsearch | Elastic Docs](https://www.elastic.co/docs/deploy-manage/deploy/self-managed/configure-elasticsearch)** > > Elasticsearch ships with good defaults and requires very little configuration. Most settings can be changed on a running cluster using the Cluster update... PS - We're moving to [https://discuss.elastic.co/](https://discuss.elastic.co/), please join us there for any future discussions! On 28 May 2015 at 01:27, David Pilato [david@pilato.fr](mailto:david@pilato.fr) wrote: > by default in path.data dir. > In zip or tar.gz distribution, it’s in "data" dir > > -- > _David Pilato_ - Developer | Evangelist > _[elastic.co](http://elastic.co) [http://elastic.co](http://elastic.co)_ > @dadoonet [https://twitter.com/dadoonet](https://twitter.com/dadoonet) | @elasticsearchfr > [https://twitter.com/elasticsearchfr](https://twitter.com/elasticsearchfr) | @scrutmydocs > [https://twitter.com/scrutmydocs](https://twitter.com/scrutmydocs) > > Le 27 mai 2015 à 17:25, John Adams [jadams007@gmail.com](mailto:jadams007@gmail.com) a écrit : > > I cannot find any info on where Elasticsearch is storing it's data. > I would like to manage this potentially valuable information. > Where, how big, how to back it up, restore it, etc. > Then on to clusters, etc.. > > Thanks, > John > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr) > [https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr?utm_medium=email&utm_source=footer) > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9BS-BBEy5W4Q1odAX7hjU%3DspAqOz8q0rTTQUb%2BU4294g%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9BS-BBEy5W4Q1odAX7hjU%3DspAqOz8q0rTTQUb%2BU4294g%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Jim\_Malone](https://avatars.discourse-cdn.com/v4/letter/j/e9a140/32.png) [@Jim\_Malone](https://discuss.elastic.co/u/Jim_Malone)\ **Post date:** [May 28, 2015, 2:31pm UTC](https://discuss.elastic.co/t/where-is-elasticsearch-storing-data/23698/4 "2015-05-28T14:31:39Z")
I similarly can't find where the data is stored. We have it running with ES-yarn though. This article says that the data is only stored in container storage by default (we haven't changed any settings): [https://www.elastic.co/guide/en/elasticsearch/hadoop/master/ey-setup.html](https://www.elastic.co/guide/en/elasticsearch/hadoop/master/ey-setup.html) However, the data is definitely persisting somehow between restarts so it has to be stored somewhere. We just can't find where. There is no "path.data" dir and also there's no "/var/lib/elasticsearch/data" dir like I've seen on other posts. And we can't find it in hdfs either. So can anyone please point me to where we might be able to find the data? If it helps, we are loading indexes from both hive and from logstash directly. Thanks, Jim On Wednesday, May 27, 2015 at 6:56:54 PM UTC-4, Mark Walkom wrote: > Check out > [Configure Elasticsearch | Elastic Docs](https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-dir-layout.html) > > PS - We're moving to [https://discuss.elastic.co/](https://discuss.elastic.co/), please join us there > for any future discussions! > > On 28 May 2015 at 01:27, David Pilato \<[da...@pilato.fr](mailto:da...@pilato.fr) \\> > wrote: > > > by default in path.data dir. > > In zip or tar.gz distribution, it’s in "data" dir > > > > -- > > _David Pilato_ - Developer | Evangelist > > _[elastic.co](http://elastic.co) [http://elastic.co](http://elastic.co)_ > > @dadoonet [https://twitter.com/dadoonet](https://twitter.com/dadoonet) | @elasticsearchfr > > [https://twitter.com/elasticsearchfr](https://twitter.com/elasticsearchfr) | @scrutmydocs > > [https://twitter.com/scrutmydocs](https://twitter.com/scrutmydocs) > > > > Le 27 mai 2015 à 17:25, John Adams \<[jada...@gmail.com](mailto:jada...@gmail.com) \\> a > > écrit : > > > > I cannot find any info on where Elasticsearch is storing it's data. > > I would like to manage this potentially valuable information. > > Where, how big, how to back it up, restore it, etc. > > Then on to clusters, etc.. > > > > Thanks, > > John > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr) > > [https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr?utm_medium=email&utm_source=footer) > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![John\_Adams](https://avatars.discourse-cdn.com/v4/letter/j/e47c2d/32.png) [@John\_Adams](https://discuss.elastic.co/u/John_Adams)\ **Post date:** [May 28, 2015, 8:47pm UTC](https://discuss.elastic.co/t/where-is-elasticsearch-storing-data/23698/5 "2015-05-28T20:47:27Z")
Thank you, I will check it out. On Wednesday, May 27, 2015 at 8:27:23 AM UTC-7, David Pilato wrote: > by default in path.data dir. > In zip or tar.gz distribution, it’s in "data" dir > > -- > _David Pilato_ - Developer | Evangelist > _[elastic.co](http://elastic.co) [http://elastic.co](http://elastic.co)_ > @dadoonet [https://twitter.com/dadoonet](https://twitter.com/dadoonet) | @elasticsearchfr > [https://twitter.com/elasticsearchfr](https://twitter.com/elasticsearchfr) | @scrutmydocs > [https://twitter.com/scrutmydocs](https://twitter.com/scrutmydocs) > > Le 27 mai 2015 à 17:25, John Adams \<[jada...@gmail.com](mailto:jada...@gmail.com) \\> a > écrit : > > I cannot find any info on where Elasticsearch is storing it's data. > I would like to manage this potentially valuable information. > Where, how big, how to back it up, restore it, etc. > Then on to clusters, etc.. > > Thanks, > John > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/81307403-978f-45f2-972f-07595b9df337%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/81307403-978f-45f2-972f-07595b9df337%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![warkolm](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/warkolm/32/39224_2.png) [@warkolm](https://discuss.elastic.co/u/warkolm)\ **Post date:** [May 28, 2015, 10:10pm UTC](https://discuss.elastic.co/t/where-is-elasticsearch-storing-data/23698/6 "2015-05-28T22:10:19Z")
If you query "\_nodes?pretty | grep data" you will see a value, that's where the data is. PS - We're moving to [https://discuss.elastic.co/](https://discuss.elastic.co/), please join us there for any future discussions! On 29 May 2015 at 00:31, Jim Malone [malonej7@gmail.com](mailto:malonej7@gmail.com) wrote: > I similarly can't find where the data is stored. We have it running with > ES-yarn though. This article says that the data is only stored in > container storage by default (we haven't changed any settings): > > [https://www.elastic.co/guide/en/elasticsearch/hadoop/master/ey-setup.html](https://www.elastic.co/guide/en/elasticsearch/hadoop/master/ey-setup.html) > > However, the data is definitely persisting somehow between restarts so it > has to be stored somewhere. We just can't find where. There is no > "path.data" dir and also there's no "/var/lib/elasticsearch/data" dir > like I've seen on other posts. And we can't find it in hdfs either. > > So can anyone please point me to where we might be able to find the data? > If it helps, we are loading indexes from both hive and from logstash > directly. > > Thanks, > Jim > > On Wednesday, May 27, 2015 at 6:56:54 PM UTC-4, Mark Walkom wrote: > > > Check out > > [Configure Elasticsearch | Elastic Docs](https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-dir-layout.html) > > > > PS - We're moving to [https://discuss.elastic.co/](https://discuss.elastic.co/), please join us there > > for any future discussions! > > > > On 28 May 2015 at 01:27, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > > > > by default in path.data dir. > > > In zip or tar.gz distribution, it’s in "data" dir > > > > > > -- > > > _David Pilato_ - Developer | Evangelist > > > _[elastic.co](http://elastic.co) [http://elastic.co](http://elastic.co)_ > > > @dadoonet [https://twitter.com/dadoonet](https://twitter.com/dadoonet) | @elasticsearchfr > > > [https://twitter.com/elasticsearchfr](https://twitter.com/elasticsearchfr) | @scrutmydocs > > > [https://twitter.com/scrutmydocs](https://twitter.com/scrutmydocs) > > > > > > Le 27 mai 2015 à 17:25, John Adams [jada...@gmail.com](mailto:jada...@gmail.com) a écrit : > > > > > > I cannot find any info on where Elasticsearch is storing it's data. > > > I would like to manage this potentially valuable information. > > > Where, how big, how to back it up, restore it, etc. > > > Then on to clusters, etc.. > > > > > > Thanks, > > > John > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com) > > > [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm_medium=email&utm_source=footer) > > > . > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > You received this message because you are subscribed to the Google > > > Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit > > > [https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr) > > > [https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr?utm_medium=email&utm_source=footer) > > > . > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > -- > > Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > * * * > > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com) > [https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com?utm_medium=email&utm_source=footer) > . > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9pYUtnr%2B4U35t1oNu%3Dwbom4UqZyJEs0iB96CikSOiD7g%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9pYUtnr%2B4U35t1oNu%3Dwbom4UqZyJEs0iB96CikSOiD7g%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Jim\_Malone](https://avatars.discourse-cdn.com/v4/letter/j/e9a140/32.png) [@Jim\_Malone](https://discuss.elastic.co/u/Jim_Malone)\ **Post date:** [May 29, 2015, 1:04am UTC](https://discuss.elastic.co/t/where-is-elasticsearch-storing-data/23698/7 "2015-05-29T01:04:10Z")
Thank you, that little query is very helpful. Although there isn't any actual "data" property anywhere in the response. I'm guessing it's cause our data is still just cached, and it appears to be in the "home" directory. Now we just have to figure out how to set the data dir using es-yarn so that it's stored on the local nodes permanently. Haven't had luck finding that yet. And I will use the new forum going forward, just wanted to continue on this thread instead of starting a new one. Jim On Thursday, May 28, 2015 at 6:10:49 PM UTC-4, Mark Walkom wrote: > If you query "\_nodes?pretty | grep data" you will see a value, that's > where the data is. > > PS - We're moving to [https://discuss.elastic.co/](https://discuss.elastic.co/), please join us there > for any future discussions! > > On 29 May 2015 at 00:31, Jim Malone \<[malo...@gmail.com](mailto:malo...@gmail.com) \\> > wrote: > > > I similarly can't find where the data is stored. We have it running with > > ES-yarn though. This article says that the data is only stored in > > container storage by default (we haven't changed any settings): > > > > [https://www.elastic.co/guide/en/elasticsearch/hadoop/master/ey-setup.html](https://www.elastic.co/guide/en/elasticsearch/hadoop/master/ey-setup.html) > > > > However, the data is definitely persisting somehow between restarts so > > it has to be stored somewhere. We just can't find where. There is no > > "path.data" dir and also there's no "/var/lib/elasticsearch/data" dir > > like I've seen on other posts. And we can't find it in hdfs either. > > > > So can anyone please point me to where we might be able to find the data? > > If it helps, we are loading indexes from both hive and from logstash > > directly. > > > > Thanks, > > Jim > > > > On Wednesday, May 27, 2015 at 6:56:54 PM UTC-4, Mark Walkom wrote: > > > > > Check out > > > [Configure Elasticsearch | Elastic Docs](https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-dir-layout.html) > > > > > > PS - We're moving to [https://discuss.elastic.co/](https://discuss.elastic.co/), please join us there > > > for any future discussions! > > > > > > On 28 May 2015 at 01:27, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > > > > > > by default in path.data dir. > > > > In zip or tar.gz distribution, it’s in "data" dir > > > > > > > > -- > > > > _David Pilato_ - Developer | Evangelist > > > > _[elastic.co](http://elastic.co) [http://elastic.co](http://elastic.co)_ > > > > @dadoonet [https://twitter.com/dadoonet](https://twitter.com/dadoonet) | @elasticsearchfr > > > > [https://twitter.com/elasticsearchfr](https://twitter.com/elasticsearchfr) | @scrutmydocs > > > > [https://twitter.com/scrutmydocs](https://twitter.com/scrutmydocs) > > > > > > > > Le 27 mai 2015 à 17:25, John Adams [jada...@gmail.com](mailto:jada...@gmail.com) a écrit : > > > > > > > > I cannot find any info on where Elasticsearch is storing it's data. > > > > I would like to manage this potentially valuable information. > > > > Where, how big, how to back it up, restore it, etc. > > > > Then on to clusters, etc.. > > > > > > > > Thanks, > > > > John > > > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > To view this discussion on the web visit > > > > [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com) > > > > [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com?utm_medium=email&utm_source=footer) > > > > . > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > > > You received this message because you are subscribed to the Google > > > > Groups "elasticsearch" group. > > > > To unsubscribe from this group and stop receiving emails from it, send > > > > an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > To view this discussion on the web visit > > > > [https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr) > > > > [https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr?utm_medium=email&utm_source=footer) > > > > . > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > -- > > > Please update your bookmarks! We have moved to > > > [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > * * * > > > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com) > > [https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com?utm_medium=email&utm_source=footer) > > . > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/91f7509c-2cc8-4d57-8fac-f271c27fd75f%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/91f7509c-2cc8-4d57-8fac-f271c27fd75f%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [May 29, 2015, 4:56am UTC](https://discuss.elastic.co/t/where-is-elasticsearch-storing-data/23698/8 "2015-05-29T04:56:34Z")
To answer to the initial question, I would not really worry about having acces to the data dir. There are APIs for that. Nodes Stats and Nodes Info should give you all metrics you need. Snapshot and restore should help for backups. HTH David > Le 29 mai 2015 à 03:04, Jim Malone [malonej7@gmail.com](mailto:malonej7@gmail.com) a écrit : > > Thank you, that little query is very helpful. Although there isn't any actual "data" property anywhere in the response. I'm guessing it's cause our data is still just cached, and it appears to be in the "home" directory. Now we just have to figure out how to set the data dir using es-yarn so that it's stored on the local nodes permanently. Haven't had luck finding that yet. > > And I will use the new forum going forward, just wanted to continue on this thread instead of starting a new one. > > Jim > > > On Thursday, May 28, 2015 at 6:10:49 PM UTC-4, Mark Walkom wrote: > > If you query "\_nodes?pretty | grep data" you will see a value, that's where the data is. > > > > PS - We're moving to [https://discuss.elastic.co/](https://discuss.elastic.co/), please join us there for any future discussions! > > > > > On 29 May 2015 at 00:31, Jim Malone [malo...@gmail.com](mailto:malo...@gmail.com) wrote: > > > I similarly can't find where the data is stored. We have it running with ES-yarn though. This article says that the data is only stored in container storage by default (we haven't changed any settings): > > > > > > [https://www.elastic.co/guide/en/elasticsearch/hadoop/master/ey-setup.html](https://www.elastic.co/guide/en/elasticsearch/hadoop/master/ey-setup.html) > > > > > > However, the data is definitely persisting somehow between restarts so it has to be stored somewhere. We just can't find where. There is no "path.data" dir and also there's no "/var/lib/elasticsearch/data" dir like I've seen on other posts. And we can't find it in hdfs either. > > > > > > So can anyone please point me to where we might be able to find the data? If it helps, we are loading indexes from both hive and from logstash directly. > > > > > > Thanks, > > > Jim > > > > > > > On Wednesday, May 27, 2015 at 6:56:54 PM UTC-4, Mark Walkom wrote: > > > > Check out [Configure Elasticsearch | Elastic Docs](https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-dir-layout.html) > > > > > > > > PS - We're moving to [https://discuss.elastic.co/](https://discuss.elastic.co/), please join us there for any future discussions! > > > > > > > > > On 28 May 2015 at 01:27, David Pilato [da...@pilato.fr](mailto:da...@pilato.fr) wrote: > > > > > by default in path.data dir. > > > > > In zip or tar.gz distribution, it’s in "data" dir > > > > > > > > > > -- > > > > > David Pilato - Developer | Evangelist > > > > > [elastic.co](http://elastic.co) > > > > > @dadoonet | @elasticsearchfr | @scrutmydocs > > > > > > > > > > > Le 27 mai 2015 à 17:25, John Adams [jada...@gmail.com](mailto:jada...@gmail.com) a écrit : > > > > > > > > > > > > I cannot find any info on where Elasticsearch is storing it's data. > > > > > > I would like to manage this potentially valuable information. > > > > > > Where, how big, how to back it up, restore it, etc. > > > > > > Then on to clusters, etc.. > > > > > > > > > > > > Thanks, > > > > > > John > > > > > > > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > > > > > > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > > > > > > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/4893b923-dbf2-45c3-a0e3-63c6d0b37b1c%40googlegroups.com). > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > > > > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > > > > > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > > > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/4836BD52-F0A0-4507-BE1D-14E3CA4B0FD7%40pilato.fr). > > > > > > > > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > > > > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > > > > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com). > > > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/bc0ad06d-21b3-4ca7-aade-876f15b379a3%40googlegroups.com). > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). > > ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) > > You received this message because you are subscribed to the Google Groups "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/91f7509c-2cc8-4d57-8fac-f271c27fd75f%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/91f7509c-2cc8-4d57-8fac-f271c27fd75f%40googlegroups.com). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ## -- Please update your bookmarks! We have moved to [https://discuss.elastic.co/](https://discuss.elastic.co/) You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/8664DEDC-87EE-4304-AED1-27E10FE5E78E%40pilato.fr](https://groups.google.com/d/msgid/elasticsearch/8664DEDC-87EE-4304-AED1-27E10FE5E78E%40pilato.fr). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 12:10am UTC](https://discuss.elastic.co/t/where-is-elasticsearch-storing-data/23698/9 "2017-07-06T00:10:56Z")