How Does Elasticsearch Store Data?

Elastic Stack Elasticsearch
1

I'm running Logstash with Redis, Kibana, and Elasticsearch.

All is working well. But when I look in the configured location for data,
as set in the elasticsearch.yml file I see nothing. The directory is empty.

But I can see my data in Kibana and view it in Redis.

So where is Elasticsearch hiding it?

My config setting is: path.data: /var/lib/elasticsearch

...which is empty.

As I understand it Elasticsearch relies on Lucene which I thought stored
data in flat files. If this is the case where are these files?

I need to know this so I can adequately plan storage.

Thanks.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/7fe3bfb6-869f-42fa-9d84-de8238c78019%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

I'm new to Elasticsearch and recently started playing around with version
1.0.1. Just saw your question and noticed that the data files at

/data//nodes/0/indices//0/index/segment_1

Note that lucene data is stored in segments.

On Mon, Mar 10, 2014 at 4:47 PM, Marcus Young marcusdyoung@gmail.comwrote:

I'm running Logstash with Redis, Kibana, and Elasticsearch.

All is working well. But when I look in the configured location for data,
as set in the elasticsearch.yml file I see nothing. The directory is empty.

But I can see my data in Kibana and view it in Redis.

So where is Elasticsearch hiding it?

My config setting is: path.data: /var/lib/elasticsearch

...which is empty.

As I understand it Elasticsearch relies on Lucene which I thought stored
data in flat files. If this is the case where are these files?

I need to know this so I can adequately plan storage.

Thanks.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/7fe3bfb6-869f-42fa-9d84-de8238c78019%40googlegroups.comhttps://groups.google.com/d/msgid/elasticsearch/7fe3bfb6-869f-42fa-9d84-de8238c78019%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CA%2BpvUGXEzAuD3UV5R5bVXRcuWQzn%2BuYRUy1g2e2wiYTugeUsmg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

Hi Marcus,

You can find out where the data is by calling the nodes stats api and
looking a the fs.data section. Assuming you are running 1.0 this will be:

curl -XGET "http://localhost:9200/_nodes/stats/fs"

And yes, ES stores the data in lucene.

Cheers,
Boaz

On Tuesday, March 11, 2014 12:47:09 AM UTC+1, Marcus Young wrote:

I'm running Logstash with Redis, Kibana, and Elasticsearch.

All is working well. But when I look in the configured location for data,
as set in the elasticsearch.yml file I see nothing. The directory is empty.

But I can see my data in Kibana and view it in Redis.

So where is Elasticsearch hiding it?

My config setting is: path.data: /var/lib/elasticsearch

...which is empty.

As I understand it Elasticsearch relies on Lucene which I thought stored
data in flat files. If this is the case where are these files?

I need to know this so I can adequately plan storage.

Thanks.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/190cba30-874b-4f81-b6dd-005907781fa6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.