ElasticSearch store Index data externally

Elastic Stack Elasticsearch
1

Hello,

I've been using ElasticSearch last few months, and due to specifications of one project I have one doubt about configuration.

It's possible to set the path of the index data in the file "elasticsearch.yml".

My question is about the possibility to store the Index Data in external server.

  • To have ElasticSearch installed on Server1
  • To have the index data stored in Server2
  • ElasticSearch installed only in Server1

I know this wouldn't be optimal but some projects hasn't too much queries to ES, so I would like to separate the data from the server where the site is installed.

Is this possible ??

I'm thinking about NFS folder or SSHFS...

Sorry for my english

2

Hello ,

path.data: /path/to/data

You can use this variable in elasticsearch.yml to set the path of data
storage

If you can mount the disk space of server2 on server1 via network , that
might do the trick.

Thanks
Vineeth

On Tue, Sep 2, 2014 at 3:34 PM, a.aneiros alvaroaneirosveiga@gmail.com
wrote:

Hello,

I've been using Elasticsearch last few months, and due to specifications of
one project I have one doubt about configuration.

It's possible to set the path of the index data in the file
"elasticsearch.yml".

My question is about the possibility to store the Index Data in external
server.

  • To have Elasticsearch installed on Server1
  • To have the index data stored in Server2
  • Elasticsearch installed only in Server1

I know this wouldn't be optimal but some projects hasn't too much queries
to
ES, so I would like to separate the data from the server where the site is
installed.

Is this possible ??

Sorry for my english

I know that I know nothing.

View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/ElasticSearch-store-Index-data-externally-tp4062812.html
Sent from the Elasticsearch Users mailing list archive at Nabble.com.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/1409652291329-4062812.post%40n3.nabble.com
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGdPd5kcWJweReJJ3RS-yiU-geFqmtm%2Bp5JE%2BJT7H5Ymn9y8Ew%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

3

Hi, you need to create a shared file system. So that the data path of
server2 is accessible from server1 and then provide that data path inside
elasticsearch.yml file.
When you will create a shared file system the data directory of server2
will be seems like it is existing on server1 itself.

Regards,
Bharvi

On Wednesday, 3 September 2014 16:01:46 UTC+5:30, Alvaro Aneiros Veiga
wrote:

Hello,

I've been using Elasticsearch last few months, and due to specifications
of
one project I have one doubt about configuration.

It's possible to set the path of the index data in the file
"elasticsearch.yml".

My question is about the possibility to store the Index Data in external
server.

  • To have Elasticsearch installed on Server1
  • To have the index data stored in Server2
  • Elasticsearch installed only in Server1

I know this wouldn't be optimal but some projects hasn't too much queries
to
ES, so I would like to separate the data from the server where the site is
installed.

Is this possible ??

Sorry for my english

I know that I know nothing.

View this message in context:
http://elasticsearch-users.115913.n3.nabble.com/ElasticSearch-store-Index-data-externally-tp4062812.html
Sent from the Elasticsearch Users mailing list archive at Nabble.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/97086185-3037-4c26-8def-8c974ae2eb88%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

4

Thanks for your answers,

Yesterday I built a NFS folder, and set the ElasticSearch index path to this NFS folder, so when I create an index and add data to it, ElasticSearch stores the information in this NFS folder (so the information is stored in a external server) but the speed is not the best (something I was counting on).

Is there a better solution to do this ?

5

Why do you want to separate data and elasticsearch process?

--
David :wink:
Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs

Le 4 sept. 2014 à 12:47, "a.aneiros" alvaroaneirosveiga@gmail.com a écrit :

Thanks for your answers,

Yesterday I built a NFS folder, and set the ElasticSearch index path to this
NFS folder, so when I create an index and add data to it, ElasticSearch
stores the information in this NFS folder (so the information is stored in a
external server) but the speed is not the best (something I was counting
on).

Is there a better solution to do this ?

I know that I know nothing.

View this message in context: http://elasticsearch-users.115913.n3.nabble.com/ElasticSearch-store-Index-data-externally-tp4062812p4062989.html
Sent from the ElasticSearch Users mailing list archive at Nabble.com.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/1409827650662-4062989.post%40n3.nabble.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8A90BA25-17E9-4318-AADB-700051CB0AA0%40pilato.fr.
For more options, visit https://groups.google.com/d/optout.

6

This is because in one project I'm going to have 1 "main" index, wich are going to be in the same place that elasticsearch, but there are some other indices (less important and less used) and these indices are going to be used like 1 time per week or less, so I don't need this indices to be "optimal" and I need to save the data for this indices in an external server to save some disk space.