Encrypted Indices?

Parag_Shah · March 13, 2014, 12:18am

Hi all,

I know ElasticSearch does not support encrypting indices. Has anyone

built something on top of ElasticSearch or modified ElasticSearch to
achieve encrypted indices? Would like to hear stories of how it went and
how the performance is.

Thanks in advance
Parag

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/7ae652b8-50aa-4e6c-8621-ab0e867068c3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

andrew · March 13, 2014, 2:19am

Hi Parag,

I have seen a few implementations of encrypted Lucene indices, but they are largely experimental from what I can tell. There are no Elasticsearch implementations as far as I know.

If you require strong encryption your best bet is to store your Elasticsearch indices on an encrypted filesystem.

Best,
Andrew

On Mar 12, 2014, at 5:18 PM, Parag Shah parags@gmail.com wrote:

Hi all,
I know ElasticSearch does not support encrypting indices. Has anyone built something on top of ElasticSearch or modified ElasticSearch to achieve encrypted indices? Would like to hear stories of how it went and how the performance is.
Thanks in advance
Parag

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/7ae652b8-50aa-4e6c-8621-ab0e867068c3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/5EE4D14D-38EB-4745-8904-38A65DC819CB%40elasticsearch.com.
For more options, visit https://groups.google.com/d/optout.

Ivan · March 13, 2014, 5:03am

If you stick to non-analyzed term queries, you can always encrypt your data
before it is index and then encrypt the query terms that are to be matched.
The hashes of the terms will match, but if you use one-way hashing, the
original data representation cannot be recovered. Somewhat kludgy and the
burden of maintaining the hash key is now simply at another layer.

--
Ivan

On Wed, Mar 12, 2014 at 7:19 PM, Andrew Selden <
andrew.selden@elasticsearch.com> wrote:

Hi Parag,

I have seen a few implementations of encrypted Lucene indices, but they
are largely experimental from what I can tell. There are no Elasticsearch
implementations as far as I know.

If you require strong encryption your best bet is to store your
Elasticsearch indices on an encrypted filesystem.

Best,
Andrew

On Mar 12, 2014, at 5:18 PM, Parag Shah parags@gmail.com wrote:

Hi all,
I know ElasticSearch does not support encrypting indices. Has anyone
built something on top of Elasticsearch or modified Elasticsearch to
achieve encrypted indices? Would like to hear stories of how it went and
how the performance is.

Thanks in advance
Parag

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/7ae652b8-50aa-4e6c-8621-ab0e867068c3%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/7ae652b8-50aa-4e6c-8621-ab0e867068c3%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/5EE4D14D-38EB-4745-8904-38A65DC819CB%40elasticsearch.com https://groups.google.com/d/msgid/elasticsearch/5EE4D14D-38EB-4745-8904-38A65DC819CB%40elasticsearch.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQBz_9%2B5pYjEP1S_nx8nGgOr_KTMUMwMjQ5vW4RdEqPaJQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

jprante · March 13, 2014, 7:09am

Use Linux Disk encryption (LUKS) and trusted computers for encrypting files.

Block device encryption is outside the scope of Lucene.

Jörg

On Thu, Mar 13, 2014 at 6:03 AM, Ivan Brusic ivan@brusic.com wrote:

If you stick to non-analyzed term queries, you can always encrypt your
data before it is index and then encrypt the query terms that are to be
matched. The hashes of the terms will match, but if you use one-way
hashing, the original data representation cannot be recovered. Somewhat
kludgy and the burden of maintaining the hash key is now simply at another
layer.

--
Ivan

On Wed, Mar 12, 2014 at 7:19 PM, Andrew Selden <
andrew.selden@elasticsearch.com> wrote:
Hi Parag,

I have seen a few implementations of encrypted Lucene indices, but they
are largely experimental from what I can tell. There are no Elasticsearch
implementations as far as I know.

If you require strong encryption your best bet is to store your
Elasticsearch indices on an encrypted filesystem.

Best,
Andrew

On Mar 12, 2014, at 5:18 PM, Parag Shah parags@gmail.com wrote:

Hi all,
I know ElasticSearch does not support encrypting indices. Has anyone
built something on top of Elasticsearch or modified Elasticsearch to
achieve encrypted indices? Would like to hear stories of how it went and
how the performance is.

Thanks in advance
Parag

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/7ae652b8-50aa-4e6c-8621-ab0e867068c3%40googlegroups.com https://groups.google.com/d/msgid/elasticsearch/7ae652b8-50aa-4e6c-8621-ab0e867068c3%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/5EE4D14D-38EB-4745-8904-38A65DC819CB%40elasticsearch.com https://groups.google.com/d/msgid/elasticsearch/5EE4D14D-38EB-4745-8904-38A65DC819CB%40elasticsearch.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQBz_9%2B5pYjEP1S_nx8nGgOr_KTMUMwMjQ5vW4RdEqPaJQ%40mail.gmail.com https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQBz_9%2B5pYjEP1S_nx8nGgOr_KTMUMwMjQ5vW4RdEqPaJQ%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHFS2HaOM31%3DO2F6jXFDG%3DjhobzYhFU3LBNRwOox3eGVQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.