Elasticsearch for Sensitive Data (Bank Data)


(vijuitech) #1

Hi,

Can Elasticsearch can be used for the following use cases in Bank Scenario,

  1. Money Transactions.

  2. Handling Bank related information.

Please Explain why it can/cannot be used?

Thanks,
George

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/c18a2797-3834-4587-b161-f30231df24c6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


(Mark Walkom) #2

That'd be hard to answer as it'd depend on what laws are involved.

Regards,
Mark Walkom

Infrastructure Engineer
Campaign Monitor
email: markw@campaignmonitor.com
web: www.campaignmonitor.com

On 10 July 2014 20:40, George Viju vijuitech@gmail.com wrote:

Hi,

Can Elasticsearch can be used for the following use cases in Bank Scenario,

  1. Money Transactions.

  2. Handling Bank related information.

Please Explain why it can/cannot be used?

Thanks,
George

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/c18a2797-3834-4587-b161-f30231df24c6%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/c18a2797-3834-4587-b161-f30231df24c6%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624ZpBWQFLneVwS59kWSNCUS4nch70AJ8tcN%3DqKaH3XyULg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Jörg Prante) #3

You will have to implement transactions by yourself, using the document
versioning of Elasticsearch.

Also you will have to take care for rounding in currency amounts.
BigDecimal is used for that but the Elasticsearch support for this data
type is not complete yet.

Guarding Elasticsearch from public access is taken for granted, you will
have to set up private subnets for your cluster and enforce security
policies to your data center.

Jörg

On Thu, Jul 10, 2014 at 12:40 PM, George Viju vijuitech@gmail.com wrote:

Hi,

Can Elasticsearch can be used for the following use cases in Bank Scenario,

  1. Money Transactions.

  2. Handling Bank related information.

Please Explain why it can/cannot be used?

Thanks,
George

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/c18a2797-3834-4587-b161-f30231df24c6%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/c18a2797-3834-4587-b161-f30231df24c6%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHN%3D6dvAdai0naa9357biYDjN_OxseyXd3Y7j5d2rKWqw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Nik Everett) #4

Depending on the laws some data can't ever be sent in clear text and has to
live encrypted on the disk. Elasticsearch's intra-node protocol isn't
encrypted and it doesn't have an option to encrypt the data that it
writes. I imagine it could live just fine on an encrypted volume. I
dunno, I bet you could get it legal but it'd be a project.

Anyway, there are more issues then BigDecimal support, I think.

Nik

On Thu, Jul 10, 2014 at 9:57 AM, joergprante@gmail.com <
joergprante@gmail.com> wrote:

You will have to implement transactions by yourself, using the document
versioning of Elasticsearch.

Also you will have to take care for rounding in currency amounts.
BigDecimal is used for that but the Elasticsearch support for this data
type is not complete yet.

Guarding Elasticsearch from public access is taken for granted, you will
have to set up private subnets for your cluster and enforce security
policies to your data center.

Jörg

On Thu, Jul 10, 2014 at 12:40 PM, George Viju vijuitech@gmail.com wrote:

Hi,

Can Elasticsearch can be used for the following use cases in Bank
Scenario,

  1. Money Transactions.

  2. Handling Bank related information.

Please Explain why it can/cannot be used?

Thanks,
George

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/c18a2797-3834-4587-b161-f30231df24c6%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/c18a2797-3834-4587-b161-f30231df24c6%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHN%3D6dvAdai0naa9357biYDjN_OxseyXd3Y7j5d2rKWqw%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHN%3D6dvAdai0naa9357biYDjN_OxseyXd3Y7j5d2rKWqw%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd1OA9epjGcTSfC_dJyP%3D_2ANqOWxYFH0ZEyURai-v-G3g%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(Jörg Prante) #5

Can you give more details about what are the issues in ES in relation to
financial applications?

Do you think of audit trails? I forgot to mention, yes. That is an issue
which I want to address with a plugin that wraps the existing transport
layer.

Thanks,

Jörg

On Thu, Jul 10, 2014 at 4:04 PM, Nikolas Everett nik9000@gmail.com wrote:

Depending on the laws some data can't ever be sent in clear text and has
to live encrypted on the disk. Elasticsearch's intra-node protocol isn't
encrypted and it doesn't have an option to encrypt the data that it
writes. I imagine it could live just fine on an encrypted volume. I
dunno, I bet you could get it legal but it'd be a project.

Anyway, there are more issues then BigDecimal support, I think.

Nik

On Thu, Jul 10, 2014 at 9:57 AM, joergprante@gmail.com <
joergprante@gmail.com> wrote:

You will have to implement transactions by yourself, using the document
versioning of Elasticsearch.

Also you will have to take care for rounding in currency amounts.
BigDecimal is used for that but the Elasticsearch support for this data
type is not complete yet.

Guarding Elasticsearch from public access is taken for granted, you will
have to set up private subnets for your cluster and enforce security
policies to your data center.

Jörg

On Thu, Jul 10, 2014 at 12:40 PM, George Viju vijuitech@gmail.com
wrote:

Hi,

Can Elasticsearch can be used for the following use cases in Bank
Scenario,

  1. Money Transactions.

  2. Handling Bank related information.

Please Explain why it can/cannot be used?

Thanks,
George

--
You received this message because you are subscribed to the Google
Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/c18a2797-3834-4587-b161-f30231df24c6%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/c18a2797-3834-4587-b161-f30231df24c6%40googlegroups.com?utm_medium=email&utm_source=footer
.
For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHN%3D6dvAdai0naa9357biYDjN_OxseyXd3Y7j5d2rKWqw%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHN%3D6dvAdai0naa9357biYDjN_OxseyXd3Y7j5d2rKWqw%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/CAPmjWd1OA9epjGcTSfC_dJyP%3D_2ANqOWxYFH0ZEyURai-v-G3g%40mail.gmail.com
https://groups.google.com/d/msgid/elasticsearch/CAPmjWd1OA9epjGcTSfC_dJyP%3D_2ANqOWxYFH0ZEyURai-v-G3g%40mail.gmail.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHEEvpjtCKNxpb6MRa0K8XMmR8vS_EuMo3u12ryvnVaCA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


(system) #6