String type field data encrypted in ES 2.3.5/2.3.1

Elastic Stack Elasticsearch
1

Recently I have built two node cluster with ES 2.3.5 and created index and loaded data which went file.
However I have noticed String data loaded as encrypted. While searching also I am seeing data as encrypted.

while searching also string data populated as encrypted.

_id": "17",
"_score": 1,
"_source": {
"reportkey": 2532,
"thiswksrank": 17,
"peakposition": 17,
"weeksonchart": 1,
"labelabbreviation": "SU5ERVBFTkRFTlQgTEFCRUwgU1VCTUlTU0lPTnxBdGxhbnRpYyBHcm91cHxBcnRpc3QgUGFydG5lciBHcm91cHxBVExBTlRJQw==",
"genre": "UG9w",
"twtotalvolume": 76865,
"changetotalvolume": "LTMzLjE=",
"lwtotalvolume": 114932,
"thiswkssales": 62726,
"changesongsales": "LTM4Ljg=",
"twondemandaudiostreams": 2120977,
"changeaudioodstreams": "MTQuMQ==",
"enm": "T25lIENhbGwgQXdheQ==",
"upid": 305176,
"pnm": "Q2hhcmxpZSBQdXRo",
"upnm": "Q2hhcmxpZSBQdXRo",
"weekid": 201601

I am wondering how to turn this off ? Any help would be greatly appreciable.

Thanks,

2

ES doesn't encrypt fields.
Either the data is coming in to ES like this or some sort of plugin is doing it.

3

Hi Warkolm,

My ES cluster has only head plugin installed so far. we are using spark to load data which was working fine with ES 1.7 cluster and same spark job with updated elasticsearch-hadoop(2.3.4) jar used to loaded data in ES 2.3.5 cluster. During spark job runtime I have been seeing following log snippet which I am not sure anyway related to issue I am having...

16/08/23 11:00:19 INFO metadata.Hive: Registering function md5hash
16/08/23 11:00:19 INFO metadata.Hive: Registering function md5hash
16/08/23 11:00:19 INFO metadata.Hive: Registering function decrypt
16/08/23 11:00:19 INFO metadata.Hive: Registering function md5hash
16/08/23 11:00:19 INFO metadata.Hive: Registering function md5hash
16/08/23 11:00:19 INFO metadata.Hive: Registering function decrypt
16/08/23 11:00:19 INFO metadata.Hive: Registering function md5hash
16/08/23 11:00:19 INFO metadata.Hive: Registering function decrypt
16/08/23 11:00:19 INFO metadata.Hive: Registering function md5hash

4

I have manually created an index in ES and added data through curl command. it does not encrypted data.

I am using spark job to load data using hadoop elasticsearch connector(elasticsearch-hadoop-2.3.4.jar),Not sure how data getting encrypted, any help Pl?

I had used elasticsearch-hadoop-2.1.0.jar with Elasticsearch 1.7 and see no issues.