ES hadoop spark connector having a issue with nested json

Elastic Stack Elasticsearch
1

org.elasticsearch.hadoop.rest.EsHadoopParsingException: org.elasticsearch.hadoop.EsHadoopIllegalStateException: Position for 'contacts.phone' not found in row; typically this is caused by a mapping inconsistency

Not able to read the data...

2

Hi @Kuldeep_Pal. What version of es-hadoop are you using? I'm guessing that the problem is that es-hadoop does not currently support dots (.) in field names. Newer versions of es-hadoop (8.2.0 and above) give a better error message about this -- Documenting that we do not support dots in field names by masseyke · Pull Request #1900 · elastic/elasticsearch-hadoop · GitHub. There is an open ticket about supporting dots at Dots in field names exception · Issue #853 · elastic/elasticsearch-hadoop · GitHub.

3

So there is no way I can use the nested json or read the data from elastic? This is still open issue for newest version also , right?
@Keith_Massey

4

Nested fields are fine. The problem is with non-nested field names that actually have a . in their name. Can you post the mapping, data, and spark code to reproduce this?

6

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.