Elasticsearch - spark field name

[kdh6429 (Dh)]

No one knows about this?

Continuing the discussion from Elasitcsearch-spark field name:

@kdh6429

I'm generating es data with spark like below code

myParentRdd.saveToEs( Map( "es.mapping.id" -> "oid", "es.mapping.join" -> "pd_join"))
myChildRdd.saveToEs( Map( "es.mapping.join" -> "pd_join"))

This code works well but there is some deprecated logs.

Deprecated field [_routing] used, expected [routing] instead
Deprecated field [_parent] used, expected [parent] instead

Any idea with this log?

I'm using Elastics Search 6.2.2 with below libraries

compile group: 'org.elasticsearch', name: 'elasticsearch-spark-20_2.11', version: '6.2.2'
compile group: 'org.scala-lang', name: 'scala-library', version: '2.11.8'
compile group: 'org.apache.spark', name: 'spark-core_2.11', version: '2.1.2'

[james.baiera]

Hi @kdh6429 sorry that your post slipped under the radar. I've not had a chance to check in on the forums for a bit.

Those document metadata names should still be functional until 7.0 is released. There is already code checked in to the master branch to switch those field names in a backwards compatible manner when 7.0 goes live.