I'm using elasticsearch to import data from S3 to be visualized in kibana, to do this I'm using spark scala running in an EMR instance. The ES service is being started with the following command
< /usr/lib/spark/bin/spark-shell --packages org.elasticsearch:elasticsearch-spark-20_2.11:6.7.0,org.elasticsearch.client:elasticsearch-rest-high-level-client:6.7.0>
By default saveToEs() posts the data to a locahost, but i need to configure it to be sent to amazon's elastic search instance. I read I need ImmutableSettings to do so, but when trying to import it, I get the following error:
scala> import org.elasticsearch.common.settings.ImmutableSettings <console>:23: error: object ImmutableSettings is not a member of package org.elasticsearch.common.settings
I've tried importing until 'settings' and works fine, but fails with immutable settings.
Appreciate it you can help me import this or with any way to change the posting address