I tried to insert 580 docs(~2MB size) to es but I got this message,
when i tried to decrease the number of docs to 50 the job success.
I am working with one spark partition, tried to tweak the batch size and the batch entries,
but didn't succeed to overcome this...
I also succeeded to connect to the es nodes from spark.
org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException: Connection error (check network and/or proxy settings)- all nodes failed;[nodes with ip and port]
4 nodes of spark and elastic (4 cores 24GB, elastic heap size 2GB)