Index JSONArray into elastcisearch

(Malini) #1


My requirement is to index a JSONArray as one of the field value into elstic search using spark...I am trying to do the following, but no luck..

   val resMap = scala.collection.mutable.Map[String,JSONArray]()
   resMap += ("tagName"->k,"objectids"->v) ( Add few rows here)
      val saveRdd = sc.parallelize(Seq(resMap))
   val esconf = Map("es.nodes" -> getConf(ELASTICSEARCH).split(":")(0), "es.port" ->            "9200","" -> "true", "" -> "tagName")


But i am getting following exception..

         org.elasticsearch.hadoop.serialization.EsHadoopSerializationException: Cannot handle type [class        org.codehaus.jettison.json.JSONArray] within type [class scala.collection.mutable.HashMap]

Any best way to index this type of data. We are using spark 1.6.2 and elasticearch 2.3.4


(Christoph) #2


Maybe this question should better be asked in the ESHadoop Forum? I think you can move it there if you like.

(system) #3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.