Hi, I am trying to write a PySpark RDD into Elasticsearch, however I am getting the GregorianCalendar error. Any suggestions or help would be appreciated. es_fault_df = sqlContext.sql("select * from fault_search_all limit 10") es_fault_rdd = es_fault_df.rdd.map(lambda item: ('key', {'objid': item[…

Caused by: org.apache.spark.SparkException: Data of type java.util.GregorianCalendar cannot be used

system (system) Closed September 11, 2019, 7:25pm 3

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Data of type java.util.GregorianCalendar cannot be used Elasticsearch	1	1782	August 15, 2017
Cannot Read Elasticsearch date type with format basic_date_time in Spark Elasticsearch	4	1589	July 6, 2017
Spark SQL types are not handled through basic RDD saveToEs() calls Elasticsearch es-hadoop	2	3280	December 16, 2016
Save Spark Dataframe into ES - Can't handle type exception Elasticsearch es-hadoop	25	8598	July 6, 2017
Cannot find mapping for spark/test-1463342115226 - one is required before using Spark SQL Elasticsearch es-hadoop	7	5017	July 6, 2017