Streaming sink with commit log disabled still throws the exception , any reason why it looks for checkpointlocation when i have option set not to use checkpoint ?
org.apache.spark.sql.AnalysisException: checkpointLocation must be specified either through option("checkpointLocation", ...) or SparkSession.conf.set("spark.sql.streaming.checkpointLocation", ...);
df.writeStream
.format("org.elasticsearch.spark.sql")
.option("es.resource", "document")
.option("es.mapping.id","id")
.option("es.spark.sql.streaming.sink.log.enabled",false)
.option("es.index.auto.create","no")
.option("es.nodes", "")
.option("es.write.operation", "upsert")
.outputMode("append")
.start("document")