Streaming Sink doesnt work without checkpoint?

Streaming sink with commit log disabled still throws the exception , any reason why it looks for checkpointlocation when i have option set not to use checkpoint ? :frowning:

org.apache.spark.sql.AnalysisException: checkpointLocation must be specified either through option("checkpointLocation", ...) or SparkSession.conf.set("spark.sql.streaming.checkpointLocation", ...);

.option("es.resource", "document")
.option("es.nodes", "")
.option("es.write.operation", "upsert")

using databricks 5.2 with Spark 2.4.0 , Scala 2.11 and elasticsearch_spark_20_2_11_6_6_1.jar

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.