How to use ElasticSearch hadoop connector to create type automatically from Streaming DataSet ? I have the following code. df .writeStream() .outputMode("append") .trigger(Trigger.ProcessingTime(1000)) .format("org.elasticsearch.spark.sql") .option("checkpoi…

How to use ElasticSearch hadoop connector to create type automatically from Streaming DataSet<Row>?

BicaLuv January 24, 2018, 8:10am 4

Can you please post the printSchema output of your transformation result?
( you have to change the reading from streaming to regular style to do this)

Topic		Replies	Views
(apache spark df).saveToES(elastic search) Elasticsearch es-hadoop	3	2079	March 26, 2017
Write RDD/DF to Index with no type Elasticsearch es-hadoop	1	1149	November 9, 2017
Mapper_parsing_exception: failed to parse ( Dataframe to Elastic - batch process) Elasticsearch	1	856	September 22, 2022
Loading JSON documents to elasticsearch via es-spark connector Elasticsearch es-hadoop	5	1541	August 22, 2018
Elasticsearch and spark Elasticsearch	7	1183	July 6, 2017

How to use ElasticSearch hadoop connector to create type automatically from Streaming DataSet<Row>?

Related topics