I am using spark streaming to dump data from Kafka to ES and I got the following errors. org.apache.spark.sql.streaming.StreamingQueryException: Job aborted due to stage failure: Task 6 in stage 4888.0 failed 4 times, most recent failure: Lost task 6.3 in stage 4888.0 (TID 58565, 10.139.64.27, exe…

How to avoid Data too large error for org.apache.spark.sql.streaming.StreamingQueryException

system (system) Closed August 14, 2019, 5:57am 4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
ES Spark Connector - Circuit Breaker error Elasticsearch es-hadoop	3	1280	July 30, 2019
EsSparkSQL.saveToEs() CircuitBreakingException: [parent] Data too large, data for [<transport_request>] Elasticsearch es-hadoop	1	1085	January 15, 2020
Data too large, data for [<transport_request>] - CircuitBreakingException Elasticsearch es-hadoop	1	1275	July 2, 2020
Spark structured streaming Elasticsearch integration issue Elasticsearch es-hadoop	2	877	July 11, 2019
Circuit_breaking_exception [parent] Data too large, data for [<http_request>] Elasticsearch es-hadoop	1	2309	July 29, 2020