# Java.lang.ClassCastException: scala.collection.Iterator$$anon$11 cannot be cast to scala.Tuple2

**URL:** <https://discuss.elastic.co/t/java-lang-classcastexception-scala-collection-iterator-anon-11-cannot-be-cast-to-scala-tuple2/26103>\
**Category:** Elasticsearch\
**Tags:** es-hadoop\
**Created:** [July 22, 2015, 6:06pm UTC](https://discuss.elastic.co/t/java-lang-classcastexception-scala-collection-iterator-anon-11-cannot-be-cast-to-scala-tuple2/26103 "2015-07-22T18:06:53Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Philip\_K\_Adetiloye](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/philip_k_adetiloye/32/14386_2.png) [@Philip\_K\_Adetiloye](https://discuss.elastic.co/u/Philip_K_Adetiloye)\
**Post date:** [July 22, 2015, 6:06pm UTC](https://discuss.elastic.co/t/java-lang-classcastexception-scala-collection-iterator-anon-11-cannot-be-cast-to-scala-tuple2/26103/1 "2015-07-22T18:06:53Z")

</div>

I am having trouble running my job on my spark Cluster.  
Each time I ran the job, I keep getting this error:

```auto

Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Task 3 in stage 0.0 failed 4 times, most recent failure: Lost task
 3.3 in stage 0.0 (TID 12, 10.0.0.207): java.lang.ClassCastException: scala.coll
ection.Iterator$$anon$11 cannot be cast to scala.Tuple2
        at org.apache.spark.sql.DataFrame$$anonfun$33.apply(DataFrame.scala:1189
)
        at org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1$$anonfun$apply$17.a
pply(RDD.scala:686)
        at org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1$$anonfun$apply$17.a
pply(RDD.scala:686)
        at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:
35)
 

```

Here is my code:

````auto

public static void main(String[] args) 
       throws UnsupportedEncodingException, FileNotFoundException, IOException 
{
int cpus = 30;		
SparkConf sparkConf = new SparkConf(true).setAppName("SparkQueryApp").setMaster("spark://10.0.0.206:7077").set("es.nodes", "10.0.0.207").set("es.nodes.discovery", "false").set("es.cluster", "es-dev").set("es.scroll.size", "5000").setJars(JavaSparkContext.jarOfClass(Demo.class)).set("spark.serializer", "org.apache.spark.serializer.KryoSerializer").set("spark.default.parallelism", String.valueOf(cpus * 2)).set("spark.logConf", "true");
				 

		SparkContext sparkCtx = new SparkContext(sparkConf);		
		SQLContext sqlContext = new SQLContext(sparkCtx);
	
		DataFrame df = JavaEsSparkSQL.esDF(sqlContext, "rt-logs/test");
		
		df.registerTempTable("Log");
		
		
		DataFrame sqlDFTest = sqlContext.sql("SELECT created, count(instances) FROM Log where id = 100000 group by instances");

		List<String> results = sqlDFTest.javaRDD().map(new Function<Row, String>(){

			static final long serialVersionUID = 1L;

			@Override
			public String call(Row row) throws Exception {					
				return "Created" + row.getString(0) + " Count " + row.getInt(1);
			}				
		}).collect();
		
		try (Writer writer = new BufferedWriter(new OutputStreamWriter(new FileOutputStream("result3.txt"), "utf-8"))) {
			
			for (String row : results) {				
				writer.write(row);
			}
			
			writer.write(sqlDFTest.first().toString());
		}
	}

```

Any help please ?
````

---

<div class="post-metadata">

**Author:** ![Philip\_K\_Adetiloye](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/philip_k_adetiloye/32/14386_2.png) [@Philip\_K\_Adetiloye](https://discuss.elastic.co/u/Philip_K_Adetiloye)\
**Post date:** [July 23, 2015, 6:44pm UTC](https://discuss.elastic.co/t/java-lang-classcastexception-scala-collection-iterator-anon-11-cannot-be-cast-to-scala-tuple2/26103/2 "2015-07-23T18:44:17Z")

</div>

I found out the problem....basically I was running Spark 1.4.1 while my maven dependency was using 1.4.0.

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [July 25, 2015, 11:35am UTC](https://discuss.elastic.co/t/java-lang-classcastexception-scala-collection-iterator-anon-11-cannot-be-cast-to-scala-tuple2/26103/3 "2015-07-25T11:35:28Z")

</div>

Looks like you have a configuration mismatch between your compile code and your deployment; likely a Spark version mismatch.

---

<div class="post-metadata">

**Author:** ![costin](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/costin/32/44950_2.png) [@costin](https://discuss.elastic.co/u/costin)\
**Post date:** [July 25, 2015, 11:35am UTC](https://discuss.elastic.co/t/java-lang-classcastexception-scala-collection-iterator-anon-11-cannot-be-cast-to-scala-tuple2/26103/4 "2015-07-25T11:35:51Z")

</div>

Doh, just saw your reply ...

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 1:27pm UTC](https://discuss.elastic.co/t/java-lang-classcastexception-scala-collection-iterator-anon-11-cannot-be-cast-to-scala-tuple2/26103/5 "2017-07-06T13:27:50Z")

</div>