# Error while indexing list to Elastic search using pyspark
**URL:** https://discuss.elastic.co/t/error-while-indexing-list-to-elastic-search-using-pyspark/115715
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [January 16, 2018, 1:00pm UTC](https://discuss.elastic.co/t/error-while-indexing-list-to-elastic-search-using-pyspark/115715 "2018-01-16T13:00:12Z")
**Posts on this page:** 5
**Page:** 1
### Author:  [@Ravi\_Ranjan](https://discuss.elastic.co/u/Ravi_Ranjan)
#### Post date: [January 16, 2018, 1:00pm UTC](https://discuss.elastic.co/t/error-while-indexing-list-to-elastic-search-using-pyspark/115715/1 "2018-01-16T13:00:13Z")
Hi, we are facing an issue while reading a bson file as pyspark and then indexing it in ES.
The error is regarding the type of certain keys in the bson file which is an array. The error is as follows:
Data of type java.util.ArrayList cannot be used.
There is an answer to similar problem which is not helpful. The link is given below
> [@Pyspark write list type to ES](https://discuss.elastic.co/t/pyspark-write-list-type-to-es/43944):
>
> I'm attempting to write data to elasticsearch using pyspark. I can successfully write using the "saveAsNewAPIHadoopFile" api for most cases, however, when one of the json objects is a list, it throws an error: SparkException: Data of type java.util.ArrayList cannot be used ES can ingest lists via other means, and it is a bit cumbersome to transform my list to another state. Any advice would be useful. For refference, I am using ElasticSearch 1.7.3 Spark 1.5.0-cdh5.5.1, Hadoop 2.6.0-cdh5.…
How to get rid of this?
---
### Author:  [@james.baiera](https://discuss.elastic.co/u/james.baiera)
#### Post date: [January 29, 2018, 4:40am UTC](https://discuss.elastic.co/t/error-while-indexing-list-to-elastic-search-using-pyspark/115715/2 "2018-01-29T04:40:17Z")
Could you share the full stack trace?
---
### Author:  [@Ravi\_Ranjan](https://discuss.elastic.co/u/Ravi_Ranjan)
#### Post date: [January 29, 2018, 5:38am UTC](https://discuss.elastic.co/t/error-while-indexing-list-to-elastic-search-using-pyspark/115715/3 "2018-01-29T05:38:11Z")
Solved the issue. The error was with spark not being able to handle arrayList type. So i converted all the arraylists in my data to tuple which worked.
---
### Author:  [@james.baiera](https://discuss.elastic.co/u/james.baiera)
#### Post date: [January 29, 2018, 5:39am UTC](https://discuss.elastic.co/t/error-while-indexing-list-to-elastic-search-using-pyspark/115715/4 "2018-01-29T05:39:02Z")
Great to hear, cheers!
---
### Author:  [@system](https://discuss.elastic.co/u/system)
#### Post date: [February 26, 2018, 5:39am UTC](https://discuss.elastic.co/t/error-while-indexing-list-to-elastic-search-using-pyspark/115715/5 "2018-02-26T05:39:31Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.