# Error while creating spark dataframe with elasticsearch query **URL:** \ **Category:** Elasticsearch\ **Tags:** es-hadoop\ **Created:** [January 12, 2018, 12:39pm UTC](https://discuss.elastic.co/t/error-while-creating-spark-dataframe-with-elasticsearch-query/115293 "2018-01-12T12:39:55Z")\ **Posts on this page:** 3\ **Page:** 1
**Author:** ![pavan1](https://avatars.discourse-cdn.com/v4/letter/p/2acd7d/32.png) [@pavan1](https://discuss.elastic.co/u/pavan1)\ **Post date:** [January 12, 2018, 12:39pm UTC](https://discuss.elastic.co/t/error-while-creating-spark-dataframe-with-elasticsearch-query/115293/1 "2018-01-12T12:39:55Z")
Hi, I am trying to read from elasticsearch and create a spark dataframe. I am getting following error. ERROR 2018-01-12 17:59:00,603 Executor task launch worker-1 DefaultWriterContainer:96 - Aborting task. org.elasticsearch.hadoop.rest.EsHadoopInvalidRequest: failed to parse [1.6h], fractional time values are not supported {"query":{"bool":{"must":[{"match\_all":{"boost":1.0}}],"filter":[{"terms":{"user\_id":["106616"],"boost":1.0}}],"disable\_coord":false,"adjust\_pure\_negative":true,"boost":1.0}}} at org.elasticsearch.hadoop.rest.RestClient.checkResponse(RestClient.java:505) at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:463) at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:445) at org.elasticsearch.hadoop.rest.RestRepository.scroll(RestRepository.java:365) at org.elasticsearch.hadoop.rest.ScrollQuery.hasNext(ScrollQuery.java:92) at org.elasticsearch.spark.rdd.AbstractEsRDDIterator.hasNext(AbstractEsRDDIterator.scala:61) at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327) at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:371) at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:350) at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:327) at org.apache.spark.sql.execution.datasources.DefaultWriterContainer.writeRows(WriterContainer.scala:240) at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1$$anonfun$apply$mcV$sp$3.apply(InsertIntoHadoopFsRelation.scala:150) at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1$$anonfun$apply$mcV$sp$3.apply(InsertIntoHadoopFsRelation.scala:150) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) INFO 2018-01-12 17:59:00,605 Executor task launch worker-0 InternalParquetRecordWriter:151 - Flushing mem columnStore to file. allocated memory: 0 INFO 2018-01-12 17:59:00,605 Executor task launch worker-1 InternalParquetRecordWriter:151 - Flushing mem columnStore to file. allocated memory: 0 SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See [http://www.slf4j.org/codes.html#StaticLoggerBinder](http://www.slf4j.org/codes.html#StaticLoggerBinder) for further details. ERROR 2018-01-12 17:59:00,662 Executor task launch worker-1 DefaultWriterContainer:75 - Task attempt attempt\_201801121758\_0000\_m\_000001\_0 aborted. ERROR 2018-01-12 17:59:00,662 Executor task launch worker-0 DefaultWriterContainer:75 - Task attempt attempt\_201801121758\_0000\_m\_000000\_0 aborted. ERROR 2018-01-12 17:59:00,667 Executor task launch worker-1 Executor:96 - Exception in task 1.0 in stage 0.0 (TID 1) org.apache.spark.SparkException: Task failed while writing rows. at org.apache.spark.sql.execution.datasources.DefaultWriterContainer.writeRows(WriterContainer.scala:250) at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1$$anonfun$apply$mcV$sp$3.apply(InsertIntoHadoopFsRelation.scala:150) at org.apache.spark.sql.execution.datasources.InsertIntoHadoopFsRelation$$anonfun$run$1$$anonfun$apply$mcV$sp$3.apply(InsertIntoHadoopFsRelation.scala:150) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66) at org.apache.spark.scheduler.Task.run(Task.scala:88) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) We are using elasticsearch 5.6.4. Spark 1.6.0 org.elasticsearch elasticsearch-spark-13\_2.10 5.6.4 Please suggest to fix this issue. ---
**Author:** ![james.baiera](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/james.baiera/32/10209_2.png) [@james.baiera](https://discuss.elastic.co/u/james.baiera)\ **Post date:** [January 19, 2018, 5:59pm UTC](https://discuss.elastic.co/t/error-while-creating-spark-dataframe-with-elasticsearch-query/115293/2 "2018-01-19T17:59:46Z")
This is a failed request to Elasticsearch. You might want to check your Elasticsearch logs to see if there is an issue on the server that is triggered by this search request. ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [February 16, 2018, 6:00pm UTC](https://discuss.elastic.co/t/error-while-creating-spark-dataframe-with-elasticsearch-query/115293/3 "2018-02-16T18:00:11Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.