# Elasticsearch.spark.sql queries return null

**URL:** https://discuss.elastic.co/t/elasticsearch-spark-sql-queries-return-null/179777
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [May 6, 2019, 1:09pm UTC](https://discuss.elastic.co/t/elasticsearch-spark-sql-queries-return-null/179777 "2019-05-06T13:09:49Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![niloo-sh](https://avatars.discourse-cdn.com/v4/letter/n/4491bb/32.png) [@niloo-sh](https://discuss.elastic.co/u/niloo-sh)
#### Post date: [May 6, 2019, 1:09pm UTC](https://discuss.elastic.co/t/elasticsearch-spark-sql-queries-return-null/179777/1 "2019-05-06T13:09:50Z")

</div>

I connect to remote elastic search. when I load my index data metadata column has information but all of other fields that are in "doc" column are null.

spark 2.4.0  
elasticsearch-hadoop-7.0.1.jar

output:

schema:  
root  
|-- doc: struct (nullable = true)  
| |-- screen\_name: string (nullable = true)  
|-- \_metadata: map (nullable = true)  
| |-- key: string  
| |-- value: string (valueContainsNull = true)

+----+-------------------------------------------------------------------------------+  
|doc |\_metadata |  
+----+-------------------------------------------------------------------------------+  
|null|[\_index -\> ab\_fa, \_type -\> doc, \_id -\> 152515152, \_score -\> 16.521849]|  
+----+-------------------------------------------------------------------------------+

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [June 3, 2019, 1:10pm UTC](https://discuss.elastic.co/t/elasticsearch-spark-sql-queries-return-null/179777/2 "2019-06-03T13:10:57Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.