# Value got nulled when ingesting to ES from Hadoop using Spark

**URL:** https://discuss.elastic.co/t/value-got-nulled-when-ingesting-to-es-from-hadoop-using-spark/258135
**Category:** Elasticsearch
**Tags:** es-hadoop
**Created:** [December 9, 2020, 1:53pm UTC](https://discuss.elastic.co/t/value-got-nulled-when-ingesting-to-es-from-hadoop-using-spark/258135 "2020-12-09T13:53:21Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![anung](https://avatars.discourse-cdn.com/v4/letter/a/d9b06d/32.png) [@anung](https://discuss.elastic.co/u/anung)
#### Post date: [December 9, 2020, 1:53pm UTC](https://discuss.elastic.co/t/value-got-nulled-when-ingesting-to-es-from-hadoop-using-spark/258135/1 "2020-12-09T13:53:22Z")

</div>

my env:

```auto
cloudera hadoop 6.3
es 7.10
spark 2.4.0
elasticsearch-spark-20_2.11-7.10.0.jar

```

my code very simple:

> import org.elasticsearch.spark.rdd.api.java.JavaEsSpark;
> 
> JavaEsSpark.saveToEs(rdd\_tJava\_1, "nyc\_yellow\_taxi/docs");

the output is as expected, the record count is the same. but when inspecting the records, there are problems, some columns got nulled. all of the records from that colums.

so columns:

```auto
pulocationid, vendorid, dolocationid, dolocationid

```

got nulled.

example here a record in hadoop:

 ![Screen Shot 2020-12-09 at 20.20.34](https://us1.discourse-cdn.com/elastic/original/3X/6/b/6bc1172045c70c67ec2517a79a72e7fc6ae4df8f.png)

and here the output in elastic:

 ![Screen Shot 2020-12-09 at 20.49.54](https://us1.discourse-cdn.com/elastic/original/3X/5/5/55203f162921266decfe35be5f8fb55daf93988b.png)

any idea guys?

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [January 6, 2021, 1:53pm UTC](https://discuss.elastic.co/t/value-got-nulled-when-ingesting-to-es-from-hadoop-using-spark/258135/2 "2021-01-06T13:53:28Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.