Question about Reading Flattened Field from ES Index to Pyspark

Elastic Stack Elasticsearch
1

Hi ,
I am trying to read flattened Filed from Elasticsearch .
I will be able to read all filed from Index except Flattened Datatype filed.
Could you please let me know how to read that filed from Spark.
Any option that i have to enable from spark to read flattened fields?

2

Hi @musku. Unfortunately we don't yet support all Elasticsearch field types in es-spark. Flattened fields are on my to-do list -- Support for all Elasticsearch field types · Issue #1813 · elastic/elasticsearch-hadoop · GitHub. I don't know of a workaround at the moment but I'll try to take a look at some point soon.

3

I just took a look, and unfortunately I don't see an obvious workaround or even a really simple code change to get flattened fields to work.

4

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.