Spark ES connector is taking time


(Kedar Dixit) #1

Hi,

We are using Spark ES connector to get the data from Elasticsearch, for some reason when we put the query which is comprised of 1 bool and 2 range queries, the query takes quite longer than expected. However the Transport client is little faster relative to this.

But since we are using spark for processing the data, we preferred the Spark-Es connector.

Can someone help in debugging or executing the query bit faster please?

We are on Spark 2.x, sample code looks like:

    JavaEsSpark.esJsonRDD(sparkContext, index+"*",  query);

Regards,
~Kedar


(system) #2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.