Using Apache Spark for elasticsearch indexing


(Siddharth Gupta) #1

Hello,

I want to use apache spark for indexing in elasticsearch because it takes me 5-6 hours to index my 1400000 records.

Can anybody suggest a proper tutorial ?

Thanks,
Siddharth


(Mark Walkom) #2

What exactly do you mean.


(Christian Dahlqvist) #3

That sounds like very poor indexing performance. How large are your documents? Are you using bulk requests? If so, what is your bulk size? What is the specification of your cluster?


(system) #4