Pull data from wikipedia


#1

Hi All,

How can we pull data from wikipedia to elastic search by using logstash and how can i index that data.

please give an example for config file.

Thanks & Regards,
Dinesh


(Tanya Bragin) #2

If you're on ES 1.x, you can still use Rivers and there is a River dedicated for pulling docs from Wikipedia: [ANN] Elasticsearch Wikipedia River plugin 2.6.0 released

However, Rivers are deprecated in ES 2.x, so you'd need another approach long-term. I'm not aware of a Wikipedia LS plugin, but it couldn't be hard to write.


(system) #3