Connecting to ELK from databricks

Elastic Stack Elasticsearch
1

Hi,

I'm trying to load data into databrciks from ELK with the help of API using python script. Can you suggest me the best option that I can read the huge data like 200 million in single shot. The method now I'm using is allowing me only 5million of data even that is running for 40 min approx. The run is happening on single core and not spreading between the cluster cores in databricks.

Thanks
Sasidhar

2

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.