# Connecting to ELK from databricks

**URL:** https://discuss.elastic.co/t/connecting-to-elk-from-databricks/343998
**Category:** Elasticsearch
**Created:** [September 27, 2023, 2:35pm UTC](https://discuss.elastic.co/t/connecting-to-elk-from-databricks/343998 "2023-09-27T14:35:10Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![ksasidhar1103](https://avatars.discourse-cdn.com/v4/letter/k/f6c823/32.png) [@ksasidhar1103](https://discuss.elastic.co/u/ksasidhar1103)
#### Post date: [September 27, 2023, 2:35pm UTC](https://discuss.elastic.co/t/connecting-to-elk-from-databricks/343998/1 "2023-09-27T14:35:10Z")

</div>

Hi,

I'm trying to load data into databrciks from ELK with the help of API using python script. Can you suggest me the best option that I can read the huge data like 200 million in single shot. The method now I'm using is allowing me only 5million of data even that is running for 40 min approx. The run is happening on single core and not spreading between the cluster cores in databricks.

Thanks  
Sasidhar

---

<div class="post-metadata">

### Author: ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)
#### Post date: [October 25, 2023, 2:35pm UTC](https://discuss.elastic.co/t/connecting-to-elk-from-databricks/343998/2 "2023-10-25T14:35:18Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.