# Elastic/Kibana data exportaion (over 1b hits)

**URL:** https://discuss.elastic.co/t/elastic-kibana-data-exportaion-over-1b-hits/366402
**Category:** Elasticsearch
**Created:** [September 11, 2024, 10:14am UTC](https://discuss.elastic.co/t/elastic-kibana-data-exportaion-over-1b-hits/366402 "2024-09-11T10:14:54Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![yzaritskyi](https://avatars.discourse-cdn.com/v4/letter/y/a6a055/32.png) [@yzaritskyi](https://discuss.elastic.co/u/yzaritskyi)
#### Post date: [September 11, 2024, 10:14am UTC](https://discuss.elastic.co/t/elastic-kibana-data-exportaion-over-1b-hits/366402/1 "2024-09-11T10:14:54Z")

</div>

Hello.

I have the assignment to export specific client data from the elastic to any compatible format (csv, json, ndjson, etc.)

There is an option to generate a CSV Report from Kibana by a saved query.  
 ![image](https://us1.discourse-cdn.com/elastic/original/3X/2/a/2a70bfb4239c72f449a735b9a019ddd3ac0c3976.png)

However, this option isn't working for me for a few reasons:

It has stringent size limits - I tried to download 300k hits but got only 130k (because of the max size limit reached).

![image](https://us1.discourse-cdn.com/elastic/original/3X/a/4/a4779fd4fb016ca17a8c494fcad534440d026015.png)

In fact, I have to download billions of rows (1.6 billion rows for the last 30 days). Using this method isn't a good way to save time.

Are there any other methods I can use?

I'm thinking about some tool that can reach the elastic database from the backend (I saw elasticdump, but don't know much about it).

I will be so glad for any tips or hints.

Thank you all!

---

<div class="post-metadata">

### Author: ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)
#### Post date: [September 11, 2024, 4:28pm UTC](https://discuss.elastic.co/t/elastic-kibana-data-exportaion-over-1b-hits/366402/2 "2024-09-11T16:28:05Z")

</div>

Hi @yzaritskyi,

Welcome back. There is a 10MB limit by default for exporting from Kibana. It can be configured via the [`xpack.reporting.csv.maxSizeBytes`](https://www.elastic.co/guide/en/kibana/current/reporting-settings-kb.html#reporting-csv-settings) setting in kibana.yml for your cluster [as per this thread](https://discuss.elastic.co/t/reporting-generate-csv-maximum-limit/134692). But I would tread carefully there as it can impact performance if set too high.

[This thread](https://discuss.elastic.co/t/is-it-possible-to-generate-or-export-a-csv-from-kibana-dev-tool/343027) gives a couple of options that you could try, including:

1. Writing a script using a language client and a CSV utility, such as Python. There is a [StackOverflow thread here](https://stackoverflow.com/questions/46682018/export-elasticsearch-results-into-a-csv-file) that shares that example.
2. Using Logstash with an [Elasticsearch filter processor](https://www.elastic.co/guide/en/logstash/current/plugins-filters-elasticsearch.html#plugins-filters-elasticsearch-query) and the [CSV output plugin](https://www.elastic.co/guide/en/logstash/current/plugins-outputs-csv.html).
3. Split your query into multiple to export the records across multiple CSV files.

Let us know if any of those options work for you.

---

<div class="post-metadata">

### Author: ![yzaritskyi](https://avatars.discourse-cdn.com/v4/letter/y/a6a055/32.png) [@yzaritskyi](https://discuss.elastic.co/u/yzaritskyi)
#### Post date: [September 24, 2024, 12:18pm UTC](https://discuss.elastic.co/t/elastic-kibana-data-exportaion-over-1b-hits/366402/3 "2024-09-24T12:18:02Z")

</div>

Thank you for the info. From what you suggested - I'm looking into logstash as the most automized option. However, I'd like to ask if you know anything elastic-dump tool. Is it authorized by elastic devs to use for data exportation?

Thanks!

---

<div class="post-metadata">

### Author: ![carly.richmond](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/carly.richmond/32/104935_2.png) [@carly.richmond](https://discuss.elastic.co/u/carly.richmond)
#### Post date: [September 24, 2024, 2:06pm UTC](https://discuss.elastic.co/t/elastic-kibana-data-exportaion-over-1b-hits/366402/4 "2024-09-24T14:06:50Z")

</div>

Hi @yzaritskyi,

By _elastic-dump tool_ do you mean this:

> **[GitHub - elasticsearch-dump/elasticsearch-dump: Import and export tools for elasticsearch &...](https://github.com/elasticsearch-dump/elasticsearch-dump)**
>
> Import and export tools for elasticsearch & opensearch

It's not a tool I've come across before, and it looks to be community maintained. It's definitely not an Elastic tool that we support.

It's really up to yourself whether you would like to use the tool, but I would read their instructions and specifically version caveats carefully.

Hope that helps!
