# How to ingest very large json file into elastic search quickly

**URL:** <https://discuss.elastic.co/t/how-to-ingest-very-large-json-file-into-elastic-search-quickly/361816>\
**Category:** Logstash\
**Created:** [June 21, 2024, 3:32am UTC](https://discuss.elastic.co/t/how-to-ingest-very-large-json-file-into-elastic-search-quickly/361816 "2024-06-21T03:32:29Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![leandrojmp](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/leandrojmp/32/107231_2.png) [@leandrojmp](https://discuss.elastic.co/u/leandrojmp)\
**Post date:** [June 21, 2024, 4:37am UTC](https://discuss.elastic.co/t/how-to-ingest-very-large-json-file-into-elastic-search-quickly/361816/4 "2024-06-21T04:37:16Z")

</div>

> [@mradulag](#):
>
> I have tuned Elastic search and have tried multiple tuning options the document mentions.

What options have you changed? In your other [question](https://discuss.elastic.co/t/not-able-to-use-templates-with-log-stash/361777) about a template, your template didn't change the default refresh\_interval which can heavily impact on performance.

What is the `refresh_interval` that you set for your index? Also, did you create a mapping for your data or is using the dynamic mapping? This also impacts on performance.

Please share the specs of your Elasticsearch, the `elasticsearch.yml` and the tuning options you changed, without knowing what you already did it is complicated to provide any feedback.

Also, how many TBs are you talking about in this file? 10s TBs? 100s TBs?

Another thing, is this mount path a network share?

```auto
mountPath: /mnt/logstash/

```

This is no trivial issue, there are many variables, disk speed, tuning configurations, network speed etc.

> [@mradulag](#):
>
> Can you provide a more general solution to this problem (not even with Logstash), my target is to just ingest the a very large file into the server.

I do not use Logstash to read files anymore, I normally put all my data in some Kafka clusters and have multiple logstash reading from the Kafka topics, but to get your data into Kafka you would also need some tool to read the file and put it on the topics.

Not sure if this is justified for a one time ingestion or even if this would change anything.

---

_[View the full topic](https://discuss.elastic.co/t/how-to-ingest-very-large-json-file-into-elastic-search-quickly/361816)._