# How to bulk insert 600MB large json file to elasticsearch?

**URL:** <https://discuss.elastic.co/t/how-to-bulk-insert-600mb-large-json-file-to-elasticsearch/142700>\
**Category:** Elasticsearch\
**Created:** [August 2, 2018, 7:36am UTC](https://discuss.elastic.co/t/how-to-bulk-insert-600mb-large-json-file-to-elasticsearch/142700 "2018-08-02T07:36:17Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ash\_Chamari](https://avatars.discourse-cdn.com/v4/letter/a/b9bd4f/32.png) [@Ash\_Chamari](https://discuss.elastic.co/u/Ash_Chamari)\
**Post date:** [August 2, 2018, 7:36am UTC](https://discuss.elastic.co/t/how-to-bulk-insert-600mb-large-json-file-to-elasticsearch/142700/1 "2018-08-02T07:36:17Z")

</div>

> <https://stackoverflow.com/questions/51647977/how-to-bulk-insert-600mb-large-json-file-to-elasticsearch>

---

<div class="post-metadata">

**Author:** ![Christian\_Dahlqvist](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/christian_dahlqvist/32/4617_2.png) [@Christian\_Dahlqvist](https://discuss.elastic.co/u/Christian_Dahlqvist)\
**Post date:** [August 2, 2018, 8:03am UTC](https://discuss.elastic.co/t/how-to-bulk-insert-600mb-large-json-file-to-elasticsearch/142700/2 "2018-08-02T08:03:10Z")

</div>

Have a look at these recent threads:

> [@1GB single json record](https://discuss.elastic.co/t/1gb-single-json-record/142512):
>
> Hi all, We are trying to let the filebeat to collect a json file. Which is a single record json file, but it got 1GB file size. We tried filebeat send to logstash also the filebeat send to ES directly. Unfortunately we are not lucky enough. Does any body face this problem before? Any replies will be very helpful. Thanks, From Mulder

> [@How to bulk load huge JSON docs from files using Java client?](https://discuss.elastic.co/t/how-to-bulk-load-huge-json-docs-from-files-using-java-client/142607):
>
> Hi. I need your help / advice / opinion: TL;DR: How do I read file from the disk for bulk loading using IndexRequest.source(BytesReference)? And the detailed question: The context: I am indexing text in a public dataset, such as: [http://data.cityofnewyork.us/resource/nc67-uf89](http://data.cityofnewyork.us/resource/nc67-uf89) The dataset includes some simple meta-data fields (such as dataset name and description) and a large CSV table of the data itself. I am indexing the text from the big CSV table. The CSV table size may be a few GBs …

If the file consists of multiple documents, break it up into smaller chunks. If it is a single document, rethink how you are going to index and search it.

---

<div class="post-metadata">

**Author:** ![Ash\_Chamari](https://avatars.discourse-cdn.com/v4/letter/a/b9bd4f/32.png) [@Ash\_Chamari](https://discuss.elastic.co/u/Ash_Chamari)\
**Post date:** [August 7, 2018, 12:23am UTC](https://discuss.elastic.co/t/how-to-bulk-insert-600mb-large-json-file-to-elasticsearch/142700/3 "2018-08-07T00:23:23Z")

</div>

Hi @Christian_Dahlqvist,

Thanks for your reply.

In the geoJson file, under features array, I have objects that contains geometry and properties and geometry object stores the coordinates.

Currently I am mapping each {geometry & properties} as one document.

Any idea how to index this properly or chunk out to smaller potions?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [September 4, 2018, 12:29am UTC](https://discuss.elastic.co/t/how-to-bulk-insert-600mb-large-json-file-to-elasticsearch/142700/4 "2018-09-04T00:29:32Z")

</div>

This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.