# Indexing 5GB file **URL:** \ **Category:** Elasticsearch\ **Created:** [April 27, 2018, 7:09pm UTC](https://discuss.elastic.co/t/indexing-5gb-file/129875 "2018-04-27T19:09:09Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![Parul-Kudtarkar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/parul-kudtarkar/32/30650_2.png) [@Parul-Kudtarkar](https://discuss.elastic.co/u/Parul-Kudtarkar)\ **Post date:** [April 27, 2018, 7:09pm UTC](https://discuss.elastic.co/t/indexing-5gb-file/129875/1 "2018-04-27T19:09:10Z")
Hi, What is the max size to index file? What are options to index a large file ~5GB other than breaking it into chuncks. Thanks, Parul ---
**Author:** ![dadoonet](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/dadoonet/32/137187_2.png) [@dadoonet](https://discuss.elastic.co/u/dadoonet)\ **Post date:** [April 27, 2018, 7:22pm UTC](https://discuss.elastic.co/t/indexing-5gb-file/129875/2 "2018-04-27T19:22:06Z")
What contains this file? ---
**Author:** ![Parul-Kudtarkar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/parul-kudtarkar/32/30650_2.png) [@Parul-Kudtarkar](https://discuss.elastic.co/u/Parul-Kudtarkar)\ **Post date:** [April 27, 2018, 7:55pm UTC](https://discuss.elastic.co/t/indexing-5gb-file/129875/3 "2018-04-27T19:55:03Z")
This tab-delimited file with genomic information i.e chromosome1 1000 834206 some\_text some\_value ...... ..... Thanks! ---
**Author:** ![shanec](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shanec/32/4004_2.png) [@shanec](https://discuss.elastic.co/u/shanec)\ **Post date:** [April 27, 2018, 8:18pm UTC](https://discuss.elastic.co/t/indexing-5gb-file/129875/4 "2018-04-27T20:18:12Z")
You're fortunately not the first one to store genomic information in Elasticsearch! You may be interested in reaching out to others to hear what they've done if any of these sound familiar to your own problems: - [Indexing DNA sequences](https://discuss.elastic.co/t/indexing-dna-sequences/63087) - [https://www.elastic.co/blog/uncoiling-data-in-dna-elasticsearch-as-a-bioinformatics-research-tool](https://www.elastic.co/blog/uncoiling-data-in-dna-elasticsearch-as-a-bioinformatics-research-tool) - [https://www.elastic.co/blog/elastic-yale-and-the-quest-to-cure-cancer](https://www.elastic.co/blog/elastic-yale-and-the-quest-to-cure-cancer) As to how to specifically deal with this, I think the answer is going to depend on what your search goal(s) is/are. 5GB of text is just going to be too much to reasonably index/search in a single document, so I think some other strategy is going to be necessary. ---
**Author:** ![Parul-Kudtarkar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/parul-kudtarkar/32/30650_2.png) [@Parul-Kudtarkar](https://discuss.elastic.co/u/Parul-Kudtarkar)\ **Post date:** [April 27, 2018, 8:33pm UTC](https://discuss.elastic.co/t/indexing-5gb-file/129875/5 "2018-04-27T20:33:18Z")
Excellent! Thanks Shane for resources. We will get back to you and the community on our solution. ---
**Author:** ![Parul-Kudtarkar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/parul-kudtarkar/32/30650_2.png) [@Parul-Kudtarkar](https://discuss.elastic.co/u/Parul-Kudtarkar)\ **Post date:** [April 28, 2018, 1:29am UTC](https://discuss.elastic.co/t/indexing-5gb-file/129875/6 "2018-04-28T01:29:53Z")
Just to confirm the max size of file that can be indexed is up to 20MB? ---
**Author:** ![shanec](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/shanec/32/4004_2.png) [@shanec](https://discuss.elastic.co/u/shanec)\ **Post date:** [April 30, 2018, 6:34pm UTC](https://discuss.elastic.co/t/indexing-5gb-file/129875/7 "2018-04-30T18:34:16Z")
Lucene (which Elasticsearch uses) has a limit of 2GB, but Elasticsearch accepts requests over HTTP and has a default limit (`http.max_content_length`) of 100MB. You can increase that, but you'd probably want to read about it more [here](https://www.elastic.co/guide/en/elasticsearch/reference/6.2/general-recommendations.html#maximum-document-size). ---
**Author:** ![Parul-Kudtarkar](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/parul-kudtarkar/32/30650_2.png) [@Parul-Kudtarkar](https://discuss.elastic.co/u/Parul-Kudtarkar)\ **Post date:** [May 1, 2018, 3:14pm UTC](https://discuss.elastic.co/t/indexing-5gb-file/129875/8 "2018-05-01T15:14:30Z")
Thanks Shane, this is helpful! ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [May 29, 2018, 3:14pm UTC](https://discuss.elastic.co/t/indexing-5gb-file/129875/9 "2018-05-29T15:14:31Z")
This topic was automatically closed 28 days after the last reply. New replies are no longer allowed.