# Index creation from very large data set **URL:** \ **Category:** Elasticsearch\ **Created:** [July 12, 2014, 10:00pm UTC](https://discuss.elastic.co/t/index-creation-from-very-large-data-set/18629 "2014-07-12T22:00:01Z")\ **Posts on this page:** 2\ **Page:** 1
**Author:** ![hrgdvqejerhrgdvqejer](https://avatars.discourse-cdn.com/v4/letter/h/3e96dc/32.png) [@hrgdvqejerhrgdvqejer](https://discuss.elastic.co/u/hrgdvqejerhrgdvqejer)\ **Post date:** [July 12, 2014, 10:00pm UTC](https://discuss.elastic.co/t/index-creation-from-very-large-data-set/18629/1 "2014-07-12T22:00:01Z")
Hi, What are the options for creating a new index form an existing very large data set? do we need to linearly walk the data and insert each document one-by-one? ## . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12480.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12480.html) [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12479.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12479.html) [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12478.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12478.html) [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12477.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12477.html) [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12476.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12476.html) [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12475.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12475.html) [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12474.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12474.html) [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12473.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12473.html) [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12472.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12472.html) [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12471.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12471.html) [https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12470.html](https://www.mail-archive.com/elasticsearch@googlegroups.com/msg12470.html) [https://groups.google.com/d/topic/elasticsearch/FxTNOPk2rm8](https://groups.google.com/d/topic/elasticsearch/FxTNOPk2rm8) [https://groups.google.com/d/topic/elasticsearch/uo4WzBKHtVs](https://groups.google.com/d/topic/elasticsearch/uo4WzBKHtVs) [https://groups.google.com/d/topic/elasticsearch/iAWLN0yLGag](https://groups.google.com/d/topic/elasticsearch/iAWLN0yLGag) [https://groups.google.com/d/topic/elasticsearch/86sRz4J9GgM](https://groups.google.com/d/topic/elasticsearch/86sRz4J9GgM) [https://groups.google.com/d/topic/elasticsearch/wI8kLa22cA0](https://groups.google.com/d/topic/elasticsearch/wI8kLa22cA0) [https://groups.google.com/d/topic/elasticsearch/Mgf9tTEWYoE](https://groups.google.com/d/topic/elasticsearch/Mgf9tTEWYoE) [https://groups.google.com/d/topic/elasticsearch/Qe7dZnydWEs](https://groups.google.com/d/topic/elasticsearch/Qe7dZnydWEs) [https://groups.google.com/d/topic/elasticsearch/u1abfqf-p-0](https://groups.google.com/d/topic/elasticsearch/u1abfqf-p-0) [https://groups.google.com/d/topic/elasticsearch/y0mHmko8SE8](https://groups.google.com/d/topic/elasticsearch/y0mHmko8SE8) [https://groups.google.com/d/topic/elasticsearch/qG0vi-cwkvc](https://groups.google.com/d/topic/elasticsearch/qG0vi-cwkvc) [https://groups.google.com/d/topic/theano-users/9EkJWXCwYEc](https://groups.google.com/d/topic/theano-users/9EkJWXCwYEc) [https://groups.google.com/d/topic/orbeon/tHCMaAByJV0](https://groups.google.com/d/topic/orbeon/tHCMaAByJV0) [https://groups.google.com/d/topic/jenkinsci-dev/na5iegT6zAA](https://groups.google.com/d/topic/jenkinsci-dev/na5iegT6zAA) [https://groups.google.com/d/topic/griffith-devel/DflKejVZtns](https://groups.google.com/d/topic/griffith-devel/DflKejVZtns) [https://groups.google.com/d/topic/atmosphere-framework/GzzvqLT2oD4](https://groups.google.com/d/topic/atmosphere-framework/GzzvqLT2oD4) [https://groups.google.com/d/topic/atmosphere-framework/H6cnmcVma4o](https://groups.google.com/d/topic/atmosphere-framework/H6cnmcVma4o) [https://groups.google.com/d/topic/griffith-devel/3\_3CDGpCBhY](https://groups.google.com/d/topic/griffith-devel/3_3CDGpCBhY) [https://groups.google.com/d/topic/jenkinsci-dev/QFoWO9VXdJ8](https://groups.google.com/d/topic/jenkinsci-dev/QFoWO9VXdJ8) [https://groups.google.com/d/topic/orbeon/Zrzjz\_MkSOg](https://groups.google.com/d/topic/orbeon/Zrzjz_MkSOg) [https://groups.google.com/d/topic/theano-users/8DyD-AmviM0](https://groups.google.com/d/topic/theano-users/8DyD-AmviM0) [https://groups.google.com/d/topic/atmosphere-framework/ae1rORzwq-k](https://groups.google.com/d/topic/atmosphere-framework/ae1rORzwq-k) [https://groups.google.com/d/topic/griffith-devel/KFFYQGkDQhc](https://groups.google.com/d/topic/griffith-devel/KFFYQGkDQhc) [https://groups.google.com/d/topic/jenkinsci-dev/I2g5UTo7lJ8](https://groups.google.com/d/topic/jenkinsci-dev/I2g5UTo7lJ8) [https://groups.google.com/d/topic/orbeon/IMRK7tBe\_0A](https://groups.google.com/d/topic/orbeon/IMRK7tBe_0A) [https://groups.google.com/d/topic/theano-users/gnMbuWnpu-Y](https://groups.google.com/d/topic/theano-users/gnMbuWnpu-Y) ## . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/ac15834d-303a-44c2-943e-f4f6324dc5a7%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/ac15834d-303a-44c2-943e-f4f6324dc5a7%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:16am UTC](https://discuss.elastic.co/t/index-creation-from-very-large-data-set/18629/2 "2017-07-06T01:16:15Z")
Closed on July 6, 2017, 1:16am UTC