# Bulk index creation problem **URL:** \ **Category:** Elasticsearch\ **Created:** [May 2, 2013, 12:42pm UTC](https://discuss.elastic.co/t/bulk-index-creation-problem/11778 "2013-05-02T12:42:34Z")\ **Posts on this page:** 8\ **Page:** 1
**Author:** ![Rajesh\_Tarle](https://avatars.discourse-cdn.com/v4/letter/r/3da27b/32.png) [@Rajesh\_Tarle](https://discuss.elastic.co/u/Rajesh_Tarle)\ **Post date:** [May 2, 2013, 12:42pm UTC](https://discuss.elastic.co/t/bulk-index-creation-problem/11778/1 "2013-05-02T12:42:34Z")
Hi, I am trying to create around 150000 docs in elastic but I got the following error in elastic log file. what is the reason of this error and how i can solve this error. I am using elastic 20.5 and jdk"1.6.0\_18 . please the link for error [https://gist.github.com/rajesh07/5501938](https://gist.github.com/rajesh07/5501938) please reply Thanks in advance. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [May 2, 2013, 1:38pm UTC](https://discuss.elastic.co/t/bulk-index-creation-problem/11778/2 "2013-05-02T13:38:21Z")
Please follow the installation guidelines at > **[Elasticsearch Platform — Find real-time answers at scale](https://www.elastic.co)** > > Power insights and outcomes with the Elasticsearch Platform and AI. See into your data and find answers that matter with enterprise solutions designed to help you build, observe, and protect. Try Elasticsearch free today. --\> Important Configurations - File Descriptors Not related to the issue: please do not use JDK 1.6.0\_18. It is too old and has bugs. You will run into strange issues with memory. I recommend the latest Java 7. Jörg Am 02.05.13 14:42, schrieb raj: > Hi, > > I am trying to create around 150000 docs in elastic but I got the > following error in elastic log file. > what is the reason of this error and how i can solve this error. > I am using elastic 20.5 and jdk"1.6.0\_18 . > > please the link for error [Error occurred at the index time. · GitHub](https://gist.github.com/rajesh07/5501938) > > please reply > Thanks in advance. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Rajesh\_Tarle](https://avatars.discourse-cdn.com/v4/letter/r/3da27b/32.png) [@Rajesh\_Tarle](https://discuss.elastic.co/u/Rajesh_Tarle)\ **Post date:** [May 6, 2013, 1:06pm UTC](https://discuss.elastic.co/t/bulk-index-creation-problem/11778/3 "2013-05-06T13:06:42Z")
Hi, Thanks for reply. please can you tell me about "file descriptor" how can I increase number of open file. please may you explain it. Thanks On Thursday, May 2, 2013 7:08:21 PM UTC+5:30, Jörg Prante wrote: > Please follow the installation guidelines at > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation/) > > --\> Important Configurations - File Descriptors > > Not related to the issue: please do not use JDK 1.6.0\_18. It is too old > and has bugs. You will run into strange issues with memory. I recommend > the latest Java 7. > > Jörg > > Am 02.05.13 14:42, schrieb raj: > > > Hi, > > > > I am trying to create around 150000 docs in elastic but I got the > > following error in elastic log file. > > what is the reason of this error and how i can solve this error. > > I am using elastic 20.5 and jdk"1.6.0\_18 . > > > > please the link for error [Error occurred at the index time. · GitHub](https://gist.github.com/rajesh07/5501938) > > > > please reply > > Thanks in advance. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Rajesh\_Tarle](https://avatars.discourse-cdn.com/v4/letter/r/3da27b/32.png) [@Rajesh\_Tarle](https://discuss.elastic.co/u/Rajesh_Tarle)\ **Post date:** [May 7, 2013, 11:50am UTC](https://discuss.elastic.co/t/bulk-index-creation-problem/11778/4 "2013-05-07T11:50:43Z")
Hi, I have updated java 7 and also increase the size of open files descriptor.also I have increased the heap memory but I got same error. it's any other change required? and have elasticsearch any limit of index. please give me reply. Thanks On Thursday, May 2, 2013 7:08:21 PM UTC+5:30, Jörg Prante wrote: > Please follow the installation guidelines at > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/guide/reference/setup/installation/) > > --\> Important Configurations - File Descriptors > > Not related to the issue: please do not use JDK 1.6.0\_18. It is too old > and has bugs. You will run into strange issues with memory. I recommend > the latest Java 7. > > Jörg > > Am 02.05.13 14:42, schrieb raj: > > > Hi, > > > > I am trying to create around 150000 docs in elastic but I got the > > following error in elastic log file. > > what is the reason of this error and how i can solve this error. > > I am using elastic 20.5 and jdk"1.6.0\_18 . > > > > please the link for error [Error occurred at the index time. · GitHub](https://gist.github.com/rajesh07/5501938) > > > > please reply > > Thanks in advance. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Ivan](https://avatars.discourse-cdn.com/v4/letter/i/df788c/32.png) [@Ivan](https://discuss.elastic.co/u/Ivan)\ **Post date:** [May 7, 2013, 10:08pm UTC](https://discuss.elastic.co/t/bulk-index-creation-problem/11778/5 "2013-05-07T22:08:14Z")
Are you sure that you changed the max open files for the user running elasticsearch? Are you sure that your values were saved for future sessions? Both are common gotchas when changing the setting. When you open a shell as the user running elasticsearch, make sure you have a high ulimit value: $ ulimit -n -- Ivan On Tue, May 7, 2013 at 4:50 AM, raj [rajesh.elasticsearch@gmail.com](mailto:rajesh.elasticsearch@gmail.com) wrote: > Hi, > > I have updated java 7 and also increase the size of open files > descriptor.also I have increased the heap memory > but I got same error. > > it's any other change required? > and have elasticsearch any limit of index. > > please give me reply. > > Thanks > > On Thursday, May 2, 2013 7:08:21 PM UTC+5:30, Jörg Prante wrote: > > > Please follow the installation guidelines at > > > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/ **guide/reference/setup/** installation/)[http://www.elasticsearch.org/guide/reference/setup/installation/](http://www.elasticsearch.org/guide/reference/setup/installation/) > > > > --\> Important Configurations - File Descriptors > > > > Not related to the issue: please do not use JDK 1.6.0\_18. It is too old > > and has bugs. You will run into strange issues with memory. I recommend > > the latest Java 7. > > > > Jörg > > > > Am 02.05.13 14:42, schrieb raj: > > > > > Hi, > > > > > > I am trying to create around 150000 docs in elastic but I got the > > > following error in elastic log file. > > > what is the reason of this error and how i can solve this error. > > > I am using elastic 20.5 and jdk"1.6.0\_18 . > > > > > > please the link for error [https://gist.github.com/\*\*rajesh07/5501938](https://gist.github.com/**rajesh07/5501938)[https://gist.github.com/rajesh07/5501938](https://gist.github.com/rajesh07/5501938) > > > > > > please reply > > > Thanks in advance. > > > > -- > > You received this message because you are subscribed to the Google Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![Rajesh\_Tarle](https://avatars.discourse-cdn.com/v4/letter/r/3da27b/32.png) [@Rajesh\_Tarle](https://discuss.elastic.co/u/Rajesh_Tarle)\ **Post date:** [May 8, 2013, 10:36am UTC](https://discuss.elastic.co/t/bulk-index-creation-problem/11778/6 "2013-05-08T10:36:59Z")
yes i am sure about changed max open files(1024000) for user(root) running elasticsearch. yes value is saved for future sessions. any other changed required? Thanks On Wednesday, May 8, 2013 3:38:14 AM UTC+5:30, Ivan Brusic wrote: > Are you sure that you changed the max open files for the user running > elasticsearch? Are you sure that your values were saved for future > sessions? Both are common gotchas when changing the setting. When you open > a shell as the user running elasticsearch, make sure you have a high ulimit > value: > > $ ulimit -n > > -- > Ivan > > On Tue, May 7, 2013 at 4:50 AM, raj \<[rajesh.ela...@gmail.com](mailto:rajesh.ela...@gmail.com) \ > > > wrote: > > > Hi, > > > > I have updated java 7 and also increase the size of open files > > descriptor.also I have increased the heap memory > > but I got same error. > > > > it's any other change required? > > and have elasticsearch any limit of index. > > > > please give me reply. > > > > Thanks > > > > On Thursday, May 2, 2013 7:08:21 PM UTC+5:30, Jörg Prante wrote: > > > > > Please follow the installation guidelines at > > > > > > [Elasticsearch Platform — Find real-time answers at scale | Elastic](http://www.elasticsearch.org/ **guide/reference/setup/** installation/)[http://www.elasticsearch.org/guide/reference/setup/installation/](http://www.elasticsearch.org/guide/reference/setup/installation/) > > > > > > --\> Important Configurations - File Descriptors > > > > > > Not related to the issue: please do not use JDK 1.6.0\_18. It is too old > > > and has bugs. You will run into strange issues with memory. I recommend > > > the latest Java 7. > > > > > > Jörg > > > > > > Am 02.05.13 14:42, schrieb raj: > > > > > > > Hi, > > > > > > > > I am trying to create around 150000 docs in elastic but I got the > > > > following error in elastic log file. > > > > what is the reason of this error and how i can solve this error. > > > > I am using elastic 20.5 and jdk"1.6.0\_18 . > > > > > > > > please the link for error [https://gist.github.com/\*\*rajesh07/5501938](https://gist.github.com/**rajesh07/5501938)[https://gist.github.com/rajesh07/5501938](https://gist.github.com/rajesh07/5501938) > > > > > > > > please reply > > > > Thanks in advance. > > > > > > -- > > > You received this message because you are subscribed to the Google Groups > > > "elasticsearch" group. > > > To unsubscribe from this group and stop receiving emails from it, send an > > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > > For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![jprante](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/jprante/32/44941_2.png) [@jprante](https://discuss.elastic.co/u/jprante)\ **Post date:** [May 8, 2013, 8:42pm UTC](https://discuss.elastic.co/t/bulk-index-creation-problem/11778/7 "2013-05-08T20:42:29Z")
If you still get the error, check your process how many files are open with lsof or similar tools. What result gives ulimit -a? It is enough to increase nofiles in /etc/security/limits.conf to around 10000 (a few thousand, not millions). It is not recommended to run ES (or any other app) under root privileges. Jörg Am 08.05.13 12:36, schrieb raj: > yes i am sure about changed max open files(1024000) for user(root) > running elasticsearch. yes value is saved for future sessions. > > any other changed required? > > Thanks -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). For more options, visit [https://groups.google.com/groups/opt\_out](https://groups.google.com/groups/opt_out). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 2:37am UTC](https://discuss.elastic.co/t/bulk-index-creation-problem/11778/8 "2017-07-06T02:37:34Z")