# Bulk Load Large Spatial Datasets **URL:** \ **Category:** Elasticsearch\ **Created:** [May 12, 2014, 4:21pm UTC](https://discuss.elastic.co/t/bulk-load-large-spatial-datasets/17464 "2014-05-12T16:21:09Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![bbehling](https://avatars.discourse-cdn.com/v4/letter/b/f1d935/32.png) [@bbehling](https://discuss.elastic.co/u/bbehling)\ **Post date:** [May 12, 2014, 4:21pm UTC](https://discuss.elastic.co/t/bulk-load-large-spatial-datasets/17464/1 "2014-05-12T16:21:09Z")
Hello. I'm trying to bulk load about 550k records with spatial data into ElasticSearch. After about 20 mins, an error occurs "No Handlers Can Be Found For Logger elasticsearch', then the connection times out and the Python scripts stops. The Python loading script was working fine before adding the spatial data. Anyone have some ideas on how to load large spatial datasets? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/c2866bc2-f511-45ef-b780-3c7e275da3b6%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c2866bc2-f511-45ef-b780-3c7e275da3b6%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![Honza\_Kral](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/honza_kral/32/876_2.png) [@Honza\_Kral](https://discuss.elastic.co/u/Honza_Kral)\ **Post date:** [May 12, 2014, 4:24pm UTC](https://discuss.elastic.co/t/bulk-load-large-spatial-datasets/17464/2 "2014-05-12T16:24:24Z")
Hi Brian, that message you are seeing is not an error - it's a warning from the python logging system that you don't have any logging configured. So when elasticsearch tries to log something it cannot. I'd suggest to set up your logging and try again. To set up logging just include: import logging logging.basicConfig(level=logging.INFO) at the top of your script. On Mon, May 12, 2014 at 6:21 PM, Brian Behling [brian.behling@gmail.com](mailto:brian.behling@gmail.com) wrote: > Hello. > > I'm trying to bulk load about 550k records with spatial data into > Elasticsearch. After about 20 mins, an error occurs "No Handlers Can Be > Found For Logger elasticsearch', then the connection times out and the > Python scripts stops. > > The Python loading script was working fine before adding the spatial data. > > Anyone have some ideas on how to load large spatial datasets? > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). > To view this discussion on the web visit > [https://groups.google.com/d/msgid/elasticsearch/c2866bc2-f511-45ef-b780-3c7e275da3b6%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c2866bc2-f511-45ef-b780-3c7e275da3b6%40googlegroups.com). > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CABfdDipHG3g9k%3D0i93iO1g5%3D1Pgi7GcLF3JMLgfY9dX8%3DSZ-bg%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CABfdDipHG3g9k%3D0i93iO1g5%3D1Pgi7GcLF3JMLgfY9dX8%3DSZ-bg%40mail.gmail.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![bbehling](https://avatars.discourse-cdn.com/v4/letter/b/f1d935/32.png) [@bbehling](https://discuss.elastic.co/u/bbehling)\ **Post date:** [May 12, 2014, 5:02pm UTC](https://discuss.elastic.co/t/bulk-load-large-spatial-datasets/17464/3 "2014-05-12T17:02:24Z")
Thank you. I did find the error causing this script to crash. Looks like there many invalid polygons (self intersecting) that is causing this problem. But this should be for another thread if the business rules dictate we can't simplify the geometries. On Monday, May 12, 2014 10:24:24 AM UTC-6, Honza Král wrote: > Hi Brian, > > that message you are seeing is not an error - it's a warning from the > python logging system that you don't have any logging configured. So > when elasticsearch tries to log something it cannot. > > I'd suggest to set up your logging and try again. To set up logging > just include: > > import logging > logging.basicConfig(level=logging.INFO) > > at the top of your script. > > On Mon, May 12, 2014 at 6:21 PM, Brian Behling \<[brian....@gmail.com](mailto:brian....@gmail.com)\\> > wrote: > > > Hello. > > > > I'm trying to bulk load about 550k records with spatial data into > > Elasticsearch. After about 20 mins, an error occurs "No Handlers Can Be > > Found For Logger elasticsearch', then the connection times out and the > > Python scripts stops. > > > > The Python loading script was working fine before adding the spatial > > data. > > > > Anyone have some ideas on how to load large spatial datasets? > > > > -- > > You received this message because you are subscribed to the Google > > Groups > > "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send > > an > > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \. > > To view this discussion on the web visit > > [https://groups.google.com/d/msgid/elasticsearch/c2866bc2-f511-45ef-b780-3c7e275da3b6%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c2866bc2-f511-45ef-b780-3c7e275da3b6%40googlegroups.com). > > > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com). To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/56a80e65-cc36-4388-ac07-0f4a228922f2%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/56a80e65-cc36-4388-ac07-0f4a228922f2%40googlegroups.com). For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout). ---
**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\ **Post date:** [July 6, 2017, 1:30am UTC](https://discuss.elastic.co/t/bulk-load-large-spatial-datasets/17464/4 "2017-07-06T01:30:04Z")
Closed on July 6, 2017, 1:30am UTC