# Pyes indexing problem

**URL:** <https://discuss.elastic.co/t/pyes-indexing-problem/9347>\
**Category:** Elasticsearch\
**Created:** [October 13, 2012, 7:00am UTC](https://discuss.elastic.co/t/pyes-indexing-problem/9347 "2012-10-13T07:00:52Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![paulp](https://avatars.discourse-cdn.com/v4/letter/p/a3d4f5/32.png) [@paulp](https://discuss.elastic.co/u/paulp)\
**Post date:** [October 13, 2012, 7:00am UTC](https://discuss.elastic.co/t/pyes-indexing-problem/9347/1 "2012-10-13T07:00:52Z")

</div>

Hi,

I am currently evaluating ES as an alternative to SolR.  
My test environment consists of 4 m1.xlarge instances cluster on EC2, 8GB  
(out of 16GB) is allocated for ES JVM.  
The index is broken into 5 shards with 1 replica.  
For indexing JSON docs I'm using "Pyes" with "Bulking" enabled (chunks of  
100 docs).

I've encountered a problem when indexing about ~1.5 million of docs (same  
index) where I get time-out from ES and unable to index any new documents .  
The system load is normal, no swapping accrued, I also I couldn't find  
anything relevant in ES logs.

Has anyone faced similar problem?

--  
Regards,  
Paul

\*\*

---

<div class="post-metadata">

**Author:** ![es\_learner](https://avatars.discourse-cdn.com/v4/letter/e/8dc957/32.png) [@es\_learner](https://discuss.elastic.co/u/es_learner)\
**Post date:** [October 14, 2012, 1:41am UTC](https://discuss.elastic.co/t/pyes-indexing-problem/9347/2 "2012-10-14T01:41:19Z")

</div>

What params did you use when you called ES() for a connection?

e.g.  
from pyes import ES  
connection=ES([index\_server], bulk\_size=BS, timeout=TS)

By default BS=400 and TS=5 (secs)

Try adjusting the timeout value. timeout=None will not time out.

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 3:08am UTC](https://discuss.elastic.co/t/pyes-indexing-problem/9347/3 "2017-07-06T03:08:56Z")

</div>


