# Some elasticsearch thrift test performances - python

**URL:** <https://discuss.elastic.co/t/some-elasticsearch-thrift-test-performances-python/3321>\
**Category:** Elasticsearch\
**Created:** [September 10, 2010, 10:14pm UTC](https://discuss.elastic.co/t/some-elasticsearch-thrift-test-performances-python/3321 "2010-09-10T22:14:10Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Alberto\_Paro\_2](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/alberto_paro_2/32/1137_2.png) [@Alberto\_Paro\_2](https://discuss.elastic.co/u/Alberto_Paro_2)\
**Post date:** [September 10, 2010, 10:14pm UTC](https://discuss.elastic.co/t/some-elasticsearch-thrift-test-performances-python/3321/1 "2010-09-10T22:14:10Z")

</div>

I'm writing an elasticsearch "driver" in python.  
I'm started the project looking pyelasticsearch and I created a new project  
because I don't like the previous api and I want to experiment new way.

The project is in very alpha state, but I have implemented first a connection using standard library via HTTP,  
the using the thrift interface.

This is a small dump of results.

(pyes)MBPAlbertoParo:tests alberto$ python generate\_dataset.py 10000  
samples.shelve generated with 10000 samples

## Urllib

(pyes)MBPAlbertoParo:tests alberto$ python performance.py  
time: 0:00:08.652321  
(pyes)MBPAlbertoParo:tests alberto$ python performance.py  
time: 0:00:08.282428  
(pyes)MBPAlbertoParo:tests alberto$ python performance.py  
time: 0:00:08.889818  
(pyes)MBPAlbertoParo:tests alberto$

## Thrift

(pyes)MBPAlbertoParo:tests alberto$ python performance.py  
time: 0:00:04.448639  
(pyes)MBPAlbertoParo:tests alberto$ python performance.py  
time: 0:00:04.812295  
(pyes)MBPAlbertoParo:tests alberto$ python performance.py  
time: 0:00:04.301892  
(pyes)MBPAlbertoParo:tests alberto$

This is a first step. I'm investigating in using multiprocess and a producer/consumer to increase the parallel/throughtput.  
I'm open to suggestions and hits.

Hi,  
Alberto

---

<div class="post-metadata">

**Author:** ![kimchy](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/kimchy/32/44952_2.png) [@kimchy](https://discuss.elastic.co/u/kimchy)\
**Post date:** [September 12, 2010, 8:33am UTC](https://discuss.elastic.co/t/some-elasticsearch-thrift-test-performances-python/3321/2 "2010-09-12T08:33:24Z")

</div>

Look good Alberto!, I see you already have it on github (  
[GitHub - aparo/pyes: Python connector for ElasticSearch - the pythonic way to use ElasticSearch](http://github.com/aparo/pyes)), I added it to the projects page on the site.

p.s. Love the name (pyes)!

On Sat, Sep 11, 2010 at 12:14 AM, Alberto Paro [alberto.paro@gmail.com](mailto:alberto.paro@gmail.com)wrote:

> I'm writing an elasticsearch "driver" in python.  
> I'm started the project looking pyelasticsearch and I created a new project  
> because I don't like the previous api and I want to experiment new way.
> 
> The project is in very alpha state, but I have implemented first a  
> connection using standard library via HTTP,  
> the using the thrift interface.
> 
> This is a small dump of results.
> 
> (pyes)MBPAlbertoParo:tests alberto$ python generate\_dataset.py 10000  
> samples.shelve generated with 10000 samples
> 
> ## Urllib
> 
> (pyes)MBPAlbertoParo:tests alberto$ python performance.py  
> time: 0:00:08.652321  
> (pyes)MBPAlbertoParo:tests alberto$ python performance.py  
> time: 0:00:08.282428  
> (pyes)MBPAlbertoParo:tests alberto$ python performance.py  
> time: 0:00:08.889818  
> (pyes)MBPAlbertoParo:tests alberto$
> 
> ## Thrift
> 
> (pyes)MBPAlbertoParo:tests alberto$ python performance.py  
> time: 0:00:04.448639  
> (pyes)MBPAlbertoParo:tests alberto$ python performance.py  
> time: 0:00:04.812295  
> (pyes)MBPAlbertoParo:tests alberto$ python performance.py  
> time: 0:00:04.301892  
> (pyes)MBPAlbertoParo:tests alberto$
> 
> This is a first step. I'm investigating in using multiprocess and a  
> producer/consumer to increase the parallel/throughtput.  
> I'm open to suggestions and hits.
> 
> Hi,  
> Alberto

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 4:19am UTC](https://discuss.elastic.co/t/some-elasticsearch-thrift-test-performances-python/3321/3 "2017-07-06T04:19:28Z")

</div>