# Some questions about Wikipedia river

**URL:** <https://discuss.elastic.co/t/some-questions-about-wikipedia-river/7864>\
**Category:** Elasticsearch\
**Created:** [May 25, 2012, 2:16pm UTC](https://discuss.elastic.co/t/some-questions-about-wikipedia-river/7864 "2012-05-25T14:16:21Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Pinar\_Yanardag](https://sea2.discourse-cdn.com/elastic/user_avatar/discuss.elastic.co/pinar_yanardag/32/2611_2.png) [@Pinar\_Yanardag](https://discuss.elastic.co/u/Pinar_Yanardag)\
**Post date:** [May 25, 2012, 2:16pm UTC](https://discuss.elastic.co/t/some-questions-about-wikipedia-river/7864/1 "2012-05-25T14:16:21Z")

</div>

Hi,

I am using elasticsearch 0.19.4 and I've set up a wikipedia river [1](https://github.com/elasticsearch/elasticsearch-river-wikipedia) on  
top of that. I have three questions (sorry to pack them up in one thread):

1. the wikipedia dump is around 8GB -unzipped. But my data folder after  
indexing wikipedia is around 7GB. I assume that there was an interrupt  
during the indexing process, so it is not complete yet. Is there a way to  
make elasticsearch to continue indexing?

2. I am using elasticsearch to query tweets. I am experimenting if it's  
available to get some topic assignments from the search engine by doing  
this. I am currently using pyelasticsearch [2](https://github.com/rhec/pyelasticsearch) Python library and using  
basic search function. Do you think of any better search type that might be  
useful to search queries like the following?

res = conn.search("Donna Karan To Attend Haiti Charity Fundraiser")

Top 10 results and their scores:

Donna Karan 0.43873835  
Haiti/Government 0.1892942  
Haiti/People 0.1892942  
Haiti/Transportation 0.1892942  
Donna Summers 0.18910009  
Haiti/History 0.1801775  
Haiti/Communications 0.1801775  
Haitian music 0.1600614  
ISO 3166-1:HT 0.15908843  
Haiti/Transnational issues 0.15862915

1. Does elasticsearch supports query rewriting/pre-processing? If I search  
for "Obama" and "Obama's", the results are quite different.

Thanks,  
Pinar

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 3:27am UTC](https://discuss.elastic.co/t/some-questions-about-wikipedia-river/7864/2 "2017-07-06T03:27:07Z")

</div>