# Using a percolator for a huge blacklist

**URL:** <https://discuss.elastic.co/t/using-a-percolator-for-a-huge-blacklist/22394>\
**Category:** Elasticsearch\
**Created:** [February 25, 2015, 11:02pm UTC](https://discuss.elastic.co/t/using-a-percolator-for-a-huge-blacklist/22394 "2015-02-25T23:02:42Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![alexandre\_klein](https://avatars.discourse-cdn.com/v4/letter/a/8797f3/32.png) [@alexandre\_klein](https://discuss.elastic.co/u/alexandre_klein)\
**Post date:** [February 25, 2015, 11:02pm UTC](https://discuss.elastic.co/t/using-a-percolator-for-a-huge-blacklist/22394/1 "2015-02-25T23:02:42Z")

</div>

Hello,

I am trying to try and test different usages of the percolator.

I was wondering: i am currently storing in elasticsearch a lot of  
informations from twitter. And there is a lot of... inapropriate content.

Is percolator a good idea to store a query containing violent expressions  
list or domain list to match ?

It could be a huge list of words (10K entries, at last) , i don't think the  
query match with OR would fit for this usage...  
Do you have an idea of how i could implement it? Or is it a bad idea ?

Alex

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/9132c2b7-0bd8-416f-a1d6-368314acf7ad%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/9132c2b7-0bd8-416f-a1d6-368314acf7ad%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![alexandre\_klein](https://avatars.discourse-cdn.com/v4/letter/a/8797f3/32.png) [@alexandre\_klein](https://discuss.elastic.co/u/alexandre_klein)\
**Post date:** [February 26, 2015, 10:27am UTC](https://discuss.elastic.co/t/using-a-percolator-for-a-huge-blacklist/22394/2 "2015-02-26T10:27:03Z")

</div>

Forget it, it was a terrible idea. 🙂

Le jeudi 26 février 2015 00:02:42 UTC+1, [alexand...@instantluxe.com](mailto:alexand...@instantluxe.com) a  
écrit :

> Hello,
> 
> I am trying to try and test different usages of the percolator.
> 
> I was wondering: i am currently storing in elasticsearch a lot of  
> informations from twitter. And there is a lot of... inapropriate content.
> 
> Is percolator a good idea to store a query containing violent expressions  
> list or domain list to match ?
> 
> It could be a huge list of words (10K entries, at last) , i don't think  
> the query match with OR would fit for this usage...  
> Do you have an idea of how i could implement it? Or is it a bad idea ?
> 
> Alex

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![lesbarstow](https://avatars.discourse-cdn.com/v4/letter/l/4da419/32.png) [@lesbarstow](https://discuss.elastic.co/u/lesbarstow)\
**Post date:** [February 26, 2015, 4:28pm UTC](https://discuss.elastic.co/t/using-a-percolator-for-a-huge-blacklist/22394/3 "2015-02-26T16:28:34Z")

</div>

In the interest of enlightening others, what did you find?

On Thu, Feb 26, 2015 at 3:27 AM, [alexandre.klein@instantluxe.com](mailto:alexandre.klein@instantluxe.com) wrote:

> Forget it, it was a terrible idea. 🙂
> 
> Le jeudi 26 février 2015 00:02:42 UTC+1, [alexand...@instantluxe.com](mailto:alexand...@instantluxe.com) a  
> écrit :
> 
> > Hello,
> > 
> > I am trying to try and test different usages of the percolator.
> > 
> > I was wondering: i am currently storing in elasticsearch a lot of  
> > informations from twitter. And there is a lot of... inapropriate content.
> > 
> > Is percolator a good idea to store a query containing violent expressions  
> > list or domain list to match ?
> > 
> > It could be a huge list of words (10K entries, at last) , i don't think  
> > the query match with OR would fit for this usage...  
> > Do you have an idea of how i could implement it? Or is it a bad idea ?
> > 
> > Alex
> 
> --  
> You received this message because you are subscribed to the Google Groups  
> "elasticsearch" group.  
> To unsubscribe from this group and stop receiving emails from it, send an  
> email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
> To view this discussion on the web visit  
> [https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com)  
> [https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com?utm_medium=email&utm_source=footer)  
> .
> 
> For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/CAOppbCVSwdKgDqEznbNLE5E3Y6FovB4ZZw69wXV7X34RyiyFGw%40mail.gmail.com](https://groups.google.com/d/msgid/elasticsearch/CAOppbCVSwdKgDqEznbNLE5E3Y6FovB4ZZw69wXV7X34RyiyFGw%40mail.gmail.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![alexandre\_klein](https://avatars.discourse-cdn.com/v4/letter/a/8797f3/32.png) [@alexandre\_klein](https://discuss.elastic.co/u/alexandre_klein)\
**Post date:** [February 26, 2015, 10:59pm UTC](https://discuss.elastic.co/t/using-a-percolator-for-a-huge-blacklist/22394/4 "2015-02-26T22:59:07Z")

</div>

That i didn't really understood what Percolator is for. It's not a good  
idea to store a list of hundreds of domains in one query.

But it s better to store one domain by query.

Le jeudi 26 février 2015 17:28:42 UTC+1, Les Barstow a écrit :

> In the interest of enlightening others, what did you find?
> 
> On Thu, Feb 26, 2015 at 3:27 AM, \<[alexand...@instantluxe.com](mailto:alexand...@instantluxe.com) \<javascript:\>
> 
> > wrote:
> 
> > Forget it, it was a terrible idea. 🙂
> > 
> > Le jeudi 26 février 2015 00:02:42 UTC+1, [alexand...@instantluxe.com](mailto:alexand...@instantluxe.com) a  
> > écrit :
> > 
> > > Hello,
> > > 
> > > I am trying to try and test different usages of the percolator.
> > > 
> > > I was wondering: i am currently storing in elasticsearch a lot of  
> > > informations from twitter. And there is a lot of... inapropriate content.
> > > 
> > > Is percolator a good idea to store a query containing violent  
> > > expressions list or domain list to match ?
> > > 
> > > It could be a huge list of words (10K entries, at last) , i don't think  
> > > the query match with OR would fit for this usage...  
> > > Do you have an idea of how i could implement it? Or is it a bad idea ?
> > > 
> > > Alex
> > 
> > --  
> > You received this message because you are subscribed to the Google Groups  
> > "elasticsearch" group.  
> > To unsubscribe from this group and stop receiving emails from it, send an  
> > email to [elasticsearc...@googlegroups.com](mailto:elasticsearc...@googlegroups.com) \<javascript:\>.  
> > To view this discussion on the web visit  
> > [https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com)  
> > [https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com?utm\_medium=email&utm\_source=footer](https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com?utm_medium=email&utm_source=footer)  
> > .
> > 
> > For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

--  
You received this message because you are subscribed to the Google Groups "elasticsearch" group.  
To unsubscribe from this group and stop receiving emails from it, send an email to [elasticsearch+unsubscribe@googlegroups.com](mailto:elasticsearch+unsubscribe@googlegroups.com).  
To view this discussion on the web visit [https://groups.google.com/d/msgid/elasticsearch/c4004865-7f5d-436e-863a-47220031f743%40googlegroups.com](https://groups.google.com/d/msgid/elasticsearch/c4004865-7f5d-436e-863a-47220031f743%40googlegroups.com).  
For more options, visit [https://groups.google.com/d/optout](https://groups.google.com/d/optout).

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/elastic/original/3X/1/a/1ac57faf039f6b580b3f104ef42a2a89e41014de.png) [@system](https://discuss.elastic.co/u/system)\
**Post date:** [July 6, 2017, 12:29am UTC](https://discuss.elastic.co/t/using-a-percolator-for-a-huge-blacklist/22394/5 "2017-07-06T00:29:44Z")

</div>


