Using a percolator for a huge blacklist

Elastic Stack Elasticsearch
1

Hello,

I am trying to try and test different usages of the percolator.

I was wondering: i am currently storing in elasticsearch a lot of
informations from twitter. And there is a lot of... inapropriate content.

Is percolator a good idea to store a query containing violent expressions
list or domain list to match ?

It could be a huge list of words (10K entries, at last) , i don't think the
query match with OR would fit for this usage...
Do you have an idea of how i could implement it? Or is it a bad idea ?

Alex

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/9132c2b7-0bd8-416f-a1d6-368314acf7ad%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

2

Forget it, it was a terrible idea. :slight_smile:

Le jeudi 26 février 2015 00:02:42 UTC+1, alexand...@instantluxe.com a
écrit :

Hello,

I am trying to try and test different usages of the percolator.

I was wondering: i am currently storing in elasticsearch a lot of
informations from twitter. And there is a lot of... inapropriate content.

Is percolator a good idea to store a query containing violent expressions
list or domain list to match ?

It could be a huge list of words (10K entries, at last) , i don't think
the query match with OR would fit for this usage...
Do you have an idea of how i could implement it? Or is it a bad idea ?

Alex

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

3

In the interest of enlightening others, what did you find?

On Thu, Feb 26, 2015 at 3:27 AM, alexandre.klein@instantluxe.com wrote:

Forget it, it was a terrible idea. :slight_smile:

Le jeudi 26 février 2015 00:02:42 UTC+1, alexand...@instantluxe.com a
écrit :

Hello,

I am trying to try and test different usages of the percolator.

I was wondering: i am currently storing in elasticsearch a lot of
informations from twitter. And there is a lot of... inapropriate content.

Is percolator a good idea to store a query containing violent expressions
list or domain list to match ?

It could be a huge list of words (10K entries, at last) , i don't think
the query match with OR would fit for this usage...
Do you have an idea of how i could implement it? Or is it a bad idea ?

Alex

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAOppbCVSwdKgDqEznbNLE5E3Y6FovB4ZZw69wXV7X34RyiyFGw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

4

That i didn't really understood what Percolator is for. It's not a good
idea to store a list of hundreds of domains in one query.

But it s better to store one domain by query.

Le jeudi 26 février 2015 17:28:42 UTC+1, Les Barstow a écrit :

In the interest of enlightening others, what did you find?

On Thu, Feb 26, 2015 at 3:27 AM, <alexand...@instantluxe.com <javascript:>

wrote:

Forget it, it was a terrible idea. :slight_smile:

Le jeudi 26 février 2015 00:02:42 UTC+1, alexand...@instantluxe.com a
écrit :

Hello,

I am trying to try and test different usages of the percolator.

I was wondering: i am currently storing in elasticsearch a lot of
informations from twitter. And there is a lot of... inapropriate content.

Is percolator a good idea to store a query containing violent
expressions list or domain list to match ?

It could be a huge list of words (10K entries, at last) , i don't think
the query match with OR would fit for this usage...
Do you have an idea of how i could implement it? Or is it a bad idea ?

Alex

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com
https://groups.google.com/d/msgid/elasticsearch/8539a7fd-a0e6-4d16-af52-4d4df1e0c1b9%40googlegroups.com?utm_medium=email&utm_source=footer
.

For more options, visit https://groups.google.com/d/optout.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/c4004865-7f5d-436e-863a-47220031f743%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.