Percentiles and outliers

hi all,

i'm trying to filter a search by 99 percentile, which for now i consider
as outlier.
currently i have 3 phases:

  1. get all rows
  2. calculate the 99 percentile for each row (by its key)- update the row
    with outlier=true or false
  3. search again with filter "outlier=false"

i'm looking for a more elegant way to do it..

thanks
Lior

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b736aeb3-ae6d-49fc-805d-cd23a30e4879%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Perhaps you could use the Percentile Aggregation?

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/search-aggregations-metrics-percentile-aggregation.html

On Sep 30, 2014, at 2:01 AM, Lior Goldemberg liorg2@gmail.com wrote:

hi all,

i'm trying to filter a search by 99 percentile, which for now i consider as outlier.
currently i have 3 phases:

get all rows
calculate the 99 percentile for each row (by its key)- update the row with outlier=true or false
search again with filter "outlier=false"

i'm looking for a more elegant way to do it..

thanks
Lior

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b736aeb3-ae6d-49fc-805d-cd23a30e4879%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Concurso "Mi selfie por los 5". Detalles en http://justiciaparaloscinco.wordpress.com

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/3A52B632-EC6A-4651-BA29-EA52CCB075DE%40uci.cu.
For more options, visit https://groups.google.com/d/optout.