How to calculate relevancy by the help of precision and recall


(Navneet Mathpal) #1

Hi,

I want to know how do we calculate relevancy with the help of precision and
reacall,

for example:-
A = The number of relevant records retrieved,
B = The number of relevantrecords not retrieved, and
C = The number of irrelevant records retrieved.
In this example A = 45, B = 35(80-45)and C = 15(60-45)
Recall =(45 / (45 + 35)) * 100% => 45/80 * 100% =56%
Precision =(45 / (45 + 15)) * 100% => 45/60 * 100% =75%

what would be its relevancy how how ?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/0c5e3d1e-b58b-4ff1-a893-0cfbaef87aa8%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Ivan Brusic) #2

Interesting topic. Not elasticsearch specific, but nevertheless
interesting. One method to calculate relevancy given the precision and
recall of a query is by using the F1 score:

F1 would be equal to 2 * (P * R) / (P + R), where P is the precision and R
is the recall.

I am glad someone is using elasticsearch as a search engine. Lately it
feels like it is mainly an analytical tool. :slight_smile:

Cheers,

Ivan

On Tue, Feb 4, 2014 at 10:06 PM, Navneet Mathpal <navneetmathpal93@gmail.com

wrote:

Hi,

I want to know how do we calculate relevancy with the help of precision
and reacall,

for example:-
A = The number of relevant records retrieved,
B = The number of relevantrecords not retrieved, and
C = The number of irrelevant records retrieved.
In this example A = 45, B = 35(80-45)and C = 15(60-45)
Recall =(45 / (45 + 35)) * 100% => 45/80 * 100% =56%
Precision =(45 / (45 + 15)) * 100% => 45/60 * 100% =75%

what would be its relevancy how how ?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0c5e3d1e-b58b-4ff1-a893-0cfbaef87aa8%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CALY%3DcQCA2jdxr9G0p9fL6FVx%3DRvt5GH-O2vLsXb2N41OeCA5sw%40mail.gmail.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Navneet Mathpal) #3

hey thanks ivan :slight_smile:

On Wednesday, 5 February 2014 12:44:46 UTC+5:30, Ivan Brusic wrote:

Interesting topic. Not elasticsearch specific, but nevertheless
interesting. One method to calculate relevancy given the precision and
recall of a query is by using the F1 score:
http://en.wikipedia.org/wiki/F1_score

F1 would be equal to 2 * (P * R) / (P + R), where P is the precision and R
is the recall.

I am glad someone is using elasticsearch as a search engine. Lately it
feels like it is mainly an analytical tool. :slight_smile:

Cheers,

Ivan

On Tue, Feb 4, 2014 at 10:06 PM, Navneet Mathpal <navneetm...@gmail.com<javascript:>

wrote:

Hi,

I want to know how do we calculate relevancy with the help of precision
and reacall,

for example:-
A = The number of relevant records retrieved,
B = The number of relevantrecords not retrieved, and
C = The number of irrelevant records retrieved.
In this example A = 45, B = 35(80-45)and C = 15(60-45)
Recall =(45 / (45 + 35)) * 100% => 45/80 * 100% =56%
Precision =(45 / (45 + 15)) * 100% => 45/60 * 100% =75%

what would be its relevancy how how ?

--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to elasticsearc...@googlegroups.com <javascript:>.
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/0c5e3d1e-b58b-4ff1-a893-0cfbaef87aa8%40googlegroups.com
.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/ec8db27b-761b-4af5-a59b-fbd7901c5d8c%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(Navneet Mathpal) #4

Ivan but
On Wednesday, 5 February 2014 11:36:50 UTC+5:30, Navneet Mathpal wrote:

Hi,

I want to know how do we calculate relevancy with the help of precision
and reacall,

for example:-
A = The number of relevant records retrieved,
B = The number of relevantrecords not retrieved, and
C = The number of irrelevant records retrieved.
In this example A = 45, B = 35(80-45)and C = 15(60-45)
Recall =(45 / (45 + 35)) * 100% => 45/80 * 100% =56%
Precision =(45 / (45 + 15)) * 100% => 45/60 * 100% =75%

what would be its relevancy how how ?

--
You received this message because you are subscribed to the Google Groups "elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/a3fff8c4-c80b-4b78-9f3b-0ee38dd9b6b5%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


(system) #5