MRR

Mean Reciprocal Rank (MRR)

MRR

$\text{MRR}=\frac{1}{|Q|}{\sum }_{i=1}^{|Q|}\frac{1}{{\text{rank}}_i}$

where ${\text{rank}}_i$ is the rank of the first relevant document for query $i$.

Useful when you care about how quickly the user finds any relevant result (e.g., question answering, navigational queries).

Appears In

• IR-L04 - Evaluation
• RS-L01 - Course Overview & Introduction
• RS-L02 - Evaluation Beyond Accuracy