IR Technologies … TREC consequences - 3
Forced concentration on quantitatively measured performance figures
- as TREC is about evaluation, comparison across systems is natural, but impossible in fairness
- good average Precision has become the holy grail
- now realised by most that this is not everything in measuring an IR system