General items search task
Same as known item, except evaluation by NIST information analysts;
Two sets of judgements completed, with 84.6% agreement !
Evaluation measure calculated was precision but ongoing work on calculating ako recall;
Lessons learned … topics are very rich and relationship between text and video/image/audio not always obvious;