Test topics available
The test topics are available for download at the TREC site. You need to be a registered participant to be able to access them.
Developing topics for this track has turned out to be a very hard task. Among the many reasons is that lots of entity homepages are not in the Category B subset of the collection.
Given the facts that this is a new task, a new collection, and we have a relatively small number of topics (20), evaluation will primarily focus on analysis of the results on a per-topic basis, rather than on average measures.
The guidelines and the timeline have been updated.
Submissions are due by Sept 21.
Tags: guidelines, timeline, topics