TREC Entity Track // Searching for entities and properties of entities

Monthly Archive for July, 2009

Test topics available

July 31, 2009Data, Update2 Comments

The test topics are available for download at the TREC site. You need to be a registered participant to be able to access them.

Developing topics for this track has turned out to be a very hard task. Among the many reasons is that lots of entity homepages are not in the Category B subset of the collection.

Given the facts that this is a new task, a new collection, and we have a relatively small number of topics (20), evaluation will primarily focus on analysis of the results on a per-topic basis, rather than on average measures.

The guidelines and the timeline have been updated.

Submissions are due by Sept 21.

Tags: , ,