Below is an overview of entity track related events over the 2009 TREC conference.
| Date | Time | Event | Location |
|---|---|---|---|
| Tue, Nov 17 | 13:30-17:30 | Entity Track Workshop I | Lecture Room D |
| Wed, Nov 18 | 12:30-13:00 | Entity Track Overview | Main Auditorium |
| Thu, Nov 19 | 14:10-15:30 | Entity Track Session | Green Auditorium |
| Fri, Nov 20 | 09:00-10:30 | Entity Track Workshop II | Lecture Room D |
Tags: agenda, conference, TREC2009
The test topics are available for download at the TREC site. You need to be a registered participant to be able to access them.
Developing topics for this track has turned out to be a very hard task. Among the many reasons is that lots of entity homepages are not in the Category B subset of the collection.
Given the facts that this is a new task, a new collection, and we have a relatively small number of topics (20), evaluation will primarily focus on analysis of the results on a per-topic basis, rather than on average measures.
The guidelines and the timeline have been updated.
Submissions are due by Sept 21.
Tags: guidelines, timeline, topics
The timeline has been posted.
A number of training topics have been made available. There is a separate page to facilitate discussion.
The first year of the track will investigate the problem of related entity finding. Given the name and homepage of an entity, as well as the type of the target entity, find related entities that are of target type. Entity types are limited to people, organizations, and products. Participating systems need to return homepages of related entities, and, optionally, a string answer that represents the entity concisely (i.e., the name of the entity).
The draft guidelines are available at this page.
Your comments on the draft are welcomed and encouraged.
Tags: task guidelines
The Entity track (among several other TREC tracks) will use the ClueWeb09 dataset, which has officially been released. The full collection consists of 1 billion pages, in 10 languages. For the first year of the Entity track we will use the smaller, “Category B” subset, which contains about 50 million English pages.
Tags: Data
There is only one pilot task is going to run in 2009. We invite you to exchange views on the two candidates: related entity finding and attribute identification.
You need to register before being able to post comments.
Tags: Discussion, proposal, tasks
This is a brief summary of the Entity track workshop from the TREC 2008 conference.
The overall aim of this new track is to perform entity-related search on Web data. Often, users search for speciļ¬c entities instead of just any type of documents. These search tasks address common information needs that are not that well modeled as adhoc document search.
This blog serves as the official homepage of the TREC Entity track.
In order to post comments, you need to register.
You are very welcome to join the track’s mailing list, visit http://groups.google.com/group/trec-entity to apply for membership.
Tags: blog, launched, mailing_list