TREC Entity Track // Searching for entities and properties of entities

Conference agenda

Below is an overview of entity track related events over the 2009 TREC conference.

Date Time Event Location
Tue, Nov 17 13:30-17:30 Entity Track Workshop I Lecture Room D
Wed, Nov 18 12:30-13:00 Entity Track Overview Main Auditorium
Thu, Nov 19 14:10-15:30 Entity Track Session Green Auditorium
Fri, Nov 20 09:00-10:30 Entity Track Workshop II Lecture Room D

Tags: , ,

Test topics available

The test topics are available for download at the TREC site. You need to be a registered participant to be able to access them.

Developing topics for this track has turned out to be a very hard task. Among the many reasons is that lots of entity homepages are not in the Category B subset of the collection.

Given the facts that this is a new task, a new collection, and we have a relatively small number of topics (20), evaluation will primarily focus on analysis of the results on a per-topic basis, rather than on average measures.

The guidelines and the timeline have been updated.

Submissions are due by Sept 21.

Tags: , ,

Timeline and training topics

The timeline has been posted.
A number of training topics have been made available. There is a separate page to facilitate discussion.

Tags: ,

Draft guidelines available

The first year of the track will investigate the problem of related entity finding. Given the name and homepage of an entity, as well as the type of the target entity, find related entities that are of target type. Entity types are limited to people, organizations, and products. Participating systems need to return homepages of related entities, and, optionally, a string answer that represents the entity concisely (i.e., the name of the entity).

The draft guidelines are available at this page.

Your comments on the draft are welcomed and encouraged.

Tags:

Dataset is available

The Entity track (among several other TREC tracks) will use the ClueWeb09 dataset, which has officially been released. The full collection consists of 1 billion pages, in 10 languages. For the first year of the Entity track we will use the smaller, “Category B” subset, which contains about 50 million English pages.

Tags:

Task proposals up for discussion

December 12, 2008 by Krisztian BalogUpdate2 Comments

There is only one pilot task is going to run in 2009. We invite you to exchange views on the two candidates: related entity finding and attribute identification.
You need to register before being able to post comments.

Tags: , ,

Entity workshop summary from TREC2008

This is a brief summary of the Entity track workshop from the TREC 2008 conference.

The overall aim of this new track is to perform entity-related search on Web data. Often, users search for specific entities instead of just any type of documents. These search tasks address common information needs that are not that well modeled as adhoc document search.

Read the rest of this entry »

Tags: , , ,

Blog launched

This blog serves as the official homepage of the TREC Entity track.

In order to post comments, you need to register.

You are very welcome to join the track’s mailing list, visit http://groups.google.com/group/trec-entity to apply for membership.

Tags: , ,