CLEF 2009 |

CLEF 2009 Ad-Hoc Track

Page under development.

More complete information available soon

 

 

There are three very distinct tasks in the 2008 Ad-Hoc Track. The aim is to test both CL and IR aspects in a multilingual context.

The main task offers monolingual and cross-language search on library catalog records in English, French, and German, organised in collaboration with The European Library (TEL). The second task focuses more on linguistic issues, offering retrieval on test collections in languages thta pose processing challenges. . The third task is the robust task which aims at assessing whether word sense disambiguated (WSD) data does impact on IR system performance.

 

TEL@CLEF

 

Input on task organisation will be provided soon.

 

"Exotic" CLIR

 

Input on task organisation will be provided soon.

 

Robust-WSD

Robust-WSD aims at exploring the contribution of Word Sense Disambiguation to monolingual and multilingual Information Retrieval. The organizers of the task will provide documents and topics which have been automatically tagged with Word Senses from WordNet using several state-of-the-art Word Sense Disambiguation systems.

Robust-WSD at CLEF 2008 (http://www.clef-campaign.org/2008/working_notes/adhoc-final.pdf) showed that some top-scoring systems improved their IR and CLIR results with the use of WSD tags.

The Robust-WSD task will use two languages often used in previous CLEF campaigns (English, Spanish). Documents will be in English, and topics in both English and Spanish. The documents collections are based on the widely used LA94 and GH95 news collections.

More details at http://ixa2.si.ehu.es/clirwsd/