CLEF 2004 | Workshop



The CLEF 2004 Workshop was held on 15-17 September in Bath, UK, immediately following the eighth European Conference on Digital Libraries (ECDL 2004).
Working Notes containing a description of the organisation of the campaign, reports on the experiments of the participating groups and a first analysis of their results were distributed at the Workshop.

The aim of the Workshop was to present and discuss the results of the CLEF activity and allow researchers and developers to compare performance between systems using different approaches and strategies.

Final Programme

Wednesday, 15 September 2004 
12.00-14.30   REGISTRATION  
14.30-14.50   Welcome - Carol Peters, ISTI-CNR, Pisa, Italy  

AdHoc Plenary Session: Monolingual, Bilingual and Multilingual Experiments
Chair: Martin Braschler, Eurospider, Zurich, Switzerland

14.50-15.20   ►  Ad Hoc Track Overview - Martin Braschler, Eurospider, Zurich, Switzerland  
15.20-16.00   ►  Multilingual Search using Query Translation and Collection Selection, Jacques Savoy, U. Neuchâtel, Switzerland
►  SINAI at CLEF 2004: Using Machine Translation Resources with Mixed 2-step RSV Merging Algorithm, Fernando
    Martínez Santiago,
U.Jaen, Spain
16.00-16.30   BREAK  
16.30-18.00   ►  TLR at CLEF-2004: Capturing the Translation of Compounds and Other Experiments, Isabelle Moulinier, Thomson Legal
    and Regulatory, USA
►  Application of Variable Length N-gram Vectors to Monolingual and Bilingual Information Retrieval, Daniel Gayo Avello, U.
    Oviedo, Spain
►  Using Surface-Syntactic Parser and Deviation from Randomness: X-IOTA IR System used for CLIPS Mono & Bilingual
    Experiments for CLEF 2004
, Jean-Pierre Chevallet and Gilles Serasset, IPAL-CNRS, France
►  Analysis of Experiments on Hybridization of Different Approaches in Mono and Cross-Language Information Retrieval,
    José L. Martínez, MIRACLE team  Madrid, Spain
►  Experiments on Statistical Approaches to Compensate for Limited Linguistic Resources, Giorgio M. Di Nunzio, U.Padua,
19.00-21.00   Steering Committee Meeting  
Thursday, 16 September 2004

Invited Talk:
  Issues when Building CLIR Applications, Gregor Thurmair, linguatec, Munich, Germany


QA@CLEF Plenary Session
Chair: Bernardo Magnini, ITC-irst, Trento, Italy
►  QA Track Overview, Alessandro Vallin, ITC-irst, Trento, Italy
►  A Recall Oriented Approach to Question Answering, Maarten de Rijke, U.Amsterdam, The Netherlands
►  Question Answering using Sentence Parsing and Semantic Network Matching, Sven Hartrumpf, U.Hagen, Germany
►  Question Answering Pilot Task at CLEF 2004, Anselmo Peńas, LSI-UNED, Madrid, Spain
►  Discussion

11.05-11.30   BREAK  

iCLEF Plenary Session
Chairs: Douglas W. Oard, University of Maryland, USA

►  iCLEF Track Overview, Julio Gonzalo, LSI-UNED, Madrid, Spain
►  Improving Interaction with the User in Cross-Language Question Answering through Relevant Domains and Syntactic
    Semantic Patterns
, Fernando LLopis, U. Alicante, Spain
►  Bookmarking, Thesaurus, and Cooperation in Bilingual Question Answering (and screenshot), Jussi Karlgren, SICS,Stockholm, Sweden
►  Interactive Cross-Language Question Answering: Searching Passages versus Searching Documents, Fernando López
    Ostenero, LSI-UNED, Madrid, Spain
►  iCLEF 2004 at Maryland: Summarization Design for Interactive Cross-Language Question Answering, Douglas W. Oard,
    U. Maryland, USA
►  Discussion

13.00-14.30   LUNCH  

ImageCLEF plenary Session
Chair: Paul Clough, U. Sheffield, UK and Henning Müller, U. Hospitals Geneva, Switzerland
►  ImageCLEF Track Overview, Paul Clough, U. Sheffield, UK
►   Visual Features for Content-based Medical Image Retrieval, Peter Howarth, Imperial College London, UK
►  From Text to Image: Generating Visual Queries for Image Retrieval, Wen-Cheng Lin, National Taiwan University, Taiwan
►  DCU Experiments with the St Andrew's Collection: Machine Translation, Text-Image Matching Combination and Machine
    Translation Metrics
, Gareth Jones and Andy Way, Dublin City University, Ireland
►  Toward Cross-Language and Cross-Media Image Retrieval, Ahmed Id Oumohmed, U.Montreal, Canada
►  Comparison and Combination of Textaul and Visual Features for Interactive Image Retrieval, Pei-Cheng Cheng, National
    Chiao Tung University, Taiwan
►  New Ideas for 2005, Henning Müller, U. Hospitals Geneva, Switzerland

16.00-16.30   BREAK  

GIRT Plenary Session
Chair: Michael Kluck, IZ-Bonn, Germany
►  Overview, Michael Kluck, IZ-Bonn, Germany
►  University of Hagen at CLEF 2004: Indexing and Translating Concepts for the GIRT Task, Johannes Leveling, University
    of Hagen, Germany


Cross-Language Spoken Document Retrieval Plenary Session
Chair: Gareth Jones,
 Dublin City University, Ireland

►  The 2004 CL-SDR Track, Gareth Jones, Dublin City University, Ireland
►  Ideas for 2005, Gareth Jones, DCU, Ireland and Douglas W.Oard, U.Maryland, USA

17.30-19.30   Poster Session and Reception  
Friday, 17 September 2004

2 Breakout Sessions: QA@CLEF and ImageCLEF

10.30-11.00   BREAK  

2 Breakout Sessions: iCLEF and Adhoc Mono/Bi/Multilingual


Plenary Discussion on Ideas for New Tracks
Chair: Maarten de Rijke, University of Amsterdam, The Netherlands
►  Proposals regarding Web Track, Geographic IR, Multimedia Task

13.00-14.30   LUNCH  

Preliminary Agenda for CLEF 2005
Chair: Carol Peters, ISTI-CNR, Pisa, Italy


Invited talk:
Lessons from NTCIR-4: Focusing on Evaluation of CLIR on East Asian Languages, Patent and QA, Noriko Kando, National Institute of Informatics,
Tokyo, Japan


Panel Discussion: The Future of CLEF
Moderator: Douglas W. Oard, University of Maryland, USA
:    Martin Braschler, Zurich, Switzerland, CLEF2000 – 2004 Technical Coordinator
Marcello Federico, ITC-irst, Trento, Italy
Julio Gonzalo, LSI-UNED, Madrid, Spain
Donna Harman, National Institute of Standards and Technology, USA