Welcome to Cross Language Evaluation Forum

CLEF 2002 - WORKSHOP

The CLEF 2002 Workshop was held on 19-20 September in Rome, Italy, immediately following the sixth European Conference on Digital Libraries (ECDL 2002) at the:

Pontificia Università Gregoriana
Piazza della Pilotta, 4
00187 Roma

The aim of the Workshop was to present and discuss the results of the CLEF activity and allow researchers and developers to compare performance between systems using different approaches and strategies. A report will be available shortly.

Programme (with copies of workshop presentations)

Thursday, 19 September 2002
8.30-9.00		REGISTRATION
9.00-9.20		Welcome - Carol Peters, ISTI-CNR, Pisa, Italy
9.20-9.50		Overview of Results - Martin Braschler, Eurospider, Zurich, Switzerland
9.50-13.00		Cross-language Information Retrieval Chair: Martin Braschler, Eurospider, Zurich, Switzerland
9.50-10.30		Cross-language Retrieval Experiments at CLEF-2002 - Aitao Chen, University of California at Berkeley, USA Combined Strategies for Effective Multilingual IR - Jacques Savoy, University of Neuchatel, Switzerland
10.30-11.00		BREAK
11.00-13.00		Cross-language Information Retrieval (cont.) Exeter at 2002: Using English for non-English Bilingual Retrieval - Adenike M. Lam-Adesina and Gareth Jones, University of Exeter, UK UTACLIR @ CLEF 2002: Towards a Unified Translation Process Model - Eija Airio, University of Tampere, Finland Resolving Translation Ambiguity using Monolingual Corpora - Yan Qu, Gregory Grefenstette and David A. Evans, Clairvoyance Corporation, USA Statistical CLIR at ITC-irst - Marcello Federico and Nicola Bertoldi, ITC-irst, Italy Oce@CLEF: Participation of a Corporate Research Group - Roel Brand, Océ Technologies, The Netherlands Scalable Multilingual Information Access - Paul McNamee, Johns Hopkins University, USA
13.00-14.30		LUNCH
14.30-16.00		The CLEF Interactive Track (iCLEF) Chairs: Julio Gonzalo, UNED, Madrid, Spain and Douglas W. Oard, University of Maryland, USA
14.30-14.45		Track Overview - Douglas W. Oard, University of Maryland, USA
14.45-15.45		iCLEF at Universities of Alicante and Jaen - Fernando Llopis, University of Alicante, Spain Cross-language Relevance Assessment and Task Context - Jussi Karlgren, SICS, Sweden Comparing User-assisted and Automatic Query Translation - Douglas W. Oard, University of Maryland, USA Is Query Translation a Distinct Task from Search? - Daniela Petrelli, University of Sheffield, UK Query Reformulation by Phrases in Interactive CLIR - Julio Gonzalo, UNED, Spain iCLEF: Plans for 2003 - Julio Gonzalo, UNED, Spain
15.45-16.00		Discussion
16.00-16.20		BREAK
16.20-17.00		CLIR Evaluation Initiatives Chair: Donna Harman, National Institute of Standards and Technology (NIST), USA
		CLIR at NTCIR - Noriko Kando, National Institute of Informatics (NII), Japan CLIR at TREC - Fredric C. Gey, University of California, Berkeley, USA and Douglas W. Oard, University of Maryland, USA
17.00-17.30		Invited Talk Anatomy of a CLIR Application - David A.Evans, Gregory Grefenstette and Yan Qu, Clairvoyance Corporation, USA, and Joop van Gent, Irion Technologies, The Netherlands
17.30-20.00		POSTER SESSION AND RECEPTION

Friday, 20 September 2002
9.00-9.30		Invited Talk A Research Roadmap for CLIR: Results of a Workshop at SIGIR'02 - Fredric C. Gey, University of California, Berkeley, USA
9.30-10.30		Monolingual Information Retrieval Chair: Julio Gonzalo, UNED, Madrid, Spain
		Experiments with PROSIT at the Fondazione Bordoni - Gianni Amati, Claudio Carpineto and Giovanni Romano, Fondazione Ugo Bordoni, Italy Combining Morphological and N-gram Evidence for Monolingual Retrieval - Maarten de Rijke, University of Amsterdam, The Netherlands Experiments to Evaluate a Statistical Stemming Algorithm - Michela Bacchin, Nicola Ferro and Massimo Melucci, University of Padua Automatic Query Expansion using Random Indexing - Magnus Sahlgren, Jussi Karlgren, Rickard Cöster and Timo Järvinen, SICS, Sweden
10.30-11.00		BREAK
11.00-12.30		Information Retrieval for Scientific Collections Chairs: Michael Kluck, IZ- Bonn, Germany and Laurent Schmitt, INIST, France
11.00-11.15		The Amaryllis Task - Patrick Kremer, INIST, France
11.15-11.30		The GIRT Task - Michael Kluck, IZ-Bonn, Germany
11.30-12.15		Bibliographic Database Access using Free text and Controlled Vocabulary - Jacques Savoy, University of Neuchatel, Switzerland Domain-Specific Retrieval Experiments with MIMOR - Thomas Mandl, University of Hildesheim, Germany Exploiting Keyword Structure for Domain-Specific Retrieval - Jaap Kamps, University of Amsterdam, The Netherlands
12.15-12.30		Discussion
12.30-13.00		Evaluation Issues Chair: Michael Kluck, IZ-Bonn, Germany
		Linguistic and Statistical Analysis of the CLEF Topics - Christa Womser-Hacker, University of Hildesheim, Germany Assessment of Dutch Retrieval Results: a protocal parameter evaluation - Franciska de Jong, University of Twente, The Netherlands
13.00-14.30		LUNCH
14.30-15.30		Proposals for Future Tasks Chair: Carol Peters, ISTI-CNR, Pisa, Italy
		Evaluation of Cross-Language Question Answering Systems - Bernardo Magnini, ITC-irst, Italy Preliminary Work on Cross-Language Spoken Document Retrieval - Marcello Federico, ITC-irst, Italy, and Gareth Jones, University of Exeter, UK Evaluating Cross-Language Retrieval on an Image Collection - Daniela Petrelli and Mark Sanderson, University of Sheffield, UK
15.30-16.00		Schedule for CLEF 2003 - Carol Peters, ISTI-CNR, Pisa, Italy

Workshop Steering Committee
Martin Braschler, Eurospider, Switzerland
Khalid Choukri, ELDA/ELRA, Paris, France
Julio Gonzalo Arroyo, UNED, Madrid, Spain
Donna Harman, National Institute of Standards and Technology (NIST), USA
Noriko Kando, National Institute of Informatics (NII), Japan
Michael Kluck, IZ Sozialwissenschaften, Bonn, Germany
Patrick Kremer, INstitute de Information Scientifique et Technique, Vandoeuvre, France
Douglas W. Oard, University of Maryland, USA
Carol Peters, ISTI-CNR, Pisa, Italy
Peter Schäuble, Eurospider, Switzerland
Laurent Schmitt INstitute de Information Scientifique et Technique, Vandoeuvre, France
Ellen Voorhees, National Institute of Standards and Technology (NIST), USA

Local Organisation
Francesca Borri, ISTI-CNR, Pisa, Italy - mailto:(borri@iei.pi.cnr.it