Results of the CLEF 2002 Cross-Language System Evaluation Campaign

Working Notes for the CLEF 2002 Workshop
19-20 September, Rome, Italy

edited by Carol Peters

 

Introduction
         Carol Peters, ISTI-CNR, Pisa, Italy

Cross-Language and More

Cross-language Retrieval Experiments at CLEF 2002
        Aitao Chen, University of California at Berkeley, USA

Océ at CLEF 2002
         Roel Brand and Marvin Brünner, Océ Technologies, The Netherlands

Report on CLEF-2002 Experiments: Combining Multiple Sources of Evidence
         Jacques Savoy, Université de Neuchâtel, Switzerland

ITC-irst at CLEF 2002: Using N-best query translations for CLIR
         Nicola Bertoldi and Marcello Federico, ITC-irst, Italy

UTACLIR @ CLEF 2002: Towards a Unified Translation Process Model
         Eija Airio, Heikki Keskustalo, Turid Hedlund and Ari Pirkola, University of Tampere, Finland

Merging Different Languages in a Single Document Collection
   
     Jian-Yun Nie and Fuman Jin, Université de Montréal, Canada

EXETER at CLEF 2002: Experiments with Machine Translation for Monolingual and Bilingual Retrieval
         Adenike M. Lam-Adesina and Gareth J. F. Jones, University of Exeter, UK

The University of Amsterdam at CLEF 2002
   
     Christof Monz, Jaap Kamps and Maarten de Rijke, University of Amsterdam, The Netherlands

Portuguese-English Experiments using Latent Semantic Indexing
         Viviane Moreira Orengo and Christian Huyck, Middlesex University, UK

Thomson Legal and Regulatory Experiments for CLEF 2002
   
     Isabelle Moulinier and Hugo Molina-Salgado, TLR, USA  

Merging Mechanisms in Multilingual Information Retrieval
         Wen-Cheng Lin and Hsin-Hsi Chen, National Taiwan University, Taiwan R.O.C.

SINAI* on CLEF 2002: Experimenting with Merging Strategies
       
Fernando Martinez Santiago, Maite Martín and Alfonso Ureńa, University of Jaén, Spain

Cross-language Retrieval at Twente and TNO
         Dennis Reidsma, Djoerd Hiemstra, University of Twente; Franciska de Jong, University of Twente
   
     and TNO-TPD, Wessel Kraaij, TNO-TPD, The Netherlands

Resolving Translation Ambiguity using Monolingual Corpora. A Report on Clairvoyance CLEF-2002 Experiments
         Yan Qu, Greg Grefenstette and  David A. Evans, Clairvoyance Corporation, USA

Eurospider at CLEF 2002
         Martin Braschler, Anne Göhring, Peter Schäuble, Eurospider Information Technology AG, Switzerland

Scalable Multilingual Information Access
         Paul McNamee and James Mayfield, Johns Hopkins University, USA

Some Experiments with the Dutch Collection
         Arjen P. de Vries, CWI, Amsterdam,The Netherlands and Anne Diekema, Syracuse University, USA

Monolingual Experiments

Italian Monolingual Information Retrieval with PROSIT
         Gianni Amati, Claudio Carpineto, Giovanni Romano, Fondazione Ugo Bordoni, Italy

  COLE Experiments at CLEF 2002: Spanish monolingual track
         Jesús Vilares, Miguel A. Alonso, Universidade da Coruńa; Francisco.J. Ribadas and Manuel Vilares,
   
     Universidade de Vigo, Spain

University of Padua at CLEF 2002: Experiments to Evaluate a Statistical Stemming Algorithm
   
     Michela Bacchin, Nicola Ferro, Massimo Melucci, Universitŕ di Padova, Italy

IR-n System at Clef 2002
         Fernando Llopis, José Luis Vicedo and AntonioFerrández, University of Alicante, Spain

Term Expansion using Stemming and Thesauri in Spanish
         Ángel F. Zazo, Carlos G. Figuerola, José Luis A. Berrocal and Emilio Rodríguez,
   
     Universidad de Salamanca, Spain

Information Retrieval based on Explicit Knowledge Representation
   
     Elzbieta Dura and Marek Drejak, Lexware Labs, Göteborg, Sweden 182

PLIERS and Snowball at CLEF 2002
          Andrew MacFarlane, City University, London, UK

MediaLab @ CLEF-2002: Comparing Search Strategies
        Dennis Reidsma, Peter van der Weerd, MediaLab, The Netherlands

Experiments in 8 European Languages with Hummingbird SearchServer™ at CLEF2002
         Stephen Tomlinson, Hummingbird, Canada

Experiments with a Chunker and Lucene
   
      Gil Francopoulo, Tagmatica, France

SICS at CLEF 2002: Automatic Query Expansion using Random Indexing
         Magnus Sahlgren, Jussi Karlgren and Rickard Cöster, Swedish Institute of Computer Science, Sweden,
   
     and Timo Järvinen, Helsinki Science Park, Finland

 

IMBIT: Resources and Search Strategy
         Claudia Wortmann, IMBIT, Germany

Mainly Domain-Specific Information Retrieval

Are Thesauri Useful in Cross-Language Information Retrieval?
         Vivien Petras, Natalia Perelman and Fredric Gey, University of California at Berkeley, USA

XRCE Participation in CLEF 2002
   
         Jean-Michel Renders, Hervé Dejean and Eric Gaussier, XRCE, France

Domain Specific Retrieval Experiments with MIMOR at the University of Hildesheim
   
     René Hackl, Ralph Kölle, Thomas Mandl and Christa Womser-Hacker,
   
     University of Hildesheim, Germany

Interactive Track

The CLEF 2002 Interactive Track
   
     Douglas W. Oard, University of Maryland, USA and
        Julio Gonzalo, Universidad Nacional de Educación a Distancia, Spain

Cross-Language Relevance Assessment and Task Context
   
     Jussi Karlgren and Preben Hansen, Swedish Institute of Computer Science, Sweden

iCLEF at Universities of Alicante and Jaen
        Fernando Llopis, Antonio Ferrández and Jose Luis Vicedo, University of Alicante, Spain;
        Manuel C. Diaz and Fernando Martínez, University of Jaen, Spain

Comparing User-assisted and Automatic Query Translation
         Daqing He, Jianqiang Wang, Douglas W. Oard and Michael Nossal, University of Maryland, USA

Interactive Cross-Language Searching: phrases are better than terms for query formulation and refinement
   
     Fernando López-Ostenero, Julio Gonzalo, Anselmo Peńas and Felisa Verdejo, Universidad Nacional de
   
     Educación a Distancia, Spain

Is Query Translation a Distinct Task from Search?
   
     Daniela Petrelli, George Demetriou, Patrick Herring, Micheline Beaulieu, Mark Sanderson,
        University of Sheffield, UK

Evaluation Initiatives and Issues

CLIR at NTCIR Workshop 3
        Noriko Kando, National Institute of Informatics, Tokyo, Japan

Linguistic and Statistical Analysis of the CLEF Topics
        Thomas Mandl, Christa Womser-Hacker, University of Hildesheim, Germany

Appendix

Introduction
List of runs
Overview graphs
Individual results:
        Multilingual
        Bilingual
                German (DE) target language; English (EN) target language; Spanish (ES) target language: Finnish (FI) target language
                French (FI) target language; Italian (IT) target language;
Dutch (NL) target language; Swedish (SV) target language
        Monolingual
               German (DE)
; Spanish (ES); Finnish (FI); French (FR); Italian (IT); Dutch (NL); Swedish (SV)
        AMARYLLIS Task
        GIRT Task