CLEF Home

 

Working Notes for the CLEF 2006 Workshop, 20-22 September, Alicante, Spain

 

CONTENTS

 

What happened in CLEF 2006 Introduction to the Working Notes

         Carol Peters

Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them?

         Maristella Agosti, Giorgio Maria Di Nunzio, Nicola Ferro

Multilingual Textual Document Retrieval (Ad Hoc)

CLEF 2006: Ad Hoc Track Overview

         Giorgio M. Di Nunzio, Nicola Ferro, Thomas Mandl, Carol Peters

Cross-Language

CELI participation at CLEF 2006: Cross Language Delegated Search

         Paolo Curtoni, Luca Dini

Oromo-English Information Retrieval Experiments at CLEF 2006

         Kula Kekeba Tune, Vasudeva Varma

Hindi and Telugu to English Cross Language Information Retrieval at CLEF 2006

         Prasad Pingali, Vasudeva Varma

Amharic-English Information Retrieval

         Atelach Alemu Argaw, Lars Asker

Statistical Machine Translation and Cross-Language IR: QMUL at CLEF 2006

         Christof Monz

The University of Lisbon at CLEF 2006 Ad-Hoc Task

         Nuno Cardoso, Mário J. Silva, Bruno Martins

Evaluating Language Resources for English-Indonesian CLIR

         Herika Hayurani, Syandra Sari, Mirna Adriani

Monolingual

Passage Retrieval vs. Document Retrieval in the Monolingual Task with the IR-n system

         Elisa Noguera, Fernando Llopis

The PUCRS-PLN Group Participation at CLEF 2006

         Marco Gonzalez, Vera L. S de Lima

Using Noun Phrases for Local Analysis in Automatic Query Expansion

         João Marcelo Azevedo Arcoverde, Maria das Graças Volpe Nunes, Wendel Scardua

ENSM-SE at CLEF 2006: AdHoc Uses of Fuzzy Proximity Matching Function

         Annabelle Mercier, Michel Beigbeder

A Study on the use of Stemming for Monolingual Ad-Hoc Portuguese Information Retrieval

         Viviane Moreira Orengo

Benefits of deep NLP-based Lemmatization for Information Retrieval

         Péter Halácsy

Statistical vs. Rule-Based Stemming for Monolingual French Retrieval

         Prasenjit Majumder, Mandar Mitra, Kalyankumar Datta

Robust and More

Report of MIRACLE Team for the Ad-Hoc Track in CLEF 2006

         José Miguel Goñi-Menoyo, José Carlos González-Cristóbal, Julio Villena-Román

CoLesIR at CLEF 2006: Rapid Prototyping of an N-gram-Based CLIR System

         Jesús Vilares, Michael P. Oakes, John I. Tait

SINAI at CLEF 2006 Ad Hoc Robust Multilingual Track: Query Expansion using the Google Search Engine

        Fernando Martínez-Santiago, Artruro Montejo-Ráez, Miguel A. García-Cumbreras, L. Alfonso Ureña-López

Robust Ad-hoc Retrieval Experiments with French and English at the University of Hildesheim

         Thomas Mandl, René Hackl, Christa Womser-Hacker

Comparing the Robustness of Expansion Techniques and Retrieval Measures

      Stephen Tomlinson

UniNE at CLEF 2006: Experiments with Monolingual, Bilingual, Domain-Specific and Robust Retrieval

         Jacques Savoy, Samir Abdou

REINA at CLEF 2006 Robust Task: Local Query Expansion Using Term Windows for Robust Retrieval

         Angel Zazo, Carlos G. Figuerola, José Luis A. Berrocal

DCU at CLEF 2006: Robust Cross Language Track

         Adenike M. Lam-Adesina, Gareth J.F. Jones

Domain-Specific Information Retrieval (Domain-Specific)

Domain-Specific Track CLEF 2006: Overview of Results and Approaches, Remarks on the Assessment Analysis

         Maximilian Stempfhuber, Stefan Baerisch

University of Hagen at CLEF2006: Reranking Documents for the Domain-specific Task

         Johannes Leveling

Domain Specific Retrieval: Back to Basics

         Ray Larson

Monolingual Retrieval Experiments with a Domain-Specific Document Corpus at the Chemnitz Technical University

         Jens Kürsten, Maximilian Eibl

Interactive Cross-Language Information Retrieval (iCLEF)

iCLEF 2006 Overview: Searching the Flickr WWW Photo-Sharing Repository

         Julio Gonzalo, Jussi Karlgren, Paul Clough

Are Users Willing to Search Cross-Language? An Experiment with the Flickr Image Sharing Repository

         Javier Artiles, Julio Gonzalo, Fernando López-Ostenero,Víctor Peinado

Providing Multilingual Access to FLICKR for Arabic Users

         Paul Clough, Azzah Al-Maskari, Kareem Darwish

Trusting the results in crosslingual keyword-based image retrieval

         Jussi Karlgren, Fredrik Olsson

Multiple Language Question Answering (QA@CLEF)

Overview of the CLEF 2006 Multilingual Question Answering Track

          Bernardo Magnini, Danilo Giampiccolo, Pamela Forner, Christelle Ayache, Petya Osenova, Anselmo Peñas,

          Valentin Jijkoun, Bogdan Sacaleanu, Paulo Rocha, Richard Sutcliffe

Overview of the Answer Validation Exercise 2006

          Anselmo Peñas, Álvaro Rodrigo, Valentín Sama, Felisa Verdejo

Overview of WiQA 2006

          Valentin Jijkoun, Maarten de Rijke

Main Task: Mono- and Bilingual QA

Experiments with LSA for Passage Re-Ranking in Question Answering

         David Tomás, José L. Vicedo, Empar Bisbal, Lidia Moreno

Cross-Language French-English Question Answering using the DLT System at CLEF 2006

         Richard F. E. Sutcliffe, Kieran White, Darina Slattery, Igal Gabbay, Michael Mulcahy

Prodicos Experiment Feedback for QA@CLEF2006

         Emmanuel Desmontils, Christine Jacquin, Laura Monceaux

Cross-Lingual Question Answering by Answer Translation

      Johan Bos, Malvina Nissim

Extraction of Definitions for Bulgarian

          Hristo Tanev

Priberam's Question Answering System in a Cross-Language Environment

          Adán Cassan, Helena Figueira, André Martins, Afonso Mendes, Pedro Mendes, Cláudia Pinto, Daniel Vidal

LCC's PowerAnswer at QA@CLEF 2006

          Mitchell Bowden, Marian Olteanu, Pasin Suriyentrakorn, Jonathan Clark, Dan Moldovan

The University of Groningen at QA@CLEF 2006: Using Syntactic Knowledge for QA

          Gosse Bouma, Ismail Fahmi, Jori Mur, Gertjan van Noord, Lonneke van der Plas, Jörg Tiedemann

BRUJA System. The University of Jaén at the Spanish Task of CLEFQA 2006

          Miguel A. García-Cumbreras, L. Alfonso Ureña-López, Fernando Martínez-Santiago, Jose M. Perea-Ortega

DFKI-LT at the CLEF 2006 Multiple Language Question Answering Track

          Bogdan Sacaleanu, Günter Neumann

Cross Lingual Question Answering using QRISTAL for CLEF 2006

          Dominique Laurent, Patrick Séguéla, Sophie Nègre

CLEF2006 Question Answering Experiments at Tokyo Institute of Technology

          E. W. D. Whittaker, J. R. Novak, P. Chatain, P. R. Dixon, M. H. Heie, S. Furui

The University of Amsterdam at CLEF@QA 2006

          Valentin Jijkoun, Joris van Rantwijk, David Ahn, Erik Tjong, Kim Sang, Maarten de Rijke

Using a Text Summarization System for Monolingual Question Answering

          Pedro Paulo Balage Filho, Vinícius Rodrigues de Uzêda, Thiago Alexandre Salgueiro Pardo, Maria das Graças Volpe Nunes

The UPV at QA@CLEF 2006

          Davide Buscaldi, José Manuel Gomez, Paolo Rosso, Emilio Sanchis

Developing a Question Answering System for the Romanian-English Track at CLEF 2006        

          Georgiana Puşcaşu, Adrian Iftene, Ionut Pistol, Diana Trandabăt, Dan Tufiş, Alin Ceauşu, Dan Ştefănescu,

          Radu Ion, Constantin Orăsan, Iustin Dornescu, Alex Moruz, Dan Cristea

Finding Answers in the Œdipe System by Extracting and Applying Linguistic Patterns

          Romaric Besançon, Mehdi Embarek, Olivier Ferret

Esfinge – a Modular Question Answering System for Portuguese

          Luís Costa

INAOE at CLEF 2006: Experiments in Spanish Question Answering

          Antonio Juárez-Gonzalez, Alberto Téllez-Valero, Claudia Denicia-Carral, Manuel Montes-y-Gómez, Luis Villaseñor-Pineda

Accuracy of the AID System’s Information Retrieval in Processing Huge Data Collections*

          Jolanta Mizera-Pietraszko

A Shallow Approach for Answer Selection based on Dependency Trees and Term Density

          Manuel Pérez-Coutiño, Manuel Montes-y-Gómez, Aurelio López-López, Luis Villaseñor-Pineda, Aarón Pancardo-Rodríguez

University of Hagen at QA@CLEF 2006: Interpretation and Normalization of Temporal Expressions

          Sven Hartrumpf, Johannes Leveling

The LIA at QA@CLEF-2006

          Laurent Gillard, Laurianne Sitbon, Eric Blaudez, Patrice Bellot, Marc El-Bèze

AliQAn and BRILI QA Systems at CLEF 2006

          S. Ferrández, P. López-Moreno, S. Roger, A.. Ferrández, J. Peral, X. Alvarado, E. Noguera, F. Llopis

The Bilingual System MUSCLEF at QA@CLEF 2006

          Brigitte Grau, Anne-Laure Ligozat, Isabelle Robba, Anne Vilnat, Michael Bagur, Kevin Séjourné

MIRACLE at the Spanish CLEF@QA 2006 Track

          César de Pablo-Sánchez, Ana González-Ledesma, Antonio Moreno, José Luis Martínez-Fernández, Paloma Martínez

Finding Answers to Indonesian Questions from English Documents

           Sri Hartati Wijono, Indra Budi, Lily Fitria, Mirna Adriani

Hunting Answers with RAPOSA (FOX)

           Luís Sarmento

 

Answer Validation Exercise (AVE)

 

The Effect of Entity Recognition in Answer Validation

         Álvaro Rodrigo, Anselmo Peñas, Felisa Verdejo

A Knowledge-based Textual Entailment Approach applied to the QA Answer Validation at CLEF 2006

         O. Ferrández, R.. M. Terol, R.. Muñoz, P. Martínez-Barco, M. Palomar

Automatic Answer Validation using COGEX

         Marta Tatu, Brandon Iles, Dan Moldovan

UNED Submission to AVE 2006

         Jesús Herrera, Álvaro Rodrigo, A nselmo Peñas, Felisa Verdejo

Paraphrase Substitution for Recognizing Textual Entailment

         Wauter Bosma, Chris Callison-Burch

Experimenting a ”General Purpose” Textual Entailment Learner in AVE

         Fabio Massimo Zanzotto, Alessandro Moschitti

University of Hagen at QA@CLEF 2006: Answer Validation Exercise

         Ingo Glöckner

Adaptation of a Machine-learning Textual Entailment System to a Multilingual Answer Validation Exercise

         Zornitsa Kozareva, Sonia Vázquez, Andrés Montoyo

Towards Entailment-based Question Answering: ITC-irst at CLEF 2006

         Milen Kouylekov, Matteo Negri, Bernardo Magnini, Bonaventura Coppola

Question Answering using Wikipedia (WiQA)

The University of Amsterdam at WiQA 2006

          Sisay Fissaha Adafre, Valentin Jijkoun, Maarten de Rijke

Identifying Novel Information using Latent Semantic Analysis in the WiQA Task at CLEF 2006

         Richard F. E. Sutcliffe, Josef Steinberger, Udo Kruschwitz, Mijail Alexandrov-Kabadjov, Massimo Poesio

A Naïve Bag-of-Words Approach to Wikipedia QA

         Davide Buscaldi, Paolo Rosso

University of Alicante at WiQA 2006

         Antonio Toral Ruiz, Georgiana Puşcaşu, Lorenza Moreno Monteagudo,Rubén Izquierdo Beviá, Estela Saquete Boró

A High Precision Information Retrieval Method for WiQA

         Constantin Orăsan, Georgiana Puşcaşu

LexiClone Inc. at CLEF WiQA

         Ilya Geller

MIRACLE at the Spanish WiQA Pilot: Using Named Entities and Cosine Similarity to extend Wikipedia articles

         César de Pablo-Sánchez, José Luis Martínez-Fernández, Paloma Martínez

Cross-Language Retrieval in Image Collections (ImageCLEF)

Overview of the ImageCLEF 2006 Photographic Retrieval and Object Annotation Tasks

         Paul Clough, Michael Grubinger, Thomas Deselaers, Allan Hanbury, Henning Müller

Overview of the ImageCLEFmed 2006 Medical Retrieval and Annotation Tasks

         Henning Müller, Thomas Deselaers, Thomas Lehmann, Paul Clough, Eugene Kim, William Hersh

ImageCLEFphoto

Text Retrieval and Blind Feedback for the ImageCLEF Photo Task

        Ray R. Larson

MIRACLE Team Report for ImageCLEF IR in CLEF 2006

        José Luis Martínez-Fernández, Julio Villena, Ana García-Serrano, Paloma Martínez

Visual Micro-clustering Pre-processing for Cross-Language Ad hoc Image Retrieval

        Masashi Inoue

Approaches Using a Word-Image Ontology and an Annotated Image Corpus as Intermedia for Cross-Language Image Retrieval

        Yih-Chen Chang, Hsin-Hsi Chen

Using Text and Image Retrieval Systems. Lic2m experiments at ImageCLEF 2006

        Romaric Besançon, Christophe Millet

CELI Participation at ImageCLEF 2006: Comparison with the Ad-hoc Track

        Paolo Curtoni, Luca Dini, Vittorio Di Tomaso

ImageCLEF 2006 Experiments at the Chemnitz Technical University

        Thomas Wilhelm, Maximilian Eibl

IPAL Inter-Media Pseudo-Relevance Feedback Approach to ImageCLEF 2006 Photo Retrieval

        Nicolas Maillot, Jean-Pierre Chevallet, Vlad Valea, Joo Hwee Lim

Dublin City University at CLEF 2006: Experiments for the ImageCLEF Photo Collection Standard Ad Hoc Task

        Kieran Mc Donald, Gareth J. F. Jones

ImageCLEFmed

Performing Image Classification with a Frequency-based Information Retrieval Schema for ImageCLEF 2006

         Henning Müller, Tobias Gass, Antoine Geissbuhler

University of Freiburg at ImageCLEF06 - Radiograph Annotation Using Local Relational Features

          Lokesh Setia, Alexandra Teynor, Alaa Halawani, Hans Burkhardt

Morphosaurus in ImageCLEF 2006: The Effect of Subwords on Biomedical IR

          Philipp Daumke, Jan Paetzold, Kornél Markó

Medical Image Retrieval and Automated Annotation: OHSU at ImageCLEF 2006

          William Hersh, Jayashree Kalpathy-Cramer, Jeffery Jensen

MedIC/CISMeF at ImageCLEF 2006: Image Annotation and Retrieval Tasks

          F. Florea, A. Rogozan, V. Cornea, A. Bensrhair, S. Darmoni

Medical Image Annotation and Retrieval Using Visual Features

         Jing Liu, Yang Hu, Mingjing Li, Wei-ying Ma

Combining Global Features within a Nearest Neighbor Classifier for Content-based Retrieval of Medical Images

         Mark O. Güld, Christian Thies, Benedikt Fischer, Thomas M. Lehmann

Two-stage SVM for Medical Image Annotation

          Bo Qiu, Changsheng Xu, Qi Tian

IPAL Knowledge-based Medical Image Retrieval in ImageCLEFmed 2006

         Caroline Lacoste, Jean-Pierre Chevallet, Joo-Hwee Lim, Xiong Wei, Daniel Raccoceanu, Diem Le Thi Hoang,

         Roxana Teodorescu, Nicolas Vuillenemot

Baseline Results for the ImageCLEF 2006 Medical Automatic Annotation Task

         Mark O. Güld, Christian Thies, Benedikt Fischer, Thomas M. Lehmann

ImageCLEFphoto&med

Query and Document Translation by Automatic Text Categorization: A Simple Approach to Establish a Strong Textual Baseline for ImageCLEFmed 2006

         Julien Gobeill, Henning Müller, Patrick Ruch

SINAI at ImageCLEF 2006

        M.C. Díaz-Galiano, M. A. García- Cumbreras, M. T. Martín-Valdivia, A. Montejo-Raez, L. A. Ureña-López

CINDI at ImageCLEF 2006: Image Retrieval &Annotation Tasks for the General Photographic and Medical Image Collections

        M. M. Rahman, Varun Sood, Bipin C. Desai, Prabir Bhattacharya

Image Retrieval and Annotation Using Maximum Entropy

        Thomas Deselaers, Tobias Weyand, Hermann Ney

Cross-Language Speech Retrieval (CL-SR)

Overview of the CLEF-2006 Cross-Language Speech Retrieval Track

         Douglas W. Oard, Jianqiang Wang, Gareth J.F. Jones, Ryen W. White, Pavel Pecina, Dagobert Soergel, Xiaoli Huang,

         Izhak Shafran

The University of West Bohemia at CLEF 2006, the CL-SR Track

         Pavel Ircing, Ludĕk Müller

Applying Logic Forms and Statistical Methods to CL-SR Performance

         R. M. Terol, P. Martínez-Barco, M. Palomar

Speech Retrieval Experiments using XML Information Retrieval        

         Djoerd Hiemstra, Roeland Ordelman, Robin Aly, Laurens van der Werff, Franciska de Jong

University of Ottawa's Participation in the CL-SR Task at CLEF 2006

         Muath Alzghool, Diana Inkpen

CLEF-2006 CL-SR at Maryland: English and Czech

         Jianqiang Wang, Douglas W.Oard

Dublin City University at CLEF 2006: Cross-Language Speech Retrieval (CL-SR) Experiments

         Gareth J. F. Jones, Ke Zhang, Adenike M. Lam-Adesina

Multilingual Web Track (WebCLEF)

Overview of WebCLEF 2006

         Krisztian Balog, Leif Azzopardi, Jaap Kamps, Maarten de Rijke

REINA at WebCLEF2006. Mixing Fields to Improve Retrieval

         Carlos G. Figuerola, José L. Alonso Berrocal, Ángel F. Zazo Rodríguez, Emilio Rodríguez

UPV/BUAP Participation in WebCLEF 2006

         David Pinto, Paolo Rosso, Ernesto Jiménez

The University of Amsterdam at WebCLEF 2006

         Krisztian Balog, Maarten de Rijke

Multilingual Web Retrieval Experiments with Field Specific Indexing Strategies for CLEF 2006 at the University of Hildesheim

         Ben Heuwing, Thomas Mandl, Robert Strötgen

Text Reduction-Enrichment at WebCLEF

         Franco Rojas, Héctor Jiménez-Salazar, David Pinto

European Web Retrieval Experiments at WebCLEF 2006

         Stephen Tomlinson

Using Document Structure on Retrieving Webpages at the Web-CLEF 2006

         Syntia Wijaya, Bimo Widhi, Tommy Khoerniawan, Mirna Adriani

Cross-Language Geographical Retrieval (GeoCLEF)

GeoCLEF 2006: the CLEF 2006 Cross-Language Geographic Information Retrieval Track Overview

         Fredric Gey, Ray Larson, Mark Sanderson, Kerstin Bischoff, Thomas Mandl, Christa Womser-Hacker, Diana Santos,

         Paulo Rocha, Giorgio M. Di Nunzio, Nicola Ferro

Report of MIRACLE Team for Geographical IR in CLEF 2006

         Sara Lana-Serrano, José M. Goñi-Menoyo, José C. González-Cristóbal

GIR Experimentation

         Geoffrey Andogah

Geographic IR Helped by Structured Geospatial Knowledge Resources

          A. Toral, O. Ferrández, E. Noguera, Z. Kozareva, A. Montoyo, R. Muñoz

Monolingual and Bilingual Experiments in GeoCLEF2006

           Rocio Guillén

University of Hagen at GeoCLEF2006: Experiments with Metonymy Recognition in Documents

          Johannes Leveling, Dirk Veiel

UNSW at GeoCLEF 2006

         You-Heng Hu, Linlin Ge

SINAI at GeoCLEF 2006: Expanding the Topics with Geographical Information and Thesaurus

          Manuel García-Vega, Miguel A. García-Cumbreras, L. Alfonso Ureña-López, José M. Perea-Ortega

R2D2 at GeoCLEF 2006: a Mixed Approach

          Manuel García-Vega, Miguel A. García-Cumbreras, L. Alfonso Ureña-López, José M. Perea-Ortega, F.  Javier Ariza-López,

          Oscar Ferrández, Antonio Toral, Zornitsa Kozareva, Elisa Noguera, Andrés Montoyo, Rafael Muñoz, Davide Buscaldi, Paolo Rosso

MSRA Columbus at GeoCLEF 2006

          Zhisheng Li, Chong Wang, Xing Xie, Wei-Ying Ma

Place Disambiguation with Co-occurrence Models

          Simon Overell, João Magalhães, Stefan Rüger

NICTA I2D2 Group at GeoCLEF 2006

          LiYi, Nicola Stokes, Lawrence Cavedon, Alistair Moffat

Blind Relevance Feedback and Named Entity based Query Expansion for Geographic Retrieval at GeoCLEF 2006

          Kerstin Bischoff, Thomas Mandl, Christa Womser-Hacker

WordNet-based Index Terms Expansion for Geographical Information Retrieval

          Davide Buscaldi, Paolo Rosso, Emilio Sanchis

University of Twente at GeoCLEF 2006: Geofiltered Document Retrieval

          Claudia Hauff, Dolf Trieschnigg, Henning Rode

TALP at GeoCLEF-2006: Experiments Using JIRS and Lucene with the ADL Feature Type Thesaurus

           Daniel Ferrés, Horacio Rodríguez

GeoCLEF Text Retrieval and Manual Expansion Approaches

           Ray R. Larson, Fredric C. Gey

UB at GeoCLEF 2006

           Miguel E. Ruiz, Stuart Shapiro, June Abbas, Silvia B. Southwick, David Mark

The University of Lisbon at GeoCLEF 2006

           Bruno Martins, Nuno Cardoso, Marcirio Silveira Chaves, Leonardo Andrade, Mário J. Silva

Appendices - Results for CLEF 2006 Campaign

Appendix A: Results of the Ad-hoc Bilingual and Monolingual Tasks

Appendix B: Results of the Ad-hoc Robust Task

Appendix C: Results of the Domain-Specific Track

Appendix D: Results of the GeoCLEF Track

Appendix E: Statistics for the QA@CLEF Track

Appendix F: Participating Institutions