CLEF Home

 

Working Notes for the CLEF 2007 Workshop, 19-21 September, Budapest, Hungary

 

Edited by Alessandro Nardi and Carol Peters

 

CONTENTS

 

Introduction

What Happened in CLEF 2007? Introduction to the Working Notes

         Carol Peters

Multilingual Textual Document Retrieval (Ad Hoc)

CLEF 2007: Ad Hoc Track Overview

         Giorgio M. Di Nunzio, Nicola Ferro, Thomas Mandl, Carol Peters

Monolingual

Czech Monolingual Information Retrieval Using Off-The-Shelf Components - the University of West Bohemia at CLEF 2007 Ad-Hoc track

         Pavel Ircing, Luděk Müller

Sampling Precision to Depth 10000: Evaluation Experiments at CLEF 2007

         Stephen Tomlinson

Applying Query Expansion Techniques to Ad Hoc Monolingual tasks with the IR-n system

         Elisa Noguera, Fernando Llopis

Stemming Approaches for East European Languages

         Ljiljana Dolamic, Jacques Savoy

Hungarian and Czech Stemming using YASS

         Prasenjit Majumder, Mandar Mitra, Dipasree Pal

Charles University at CLEF 2007 Ad-Hoc Track

         Pavel Češka, Pavel Pecina

Cross-Language

Ambiguity and Unknown Term Translation in CLIR

         Dong Zhou, Mark Truran, Tim Brailsford

Evaluating Language Resources for CLEF 2007

         Herika Hayurani, Syandra Sari, Mirna Adriani

Amharic-English Information Retrieval with Pseudo Relevance Feedback

         Atelach Alemu Argaw

Performing Cross-Language Retrieval with Wikipedia

         Péter Schönhofen, András Benczúr, István Bíró, Károly Csalogány

Oromo-English Information Retrieval Experiments at CLEF 2007

         Kula Kekeba Tune, Vasudeva Varma

Indian Language Subtask

Cross-Lingual Information Retrieval System for Indian Languages

         Jagadeesh Jagarlamudi, A Kumaran

Bengali, Hindi and Telugu to English Ad-hoc Bilingual task at CLEF 2007

         Sivaji Bandyopadhyay, Tapabrata Mondal, Sudip Kumar Naskar, Asif Ekbal, Rejwanul Haque, Srinivasa Rao Godavarthy

Hindi and Marathi to English Cross Language Information Retrieval at CLEF 2007

         Manoj Kumar Chinnakotla, Sagar Ranadive, Pushpak Bhattacharyya, Om P. Damani

IIIT Hyderabad at CLEF 2007 - Adhoc Indian Language CLIR task

         Prasad Pingali, Vasudeva Varma

Bengali and Hindi to English Cross-language Text Retrieval under Limited Resources

         Debasis Mandal, Sandipan Dandapat, Mayank Gupta, Pratyush Banerjee, Sudeshna Sarkar

Robust and More

Report of MIRACLE team for the Ad-Hoc track in CLEF 2007

         José Miguel Goñi-Menoyo, José C. González-Cristóbal, Julio Villena-Román, Sara Lana-Serrano

SINAI at CLEF Ad-Hoc Robust Track 2007: Applying Google Search Engine for Robust Cross-Lingual Retrieval

         Fernando Martínez-Santiago, Arturo Montejo-Ráez, Miguel A. García Cumbreras

CoLesIR at CLEF 2007: from English to French via Character N-Grams

         Jesús Vilares, Michael P. Oakes, Manuel Vilares

Robust Retrieval Experiments at the University of Hildesheim

         Ben Heuwing, Thomas Mandl

REINA at CLEF 2007 Robust Task

         Angel F. Zazo, Carlos G. Figuerola, José L. Alonso Berrocal

Domain-Specific Information Retrieval (Domain-Specific)

The Domain -Specific Track at CLEF 2007

         Vivien Petras, Stefan Baerisch, Maximillian Stempfhuber

Experiments in Classification Clustering and Thesaurus Expansion for Domain Specific Cross-Language Retrieval

         Ray R. Larson

XRCE’s Participation to CLEF 2007 Domain-Specific Track

         Stephane Clinchant, Jean-Michel Renders

Domain-Specific Cross Language Retrieval: Comparing and Merging Structured and Unstructured Indices

         Jens Kürsten, Maximilian Eibl

Domain-Specific IR for German, English and Russian Languages

         Claire Fautsch, Ljiljana Dolamic, Samir Abdou, Jacques Savoy

Multiple Language Question Answering (QA@CLEF)

Overviews

Overview of the CLEF 2007 Multilingual Question Answering Track

         Danilo Giampiccolo, Pamela Forner, Anselmo Peñas, Christelle Ayache, Dan Cristea, Valentin Jijkoun, Petya Osenova, Paulo Rocha, Bogdan Sacaleanu, Richard Sutcliffe

Overview of the Answer Validation Exercise 2007

         Anselmo Peñas, Álvaro Rodrigo, Felisa Verdejo

Overview of QAST 2007

Jordi Turmo, Pere Comas, Christelle Ayache, Djamel Mostefa, Sophie Rosset, Lori Lamel

Main Task: Mono and Bilingual QA

Question Answering with Joost at CLEF 2007

         Gosse Bouma, Geert Kloosterman, Jori Mur

Cross Lingual Question Answering using CINDI_QA for QA@CLEF 2007

         Chedid Haddad, Bipin C. Desai

AnswerFinder at QA@CLEF 2007

         Menno van Zaanen, Diego Mollá

QA@L2F@QA@CLEF

         Ana Mendes, Luísa Coheur, Nuno J. Mamede, Luis Romão, João Loureiro, Ricardo Ribeiro, Fernando Batista, David Martins de Matos

Esfinge at CLEF 2007: First Steps in a Multiple Question and Multiple Answer Approach

         Luís Miguel Cabral, Luís Fernando Costa, Diana Santos

The Senso Question Answering Approach to Portuguese QA@CLEF-2007

         José Saias, Paulo Quaresma

INAOE’s Participation at QA@CLEF 2007

         Alberto Téllez, Antonio Juárez, Gustavo Hernández, Claudia Denicia, Esaú Villatoro, Manuel Montes, Luis Villaseñor

MIRACLE Question Answering System for Spanish at CLEF 2007

         César de Pablo-Sánchez, José Luis Martínez, Ana García-Ledesma, Doaa Samy, Paloma Marnez, Antonio Moreno-Sandoval, Harith Al-Jumaily

Multilingual Question Answering through Intermediate Translation: LCC's PowerAnswer at QA@CLEF 2007

         Mitchell Bowden, Marian Olteanu, Pasin Suriyentrakorn, Thomas d'Silva, Dan Moldovan

DFKI-LT at QA@CLEF 2007

         Bogdan Sacaleanu, Günter Neumann, Christian Spurk

RACAI’s Question Answering System at QA@CLEF 2007

         Dan Tufiş, Dan Ştefănescu, Radu Ion, Alexandru Ceauşu

The UPV at QA@CLEF 2007

         Davide Buscaldi, Yassine Benajiba, Paolo Rosso, Emilio Sanchis

University of Wolverhampton at CLEF 2007

         Georgiana Puşcaşu, Constantin Orăsan

Cross Lingual Question Answering using QRISTAL for CLEF 2007

         Dominique Laurent, Patrick Séguéla, Sophie Nègre

University of Hagen at QA@CLEF 2007: Coreference Resolution for Questions and Answer Merging

         Sven Hartrumpf, Ingo Glöckner, Johannes Leveling

Priberam’s Question Answering System in QA@CLEF 2007

         Carlos Amaral, Adán Cassan, Helena Figueira, André Martins, Afonso Mendes, Pedro Mendes, Cláudia Pinto, Daniel Vidal

The University of Amsterdam at CLEF@QA 2007

         Valentin Jijkoun, Katja Hofmann, David Ahn, Mahboob Alam Khalid, Joris van Rantwijk, Maarten de Rijke, Erik Tjong, Kim Sang

FBK-irst at CLEF 2007

         Milen Kouylekov, Matteo Negri, Bernardo Magnini, Bonaventura Coppola

Finding Answers Using Resources in the Internet

         Septian Adiwibowo, Mirna Adriani

Making RAPOSA (FOX) smarter

         Luís Sarmento, Eugénio Oliveira

Answer Validation Exercise (AVE)

UNED at Answer Validation Exercise 2007

         Álvaro Rodrigo, Anselmo Penas, Felisa Verdejo

DFKI–LT at AVE 2007: Using Recognizing Textual Entailment for Answer Validation

         Rui Wang, Günter Neumann

SINAI at QA@CLEF 2007. Answer Validation Exercise

         M.A. García-Cumbreras, J.M. Perea-Ortega, F. Martínez Santiago, L.A. Ureña-López

The Contribution of the University of Alicante to AVE 2007

         Óscar Ferrández, Daniel Micol, Rafael Muñoz, Manuel Palomar

University of Hagen at CLEF 2007: Answer Validation Exercise

         Ingo Glöckner

INAOE at AVE 2007: Experiments in Spanish Answer Validation

         Alberto Téllez-Valero, Manuel Montes-y-Gómez, Luis Villaseñor-Pineda

QAST - Question Answering on Speech Transcription

Robust Question Answering for Speech Transcripts Using Minimal Syntactic Analysis

         Pere R. Comas, Jordi Turmo, Mihai Surdeanu

The LIMSI participation in the QAst track

         Sophie Rosset, Olivier Galibert, Gilles Adda, Eric Bilinski

AnswerFinder at QAst 2007: Named Entity Recognition for QA on Speech Transcripts

         Diego Mollá, Steve Cassidy, Menno van Zaanen

CLEF2007 Question Answering Experiments at Tokyo Institute of Technology

         E.W.D. Whittaker, J.R. Novak, M. Heie, S. Furui

DFKI–LT at QAST 2007: Adapting QA Components to Mine Answers in Speech Transcripts

         Günter Neumann, Rui Wang

Cross-Language Retrieval in Image Collections (ImageCLEF)

Overviews

Overview of the ImageCLEFphoto 2007 Photographic Retrieval Task

         Michael Grubinger, Paul Clough, Allan Hanbury, Henning Müller

Overview of the ImageCLEF 2007 Object Retrieval Task

         Thomas Deselaers, Allan Hanbury, Ville Viitaniemi, András Bencúr, Mátyás Brendel, Bálint Daróczy, Hugo Jair Escalante Balderas, Theo Gevers, Carlos Arturo Hernández Gracidas, Steven C. H. Hoi, Jorma Laaksonen, Mingjing Li, Heidy Marisol Marin Castro, Hermann Ney, Xiaoguang Rui, Nicu Sebe, Julian Stöttinger, Lei Wu

Overview of the ImageCLEF 2007 Medical Retrieval and Annotation Tasks

         Henning Müller, Thomas Deselaers, Eugene Kim, Jayashree Kalpathy–Cramer, Thomas M. Deserno, William Hersh

ImageCLEFphoto

Linked Relevance Feedback for the ImageCLEF Photo Task

         Ray R. Larson

Exploring Image, Text and Geographic Evidences in ImageCLEF 2007

         João Magalhães, Simon Overell, Stefan Rüger

MIRACLE at ImageCLEFphoto 2007: Evaluation of Merging Strategies for Multilingual and Multimedia Information Retrieval

         Julio Villena-Román, Sara Lana-Serrano, José Luis Martínez-Fernández, José Carlos González-Cristóbal

XRCE’s Participation to ImageCLEFphoto 2007

         Stephane Clinchant, Jean-Michel Renders, Gabriela Csurka

Cross-Language and Cross-Media Image Retrieval: An Empirical Study at ImageCLEF2007

         Steven C. H. Hoi

Experiment for Using Web Information to do Query and Document Expansion

         Yih-Chen Chang, Hsin-Hsi Chen

Experiments with Clustering the Collection at ImageCLEF 2007

         Osama El Demerdash, Leila Kosseim, Sabine Bergler

TIA-INAOE’s Participation at ImageCLEF 2007

         H. Jair Escalante, Carlos A. Hernández, Aurelio López, Heidy M. Marín, Manuel Montes, Eduardo Morales, Luis E. Sucar, Luis Villaseñor

IPAL at ImageClef 2007 Mixing Features, Models and Knowledge.

         Sheng Gao, Jean-Pierre Chevallet, Thi Hoang Diem Le, Trong Ton Pham, Joo Hwee Lim

DCU and UTA at ImageCLEFPhoto 2007

         Anni Järvelin, Peter Wilkins, Tomasz Adamek, Eija Airio, Gareth J. F. Jones, Alan F. Smeaton, Eero Sormunen

Information Retrieval of Visual Descriptions with IR-n System based on Passages

         Sergio Navarro, Fernando Llopis, Rafael Muñoz Guillena, Elisa Noguera

Multi-Modal Interactive Approach to ImageCLEF 2007 Photographic and Medical Retrieval Tasks by CINDI

         M. M. Rahman, Bipin C. Desai, Prabir Bhattacharya

Cross-modal Retrieval by Text and Image Feature Biclustering

         András Benczúr, István Bíró, Mátyás Brendel, Károly Csalogány, Bálint Daróczy, Dávid Siklósi

Using Pseudo-relevance Feedback to Improve Image Retrieval Results

         Mouna Torjmen, Karen Pinel-Sauvagnat, Mohand Boughanem

Content-based Image Retrieval Using Shape-Size Pattern Spectra

         Florence Tushabe, Michael H. F. Wilkinson

Experiments for the ImageCLEF 2007 Photographic Retrieval Task

         Thomas Wilhelm, Jens Kursten, Maximilian Eibl

ImageCLEFmed

CLEF2007: Image Annotation Task: an SVM-based Cue Integration Approach

         Tatiana Tommasi, Francesco Orabona, Barbara Caputo

CYU_IM@ImageCLEF 2007: Medical Image Annotation Task

         Pei-Cheng Cheng, Wei-Pang Yang

Multiplying Concept Sources for Graph Modeling

         Loïc Maisonnasse, Eric Gaussier, Jean-Pierre Chevallet

MIRACLE at ImageCLEFmed 2007: Merging Textual and Visual Strategies to Improve Medical Image Retrieval

         Julio Villena-Román, Sara Lana-Serrano, José Carlos González-Cristóbal

MIRACLE at ImageCLEFanot 2007: Machine Learning Experiments on Medical Image Annotation

         Sara Lana-Serrano, Julio Villena-Román, José Carlos González-Cristóbal, José Miguel Goñi-Menoyo

Medical Image Retrieval and Automatic Annotation: OHSU at ImageCLEF 2007

         Jayashree Kalpathy-Cramer, William Hersh

Speeding up IDM without Degradation of Retrieval Quality

         Michael Springmann, Heiko Schuldt

Baseline Results for the CLEF 2007 Medical Automatic Annotation Task

         Mark O. Güld, Thomas M. Deserno

ImageCLEFphoto&med

SINAI at ImageCLEF 2007

         M.C. Díaz-Galiano, M.A. García-Cumbreras, M.T. Martín-Valdivia, A. Montejo-Raez, L.A. Ureña-López

University and Hospitals of Geneva at ImageCLEF 2007

         Xin Zhou, Julien Gobeill, Patrick Ruch, Henning Müller

FIRE in ImageCLEF 2007

         Thomas Deselaers, Tobias Gass, Tobias Weyand, Hermann Ney

Cross-Language Speech Retrieval (CL-SR)

Overview of the CLEF-2007 Cross Language Speech Retrieval Track

         Pavel Pecina, Petra Hoffmannová, Gareth J.F. Jones, Ying Zhang, Douglas W. Oard

SINAI at CL-SR Task at CLEF 2007

         M.C. Díaz-Galiano, M.T. Martín-Valdivia, M.A. García-Cumbreras, L.A. Ureña-López,

Model Fusion Experiments for the Cross Language Speech Retrieval Task at CLEF 2007

         Muath Alzghool, Diana Inkpen

University of Chicago at the CLEF 2007 Cross Language Speech Retrieval Track

         Gina-Anne Levow

Attempts to Search Czech Spontaneous Spoken Interviews - the University of West Bohemia at CLEF 2007 CL-SR track

         Pavel Ircing, Luděk Müller

Dublin City University at CLEF 2007: Cross Language Speech Retrieval (CL-SR) Experiments

         Ying Zhang, Gareth J. F. Jones, Ke Zhang

Brown at CL-SR’07: Retrieving Conversational Speech in English and Czech

         Matthew Lease, Eugene Charniak

Charles University at CLEF 2007 CL-SR Track

         Pavel Češka, Pavel Pecina

The University of Amsterdam at the CLEF Cross Language Speech Retrieval Track 2007

         Bouke Huurnink

Multilingual Web Track (WebCLEF)

Overview of WebCLEF 2007

            Valentin Jijkoun, Maarten de Rijke

REINA at WebCLEF 2007. Selecting Useful Snippets

            Carlos G. Figuerola, José L. Alonso Berrocal, Ángel F. Zazo Rodríguez, Emilio Rodríguez

The University of Amsterdam at WebCLEF 2007: Using Centrality to Rank Web Snippets

            Valentin Jijkoun, Maarten de Rijke

Dublin City University at WebCLEF 2007

            Sisay Fissaha Adafre

Cross-Language Geographical Retrieval (GeoCLEF)

GeoCLEF 2007: the CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview

         Thomas Mandl, Fredric Gey, Giorgio Di Nunzio, Nicola Ferro, Ray Larson, Mark Sanderson, Diana Santos, Christa Womser-Hacker, Xing Xie

Query Parsing Task for GeoCLEF2007 Report

         Zhisheng Li, Chong Wang, Xing Xie, Wei-Ying Ma

University of Groningen at GeoCLEF 2007

         Geoffrey Andogah, Gosse Bouma

MSRA Columbus at GeoCLEF2007

         Zhisheng Li, Chong Wang, Xing Xie, Wei-Ying Ma

GIR experiments with Forostar at GeoCLEF 2007

         Simon Overell, João Magalhães, Stefan Rüger

MIRACLE at GeoCLEF Query Parsing 2007: Extraction and Classification of Geographical Information

         Sara Lana-Serrano, Julio Villena-Román, José Miguel Goñi-Menoyo

Cheshire at GeoCLEF 2007: Retesting Text Retrieval Baselines

         Ray R. Larson

GEOUJA System. University of Jaén at GeoCLEF 2007

         José M. Perea-Ortega, Miguel A. García-Cumbreras, Manuel García-Vega, Arturo Montejo-Ráez

Monolingual Retrieval Experiments with Spatial Restrictions at GeoCLEF 2007

         Ralph Kölle, Ben Heuwing, Thomas Mandl, Christa Womser-Hacker

GeoCLEF2007 Experiments in Query Parsing and Cross-language GIR

         Rocio Guillén

The UPV at GeoCLEF 2007

         Davide Buscaldi, Paolo Rosso

University of Hagen at GeoCLEF 2007: Exploring Location Indicators for Geographic Information Retrieval

         Johannes Leveling, Sven Hartrumpf

TALP at GeoCLEF 2007: Using Terrier with Geographical Knowledge Filtering

         Daniel Ferrés, Horacio Rodríguez

The University of Lisbon at GeoCLEF 2007

         Nuno Cardoso, David Cruz, Marcirio Chaves, Mário J. Silva

TALP at GeoQuery 2007: Linguistic and Geographical Analysis for Query Parsing

         Daniel Ferrés, Horacio Rodríguez

Location Identification for Geographic Information Retrieval

         Nasikhin, Mirna Adriani

CLEF in other Evaluation Initiatives

CLEF at Morpho Challenge 2007

Overview of Morpho Challenge in CLEF 2007

         Mikko Kurimo, Mathias Creutz, Ville Turunen

Using Hand-Written Rewrite Rules to Induce Underlying Morphology

         Michael A. Tepper

Towards Unsupervised Induction of Morphophonemic Rules

         Erwin Chan

Simple Morpheme Labelling in Unsupervised Morpheme Analysis

         Delphine Bernhard

Unsupervised and Knowledge-free Morpheme Segmentation and Analysis

         Stefan Bordag

ParaMor: Finding Paradigms across Morphology

         Christian Monson, Jaime Carbonell, Alon Lavie, Lori Levin

Unsupervised Acquiring of Morphological Paradigms from Tokenized Text

         Daniel Zeman

N-Gram Morphemes for Retrieval

         Paul McNamee, James Mayfield

Unsupervised Morpheme Analysis Evaluation by a Comparison to a Linguistic Gold Standard – Morpho Challenge 2007

         Mikko Kurimo, Mathias Creutz, Matti Varjokallio

Unsupervised Morpheme Analysis Evaluation by IR experiments – Morpho Challenge 2007

         Mikko Kurimo, Mathias Creutz, Ville Turunen

CLEF at SemEval 2007

SemEval-2007 Task 01: Evaluating WSD on Cross-Language Information Retrieval

         Eneko Agirre, Oier Lopez de Lacalle, Bernardo Magnini, Arantxa Otegi, German Rigau, Piek Vossen

 

Appendices - Results for CLEF 2007 Campaign

Appendix A:  Results of the Ad-hoc Bilingual and Monolingual Tasks

Appendix B:  Results of the Core Tracks - Ad-hoc Robust Tasks

Appendix C:  Results of the Domain Specific Track

Appendix D:  Results of the GeoCLEF Track

Appendix E:  Participating Institutions

File .zip

File. ISO (CD Version)