Working Notes for the CLEF 2006 Workshop, 20-22 September, Alicante, Spain
CONTENTS
What happened in CLEF 2006 Introduction to the Working Notes Carol Peters Scientific Data of an Evaluation Campaign: Do We Properly Deal With Them? Maristella Agosti, Giorgio Maria Di Nunzio, Nicola Ferro Multilingual Textual Document Retrieval (Ad Hoc)CLEF 2006: Ad Hoc Track Overview Giorgio M. Di Nunzio, Nicola Ferro, Thomas Mandl, Carol Peters Cross-LanguageCELI participation at CLEF 2006: Cross Language Delegated Search Paolo Curtoni, Luca Dini Oromo-English Information Retrieval Experiments at CLEF 2006 Kula Kekeba Tune, Vasudeva Varma Hindi and Telugu to English Cross Language Information Retrieval at CLEF 2006 Prasad Pingali, Vasudeva Varma Amharic-English Information Retrieval Atelach Alemu Argaw, Lars Asker Statistical Machine Translation and Cross-Language IR: QMUL at CLEF 2006 Christof Monz The University of Lisbon at CLEF 2006 Ad-Hoc Task Nuno Cardoso, Mário J. Silva, Bruno Martins Evaluating Language Resources for English-Indonesian CLIR Herika Hayurani, Syandra Sari, Mirna Adriani MonolingualPassage Retrieval vs. Document Retrieval in the Monolingual Task with the IR-n system Elisa Noguera, Fernando Llopis The PUCRS-PLN Group Participation at CLEF 2006 Marco Gonzalez, Vera L. S de Lima Using Noun Phrases for Local Analysis in Automatic Query Expansion João Marcelo Azevedo Arcoverde, Maria das Graças Volpe Nunes, Wendel Scardua ENSM-SE at CLEF 2006: AdHoc Uses of Fuzzy Proximity Matching Function Annabelle Mercier, Michel Beigbeder A Study on the use of Stemming for Monolingual Ad-Hoc Portuguese Information Retrieval Viviane Moreira Orengo Benefits of deep NLP-based Lemmatization for Information Retrieval Péter Halácsy Statistical vs. Rule-Based Stemming for Monolingual French Retrieval Prasenjit Majumder, Mandar Mitra, Kalyankumar Datta Robust and MoreReport of MIRACLE Team for the Ad-Hoc Track in CLEF 2006 José Miguel Goñi-Menoyo, José Carlos González-Cristóbal, Julio Villena-Román CoLesIR at CLEF 2006: Rapid Prototyping of an N-gram-Based CLIR System Jesús Vilares, Michael P. Oakes, John I. Tait SINAI at CLEF 2006 Ad Hoc Robust Multilingual Track: Query Expansion using the Google Search Engine Fernando Martínez-Santiago, Artruro Montejo-Ráez, Miguel A. García-Cumbreras, L. Alfonso Ureña-López Robust Ad-hoc Retrieval Experiments with French and English at the University of Hildesheim Thomas Mandl, René Hackl, Christa Womser-Hacker Comparing the Robustness of Expansion Techniques and Retrieval Measures Stephen Tomlinson UniNE at CLEF 2006: Experiments with Monolingual, Bilingual, Domain-Specific and Robust Retrieval Jacques Savoy, Samir Abdou REINA at CLEF 2006 Robust Task: Local Query Expansion Using Term Windows for Robust Retrieval Angel Zazo, Carlos G. Figuerola, José Luis A. Berrocal DCU at CLEF 2006: Robust Cross Language Track Adenike M. Lam-Adesina, Gareth J.F. Jones Domain-Specific Information Retrieval (Domain-Specific)Maximilian Stempfhuber, Stefan Baerisch University of Hagen at CLEF2006: Reranking Documents for the Domain-specific Task Johannes Leveling Domain Specific Retrieval: Back to Basics Ray Larson Monolingual Retrieval Experiments with a Domain-Specific Document Corpus at the Chemnitz Technical University Jens Kürsten, Maximilian Eibl Interactive Cross-Language Information Retrieval (iCLEF)iCLEF 2006 Overview: Searching the Flickr WWW Photo-Sharing Repository Julio Gonzalo, Jussi Karlgren, Paul Clough Are Users Willing to Search Cross-Language? An Experiment with the Flickr Image Sharing Repository Javier Artiles, Julio Gonzalo, Fernando López-Ostenero,Víctor Peinado Providing Multilingual Access to FLICKR for Arabic Users Paul Clough, Azzah Al-Maskari, Kareem Darwish Trusting the results in crosslingual keyword-based image retrieval Jussi Karlgren, Fredrik Olsson Multiple Language Question Answering (QA@CLEF)Overview of the CLEF 2006 Multilingual Question Answering Track Bernardo Magnini, Danilo Giampiccolo, Pamela Forner, Christelle Ayache, Petya Osenova, Anselmo Peñas, Valentin Jijkoun, Bogdan Sacaleanu, Paulo Rocha, Richard Sutcliffe Overview of the Answer Validation Exercise 2006 Anselmo Peñas, Álvaro Rodrigo, Valentín Sama, Felisa Verdejo Valentin Jijkoun, Maarten de Rijke Main Task: Mono- and Bilingual QA Experiments with LSA for Passage Re-Ranking in Question Answering David Tomás, José L. Vicedo, Empar Bisbal, Lidia Moreno Cross-Language French-English Question Answering using the DLT System at CLEF 2006 Richard F. E. Sutcliffe, Kieran White, Darina Slattery, Igal Gabbay, Michael Mulcahy Prodicos Experiment Feedback for QA@CLEF2006 Emmanuel Desmontils, Christine Jacquin, Laura Monceaux Cross-Lingual Question Answering by Answer Translation Johan Bos, Malvina Nissim Extraction of Definitions for Bulgarian Hristo Tanev Priberam's Question Answering System in a Cross-Language Environment Adán Cassan, Helena Figueira, André Martins, Afonso Mendes, Pedro Mendes, Cláudia Pinto, Daniel Vidal LCC's PowerAnswer at QA@CLEF 2006 Mitchell Bowden, Marian Olteanu, Pasin Suriyentrakorn, Jonathan Clark, Dan Moldovan The University of Groningen at QA@CLEF 2006: Using Syntactic Knowledge for QA Gosse Bouma, Ismail Fahmi, Jori Mur, Gertjan van Noord, Lonneke van der Plas, Jörg Tiedemann BRUJA System. The University of Jaén at the Spanish Task of CLEFQA 2006 Miguel A. García-Cumbreras, L. Alfonso Ureña-López, Fernando Martínez-Santiago, Jose M. Perea-Ortega DFKI-LT at the CLEF 2006 Multiple Language Question Answering Track Bogdan Sacaleanu, Günter Neumann Cross Lingual Question Answering using QRISTAL for CLEF 2006 Dominique Laurent, Patrick Séguéla, Sophie Nègre CLEF2006 Question Answering Experiments at Tokyo Institute of Technology E. W. D. Whittaker, J. R. Novak, P. Chatain, P. R. Dixon, M. H. Heie, S. Furui The University of Amsterdam at CLEF@QA 2006 Valentin Jijkoun, Joris van Rantwijk, David Ahn, Erik Tjong, Kim Sang, Maarten de Rijke Using a Text Summarization System for Monolingual Question Answering Pedro Paulo Balage Filho, Vinícius Rodrigues de Uzêda, Thiago Alexandre Salgueiro Pardo, Maria das Graças Volpe Nunes Davide Buscaldi, José Manuel Gomez, Paolo Rosso, Emilio Sanchis Developing a Question Answering System for the Romanian-English Track at CLEF 2006 Georgiana Puşcaşu, Adrian Iftene, Ionut Pistol, Diana Trandabăt, Dan Tufiş, Alin Ceauşu, Dan Ştefănescu, Radu Ion, Constantin Orăsan, Iustin Dornescu, Alex Moruz, Dan Cristea Finding Answers in the Œdipe System by Extracting and Applying Linguistic Patterns Romaric Besançon, Mehdi Embarek, Olivier Ferret Esfinge – a Modular Question Answering System for Portuguese Luís Costa INAOE at CLEF 2006: Experiments in Spanish Question Answering Antonio Juárez-Gonzalez, Alberto Téllez-Valero, Claudia Denicia-Carral, Manuel Montes-y-Gómez, Luis Villaseñor-Pineda Accuracy of the AID System’s Information Retrieval in Processing Huge Data Collections* Jolanta Mizera-Pietraszko A Shallow Approach for Answer Selection based on Dependency Trees and Term Density Manuel Pérez-Coutiño, Manuel Montes-y-Gómez, Aurelio López-López, Luis Villaseñor-Pineda, Aarón Pancardo-Rodríguez University of Hagen at QA@CLEF 2006: Interpretation and Normalization of Temporal Expressions Sven Hartrumpf, Johannes Leveling Laurent Gillard, Laurianne Sitbon, Eric Blaudez, Patrice Bellot, Marc El-Bèze AliQAn and BRILI QA Systems at CLEF 2006 S. Ferrández, P. López-Moreno, S. Roger, A.. Ferrández, J. Peral, X. Alvarado, E. Noguera, F. Llopis The Bilingual System MUSCLEF at QA@CLEF 2006 Brigitte Grau, Anne-Laure Ligozat, Isabelle Robba, Anne Vilnat, Michael Bagur, Kevin Séjourné MIRACLE at the Spanish CLEF@QA 2006 Track César de Pablo-Sánchez, Ana González-Ledesma, Antonio Moreno, José Luis Martínez-Fernández, Paloma Martínez Finding Answers to Indonesian Questions from English Documents Sri Hartati Wijono, Indra Budi, Lily Fitria, Mirna Adriani Hunting Answers with RAPOSA (FOX) Luís Sarmento
Answer Validation Exercise (AVE)
The Effect of Entity Recognition in Answer Validation Álvaro Rodrigo, Anselmo Peñas, Felisa Verdejo A Knowledge-based Textual Entailment Approach applied to the QA Answer Validation at CLEF 2006 O. Ferrández, R.. M. Terol, R.. Muñoz, P. Martínez-Barco, M. Palomar Automatic Answer Validation using COGEX Marta Tatu, Brandon Iles, Dan Moldovan Jesús Herrera, Álvaro Rodrigo, A nselmo Peñas, Felisa Verdejo Paraphrase Substitution for Recognizing Textual Entailment Wauter Bosma, Chris Callison-Burch Experimenting a ”General Purpose” Textual Entailment Learner in AVE Fabio Massimo Zanzotto, Alessandro Moschitti University of Hagen at QA@CLEF 2006: Answer Validation Exercise Ingo Glöckner Zornitsa Kozareva, Sonia Vázquez, Andrés Montoyo Towards Entailment-based Question Answering: ITC-irst at CLEF 2006 Milen Kouylekov, Matteo Negri, Bernardo Magnini, Bonaventura Coppola Question Answering using Wikipedia (WiQA) The University of Amsterdam at WiQA 2006 Sisay Fissaha Adafre, Valentin Jijkoun, Maarten de Rijke Identifying Novel Information using Latent Semantic Analysis in the WiQA Task at CLEF 2006 Richard F. E. Sutcliffe, Josef Steinberger, Udo Kruschwitz, Mijail Alexandrov-Kabadjov, Massimo Poesio A Naïve Bag-of-Words Approach to Wikipedia QA Davide Buscaldi, Paolo Rosso University of Alicante at WiQA 2006 Antonio Toral Ruiz, Georgiana Puşcaşu, Lorenza Moreno Monteagudo,Rubén Izquierdo Beviá, Estela Saquete Boró A High Precision Information Retrieval Method for WiQA Constantin Orăsan, Georgiana Puşcaşu Ilya Geller César de Pablo-Sánchez, José Luis Martínez-Fernández, Paloma Martínez Cross-Language Retrieval in Image Collections (ImageCLEF)Overview of the ImageCLEF 2006 Photographic Retrieval and Object Annotation Tasks Paul Clough, Michael Grubinger, Thomas Deselaers, Allan Hanbury, Henning Müller Overview of the ImageCLEFmed 2006 Medical Retrieval and Annotation Tasks Henning Müller, Thomas Deselaers, Thomas Lehmann, Paul Clough, Eugene Kim, William Hersh ImageCLEFphoto Text Retrieval and Blind Feedback for the ImageCLEF Photo Task Ray R. Larson MIRACLE Team Report for ImageCLEF IR in CLEF 2006 José Luis Martínez-Fernández, Julio Villena, Ana García-Serrano, Paloma Martínez Visual Micro-clustering Pre-processing for Cross-Language Ad hoc Image Retrieval Masashi Inoue Yih-Chen Chang, Hsin-Hsi Chen Using Text and Image Retrieval Systems. Lic2m experiments at ImageCLEF 2006 Romaric Besançon, Christophe Millet CELI Participation at ImageCLEF 2006: Comparison with the Ad-hoc Track Paolo Curtoni, Luca Dini, Vittorio Di Tomaso ImageCLEF 2006 Experiments at the Chemnitz Technical University Thomas Wilhelm, Maximilian Eibl IPAL Inter-Media Pseudo-Relevance Feedback Approach to ImageCLEF 2006 Photo Retrieval Nicolas Maillot, Jean-Pierre Chevallet, Vlad Valea, Joo Hwee Lim Kieran Mc Donald, Gareth J. F. Jones ImageCLEFmed Performing Image Classification with a Frequency-based Information Retrieval Schema for ImageCLEF 2006 Henning Müller, Tobias Gass, Antoine Geissbuhler University of Freiburg at ImageCLEF06 - Radiograph Annotation Using Local Relational Features Lokesh Setia, Alexandra Teynor, Alaa Halawani, Hans Burkhardt Morphosaurus in ImageCLEF 2006: The Effect of Subwords on Biomedical IR Philipp Daumke, Jan Paetzold, Kornél Markó Medical Image Retrieval and Automated Annotation: OHSU at ImageCLEF 2006 William Hersh, Jayashree Kalpathy-Cramer, Jeffery Jensen MedIC/CISMeF at ImageCLEF 2006: Image Annotation and Retrieval Tasks F. Florea, A. Rogozan, V. Cornea, A. Bensrhair, S. Darmoni Medical Image Annotation and Retrieval Using Visual Features Jing Liu, Yang Hu, Mingjing Li, Wei-ying Ma Mark O. Güld, Christian Thies, Benedikt Fischer, Thomas M. Lehmann Two-stage SVM for Medical Image Annotation Bo Qiu, Changsheng Xu, Qi Tian IPAL Knowledge-based Medical Image Retrieval in ImageCLEFmed 2006 Caroline Lacoste, Jean-Pierre Chevallet, Joo-Hwee Lim, Xiong Wei, Daniel Raccoceanu, Diem Le Thi Hoang, Roxana Teodorescu, Nicolas Vuillenemot Baseline Results for the ImageCLEF 2006 Medical Automatic Annotation Task Mark O. Güld, Christian Thies, Benedikt Fischer, Thomas M. Lehmann ImageCLEFphoto&med Julien Gobeill, Henning Müller, Patrick Ruch M.C. Díaz-Galiano, M. A. García- Cumbreras, M. T. Martín-Valdivia, A. Montejo-Raez, L. A. Ureña-López M. M. Rahman, Varun Sood, Bipin C. Desai, Prabir Bhattacharya Image Retrieval and Annotation Using Maximum Entropy Thomas Deselaers, Tobias Weyand, Hermann Ney Cross-Language Speech Retrieval (CL-SR)Overview of the CLEF-2006 Cross-Language Speech Retrieval Track Douglas W. Oard, Jianqiang Wang, Gareth J.F. Jones, Ryen W. White, Pavel Pecina, Dagobert Soergel, Xiaoli Huang, Izhak Shafran The University of West Bohemia at CLEF 2006, the CL-SR Track Pavel Ircing, Ludĕk Müller Applying Logic Forms and Statistical Methods to CL-SR Performance R. M. Terol, P. Martínez-Barco, M. Palomar Speech Retrieval Experiments using XML Information Retrieval Djoerd Hiemstra, Roeland Ordelman, Robin Aly, Laurens van der Werff, Franciska de Jong University of Ottawa's Participation in the CL-SR Task at CLEF 2006 Muath Alzghool, Diana Inkpen CLEF-2006 CL-SR at Maryland: English and Czech Jianqiang Wang, Douglas W.Oard Dublin City University at CLEF 2006: Cross-Language Speech Retrieval (CL-SR) Experiments Gareth J. F. Jones, Ke Zhang, Adenike M. Lam-Adesina Multilingual Web Track (WebCLEF)Krisztian Balog, Leif Azzopardi, Jaap Kamps, Maarten de Rijke REINA at WebCLEF2006. Mixing Fields to Improve Retrieval Carlos G. Figuerola, José L. Alonso Berrocal, Ángel F. Zazo Rodríguez, Emilio Rodríguez UPV/BUAP Participation in WebCLEF 2006 David Pinto, Paolo Rosso, Ernesto Jiménez The University of Amsterdam at WebCLEF 2006 Krisztian Balog, Maarten de Rijke Multilingual Web Retrieval Experiments with Field Specific Indexing Strategies for CLEF 2006 at the University of Hildesheim Ben Heuwing, Thomas Mandl, Robert Strötgen Text Reduction-Enrichment at WebCLEF Franco Rojas, Héctor Jiménez-Salazar, David Pinto European Web Retrieval Experiments at WebCLEF 2006 Stephen Tomlinson Using Document Structure on Retrieving Webpages at the Web-CLEF 2006 Syntia Wijaya, Bimo Widhi, Tommy Khoerniawan, Mirna Adriani Cross-Language Geographical Retrieval (GeoCLEF)GeoCLEF 2006: the CLEF 2006 Cross-Language Geographic Information Retrieval Track Overview Fredric Gey, Ray Larson, Mark Sanderson, Kerstin Bischoff, Thomas Mandl, Christa Womser-Hacker, Diana Santos, Paulo Rocha, Giorgio M. Di Nunzio, Nicola Ferro Report of MIRACLE Team for Geographical IR in CLEF 2006 Sara Lana-Serrano, José M. Goñi-Menoyo, José C. González-Cristóbal Geoffrey Andogah Geographic IR Helped by Structured Geospatial Knowledge Resources A. Toral, O. Ferrández, E. Noguera, Z. Kozareva, A. Montoyo, R. Muñoz Monolingual and Bilingual Experiments in GeoCLEF2006 Rocio Guillén University of Hagen at GeoCLEF2006: Experiments with Metonymy Recognition in Documents Johannes Leveling, Dirk Veiel You-Heng Hu, Linlin Ge SINAI at GeoCLEF 2006: Expanding the Topics with Geographical Information and Thesaurus Manuel García-Vega, Miguel A. García-Cumbreras, L. Alfonso Ureña-López, José M. Perea-Ortega R2D2 at GeoCLEF 2006: a Mixed Approach Manuel García-Vega, Miguel A. García-Cumbreras, L. Alfonso Ureña-López, José M. Perea-Ortega, F. Javier Ariza-López, Oscar Ferrández, Antonio Toral, Zornitsa Kozareva, Elisa Noguera, Andrés Montoyo, Rafael Muñoz, Davide Buscaldi, Paolo Rosso Zhisheng Li, Chong Wang, Xing Xie, Wei-Ying Ma Place Disambiguation with Co-occurrence Models Simon Overell, João Magalhães, Stefan Rüger NICTA I2D2 Group at GeoCLEF 2006 LiYi, Nicola Stokes, Lawrence Cavedon, Alistair Moffat Kerstin Bischoff, Thomas Mandl, Christa Womser-Hacker WordNet-based Index Terms Expansion for Geographical Information Retrieval Davide Buscaldi, Paolo Rosso, Emilio Sanchis University of Twente at GeoCLEF 2006: Geofiltered Document Retrieval Claudia Hauff, Dolf Trieschnigg, Henning Rode TALP at GeoCLEF-2006: Experiments Using JIRS and Lucene with the ADL Feature Type Thesaurus Daniel Ferrés, Horacio Rodríguez GeoCLEF Text Retrieval and Manual Expansion Approaches Ray R. Larson, Fredric C. Gey Miguel E. Ruiz, Stuart Shapiro, June Abbas, Silvia B. Southwick, David Mark The University of Lisbon at GeoCLEF 2006 Bruno Martins, Nuno Cardoso, Marcirio Silveira Chaves, Leonardo Andrade, Mário J. Silva Appendices - Results for CLEF 2006 CampaignAppendix A: Results of the Ad-hoc Bilingual and Monolingual Tasks Appendix B: Results of the Ad-hoc Robust Task Appendix C: Results of the Domain-Specific Track Appendix D: Results of the GeoCLEF Track Appendix E: Statistics for the QA@CLEF Track Appendix F: Participating Institutions
|