Working Notes for the CLEF 2007 Workshop, 19-21 September, Budapest, Hungary
CONTENTS
IntroductionWhat Happened in CLEF 2007? Introduction to the Working Notes Carol Peters Multilingual Textual Document Retrieval (Ad Hoc)CLEF 2007: Ad Hoc Track Overview Giorgio M. Di Nunzio, Nicola Ferro, Thomas Mandl, Carol Peters MonolingualPavel Ircing, Luděk Müller Sampling Precision to Depth 10000: Evaluation Experiments at CLEF 2007 Stephen Tomlinson Applying Query Expansion Techniques to Ad Hoc Monolingual tasks with the IR-n system Elisa Noguera, Fernando Llopis Stemming Approaches for East European Languages Ljiljana Dolamic, Jacques Savoy Hungarian and Czech Stemming using YASS Prasenjit Majumder, Mandar Mitra, Dipasree Pal Charles University at CLEF 2007 Ad-Hoc Track Pavel Češka, Pavel Pecina Cross-LanguageAmbiguity and Unknown Term Translation in CLIR Dong Zhou, Mark Truran, Tim Brailsford Evaluating Language Resources for CLEF 2007 Herika Hayurani, Syandra Sari, Mirna Adriani Amharic-English Information Retrieval with Pseudo Relevance Feedback Atelach Alemu Argaw Performing Cross-Language Retrieval with Wikipedia Péter Schönhofen, András Benczúr, István Bíró, Károly Csalogány Oromo-English Information Retrieval Experiments at CLEF 2007 Kula Kekeba Tune, Vasudeva Varma Indian Language SubtaskCross-Lingual Information Retrieval System for Indian Languages Jagadeesh Jagarlamudi, A Kumaran Bengali, Hindi and Telugu to English Ad-hoc Bilingual task at CLEF 2007 Sivaji Bandyopadhyay, Tapabrata Mondal, Sudip Kumar Naskar, Asif Ekbal, Rejwanul Haque, Srinivasa Rao Godavarthy Hindi and Marathi to English Cross Language Information Retrieval at CLEF 2007 Manoj Kumar Chinnakotla, Sagar Ranadive, Pushpak Bhattacharyya, Om P. Damani IIIT Hyderabad at CLEF 2007 - Adhoc Indian Language CLIR task Prasad Pingali, Vasudeva Varma Bengali and Hindi to English Cross-language Text Retrieval under Limited Resources Debasis Mandal, Sandipan Dandapat, Mayank Gupta, Pratyush Banerjee, Sudeshna Sarkar Robust and MoreReport of MIRACLE team for the Ad-Hoc track in CLEF 2007 José Miguel Goñi-Menoyo, José C. González-Cristóbal, Julio Villena-Román, Sara Lana-Serrano Fernando Martínez-Santiago, Arturo Montejo-Ráez, Miguel A. García Cumbreras CoLesIR at CLEF 2007: from English to French via Character N-Grams Jesús Vilares, Michael P. Oakes, Manuel Vilares Robust Retrieval Experiments at the University of Hildesheim Ben Heuwing, Thomas Mandl REINA at CLEF 2007 Robust Task Angel F. Zazo, Carlos G. Figuerola, José L. Alonso Berrocal Domain-Specific Information Retrieval (Domain-Specific)The Domain -Specific Track at CLEF 2007 Vivien Petras, Stefan Baerisch, Maximillian Stempfhuber Ray R. Larson XRCE’s Participation to CLEF 2007 Domain-Specific Track Stephane Clinchant, Jean-Michel Renders Domain-Specific Cross Language Retrieval: Comparing and Merging Structured and Unstructured Indices Jens Kürsten, Maximilian Eibl Domain-Specific IR for German, English and Russian Languages Claire Fautsch, Ljiljana Dolamic, Samir Abdou, Jacques Savoy Multiple Language Question Answering (QA@CLEF)Overviews Overview of the CLEF 2007 Multilingual Question Answering Track Danilo Giampiccolo, Pamela Forner, Anselmo Peñas, Christelle Ayache, Dan Cristea, Valentin Jijkoun, Petya Osenova, Paulo Rocha, Bogdan Sacaleanu, Richard Sutcliffe Overview of the Answer Validation Exercise 2007 Anselmo Peñas, Álvaro Rodrigo, Felisa Verdejo
Main Task: Mono and Bilingual QA Question Answering with Joost at CLEF 2007 Gosse Bouma, Geert Kloosterman, Jori Mur Cross Lingual Question Answering using CINDI_QA for QA@CLEF 2007 Chedid Haddad, Bipin C. Desai Menno van Zaanen, Diego Mollá Ana Mendes, Luísa Coheur, Nuno J. Mamede, Luis Romão, João Loureiro, Ricardo Ribeiro, Fernando Batista, David Martins de Matos Esfinge at CLEF 2007: First Steps in a Multiple Question and Multiple Answer Approach Luís Miguel Cabral, Luís Fernando Costa, Diana Santos The Senso Question Answering Approach to Portuguese QA@CLEF-2007 José Saias, Paulo Quaresma INAOE’s Participation at QA@CLEF 2007 Alberto Téllez, Antonio Juárez, Gustavo Hernández, Claudia Denicia, Esaú Villatoro, Manuel Montes, Luis Villaseñor MIRACLE Question Answering System for Spanish at CLEF 2007 César de Pablo-Sánchez, José Luis Martínez, Ana García-Ledesma, Doaa Samy, Paloma Martínez, Antonio Moreno-Sandoval, Harith Al-Jumaily Multilingual Question Answering through Intermediate Translation: LCC's PowerAnswer at QA@CLEF 2007 Mitchell Bowden, Marian Olteanu, Pasin Suriyentrakorn, Thomas d'Silva, Dan Moldovan Bogdan Sacaleanu, Günter Neumann, Christian Spurk RACAI’s Question Answering System at QA@CLEF 2007 Dan Tufiş, Dan Ştefănescu, Radu Ion, Alexandru Ceauşu Davide Buscaldi, Yassine Benajiba, Paolo Rosso, Emilio Sanchis University of Wolverhampton at CLEF 2007 Georgiana Puşcaşu, Constantin Orăsan Cross Lingual Question Answering using QRISTAL for CLEF 2007 Dominique Laurent, Patrick Séguéla, Sophie Nègre University of Hagen at QA@CLEF 2007: Coreference Resolution for Questions and Answer Merging Sven Hartrumpf, Ingo Glöckner, Johannes Leveling Priberam’s Question Answering System in QA@CLEF 2007 Carlos Amaral, Adán Cassan, Helena Figueira, André Martins, Afonso Mendes, Pedro Mendes, Cláudia Pinto, Daniel Vidal The University of Amsterdam at CLEF@QA 2007 Valentin Jijkoun, Katja Hofmann, David Ahn, Mahboob Alam Khalid, Joris van Rantwijk, Maarten de Rijke, Erik Tjong, Kim Sang Milen Kouylekov, Matteo Negri, Bernardo Magnini, Bonaventura Coppola Finding Answers Using Resources in the Internet Septian Adiwibowo, Mirna Adriani Luís Sarmento, Eugénio Oliveira Answer Validation Exercise (AVE) UNED at Answer Validation Exercise 2007 Álvaro Rodrigo, Anselmo Penas, Felisa Verdejo DFKI–LT at AVE 2007: Using Recognizing Textual Entailment for Answer Validation Rui Wang, Günter Neumann SINAI at QA@CLEF 2007. Answer Validation Exercise M.A. García-Cumbreras, J.M. Perea-Ortega, F. Martínez Santiago, L.A. Ureña-López The Contribution of the University of Alicante to AVE 2007 Óscar Ferrández, Daniel Micol, Rafael Muñoz, Manuel Palomar University of Hagen at CLEF 2007: Answer Validation Exercise Ingo Glöckner INAOE at AVE 2007: Experiments in Spanish Answer Validation Alberto Téllez-Valero, Manuel Montes-y-Gómez, Luis Villaseñor-Pineda QAST - Question Answering on Speech Transcription Robust Question Answering for Speech Transcripts Using Minimal Syntactic Analysis Pere R. Comas, Jordi Turmo, Mihai Surdeanu The LIMSI participation in the QAst track Sophie Rosset, Olivier Galibert, Gilles Adda, Eric Bilinski AnswerFinder at QAst 2007: Named Entity Recognition for QA on Speech Transcripts Diego Mollá, Steve Cassidy, Menno van Zaanen CLEF2007 Question Answering Experiments at Tokyo Institute of Technology E.W.D. Whittaker, J.R. Novak, M. Heie, S. Furui DFKI–LT at QAST 2007: Adapting QA Components to Mine Answers in Speech Transcripts Günter Neumann, Rui Wang Cross-Language Retrieval in Image Collections (ImageCLEF)Overviews Overview of the ImageCLEFphoto 2007 Photographic Retrieval Task Michael Grubinger, Paul Clough, Allan Hanbury, Henning Müller Overview of the ImageCLEF 2007 Object Retrieval Task Thomas Deselaers, Allan Hanbury, Ville Viitaniemi, András Bencúr, Mátyás Brendel, Bálint Daróczy, Hugo Jair Escalante Balderas, Theo Gevers, Carlos Arturo Hernández Gracidas, Steven C. H. Hoi, Jorma Laaksonen, Mingjing Li, Heidy Marisol Marin Castro, Hermann Ney, Xiaoguang Rui, Nicu Sebe, Julian Stöttinger, Lei Wu Overview of the ImageCLEF 2007 Medical Retrieval and Annotation Tasks Henning Müller, Thomas Deselaers, Eugene Kim, Jayashree Kalpathy–Cramer, Thomas M. Deserno, William Hersh ImageCLEFphoto Linked Relevance Feedback for the ImageCLEF Photo Task Ray R. Larson Exploring Image, Text and Geographic Evidences in ImageCLEF 2007 João Magalhães, Simon Overell, Stefan Rüger Julio Villena-Román, Sara Lana-Serrano, José Luis Martínez-Fernández, José Carlos González-Cristóbal XRCE’s Participation to ImageCLEFphoto 2007 Stephane Clinchant, Jean-Michel Renders, Gabriela Csurka Cross-Language and Cross-Media Image Retrieval: An Empirical Study at ImageCLEF2007 Steven C. H. Hoi Experiment for Using Web Information to do Query and Document Expansion Yih-Chen Chang, Hsin-Hsi Chen Experiments with Clustering the Collection at ImageCLEF 2007 Osama El Demerdash, Leila Kosseim, Sabine Bergler TIA-INAOE’s Participation at ImageCLEF 2007 H. Jair Escalante, Carlos A. Hernández, Aurelio López, Heidy M. Marín, Manuel Montes, Eduardo Morales, Luis E. Sucar, Luis Villaseñor IPAL at ImageClef 2007 Mixing Features, Models and Knowledge. Sheng Gao, Jean-Pierre Chevallet, Thi Hoang Diem Le, Trong Ton Pham, Joo Hwee Lim DCU and UTA at ImageCLEFPhoto 2007 Anni Järvelin, Peter Wilkins, Tomasz Adamek, Eija Airio, Gareth J. F. Jones, Alan F. Smeaton, Eero Sormunen Information Retrieval of Visual Descriptions with IR-n System based on Passages Sergio Navarro, Fernando Llopis, Rafael Muñoz Guillena, Elisa Noguera Multi-Modal Interactive Approach to ImageCLEF 2007 Photographic and Medical Retrieval Tasks by CINDI M. M. Rahman, Bipin C. Desai, Prabir Bhattacharya Cross-modal Retrieval by Text and Image Feature Biclustering András Benczúr, István Bíró, Mátyás Brendel, Károly Csalogány, Bálint Daróczy, Dávid Siklósi Using Pseudo-relevance Feedback to Improve Image Retrieval Results Mouna Torjmen, Karen Pinel-Sauvagnat, Mohand Boughanem Content-based Image Retrieval Using Shape-Size Pattern Spectra Florence Tushabe, Michael H. F. Wilkinson Experiments for the ImageCLEF 2007 Photographic Retrieval Task Thomas Wilhelm, Jens Kursten, Maximilian Eibl ImageCLEFmed CLEF2007: Image Annotation Task: an SVM-based Cue Integration Approach Tatiana Tommasi, Francesco Orabona, Barbara Caputo CYU_IM@ImageCLEF 2007: Medical Image Annotation Task Pei-Cheng Cheng, Wei-Pang Yang Multiplying Concept Sources for Graph Modeling Loïc Maisonnasse, Eric Gaussier, Jean-Pierre Chevallet Julio Villena-Román, Sara Lana-Serrano, José Carlos González-Cristóbal MIRACLE at ImageCLEFanot 2007: Machine Learning Experiments on Medical Image Annotation Sara Lana-Serrano, Julio Villena-Román, José Carlos González-Cristóbal, José Miguel Goñi-Menoyo Medical Image Retrieval and Automatic Annotation: OHSU at ImageCLEF 2007 Jayashree Kalpathy-Cramer, William Hersh Speeding up IDM without Degradation of Retrieval Quality Michael Springmann, Heiko Schuldt Baseline Results for the CLEF 2007 Medical Automatic Annotation Task Mark O. Güld, Thomas M. Deserno ImageCLEFphoto&med M.C. Díaz-Galiano, M.A. García-Cumbreras, M.T. Martín-Valdivia, A. Montejo-Raez, L.A. Ureña-López University and Hospitals of Geneva at ImageCLEF 2007 Xin Zhou, Julien Gobeill, Patrick Ruch, Henning Müller Thomas Deselaers, Tobias Gass, Tobias Weyand, Hermann Ney Cross-Language Speech Retrieval (CL-SR)Overview of the CLEF-2007 Cross Language Speech Retrieval Track Pavel Pecina, Petra Hoffmannová, Gareth J.F. Jones, Ying Zhang, Douglas W. Oard SINAI at CL-SR Task at CLEF 2007 M.C. Díaz-Galiano, M.T. Martín-Valdivia, M.A. García-Cumbreras, L.A. Ureña-López, Model Fusion Experiments for the Cross Language Speech Retrieval Task at CLEF 2007 Muath Alzghool, Diana Inkpen University of Chicago at the CLEF 2007 Cross Language Speech Retrieval Track Gina-Anne Levow Pavel Ircing, Luděk Müller Dublin City University at CLEF 2007: Cross Language Speech Retrieval (CL-SR) Experiments Ying Zhang, Gareth J. F. Jones, Ke Zhang Brown at CL-SR’07: Retrieving Conversational Speech in English and Czech Matthew Lease, Eugene Charniak Charles University at CLEF 2007 CL-SR Track Pavel Češka, Pavel Pecina The University of Amsterdam at the CLEF Cross Language Speech Retrieval Track 2007 Bouke Huurnink Multilingual Web Track (WebCLEF)Valentin Jijkoun, Maarten de Rijke REINA at WebCLEF 2007. Selecting Useful Snippets Carlos G. Figuerola, José L. Alonso Berrocal, Ángel F. Zazo Rodríguez, Emilio Rodríguez The University of Amsterdam at WebCLEF 2007: Using Centrality to Rank Web Snippets Valentin Jijkoun, Maarten de Rijke Dublin City University at WebCLEF 2007 Sisay Fissaha Adafre Cross-Language Geographical Retrieval (GeoCLEF)GeoCLEF 2007: the CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview Thomas Mandl, Fredric Gey, Giorgio Di Nunzio, Nicola Ferro, Ray Larson, Mark Sanderson, Diana Santos, Christa Womser-Hacker, Xing Xie Query Parsing Task for GeoCLEF2007 Report Zhisheng Li, Chong Wang, Xing Xie, Wei-Ying Ma University of Groningen at GeoCLEF 2007 Geoffrey Andogah, Gosse Bouma Zhisheng Li, Chong Wang, Xing Xie, Wei-Ying Ma GIR experiments with Forostar at GeoCLEF 2007 Simon Overell, João Magalhães, Stefan Rüger MIRACLE at GeoCLEF Query Parsing 2007: Extraction and Classification of Geographical Information Sara Lana-Serrano, Julio Villena-Román, José Miguel Goñi-Menoyo Cheshire at GeoCLEF 2007: Retesting Text Retrieval Baselines Ray R. Larson GEOUJA System. University of Jaén at GeoCLEF 2007 José M. Perea-Ortega, Miguel A. García-Cumbreras, Manuel García-Vega, Arturo Montejo-Ráez Monolingual Retrieval Experiments with Spatial Restrictions at GeoCLEF 2007 Ralph Kölle, Ben Heuwing, Thomas Mandl, Christa Womser-Hacker GeoCLEF2007 Experiments in Query Parsing and Cross-language GIR Rocio Guillén Davide Buscaldi, Paolo Rosso Johannes Leveling, Sven Hartrumpf TALP at GeoCLEF 2007: Using Terrier with Geographical Knowledge Filtering Daniel Ferrés, Horacio Rodríguez The University of Lisbon at GeoCLEF 2007 Nuno Cardoso, David Cruz, Marcirio Chaves, Mário J. Silva TALP at GeoQuery 2007: Linguistic and Geographical Analysis for Query Parsing Daniel Ferrés, Horacio Rodríguez Location Identification for Geographic Information Retrieval Nasikhin, Mirna Adriani CLEF in other Evaluation InitiativesCLEF at Morpho Challenge 2007 Overview of Morpho Challenge in CLEF 2007 Mikko Kurimo, Mathias Creutz, Ville Turunen Using Hand-Written Rewrite Rules to Induce Underlying Morphology Michael A. Tepper Towards Unsupervised Induction of Morphophonemic Rules Erwin Chan Simple Morpheme Labelling in Unsupervised Morpheme Analysis Delphine Bernhard Unsupervised and Knowledge-free Morpheme Segmentation and Analysis Stefan Bordag ParaMor: Finding Paradigms across Morphology Christian Monson, Jaime Carbonell, Alon Lavie, Lori Levin Unsupervised Acquiring of Morphological Paradigms from Tokenized Text Daniel Zeman N-Gram Morphemes for Retrieval Paul McNamee, James Mayfield Mikko Kurimo, Mathias Creutz, Matti Varjokallio Unsupervised Morpheme Analysis Evaluation by IR experiments – Morpho Challenge 2007 Mikko Kurimo, Mathias Creutz, Ville Turunen CLEF at SemEval 2007SemEval-2007 Task 01: Evaluating WSD on Cross-Language Information Retrieval Eneko Agirre, Oier Lopez de Lacalle, Bernardo Magnini, Arantxa Otegi, German Rigau, Piek Vossen
Appendices - Results for CLEF 2007 CampaignAppendix A: Results of the Ad-hoc Bilingual and Monolingual Tasks Appendix B: Results of the Core Tracks - Ad-hoc Robust Tasks Appendix C: Results of the Domain Specific Track Appendix D: Results of the GeoCLEF Track Appendix E: Participating Institutions |