The CLEF 2009 Workshop was held from 30 September to 2 October in Corfu, Greece, immediately following the thirteenth European Conference on Digital Libraries (ECDL 2009). It was preceded by the Theseus/ImageCLEF workshop on Visual Information Retrieval Evaluation.

The aim of the Workshop was to present and discuss the results of the CLEF 2009 evaluation campaign.
You can see the programme and the presentations here below (work in progress).

Wednesday, 30 September
12.30 –14.00	Registration
14.00 –18.40	Plenary Sessions - Ballroom
14.00 – 14.30	Welcome – Carol Peters, ISTI-CNR, Pisa, Italy
14.30 – 15.20	Ad Hoc Track Overview The TEL and Persian Tasks – Nicola Ferro, University of Padua, Italy Robust-WSD Exercise – Eneko Agirre, University of the Basque Country, Spain
15.20 – 16.00	CLEF-IP Track Overview CLEF-IP 2009: Retrieval Experiments in the Intellectual Property Domain – Giovanna Roda, Matrixware, Austria
16.00 – 16.30	Break
16.30 – 17.00	iCLEF Track Overview iCLEF 2009: the Good and the Bad – Julio Gonzalo, LSI-UNED, Spain
17.00 – 17.50	QA@CLEF Track Overview QA Introduction – Anselmo Peñas, UNED NLP & IR Group, Spain Overview of ResPubliQA 2009: Question Answering Evaluation over European Legislation – Anselmo Peñas, UNED NLP & IR Group, Spain Overview of QAST 2009 – Nicolas Moreau, ELDA, Paris, France Overview of GikiCLEF 2009 – Diana Santos and Luis Miguel Cabral, Linguateca, Sintef ICT, Norway
17.50 – 18.40	ImageCLEF Track Overview Non-Medical Tasks – Monica Lestari Paramita, University of Sheffield, UK Medical Tasks – Jayashree Kalpathy-Cramer, Oregon Health and Science University, USA

Thursday, 1 October
09.00 –15.30	Plenary Sessions - Ballroom
09.00 – 09.30	VideoCLEF Track Overview VideoCLEF 2009: Speech-based Multimedia Content Enrichment – Martha Larson, Delft University of Technology, The Netherlands
09.30 – 10.00	LogCLEF Track Overview Log Analysis and Geographic Query Identification (LAGI) – Thomas Mandl, University of Hildesheim, Germany Log Analysis for Digital Societies (LADS) – Giorgio di Nunzio, University of Padua, Italy
10.00 – 10.30	INFILE Track Overview Overview of the INFILE Track at CLEF 2009: Multilingual INformation FILtering Evaluation – Romaric Besançon, CEA LIST, France
10.30 – 11.00	Break
11.00 – 11.20	MorphoChallenge Overview 2009 MorphoChallenge Task at CLEF – Mikko Kurimo, Helsinki University of Technology, Finland
11.20 – 11.40	Grid@CLEF Overview 2009 Pilot Track: Overview and Lessons Learned – Nicola Ferro, University of Padua, Italy
11.45 – 12.15	KeyNote Evolution of NTCIR: Infrastructure of Large-scale Information Access Technologies Evaluation and Testing – Noriko Kando, National Institute of Informatics, Tokyo, Japan
12.15 – 13.00	Poster Boaster Session
13.00 – 14.30	Lunch
14.00 – 15.30	Posters and Demos (Pool Room 1 & Pool Room 2) Posters Features influencing Retrieval in Persian Language - Ljiljana Dolamic, & Jacques Savoy, University of Neuchatel, Switzerland Alicante at CLEF 2009 Robust-WSD Track - Javi Fernández, Rubén Izquierdo and José M. Gómez, University of Alicante, Spain GikiCLEF topics and Wikipedia articles: Did it Blend? - Nuno Cardoso, Linguateca, University of Lisbon, Portugal Are Passages Enough? The MIRACLE Team Participation in QA@CLEF2009 - María Teresa Vicente-Díez, César de Pablo-Sánchez, Paloma Martínez, Julián Moreno Schneider, Marta Garrote Salazar, Universidad Carlos III de Madrid, Spain Robust Question Answering for Speech Transcripts: The UPC Experience in QAst 2009 - Pere R. Comas and Jordi Turmo, Technical University of Catalonia, Spain TIA-INAOE’s Participation in ImageCLEF 2009 (Large-Scale Photo-Annotation) - Hugo Jair Escalante, Instituto Nacional de Astrofísica, Óptica y Electrónica, Mexico MIRACLE (FI) at ImageCLEFphoto 2009 - R. Granados¹, X. Benavent², R. Agerri¹, Ana García-Serrano³, J.M. Goñi¹, J. Gomar², E. de Ves², J. Domingo², G. Ayala²^{, 1}Universidad Politécnica de Madrid, ²Universidad de Valencia; ³Univ. Nacional de Educación a Distancia, UNED, Spain The University of Glasgow at ImageClefPhoto 2009 - G. Zuccon, T. Leelanupab, A. Goyal, M. Halvey, P. Punitha, J. M. Jose, University of Glasgow, UK IAM@ImageCLEF 2009 - Jonathon Hare, David Dupplaw, and Paul Lewis, University of Southampton, UK. The SAIAPR TC12 Benchmark - Hugo Jair Escalante, Instituto Nacional de Astrofísica, Óptica y Electrónica, Mexico Evaluating Fusion Techniques at Different Domains at ImageCLEF Subtasks - Sergio Navarro, Rafael Muñoz, Fernando Llopis, University of Alicante, Spain i-score, Image-Semantic and COntent based REtrieval system - Giannis Boutsis and Theodore Kalamboukis, Athens University of Economics and Business, Greece Topological Localization of Mobile Robots using Probabilistic Support Vector Classification - Yan Gao and Yiqun Li, Institute for Infocomm Research, Singapore The University of Amsterdam's Visual Concept Detection System - Koen E. A. van de Sande, Theo Gevers and Arnold W. M. Smeulders, University of Amsterdam, The Netherlands Non-parametric Density Estimation Algorithms - Ainhoa Llorente, Suzanne Little and Stefan Rüger, The Open University, UK XRCE participation in Large Scale Visual Concept Detection and Annotation Task - Gabriela Csurka and Yan Liu, Xerox Research Center Europe, France SZTAKI @ ImageCLEF 2009 - Bálint Daróczy, András A. Benczúr, Zsolt Fekete, Dávid Nemeskey, István Petrás, Dávid Siklósi, Zsuzsa Weiner, SZTAKI, Hungary UPMC/LIP6 at ImageCLEFannotation 2009: Large Scale Visual Concept Detection and Annotation - Ali Fakeri-Tabrizi, Sabrina Tollari, Ludovic Denoyer, Patrick Gallinari, Université Pierre et Marie CURIE – Paris 6, UMR CNRS, France Semantic Inter-media Image Retrieval in Photographic Collections - Osama El Demerdash, Leila Kosseim and Sabine Bergler, Concordia University, Canada A Particle-filter-based Self-localization Method using Invariant Features as Visual Information - Jesús Martínez-Gómez, Alejandro Jiménez-Picazo, Ismael García-Varea, University of Castilla-La Mancha, Spain University of Glasgow at ImageCLEF 2009 Robot Vision Task - Yue Feng, Martin Halvey & Joemon M. Jose, University of Glagow, UK Patent Retrieval Experiments in the Context of the CLEF IP Track 2009 - Daniela Becks, Christa Womser-Hacker, Thomas Mandl, Ralph Kölle, University of Hildesheim, Germany Search Log Analysis at the University of Sunderland - Michael Oakes and Yan Xu, University of Sunderland, UK Morphological Acquisition by Formal Analogy - Jean-François Lavallée & Philippe Langlais, University of Montreal, Canada PROMODES: A Probabilistic Generative Model for Word Decomposition - Sebastian Spiegler, Bruno Golenia, Peter Flach, University of Bristol, UK Chemnitz Retrieval Group: Xtrieval Framework @ CLEF 2009 - Jens Kürsten, Thomas Wilhelm and Maximilian Eibl, Chemnitz University of Technology, Germany Demos CACAO: A Multilingual Interface to Library Catalogs - Alessio Bosca & Luca Dini, Celi srl, Italy MultiMatch: Access to Cultural Heritage in a MultiModal Way - Franca Debole, ISTI-CNR, Italy Cross-Lingual Search on Wikipedia - Stephane Clinchant, Xerox Research Center Europe, France Automatic Language Detection using Trigram Frequencies - Michael Oakes, University of Sunderland, UK
15.30 – 16.30 15.30 – 16.30 Ballroom 15.30 – 16.30 Ithaca	Parallel sessions: Ad Hoc I (Ballroom) & VideoCLEF (Ithaca) Multilingual Textual Document Retrieval (Ad Hoc - TEL & Persian) – Chair: Nicola Ferro, University of Padua, Italy Combination of Different IR Models with Xtrieval - Maximilian Eibl, Chemnitz University of Technology, Germany Combining Concept Based and Text Based Indexes for CLIR - Philipp Sorg, University of Karlsruhe, Germany Cross-Language Explicit Semantic Analysis - Nedim Lipka, Bauhaus University Weimar, Germany Persian@CLEF - Current and Future Research Directions - Abolfazl Aleahmad, University of Tehran, Iran Cross-language Video Retrieval (VideoCLEF) – Chair: Gareth Jones, Dublin City University, Ireland VideoCLEF 2009: Introductory words - Martha Larson, Delft University of Technology, The Netherlands & Gareth Jones, Dublin City University, Ireland Classification as an IR task: Experiments and Observations - Jens Kürsten, Technical University of Chemnitz, Germany Identification of Narrative Peaks in Clips: Text Features Perform Best - Mohammad Soleymani, University of Geneva When to cross over? Cross-language linking using Wikipedia for VideoCLEF 2009 - Agnes Gyarmati, Dublin City University, Ireland A Cocktail Approach to the VideoCLEF'09 Linking Task - Stephan Raaijmakers, TNO, The Netherlands
16.30 – 17.00	Break
17.00 – 18.30 17.00 – 18.30 Ballroom 17.00 – 18.30 Ithaca	Parallel sessions: ImageCLEF (Ballroom) & CLEF-IP (Ithaca) Cross-language Retrieval in Image Collections (ImageCLEF) – Chair: Stefanie Nowak, Fraunhofer Institute for Digital Media Technology (IDMT), Germany XRCE's Participation in ImageCLEF Photo Retrieval Task - Stephane Clinchant, XEROX-SAS, France Fraunhofer FIRST’s Submission to ImageCLEF2009 Photo Annotation - Motoaki Kawanabe, Fraunhofer FIRST, Germany Combining Text/image in WikipediaMM Task 2009 - Christophe Moulin, U. Jean Monnet, France A Particle-filter-based Self-localization Method using Invariant Features as Visual Information - Ismael García-Varea, Universidad de Castilla-La Mancha, Spain Content-based Approaches to Image Retrieval for the ImageCLEF 2009 Medical Retrieval Track - Dina Demner Fushman, NLM, Bethesda, USA, Addressing the ImageClef 2009 Challenge Using a Patch-based Visual Words Representation - Uri Avni - TAU group, Israel, Intellectual Property (CLEF-IP) – Chairs: Giovanna Roda, Matrixware, Austria & John Tait, Information Retrieval Facility, Austria UTA and SICS at CLEF-IP - Antti Järvelin, University of Tampere, Finland Prior Art Search using International Patent Classification Codes and All-Claims-Queries - Benjamin Herbert, Technical University Darmstadt, Germany Multiple Retrieval Models and Regression Models for Prior Art Search - Patrice Lopez & Laurent Romary, Humboldt University, Germany Panel discussion with John Tait, Giovanna Roda, Antti Järvelin, Benjamin Herbert, Patrice Lopez, Laurent Romary
19.00 – 21.00	Steering Committee Meeting (Poolroom 1)

Friday, 2 October
09.00 – 10.30 09.00 – 10.30 Ballroom 09.00 – 09.45 Ithaca 09.45 – 10.30 Ithaca	Parallel Sessions: QA@CLEF (Ballroom) & iCLEF followed by INFILE (Ithaca) Multiple Language Question Answering (QA@CLEF) - Chair: Pamela Forner, CELCT, Trento, Italy ResPubliQA: A Trainable Multi-factored QA System - Radu Ion, RACAI, Romania Semantic Relatedness and Cross-lingual Passage Retrieval - Arantxa Otegi, IXA NLP Group, University of the Basque Country, Spain ResPubliQA IR Baselines and UNED Participation - Anselmo Peñas, UNED NLP & IR Group, Spain GIKI-CLEF: EQUAL: Encyclopaedic Question Answering for Lists - Iustin Dornescu, Univ. of Wolverhampton, UK Interactive Probabilistic Search for GikiCLEF - Ray R. Larson, UC Berkeley, USA GIRSA-WP at GikiCLEF: Integration of Structured Information and Decomposition of Questions - Johannes Leveling, Dublin City University, Ireland QAST: INAOE at QAST 2009: Evaluating the Usefulness of a Phonetic Codification of Transcriptions - Manuel Montes-y-Gómez, National Institute of Astrophysics, Optics and Electronics, Mexico. LIMSI Participation in the QAst 2009 Track - Guillaume Bernard, LIMSI-CNRS, France Interactive Cross-language Retrieval (iCLEF) - Chair: Jussi Karlgren, SICS, Sweden Users' Perceptions of Searching in Flickling - Evgenia Vassilakaki, Frances Johnson, R.J. Hartley & David Randall, Manchester Metropolitan University, UK UAIC at iCLEF 2009: Analysis of Logs of Multilingual Image Searches in Flickr - Florin-Tudor Cristea, Vlad Alexa, & Adrian Iftene, Alexandru Ioan Cuza University, Romania Lexical Ambiguity in Cross-Language Image Retrieval: a Preliminary Analysis - Borja Navarro-Colorado, Marcel Puchol-Blasco, Rafael M. Terol, Sonia Vázquez & Elena Lloret, University of Alicante, Spain Multilingual Information Filtering (INFILE@CLEF) - Chair: Romaric Besançon, CEA LIST, France Batch Document Filtering Using Nearest Neighbor Algorithm - Ali Mustafa Qamar, Laboratoire d’Informatique de Grenoble (LIG), France Using Human Plausible Reasoning as a Framework for Multilingual Information Filtering - Asma Damankesh, University of Wollongong in Dubai
10.30 – 11.00	Break
11.00 – 12.00 11.00 – 12.00 Ballroom 11.00 – 12.00 Ithaca	Parallel Sessions: Ad Hoc-2 (Ballroom) & LogCLEF (Ithaca) Robust-WSD Disambiguation Task and Grid@CLEF – Chair: Donna Harman, NIST, USA Grid@CLEF Connecting the Xtrieval and CIRCO frameworks - Jens Kuersten, Technical University Chemnitz, Germany Decomposing Text Processing for Retrieval - Ray Larson, UC Berkeley, USA Robust-WSD Combining Probabilistic and Translation-Based Models for Information Retrieval based on Word Sense Annotations - Elisabeth Wolf, Delphine Bernhard, Iryna Gurevych - Technical University of Darmstadt, Germany UNIBA-SENSE @ CLEF 2009: Robust WSD task - Pierpaolo Basile, Annalina Caputo and Giovanni Semeraro, University of Bari, Italy Application of Axiomatic Approaches to Crosslanguage Retrieval - Roman Kern, Andreas Juffinger and Michael Granitzer, Know-Center, Austria Log File Analysis – Chair: Giorgio Di Nunzio, University of Padua, Italy LADS at Sunderland - Michael Oakes, University of Sunderland, UK CACAO Project at the LogCLEF Track - Alessio Bosca, Celi, Torino, Italy Search Path Visualization and Session Performance Evaluation with Log Files from The European Library (TEL) - Katrin Lamm, University of Hildesheim, Germany TCD-DCU at LogCLEF 2009: An Analysis of Queries, Actions, and Interface Languages - Rami Ghorab, Trinity College Dublin, Ireland UAIC Participation in LAGI Task - Adrian Iftene, Alexandru Ioan Cuza University, Romania
12.00 – 13.00	Break Out Sessions - ImageCLEF (Ballroom) - CLEF-IP (Ithaca) - LogCLEF (Poolroom 1))
13.00 – 14.30	Lunch
14.30 – 17.00 14.30 – 15.00 15.00 – 15.30 15.30 – 15.45 15.45 – 17.00	Final Session - Chair: Carol Peters, ISTI-CNR, Italy (Ballroom) Report on SIGIR Workshop on The Future of IR Evaluation - Jaap Kamps, U.Amsterdam, The Netherlands Impressions of 10 years of CLEF - Donna Harman, NIST, USA TrebleCLEF MLIA Technology Transfer Day - Pamela Forner, CELCT, Trento, Italy CLEF Test Suites - New Release - Nicolas Moreau, ELDA, France CLEF 2010 - Maarten de Rijke, U. Amsterdam, The Netherlands, Nicola Ferro, U. Padua, Italy & Martin Braschler, Zurich University of Applied Sciences, Switzerland