CLEF 2007 - WORKSHOP
The CLEF 2007 Workshop was held from 19-21 September in Budapest, Hungary, immediately following the eleventh European Conference on Digital Libraries (ECDL 2007). Working Notes containing a description of the organisation of the campaign, reports on the experiments of the participating groups and a first analysis of their results are now available.
The aim of the Workshop was to present and discuss the results of the CLEF 2007 evaluation campaign and allow researchers and developers to compare performance between systems using different approaches and strategies.
MorphoChallenge 2007 Workshop
The CLEF workshop was preceded on 19 September by the MorphoChallenge 2007 Workshop.
CLEF
2007 Workshop Programme
|
Wednesday 19 September 2007 |
|
|
14:00 |
Welcome – Carol Peters, ISTI-CNR, Pisa, Italy |
|
14:30 |
Ad Hoc Overview Main Mono and Bilingual Tasks: Track Organisation
and Results Analysis – Nicola Ferro, U. Padua, Italy Overview of Results and Lessons Learned from Robustness Evaluation – Thomas Mandl, U. Hildesheim, Germany |
|
15:20 |
Domain-Specific
Overview The Domain-Specific track at CLEF 2007 – Vivien Petras, GESIS – Social Science
Information |
|
15:40 |
What’s happening in iCLEF? – Julio Gonzalo LSI-UNED, |
|
16:00 |
Break |
|
16:30 |
Use Cases for Interactive Multimedia
Access – Jussi Karlgren,
SICS, Stockholm, Sweden |
|
16:50 |
QA@CLEF Overview Multilingual Question Answering Track – Anselmo Peñas, Overview of QAST
2007 – Christelle Ayache,
|
|
17:30 |
ImageCLEF Overview ImageCLEFPhoto Task – Michael
Grubinger, Victoria University, Melbourne,
Australia ImageCLEFMed Task – Henning Müller, U and U Hospital of Geneva, Switzerland ImageCLEF Medical Annotation and Object Retrieval – Thomas Deselaers,
RWTH Aachen University, Germany |
|
20:00 |
Workshop Dinner – Restaurant Lugas, |
|
Thursday 20 September 2007,
Morning Session |
|
|
09:00 |
GeoCLEF Overview Track Overview: Query Classification and Geographic Search – Thomas Mandl, U. Hildesheim, Germany Topic Development and Relevance Assessment – Mark Sanderson U. Sheffield, UK. Results and Analysis – Giorgio Di Nunzio, U. Padua, Italy |
|
09:40 |
CL-SR
Overview The CLEF 2007 Cross-Language Speech Retrieval
Track – Gareth J.F. Jones, Dublin City U.,
Ireland; Douglas W. Oard, U. |
|
10:20 |
CLEF@SemEVAL: Joint SemEval/CLEF tasks: Contribution of WSD to CLIR – Eneko Agirre, IXA NLP Group, University of the Basque Country, Spain |
|
10:40 |
CLEF@MorphoChallenge:
Mikko Kurimo,
Adaptive Informatics Research Centre, Helsinki
University of Technology, Finland |
|
11:00 |
Break |
|
|
11:30 - 13:00 Parallel sessions |
|
11:30 - 13:00 |
Cross-Language
Speech Retrieval Brown at
CL-SR’07: Retrieving Conversational
Speech in English and Czech – Matthew Lease, Brown Laboratory for
Linguistic Information Processing, Brown
University, USA Dublin City University at CLEF
2007:Cross-Language Speech Retrieval Experiments – Gareth J.F. Jones, Dublin City U., Ireland Model
Fusion Experiments for the Cross-Language Speech Retrieval Task at CLEF 2007 – Muath Alzghool,
School of Information Technology and Engineering University of Ottawa, Canada Attempts to Search Czech Spontaneous Spoken Interviews: the University of West Bohemia
at CLEF 2007 CL-SR track – Pavel Ircing, University of West Bohemia,
Czech Republic |
|
11:30 - 13:00 |
Ad-Hoc
with Domain-specific Stemming and Search Strategies
for East European Languages – Ljiljana Dolamic, Computer
Science Dept., University of Neuchâtel, Switzerland Performing Cross-Language
Retrieval with Wikipedia – Peter Schönhofen,
Computer and Automation Research Institute of the Hungarian
Academy of Sciences Cross-Lingual Information Retrieval System for Indian Languages – Manoj Kumar Chinnakotla,
Department of CSE, IIT, Bombay, India CoLesIR at CLEF 2007: from
English to French via Character N-Grams – Jesus Vilares, U. Coruna, Spain XRCE at Domain Specific Task: Adapting Dictionaries Technology Evaluation for Multilingual and Multimodal – Gabriela Csurka, Xerox
Research Centre Europe, France |
|
13:00 |
Lunch |
|
Thursday 20 September 2007, Afternoon Session |
|
|
|
14:30 - 16:00 Parallel sessions |
|
14:30 - 16:00 |
QA@CLEF DFKI at QA@Clef 2007 – Günter Neumann, LT-lab DFKI, Saarbrücken, The Senso Question Answering Approach to Portuguese
QA@CLEF-2007– José Saias, Universidade
de Évora, Portugal Choosing the right answer - combining answer validation and information fusion for improved
answer selection – Ingo Glöckner, IICS,
FernUniversität in Hagen, Germany Answer Validation Exercise - AVE – Anselmo Peñas, LSI-UNED, Madrid, Spain Robust Question
Answering for Speech Transcriptions using Minimal Syntactic Analysis – Pere R. Comas, TALP
Research Centre - UPC, |
|
14:30 - 16:00 |
ImageCLEF Towards an Annotation-based Query/Document Expansion Method
for Image Collections – Manuel Montes y Gómez,
TIA-INAOE, Mexico XRCE at ImageCLEF – Gabriela Csurka,
Xerox Research Centre Europe, France IPAL at ImageCLEF 2007 Mixing Features, Models and Knowledge – Sheng Gao, IPAL French-Singaporean Joint Lab, I2R & CNRS, Singapore Image Annotation Task: an SVM-based Cue Integration
Approach
– Tatiana Tommasi
and Barbara Caputo, IDIAP Research Institute, Switzerland Re-Segmented Pre-Classified
Images for Object
Retrieval
– Matyas Brendel, Computer
and Automation Research Institute of the Hungarian Academy of Sciences, Hungary |
|
16:00 |
Break |
|
16:30 |
Invited Talk: Lessons from NTCIR-6 and a
Plan of Task Cluster-Based Coordination for NTCIR-7 – Noriko Kando, NII, |
|
17:00 |
Invited Talk: FIRE: Forum for Information
Retrieval Evaluation for Indian Languages – Mandar Mitra, Indian
Statistical Institute, Kolkata, India |
|
17:20 - 19:30 |
Poster Boaster and Poster Session |
|
19:00 - 21:00 |
Steering Committee
Meeting |
|
Friday 21 September 2007 |
|
|
|
09:00-10:30 Parallel sessions |
|
09:00 -
10:30 |
GeoCLEF Query Classification
Task: A Heuristic Approach to the GeoCLEF Query Parsing Task – Jochen Leidner, Linguit, UK Search Tasks: TALP at GeoCLEF 2007: Using Terrier with Geographical Knowledge Filtering – Daniel Ferrés, Universitat Politècnica de Catalunya,
Barcelona, Spain The University of Lisbon at GeoCLEF 2007 – Nuno Cardoso, University of Lisbon,
Portugal University of Groningen at GeoCLEF
2007 – Geoffrey Andogah,
University of Groningen, The Netherlands GIR experiments with Forostar at GeoCLEF 2007 – Simon Overell, Imperial College London, UK Cheshire at GeoCLEF 2007: Retesting Text Retrieval Baselines – Ray R. Larson, University of California, Berkeley, USA GeoCLEF Topic Creation – Mark Sanderson, University of Sheffield, UK, Exploring Location Indicators for Geographic Information Retrieval – Johannes Leveling, University
of Hagen, Germany |
|
09:30 -
10:30 |
WebCLEF Chair: Maarten de Rijke Track Overview – Maarten de Rijke, U. Amsterdam,
The Netherlands Using Centrality to Rank
Web Snippets – Valentin Jijkoun, U.
Amsterdam, The Netherlands |
|
10:30 |
Break |
|
11:00 - 12:00 |
Breakout discussion
sessions: ImageCLEF GeoCLEF QA@CLEF |
|
12:00 - 13:00 |
Breakout discussion
sessions: Adhoc plus Domain Specifi WebCLEF |
|
13:00 |
Lunch |
|
|
Concluding Session |
|
14:30 |
Invited Talk: Technology Evaluation for
Multilingual and Multimodal Content Processing in Quaero – Edouard Geoffrois,
DGA-CEP, France |
|
15:00 |
Final Session: Chair: Martin Braschler Proposals for future work – Donna Harman, NIST, USA Exploiting DIRECT |
|
16:30 |
END OF WORKSHOP |