ImageCLEF 2005

Evaluation of image retrieval systems for historic photographic and medical images




Introduction

ImageCLEF is the cross-language image retrieval track which is run as part of the Cross Language Evaluation Forum (CLEF) campaign. This track evaluates retrieval of images described by text captions based on queries in a different language; both text and image matching techniques are potentially exploitable. A preliminary flyer for ImageCLEF 2005 can be downloaded here

ImageCLEF 2005 offers tasks for both system-centered and user-centered evaluation of image retrieval systems and four tasks are offered: It is expected that Content-Based Image Retrieval (CBIR) will be used for the medical tasks and a base system will be made publicly accessible. The tasks offer different and challenging retrieval problems for cross-language image retrieval. The first task is also envisaged as an entry level task for newcomers to CLEF and to CLIR.

The main goals of ImageCLEF are to investigate the effectiveness of combining text and image for retrieval, collect and provide resources for benchmarking image retrieval systems and promote the exchange of ideas which will lead to improvements in the performance of retrieval systems. ImageCLEF is coordinated by the University of Sheffield, the University and University Hospitals of Geneva and Oregon Health and Science University (OHSU). For more information see the main ImageCLEF website.

What to do if interested in participating

You can register for ImageCLEF 2004 by contacting Carol Peters, the main coordinator for CLEF. For more specific information about any aspect of ImageCLEF or the tasks, please contact Paul Clough.

Once you have registered your interest with Carol Peters and filled in the appropriate copyright and declaration forms you will be able to download the data collections. The data can be downloaded from individual task websites.


Image collections

Three test collections are available:
  • ImageCLEFmed collection made available by the University and University Hospitals Geneva in collaboration with Oregon Health and Science University (OHSU) - more information.
  • IRMA database of 10,000 medical images, copyright the IRMA group, Aachen University of Technology (RWTH), Germany (use is currently limited to the ImageCLEF competition). These images are from the IRMA project.

Important dates
   
Registration opens 31 January 2005
Data release from 15 February 2005
Topics release from 15 March 2005
Submission of runs from 15 May 2005
Release of results from 15 July 2005
Submission of paper for working notes 21 August 2005
Workshop (in conjunction with ECDL2005 in Vienna, Austria) 21-23 September 2005
   

Organisers of ImageCLEF

Paul Clough and Henning Mueller are overall organisers of ImageCLEF 2005. Several other individuals and research groups are also involved in providing and running different ImageCLEF tasks. For information about the tasks, please contact the task organisers listed below:

Bilingual ad hoc task

Paul Clough, Department of Information Studies, University of Sheffield, UK (p.d.clough@sheffield.ac.uk)

Michael Grubinger, School of Computer Science and Mathematics, Victoria University, Australia (michael.grubinger@research.vu.edu.au)

Interactive search task

Paul Clough, Department of Information Studies, University of Sheffield, UK (p.d.clough@sheffield.ac.uk)


Julio Gonzalo, NLP Group, UNED, Spain (julio@lsi.uned.es)


Medical image retrieval

Henning Mueller, University and University Hospitals of Geneva, Switzerland (henning.mueller@sim.hcuge.ch)

William Hersh, Oregon Health and Science University, USA (hersh@ohsu.edu)

Automatic image annotation

Thomas Lehmann, IRMA group, Aachen University of Technology (RWTH), Germany (lehmann@computer.org)

Thomas Deselaers, IRMA group, Aachen University of Technology (RWTH), Germany (deselaers@i6.informatik.rwth-aachen.de)

Mailing list

We have set up a mailing list: imageclef@sheffield.ac.uk for participants. Please contact Paul Clough to be added to the list.

Last Modified: February 2005

By: Paul Clough