Proceedings chapter

Automated Benchmarking in Content-based Image Retrieval

Presented at Tokyo (Japan), 22-25 Aug. 2001
Publication date2001

Benchmarking has always been a crucial problem in content-based image retrieval (CBIR). A key issue is the lack of a common access method to retrieval systems, such as SQL for relational databases. The Multimedia Retrieval Mark-up Language (MRML) solves this problem by standardizing access to CBIR systems (CBIRSs). Other difficult problems are also shortly addressed, such as obtaining relevance judgments and choosing a database for performance comparison. In this article we present a fully automated benchmark for CBIRSs based on MRML, which can be adapted to any image database and almost any kind of relevance judgment. The test evaluates theperformance of positive and negative relevance feedback, which can be generated automatically from the relevance judgments. To illustrate our purpose, a freely available, non-copyright image collection is used to evaluate our CBIRS, Viper. All scripts described here are also freely available for download.

  • Image retrieval
  • Content based retrieval
  • Image databases
  • Computer vision
  • Information retrieval
  • Relational databases
  • Multimedia databases
  • Videos
  • Multimedia systems
  • Benchmark testing
Citation (ISO format)
MULLER, Henning et al. Automated Benchmarking in Content-based Image Retrieval. In: Proceedings of the 2001 IEEE International Conference on Multimedia and Expo, ICME2001. Tokyo (Japan). [s.l.] : [s.n.], 2001.
Main files (1)
Proceedings chapter (Published version)
  • PID : unige:47851

Technical informations

Creation03/06/2015 5:12:18 PM
First validation03/06/2015 5:12:18 PM
Update time03/14/2023 10:59:28 PM
Status update03/14/2023 10:59:28 PM
Last indexation01/16/2024 5:12:21 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack