en
Scientific article
Open access
English

Information-theoretic temporal segmentation of videos and applications : multiscale keyframe selection and transition detection

Published inMultimedia tools and applications, vol. 30, p. 273-288
Publication date2006
Abstract

The first step in the analysis of video content is the partitioning of a long video sequence into short homogeneous temporal segments. The homogeneity property ensures that the segments are taken by a single camera and represent a continuous action in time and space. These segments can then be used as atomic temporal components for higher level analysis like browsing, classification, indexing and retrieval. The novelty of our approach is to use color information to partition the video into segments dynamically homogeneous using a criterion inspired by compact coding theory. We perform an information-based segmentation using a Minimum Message Length (MML) criterion and minimization by a Dynamic Programming Algorithm (DPA). We show that our method is efficient and robust to detect all types of transitions in a generic manner. A specific detector for each type of transition of interest therefore becomes unnecessary. We illustrate our technique by two applications: a multiscale keyframe selection and a generic shot boundaries detection.

Keywords
  • Content-based video analysis
  • Temporal segmentation
  • Keyframe selection
  • Detection of shot boundaries
Citation (ISO format)
JANVIER, Bruno et al. Information-theoretic temporal segmentation of videos and applications : multiscale keyframe selection and transition detection. In: Multimedia tools and applications, 2006, vol. 30, p. 273–288. doi: 10.1007/s11042-006-0026-2
Main files (1)
Article (Published version)
accessLevelPublic
Identifiers
ISSN of the journal1380-7501
432views
220downloads

Technical informations

Creation03/03/2015 4:36:13 PM
First validation03/03/2015 4:36:13 PM
Update time03/14/2023 10:56:58 PM
Status update03/14/2023 10:56:58 PM
Last indexation01/16/2024 5:03:11 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack