Scientific article
English

Efficient Segmentation and Camera Motion Indexing of Compressed Video

Published inReal-time imaging, vol. 5, no. 4, p. 231-241
Publication date1999
Abstract

In order to provide sophisticated access methods to the contents of video servers, it is necessary to automatically process and represent each video through a number of visual indexes. We focus on two tasks, namely the hierarchical representation of a video as a sequence of uniform segments (shots), and the characterization of each shot by a vector describing the camera motion parameters. For the first task we use a Bayesian classification approach to detecting scene cuts by analyzing motion vectors. Adaptability to different compression qualities is achieved by learning different classification masks. For the second task, the optical flow is processed in order to distinguish between stationary and moving shots. A least-squares fitting procedure determines the pan/tilt/zoom camera parameters within shots that present regular motion. Each shot is then indexed by a vector representing the dominant motion components and the type of motion. In order to minimize processing speed, all techniques process and analyze directly MPEG-1 motion vectors, without need for video decompression. An overall processing rate of 59 frames/s is achieved on software. The successful classification performance, evaluated on various news video clips for a total of 61,023 frames, attains 97.7% for the shot segmentation, 88.4% for the stationary vs. moving shot classification, and 94.7% for the detailed camera motion characterization.

Keywords
  • Dvp, cbir
Citation (ISO format)
MILANESE, Ruggero, DEGUILLAUME, Frédéric, JACOT-DESCOMBES, Alain. Efficient Segmentation and Camera Motion Indexing of Compressed Video. In: Real-time imaging, 1999, vol. 5, n° 4, p. 231–241. doi: 10.1006/rtim.1998.0138
Main files (1)
Article (Published version)
accessLevelRestricted
Identifiers
Journal ISSN1077-2014
562views
1downloads

Technical informations

Creation03/03/2015 16:36:14
First validation03/03/2015 16:36:14
Update time14/03/2023 22:57:01
Status update14/03/2023 22:57:00
Last indexation30/10/2024 23:12:01
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack