Scientific article

Efficient Segmentation and Camera Motion Indexing of Compressed Video

Published inReal-time imaging, vol. 5, no. 4, p. 231-241
Publication date1999

In order to provide sophisticated access methods to the contents of video servers, it is necessary to automatically process and represent each video through a number of visual indexes. We focus on two tasks, namely the hierarchical representation of a video as a sequence of uniform segments (shots), and the characterization of each shot by a vector describing the camera motion parameters. For the first task we use a Bayesian classification approach to detecting scene cuts by analyzing motion vectors. Adaptability to different compression qualities is achieved by learning different classification masks. For the second task, the optical flow is processed in order to distinguish between stationary and moving shots. A least-squares fitting procedure determines the pan/tilt/zoom camera parameters within shots that present regular motion. Each shot is then indexed by a vector representing the dominant motion components and the type of motion. In order to minimize processing speed, all techniques process and analyze directly MPEG-1 motion vectors, without need for video decompression. An overall processing rate of 59 frames/s is achieved on software. The successful classification performance, evaluated on various news video clips for a total of 61,023 frames, attains 97.7% for the shot segmentation, 88.4% for the stationary vs. moving shot classification, and 94.7% for the detailed camera motion characterization.

  • Dvp, cbir
Citation (ISO format)
MILANESE, Ruggero, DEGUILLAUME, Frédéric, JACOT-DESCOMBES, Alain. Efficient Segmentation and Camera Motion Indexing of Compressed Video. In: Real-time imaging, 1999, vol. 5, n° 4, p. 231–241. doi: 10.1006/rtim.1998.0138
Main files (1)
Article (Published version)
ISSN of the journal1077-2014

Technical informations

Creation03/03/2015 4:36:14 PM
First validation03/03/2015 4:36:14 PM
Update time03/14/2023 10:57:01 PM
Status update03/14/2023 10:57:00 PM
Last indexation08/29/2023 3:04:24 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack