A neural network approach to key frame extraction

Show full item record

Title: A neural network approach to key frame extraction
Author: Narasimha, Rajesh; Savakis, Andreas; Rao, Raghuveer; De Quieroz, Ricardo
Abstract: We present a neural network based approach to key frame extraction in the compressed domain. The proposed method is an amalgamation of both the MPEG-7 descriptors namely motion intensity descriptor and spatial activity descriptor. Shot boundary detection and block motion estimation techniques are employed prior to the extraction of the descriptors. The motion intensity (“pace of action”) is obtained using a fuzzy system that classifies the motion intensity into five categories proportional to the intensity. The spatial activity matrix determines the spatial distribution of activity (“active regions”) in a frame. A neural network is used to pick those frames as key frames which have high intensity and maximum spatial activity at the center of the frame. Results are compared against two well-known key frame extraction techniques to demonstrate the advantage and robustness of the proposed approach. Results show that the neural network approach performs much better than selecting first frame of the shot as a key frame and selecting middle frame of the shot as a key frame methods.
Description: "A neural network approach to key frame extraction," Proceedings of SPIE, Storage and Retrieval Methods and Applications for Multimedia 2004. The International Society for Optical Engineering. Held December 2003. Copyright 2003 The Society of Photo-Optical Instrumentation Engineers. This paper is made available as an electronic reprint with permission of SPIE. One print or electronic copy may be made for personal use only. Systematic or multiple reproduction, distribution to multiple locations via electronic or other means, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.
Record URI: http://hdl.handle.net/1850/4190
Date: 2003-12

Files in this item

Files Size Format View
ASavakisConfProc12-2003.pdf 564.6Kb PDF View/Open

The following license files are associated with this item:

This item appears in the following Collection(s)

Show full item record

Search RIT DML


Advanced Search

Browse