Structural similarity based efficient keyframes extraction from multi-view videos
1
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
Salient information extraction from multi-view videos is a very challenging area because of interview, intra-view correlations, and computational complexity. There are several techniques developed for keyframes extraction from multi-view videos with very high computational complexities. In this paper, we present a keyframes extraction approach from multi-view videos using entropy and complexity information present inside frame. In first step, we extract representative shots of the whole video from each view based on structural similarity index measurement (SSIM) difference value between frames. In second step, entropy and complexity scores for all frames of shots in different views are computed. Finally, the frames with highest entropy and complexity scores are considered as keyframes. The proposed system is subjectively evaluated on available office benchmark dataset and the results are convenient in terms of accuracy and time complexity.
Abstract
Salient information extraction from multi-view videos is a very challenging area because of interview, intra-view correlations, and computational complexity. There are several techniques developed for keyframes extraction from multi-view videos with very high computational complexities. In this paper, we present a keyframes extraction approach from multi-view videos using entropy and complexity information present inside frame. In first step, we extract representative shots of the whole video from each view based on structural similarity index measurement (SSIM) difference value between frames. In second step, entropy and complexity scores for all frames of shots in different views are computed. Finally, the frames with highest entropy and complexity scores are considered as keyframes. The proposed system is subjectively evaluated on available office benchmark dataset and the results are convenient in terms of accuracy and time complexity.
참고문헌 (16)
- K. Muhammad, "Efficient CNN based summarization of surveillance videos for resource-constrained devices", Pattern Recognition Letters (2018)
- K. Pitstick, "Applying video summarization to aerial surveillance", SPIE Defense+Security, pp.10~ (2018)
- M. Paul, "Spatial and Motion Saliency Prediction Method using Eye Tracker Data for Video Summarization", IEEE Transactions on Circuits and Systems for Video Technology, pp.1~1 (2018)
- Z. Ji, "Surveillance video summarization based on moving object detection and trajectory extraction", Signal Processing Systems (ICSPS), 2010 2nd International Conference on, pp.V2-250~V2-253 (2010)
- U. Damnjanovic, "Event detection and clustering for surveillance video summarization", Image Analysis for Multimedia Interactive Services, 2008. WIAMIS'08. Ninth International Workshop on, pp.63~66 (2008)
- M. Ajmal, "Video summarization : techniques and classification", International Conference on Computer Vision and Graphics, pp.1~13 (2012)
- Y. Fu, "Multi-view video summarization", IEEE Transactions on Multimedia, 12, pp.717~729 (2010)
- R. Panda, "Video summarization in a multi-view camera network", Pattern Recognition (ICPR), 201623rd International Conference on, pp.2971~2976 (2016)
- Y. Jia, "Caffe : Convolutional architecture for fast feature embedding", Proceedings of the 22nd ACM international conference on Multimedia, pp.675~678 (2014)
- Y. Li, "Multi-video summarization based on Video-MMR", Image Analysis for Multimedia Interactive Services (WIAMIS), 2010 11th International Workshop on, pp.1~4 (2010)
- Y. -G. Jiang, "Visual word proximity and linguistics for semantic video indexing and near-duplicate retrieval", Computer Vision and Image Understanding, 113, pp.405~414 (2009)
- M. Sajjad, "CNN-based anti-spoofing two-tier multi-factor authentication system", Pattern Recognition Letters (2018)
- Action Recognition in Video Sequences using Deep Bi-directional LSTM with CNN Features, "A. Ullah", ~ (2017)
- A. Karpathy, "Large-scale video classification with convolutional neural networks", Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pp.1725~1732 (2014)
- Raspberry Pi assisted face recognition framework for enhanced law-enforcement services in smart cities, "M. Sajjad", ~ (2017)
- M. Sajjad, "Raspberry Pi assisted facial expression recognition framework for smart security in law-enforcement services", Information Sciences (2018)