육하원칙 정보에 기반한 홈비디오 키프레임 추출
Keyframe Extraction from Home Videos Using 5W and 1H Information
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
본 논문에서는 육하원칙 정보를 기반으로 홈비디오에서 키프레임을 추출하는 방법을 제시한다. 키프레임 추출 방법이란 비디오에서 중요하다고 생각되는 특정 프레임만을 선출하여 비디오를 요약하는 방법이다. 홈비디오의 경우 그 주제가 다양하여 특별한 가정을 통한 정보 추출이 어렵고, 주로 인물이 비디오의 중심이 되기 때문에 인물의 행동을 중심으로 요약을 수행하여야 한다. 본 논문에서는 인물의 얼굴, 인물의 행동, 전체 배경 정보를 분석하여 인물 중심의 보편적인 요약 기준인 육하원칙의 주요 정보를 추출한다. 추가적으로 비디오의 매 프레임의 블러 크기를 측정하여 이용함으로써 프레임별로 얼마나 많은 정보를 포함하고 있는지 측정하고, 가장 많은 정보를 포함한 프레임을 키프레임으로 선출한다. 사용자 실험을 통해 사용자가 홈비디오에서 여러 개의 키프레임을 선택할 경우, 기존의 방법보다 사용자의 선택과 유사함을 확인할 수 있다.
Abstract
We propose a novel method to extract keyframes from home videos based on the 5W and 1H information. Keyframe extraction is a kind of video summarization which selects only specific frames containing important information of a video. As a home video may have content with a variety of topics, we cannot make specific assumptions for information extraction. In addition, to summarize a home video we must analyze human behaviors, because people are important subjects in home videos. In this paper, we extract 5W and 1H information by analyzing human faces, human behaviors, and the global information of background. Experimental results demonstrate that our technique extract more similar keyframes to human selections than previous methods.
참고문헌 (28)
- An overview of video abstraction techniques, "Y. Li", HP Laboratory, ~, pp.Technical Report HPL-2001-191 (2001)
- B.T. Truong, "Video Abstraction: A Systematic Review and Classification", ACM Trans. Multimedia Comput. Commun. Appl, 3(1) (2007)
- M. Cooper, "Discriminative techniques for keyframe selection", ICME, pp.4~ (2005)
- G. Ciocca, "An innovative algorithm for key frame extraction in video summarization", JRTIP, pp.69~88 (2006)
- T. Liu, "An efficient error-minimizing algorithm for variable-rate temporal video sampling", ICME, pp.413~416 (2002)
- Key Frame Selection by Motion Analysis, "W. Wolf", ICASSP, 1228~1231 (1996)
- T. Liu, "Novel Video Key-Frame-Extraction Algorithm Based on Perceived Motion Energy Model", TCSVT, pp.1006~1013 (2003)
- F. Arman, "Content-based Browsing of Video Sequences", ACM Multimedia, pp.97~103 (1994)
- S.W. Smoliar, "Content-Based Video Indexing and Retrieval", pp.62~72 (1994), IEEE MultiMedia, IEEE Computer Society Press
- H. Ueda, "Automatic structure visualization for video editing", Proceedings of the INTERACT '93 and CHI '93 conference on Human factors in computing systems, pp.137~141 (1993), ACM
- H. Zhang, "An Integrated System for Content-Based Video Retrieval and Browsing", Pattern Recognition, pp.643~658 (1997)
- C. Kim, "Object-Based video abstraction for video surveillance systems", TCSVT, pp.1128~1138 (2002)
- B. Gunsel, "Content-Based Video Abstraction", ICIP, pp.128~132 (1998)
- X. Zhang, "Dynamic selection and effective compression of key frames for video abstraction", Pattern Recognition, pp.1523~1532 (2003)
- Y. Zhuang, "Adaptive Key Frame Extraction using Unsupervised Clustering", ICIP, pp.866~870 (1998)
- An Integrated Scheme for Automated Video Abstraction Based on Unsupervised Cluster-Validity Analysis, "A. Hanjalic", TCSVT, 1280~1289 (1999)
- Video Summarization based on User Log Enhanced Link Analysis, "B. Yu", ACM MM, 382~391 (2004)
- J. Luo, "Towards Extracting Semantically Meaningful Key Frames From Personal Video Clips: From Humans to Computers", TCSVT, pp.289~301 (2009)
- H.S. Chang, "Efficient video indexing scheme for content-based retrieval", TCSVT, pp.1269~1279 (1999)
- J. Rong, "Key frame extraction using inter-shot information", ICME, pp.571~574 (2004)
- T. Liu, "Optimization algorithms for the selection of key frame sequences of variable length", ECCV, pp.403~417 (2002)
- S. Han, "Scalable temporal interest points for abstraction and classification of video events", ICME, pp.4~ (2005)
- M. Werlberger, "Motion Estimation with Non-Local Total Variation Regularization", Order A Journal On The Theory Of Ordered Sets And Its Applications, pp.2464~2471 (2010), IEEE
- M. Werlberger, "Anisotropic Huber-L1 Optical Flow", Proceedings of the British Machine Vision Conference (BMVC), pp.1~11 (2009)
- Full-frame video stabilization with motion inpainting, "Y. Matsushita", IEEE Transactions on Pattern Analysis and Machine Intelligence, 1150~1163 (2006)
- Robust processing of optical flow of fluids, "A. Doshi", IEEE Transactions on Image Processing, 2232~2344 (2010)
- B. D. Lucas, "An iterative image registration technique with an application to stereo vision", Proceddings of the 7th international joint conference on Artificial intelligence (1981)
- M. A. Fischler, "Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography", Communications of the ACM, 24(6), pp.381~395 (1981)