영상 초록 구현을 위한 키프레임 추출 알고리즘의 설계와 성능 평가
Design and Evaluation of the Key-Frame Extraction Algorithm for Constructing the Virtual Storyboard Surrogates
0
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
본 연구에서는 비디오의 의미를 잘 표현하고 있는 키프레임들을 추출하는 알고리즘을 설계하고 평가하였다. 구체적으로 영상 초록의 키프레임 선정을 위한 이론 체계를 수립하기 위해서 선행 연구와 이용자들의 키프레임 인식 패턴을 조사하여 분석해 보았다. 그런 다음 이러한 이론 체계를 기초로 하여 하이브리드 방식으로 비디오에서 키프레임을 추출하는 알고리즘을 설계한 후 실험을 통해서 그 효율성을 평가해 보았다. 끝으로 이러한 실험 결과를 디지털 도서관과 인터넷 환경의 비디오 검색과 브라우징에 활용할 수 있는 방안을 제안하였다.
Abstract
The purposes of the study are to design a key-frame extraction algorithm for constructing the virtual storyboard surrogates and to evaluate the efficiency of the proposed algorithm. To do this, first, the theoretical framework was built by conducting two tasks. One is to investigate the previous studies on relevance and image recognition and classification. Second is to conduct an experiment in order to identify their frames recognition pattern of 20 participants. As a result, the key-frame extraction algorithm was constructed. Then the efficiency of proposed algorithm(hybrid method) was evaluated by conducting an experiment using 42 participants. In the experiment, the proposed algorithm was compared to the random method where key-frames were extracted simply at an interval of few seconds(or minutes) in terms of accuracy in summarizing or indexing a video. Finally, ways to utilize the proposed algorithm in digital libraries and Internet environment were suggested.
참고문헌 (23)
- 김원준, "새로운 비디오 자막 영역 검출 기법", 방송공학회 논문지, 13(4), pp.544~553 (2008), 한국방송공학회
- 김종성, "내용기반 비디오 요약을 위한 효율적인 얼굴 객체 검출", 한국통신학회논문지C, 30(7), pp.675~686 (2005), 한국통신학회
- 김현희, "비디오 자료의 의미 추출을 위한 영상 초록의 효용성에 관한 실험적 연구", 정보관리학회지, 24(4), pp.53~72 (2007), 한국정보관리학회
- 신성윤, "텔레매틱스에서 효율적인 장면전환 검출기법을 이용한 비디오 브라우징", 한국컴퓨터정보학회논문지, 11(4), pp.147~154 (2006), 한국컴퓨터정보학회
- 李重鏞, "샷 기여도와 왜곡률을 고려한 키 프레임 추출 알고리즘", 전자공학회논문지 - CI, 40(5), pp.11~17 (2003), 대한전자공학회
- Browne, P, "Video Retrieval Using Dialogue, Keyframe Similarity and Video Objects", ICIP 2005 -International Conference on Image Processing, pp.11~14 (2005)
- Choi, Y, "User's Relevance Criteria in Image Retrieval in American History", Information Pro- cessing and Management, 38(5), pp.695~726 (2002)
- Chung, E. K, "A Cat- egorical Comparison between User- supplied Tags and Web Search Queries for Images", Proceedings of the ASIST Annual Meeting. Silver Spring (2008), American Society for Information Science and Technology
- Ding, W, "Multimodal Surrogates for Video Browsing", Proceedings of the fourth ACM Conference on Digital Libraries, pp.85~93 (1999)
- Dufaux,F, "Key Frame Selection to Re- present a Video", IEEE Proceed- ings of International Conference on Im- age Processing, 통권 : 2, pp.275~278 (2000)
- Greisdorf, H, "Modelling What Users See When They Look at Images: a Cognitive Viewpoint", Journal of Documentation, 59(1), pp.6~29 (2002)
- Hughes, A, "Text or Pictures? an Eye-tracking Study of How People View Digital Video Surrogates", Proceedings of CIVR 2003, pp.271~280 (2003)
- Audio Surrogation for Digital Video: a Design Framework, "Kristin, B", UNC School of Information and Library Science(SILS), ~, pp.UNC School of Information and Library Science(SILS) Technical Report TR 2006-21. (2006)
- Laine-Hermandez, M, "Multifaceted Image Similarity Criteria as Revealed by Sorting Tasks", Pro- ceedings of the ASIST Annual Meeting. Silver Spring (2008), American Society for Information Science and Technology
- Lyer, H, "Prioritization Strategies for Video Storyboard Key- frames", Journal of American Society for Information Science and Technology, 58(5), pp.629~644 (2007)
- Marchionini, G, "The Open Video Digital Library", D-Lib Magazine, 8(12) (2008)
- Markkula, M, "Sear- ching for Photos - Journalistic Practices in Pictorial IR", The Challenge of Image Retrieval. Newcastle upon Tyne, 5-6 Feb 1998. British Computer Society(BCS), Elec- tronic Workshops in Computing. (1998)
- Mu, X, "Enriched Video Semantic Metadata: Authorization, Integration, and Presentation", Pro- ceedings of the ASIST Annual Meeting: 316-322. Silver Spring, (2003), American Society for Information Science and Technology
- Nagasaka, A, "Automatic Video Indexing. and Full-Video Search for Object Appearances", Visual Data- base Systems, 2, pp.113~127 (1992)
- Panofsky,E, "Meaning in the Visual Arts: Meaning in and on Art History" (1955), Doubleday
- Shatford,S, "Analyzing the Subject of a Picture: a Theoretical Approach", Cataloging & Classification Quarterly, 6(3), pp.39~62 (1986)
- Yang,M, "An Exploration of Users’ Video Relevance Criteria", 박사, pp.2005
- Yang, M, "Exploring Users' Video Relevance Criteria - A Pilot Study", Proceedings of the ASIST Annual Meeting: 229-238. Silver Spring, pp.229~238 (2004), American Society for Information Science and Technology