Interactive Typography System using Combined Corner and Contour Detection
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Interactive Typography is a process where a user communicates by interacting with text and a moving factor. This research covers interactive typography using real-time response to a user’s gesture. In order to form a language-independent system, preprocessing of entered text data presents image data. This preprocessing is followed by recognizing the image data and the setting interaction points. This is done using computer vision technology such as the Harris corner detector and contour detection. User interaction is achieved using skeleton information tracked by a depth camera. By synchronizing the user’s skeleton information acquired by Kinect (a depth camera,) and the typography components (interaction points), all user gestures are linked with the typography in real time. An experiment was conducted, in both English and Korean, where users showed an 81% satisfaction level using an interactive typography system where text components showed discrete movements in accordance with the users’ gestures. Through this experiment, it was possible to ascertain that sensibility varied depending on the size and the speed of the text and interactive alteration. The results show that interactive typography can potentially be an accurate communication tool, and not merely a uniform text transmission system.
Abstract
Interactive Typography is a process where a user communicates by interacting with text and a moving factor. This research covers interactive typography using real-time response to a user’s gesture. In order to form a language-independent system, preprocessing of entered text data presents image data. This preprocessing is followed by recognizing the image data and the setting interaction points. This is done using computer vision technology such as the Harris corner detector and contour detection. User interaction is achieved using skeleton information tracked by a depth camera. By synchronizing the user’s skeleton information acquired by Kinect (a depth camera,) and the typography components (interaction points), all user gestures are linked with the typography in real time. An experiment was conducted, in both English and Korean, where users showed an 81% satisfaction level using an interactive typography system where text components showed discrete movements in accordance with the users’ gestures. Through this experiment, it was possible to ascertain that sensibility varied depending on the size and the speed of the text and interactive alteration. The results show that interactive typography can potentially be an accurate communication tool, and not merely a uniform text transmission system.
참고문헌 (24)
- J. C. Lee, "The kinetic typography engine: an extensible system for animating expressive text", Proceedings of the 15th annual ACM symposium on User interface software and technology, pp.81~90 (2002)
- J. Lewis, "ActiveText: a method for creating dynamic and interactive texts", Proceedings of the 12th annual ACM symposium on User interface software and technology, pp.131~140 (1999)
- J. Forlizzi, "The kinedit system: affective messages using dynamic texts", Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp.377~384 (2003)
- J. Kato, "TextAlive: Integrated Design Environment for Kinetic Typography", Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp.3403~3412 (2015), ACM
- G. Bachfischer, "From Movable Type to Moving Type-Evolution in technological mediated Typography", Proceedings of the AUC Academic and Developers Conference (2005)
- G. Bachfischer, "A moving type framework", Proceedings of the 10th WSEAS international conference on Communications. World Scientific and Engineering Academy and Society (WSEAS), pp.607~612 (2006)
- N. M. Lau, "Enhancing Children's Language Learning and Cognition Experience through Interactive Kinetic Typography", International Education Studies, 8(9), pp.36~45 (2015)
- P. S. Cho, "Computational models for expressive dimensional typography", Doctor, pp.1999
- S. Mitra, "Gesture recognition : A survey", IEEE Transactions on Systems, Man, and Cybernetics, Part C(Applications and Reviews), 37(3), pp.311~324 (2007)
- P. Kakumanu, "A Survey of Skin-color Modeling and Detection Methods", Pattern Recognition, 40(3), pp.1106~1122 (2007)
- T. B. Moeslund, "A survey of advances in vision-based human motion capture and analysis", Computer vision and image understanding, 104(2), pp.90~126 (2006)
- T. Osunkoya, "Gesture-based Human Computer Interaction using Kinect for Windows Mouse Control and Powerpoint Presentation", Proceedings of the Midwest Instruction and Computing Symposium (2013)
- K. T. M. Tran, "Hand Gesture Recognition for 3D-Heritage-Tourism using Microsoft Kinect Sensor", Advanced Science and Technology Letters, 30, pp.145~148 (2013)
- J. Shotton, "Realtime human pose recognition in parts from single depth images", Communications of the ACM, 56(1), pp.116~124 (2013)
- M. Van den Bergh, "Real-time 3D hand gesture interaction with a robot for understanding directions from humans", Proceedings of the International Symposium on Robot and Human Interactive Communication, pp.357~362 (2011)
- D. Wagner, "Pose tracking from natural features on mobile phones", Proceedings of the 7th IEEE, 2008, 125~134[DOI]
- S. M. Smith, "SUSAN-A New Approach to Low Level Image Processing", International Journal of Computer Vision, 23(1), pp.45~78 (1997)
- M. Trajkovic, "Fast Corner Detection", Image and Vision Computing, 16(2), pp.75~87 (1998)
- S. C. Bae, "COP : a new corner detector", Pattern Recognition Letters, 23, pp.1349~1360 (2002)
- L. J. Latecki, "Convexity rule for shape decomposition based on discrete contour evolution", Computer Vision and Image Understanding, 73(3), pp.441~454 (1999)
- U. Orguner, "Statistical characteristics of harris corner detector", Proceedings of the IEEE, 2007, pp.2629, 571~575
- C. Harris, "A Combined Corner and Edge Detector", Proceedings of the Alvey Vision Conference, 15, pp.147~151 (1988)
- "The Harris Corner Detector" (2004)[URL]
- R. Fabbri, "2D Euclidean distance transform algorithms : A comparative survey", ACM Computing Surveys (CSUR), 40(1) (2008)