Head Pose and Facial Expression-Based Alternative Input Method for People with Physical Disabilities
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
The purpose of this research is to design and develop a new alternative input method, called HF Interface, for selecting and manipulating on-screen objects based on tracking the user’s head pose and recognizing his/her facial expressions, using a 3D depth sensing camera. To specify a target of interest, the HF interface detects changes in the user's head position and orientation and the detected angular deflection and velocity determines the magnitude and direction of change in the mouse cursor’s position on the screen. To specify a desired pointing command with the HF interface, eye-blinks or lip movements are used (e.g., blinking left eye for left click; blinking right eye for right click; double blinking for double click; opening mouse for drag). In the pilot experimental tests conducted with individuals with spinal cord injury, the HF interface demonstrated that it holds good potential as another viable pointing method by consistently showing faster and more accurate performance than the dwell clicking interface across all pointing operations. As a specific clinical application, HF interface is expected to be useful for both computer access and augmentative communication software.
Abstract
The purpose of this research is to design and develop a new alternative input method, called HF Interface, for selecting and manipulating on-screen objects based on tracking the user’s head pose and recognizing his/her facial expressions, using a 3D depth sensing camera. To specify a target of interest, the HF interface detects changes in the user's head position and orientation and the detected angular deflection and velocity determines the magnitude and direction of change in the mouse cursor’s position on the screen. To specify a desired pointing command with the HF interface, eye-blinks or lip movements are used (e.g., blinking left eye for left click; blinking right eye for right click; double blinking for double click; opening mouse for drag). In the pilot experimental tests conducted with individuals with spinal cord injury, the HF interface demonstrated that it holds good potential as another viable pointing method by consistently showing faster and more accurate performance than the dwell clicking interface across all pointing operations. As a specific clinical application, HF interface is expected to be useful for both computer access and augmentative communication software.
참고문헌 (38)
- Accot, J, "More than dotting the i's – Foundations for crossing-based interfaces", Paper presented at the Conference on Human Factors in Computing Systems (2002)
- Ahlstrom, D, "An evaluation of sticky and force enhanced targets in multi target situations", Paper presented at the 4th Nordic Conference on Human-Computer Interaction: Changing Roles (2006)
- Allen, J, "Designing desirability in an augmentative and alternative communication device", Universal Access in the Information Society, 4, pp.135~145 (2005)
- Arch, A, "Web accessibility for older users: successes and opportunities (keynote)", Paper presented at the Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A) (2009)
- Arch, A, "Web accessibility for older users: A literature review", ~ (2010)
- Becker, S. A, "A study of web usability for older adults seeking online health resources", ACM Transactions on Computer-Human Interaction (TOCHI), 11(4), pp.387~406 (2004)
- Beynon-Davies, P, "Integrating rapid application development and participatory design", IEE Proceedings-Software, 145(4), pp.105~112 (1998)
- Choe, E. K, "Exploring the design of accessible goal crossing desktop widgets", Paper presented at the Conference on Human Factors in Computing Systems (2009)
- Clemensen, J, "Participatory Design in health sciences: Using cooperative experimental methods in developing health services and computer technology", Qualitative Health Research, 17(1), pp.122~130 (2007)
- Grossman, T, "The bubble cursor: Enhancing target acquisition by dynamic resizing of the cursor's activation area", Paper presented at the SIGCHI Conference on Human Factors in Computing Systems (2005)
- Guiard, Y, "Object pointing: A complement to bitmap pointing in GUIs", Paper presented at the Graphics Interface 2004 (2004)
- Hart, S. G, "Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research", Human mental workload, 1, pp.139~183 (1988)
- Holt, B, "Creating senior-friendly Web sites", Issue Brief Cent Medicare Educ, 1(4), pp.1~8 (2000)
- Hwang, F, "Mouse movements of motion-impaired users: a submovement analysis", Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility (2004)
- Keates, S, "The use of cursor measures for motion-impaired computer users", Universal Access in the Information Society, 2(1), pp.18~29 (2002)
- Keates, S, "Cursor measures for motion-impaired computer users", Paper presented at the Proceedings of the fifth international ACM conference on Assistive technologies (2002)
- Keates, S, "The use of cursor measures for motion-impaired computer users", Universal Access in the Information Society, 2(1), pp.18~29 (2002)
- Keates, S, "Effect of age and Parkinson's disease on cursor positioning using a mouse", Paper presented at the 7th International ACM SIGACCESS Conference on Computers and Accessibility (2005)
- Peter J. Keir, "Effects of computer mouse design and task on carpal tunnel pressure", Ergonomics, 42(10), pp.1350~1360 (1999), Informa UK Limited[DOI]
- Kensing, F, "Participatory design: Issues and concerns", Computer Supported Cooperative Work, 7, pp.167~185 (1998)
- Ketcham, C. J, "Age-related kinematic differences as influenced by task difficulty, target size, and movement amplitude", Journals of Gerontology Series B-Psychological Sciences and Social Sciences, 57(1), pp.54~64 (2002)
- MacKenzie, I. S, "Fitts' Law as a research and design tool in human-computer interaction", Human-Computer Interaction, 7(1), pp.91~139 (1992)
- MacKenzie, I. S, "Accuracy measures for evaluating computer pointing devices", Paper presented at the SIGCHI Conference on Human Factors in Computing Systems (2001)
- Michael J. McGuffin, "Fitts' law and expanding targets", ACM Transactions on Computer-Human Interaction, 12(4), pp.388~422 (2005), Association for Computing Machinery (ACM)[DOI]
- Karyn Moffatt, "Exploring Methods to Improve Pen-Based Menu Selection for Younger and Older Adults", ACM Transactions on Accessible Computing, 2(1), pp.1~34 (2009), Association for Computing Machinery (ACM)[DOI]
- Noyes, J. M, "A self-analysis of the NASA-TLX workload measure", Ergonomics, 50(4), pp.514~519 (2007)
- Rogers, W. A, "Technology and aging", Reviews of human factors and ergonomics, 1(1), pp.130~171 (2005)
- Sears, A, "Physical disabilities and computing technologies: an analysis of impairments" (2002), Paper presented at the The human-computer interaction handbook
- Silva, G. C. D, "Human factors evaluation of a vision-based facial gesture interface", Paper presented at the Computer Vision and Pattern Recognition Workshop, 2003. CVPRW'03. Conference on (2003)
- Smith, M. W, "Aging, motor control, and the performance of computer mouse task", 41(3), pp.389~396 (1999)
- Stevenson, B, "The Wide Range of Abilities and Its Impact on Computer Technology. Retrieved from Cambridge", ~ (2003)
- Alvaro D. Taveira, "Review Study of Computer Input Devices and Older Users", International Journal of Human-Computer Interaction, 25(5), pp.455~474 (2009), Informa UK Limited[DOI]
- Trewin, S, "Developing Steady Clicks: A method of cursor assistance for people with motor impairments", Paper presented at the 8th International ACM SIGACCESS Conference on Computers and Accessibility (2006)
- Trewin, S, "Keyboard and mouse errors due to motor disabilities", International Journal of Human-Computer Studies, 50(2), pp.109~144 (1999)
- Shari Trewin, "A model of keyboard configuration requirements", Behaviour & Information Technology, 18(1), pp.27~35 (1999), Informa UK Limited[DOI]
- Walker, N, "Age-related differences in movement control:adjusting submovement structure to optimize performance", J Gerontol B Psychol Sci Soc Sci, 52(1), pp.40~52 (1997)
- Wobbrock, J. O, "Goal crossing with mice and trackballs for people with motor impairments: Performance, submovements and design directions", ACM Transactions on Access Computing, 1(1), pp.1~37 (2008)
- Wobbrock, J. O, "Goal crossing with mice and trackballs for people with motor impairments: Performance, submovements, and design directions", ACM Transactions on Accessible Computing (TACCESS), 1(1), pp.4~ (2008)