의과대학의 컴퓨터기반시험 프로그램 및 시험환경 만족도 분석
Analysis of the Satisfaction with Computer Based Test Program and Test Environment in Medical School
2
조회
0
다운로드
8
인용
0
참고문헌
키워드
초록
This study aimed to identify needed improvements to current evaluation methods in medical school computer-based test (CBT) programs and test environments. To that end, an analysis of the importance and satisfaction was conducted through a survey of 3rd and 4th year medical students who had sufficient experience with CBT programs. Importance performance analysis methodology using the correlation coefficient was applied to assess average satisfaction and importance. The first quadrant (keep up the good work) was a factor of review and time management and test facilities among the conveniences of the CBT program. The second quadrant (concentrate here) was a factor of the convenience of the CBT program and computer monitor and chair factor within the test facilities. The third quadrant (low priority) was a factor of cheating and computer failure. The fourth quadrant (possible overkill) was the location, spacing, and temperature factors of the test facilities. Improvements are needed to reduce ‘eye fatigue’ and help students focus and understand the questions in the CBT programs. It is necessary to improve computer monitors, desks and chairs, and consider the subject’s body type and manager in order to cope with computer breakdown and peripheral failures. Spare computers are needed. These findings are meaningful in that they have been able to identify factors that require improvement in the CBT program and test environment resulting from changes in assessment tools.
Abstract
This study aimed to identify needed improvements to current evaluation methods in medical school computer-based test (CBT) programs and test environments. To that end, an analysis of the importance and satisfaction was conducted through a survey of 3rd and 4th year medical students who had sufficient experience with CBT programs. Importance performance analysis methodology using the correlation coefficient was applied to assess average satisfaction and importance. The first quadrant (keep up the good work) was a factor of review and time management and test facilities among the conveniences of the CBT program. The second quadrant (concentrate here) was a factor of the convenience of the CBT program and computer monitor and chair factor within the test facilities. The third quadrant (low priority) was a factor of cheating and computer failure. The fourth quadrant (possible overkill) was the location, spacing, and temperature factors of the test facilities. Improvements are needed to reduce ‘eye fatigue’ and help students focus and understand the questions in the CBT programs. It is necessary to improve computer monitors, desks and chairs, and consider the subject’s body type and manager in order to cope with computer breakdown and peripheral failures. Spare computers are needed. These findings are meaningful in that they have been able to identify factors that require improvement in the CBT program and test environment resulting from changes in assessment tools.
참고문헌 (24)
- 박주현, "의과대학에서 학습관리시스템과 컴퓨터 기반 평가시스템의 구축 및 운영 경험", Korean Journal of Medical Education, 24(3), pp.213~222 (2012), 한국의학교육학회[DOI]
- 임은정, "Computer-Based Test(CBT) 개발 및 CBT에 대한 학생들의 인식", Korean Journal of Medical Education, 20(2), pp.145~154 (2008), 한국의학교육학회
- 이정미, "CBT(Computer-Based Testing) 시험의 부정행위 방지를 위한 랜덤(Random) 보기 기반 학습자 능력평가 시스템", 예술인문사회 융합 멀티미디어 논문지, 8(1), pp.825~835 (2018), 사단법인 인문사회과학기술융합학회[DOI]
- "Announcement of examination method changing for the national examination to physician, dentist and oriental doctor"[URL]
- Back SG, "Computerized adaptive test" (1998), Wonmisa
- Kim IS, "An overview of computer-assisted English testing research and suggestions for developing a performance-based computer adaptive English listening test for elementary school students", J Humanit, 9, pp.55~87 (2003)
- 권오영, "의학교육 평가도구로서의 유비쿼터스바탕검사의 유용성", Korean Journal of Medical Education, 27(1), pp.3~10 (2015), 한국의학교육학회[DOI]
- 김상현, "컴퓨터 기반 평가 시스템의 보안성 강화 방안", 융합보안 논문지, 18(2), pp.33~40 (2018), 한국융합보안학회
- 정한호, "컴퓨터 기반 평가와 지필 기반 평가 간 점수 비교: 성별과 학습능력에 따른 차이분석을 중심으로", 교육공학연구, 26(3), pp.81~104 (2010), 한국교육공학회
- 권근희, "UBT(Ubiquitous Based Test)의 사용성 개선을 위한 방향 연구", 디지털디자인학연구, 15(3), pp.259~276 (2015), 한국디지털디자인학회[DOI]
- Krantz JH, "Tell me, what did you see?: the stimulus on computers", Behav Res Methods Instrum Comput, 32(2), pp.221~229 (2000)
- Kveton P, "Computer-based tests : the impact of test design and problem of equivalency", Comput Hum Behav, 23(1), pp.32~51 (2007)
- Martilla JA, "Importance-performance analysis", J Mark, 41(1), pp.77~79 (1977)
- Ki KC, "An evaluation of education service through IPA", J Train Dev, 12, pp.37~53 (2006)
- 성민경, "중요도-실행도 분석(IPA)을 통한 사립대학교 대학생의 학습역량에 대한 교육요구도 분석", 교육연구논총, 37(2), pp.73~96 (2016), 교육연구소[DOI]
- 배금광, "IPA 분석을 이용한 동해안 해양관광지 관광객 조사", Culinary Science & Hospitality Research, 26(1), pp.159~168 (2020), (사)한국조리학회[DOI]
- Duke CR, "Performance-importance analysis of escorted tour evaluations", J Travel Tour Mark, 5(3), pp.207~223 (1996)
- Deng W, "Using a revised importance-performance analysis approach : the case of Taiwanese hot springs tourism", Tour Manag, 28(5), pp.1274~1284 (2007)
- Matzler K, "Importance-performance analysis revisited : the role of the factor structure of customer satisfaction", Serv Ind J, 23(2), pp.112~129 (2003)
- Oh H, "Revisiting importance-performance analysis", Tour Manag, 22(6), pp.617~627 (2001)
- Breiter D, "Attendees’ needs and service priorities in a large convention center : application of the importance-performance theory", Tour Manag, 27(6), pp.1364~1370 (2006)
- Crompton JL, "An investigation of the relative efficacy of four alternative approaches to importance-performance analysis", J Acad Mark Sci, 13(4), pp.69~80 (1985)
- 신상현, "Revised-IPA를 이용한 전시회서비스품질의 중요도-만족도 분석 연구", 관광레저연구, 30(11), pp.517~530 (2018), (사)한국관광레저학회
- 윤보람, "Tablet PC에서 Nearly White 배경색과 가독성의 관계", 감성과학, 17(2), pp.35~44 (2014), 한국감성과학회[DOI]