CBT(Computer-Based Testing) 시험의 부정행위 방지를 위한 랜덤(Random) 보기 기반 학습자 능력평가 시스템
A Deterrent method for Cheating in CBT(Computer-Based Testing) Applications
0
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
의학교육에 있어 디지털기술의 한가지인 CBT(Computer-Based Testing)는 관리자 차원에서의 과제 생성과 관리, 수정 등 아이템들의 검토와 조절이 쉬우며 정확한 자신의 평가능력 수준을 제시해 주는 등 많은 강점을 가지고 있다. 하지만 이러한 많은 장점들에도 불구하고, 학생들의 여러 종류의 부정 시험(A Deterrent for Cheating)과 관리자 영역의 해킹 등이 문제시 되어 CBT의 형평성과 공정성을 담보하기 위한 보완점들이 요구되어 지고 있다. 특히, CBT가 이루어지는 시험실 공간이 좁다보니 PC가 학생들 간에 너무 가까이 있어 커닝할 여지가 많다는 우려의 목소리가 높았다. 이에 본 논문에서는 CBT 수행 시 타인의 모니터를 보고 답안을 베끼는 부정 행위를 방지하기 위해 랜덤(Random)방식으로 시험 문제와 보기 지문을 나열하는 “랜덤(Random) 보기 기반 학습자 능력평가 시스템(The practise of randomizing multiple choice items in computer-based test)”을 개발하여 의학전문대학원 3학년 CBT 수행 시에 적용하였다. 그 결과, CBT에 대한 만족도로 아주 만족한다, 만족한다의 긍정적인 응답이 83.3%, 랜덤방식 출제 후 부정행위 감소 효과에 대해 감소되었다가 75%로 랜덤(Random) 보기 기반 학습자 능력평가 프로그램이 부정 행위를 막아주는 역할을 해내었음을 확인할 수 있었다.
Abstract
Today Computer Based Tests (CBT) are used more frequently than Paper Based Tests (PBT) however CBTs are often taken place in classrooms with not much space for computer system so that computer screens are very close together. In this case dishonesty during exam in Computer Based Test (CBT) is unavoidable because the environment itself is open for copying answers from other students. Randomizing questions in an examination is a method that has been used mainly to deterrent student. In this study we argue that if test question reordered with a randomizing method and question items shuffled it effects setting environment in which disables student from copying answers from colleagues. A survey of test validity from pre and post randomization of CBT assessment conducted on 3rd grade student of Pusan National University School of Medicine. Satisfaction of students recorded in 83.3%, Although 75% of answers recorded of reduction in copying answers from colleagues after randomizing CBT. We conclude that reordering questions and shuffling question items are a valid method to examination in large or classrooms. Important factor is not only reduction of dishonesty but also fairness of test scores by performing randomization in computer assessment.
참고문헌 (14)
- Ogilvie, R. W., "Students' attitudes towards computer testing in a basic science course", Med Educ(ASME), 33(11), pp.828~831 (1999)
- Kingsury, G. G., "A comparison of procedures for content-sensitive item selection in computerrized adaptive tests", Measurement in Education, 4(3), pp.241~261 (1991)
- Miller, A. P., "Pilot studies of in-course assessment for a revised medical curriculum. II", Computerbased individual, Acad Med, 12(72), pp.1113~1115 (1997)
- Roy Clariana, "Paper–based versus computer–based assessment: key factors associated with the test mode effect", British Journal of Educational Technology, 33(3), pp.593~602 (2002)
- Kwak Beum Deauk, "Use of Smart Phone by College Students and Their Perception on Smart Phone-based LearningManagement System", Korean Journal of Social Science, 31(1), pp.7~29 (2012)
- Rita Wutoh,, "eLearning: A review of Internet-based continuing medical education, The Society for Academic Continuing Medical Education, and the Council on CME", Association or Hospital Medical Education, 24(1), pp.20~30 (2004)
- Stokiing, M. L., "A new method of controlling item exposure in computerized adaptive testing", ETS Research Report Series, 95(2), pp.29~ (1995), Educational Testing Service
- Kwon Hyung-Kyu, "Design and Implementation for the Web-based Full text Thesis Service For Self- Directed Education By Online Interaction And User Interface Issues", Journal of Education Technology KCI, 18(2), pp.123~155 (2002)
- ACAP item pools: Analysis and recommendations. Unpublished manuscript, "Segall, D. O.", Navy Personnel Research and Development Center, ~ (1987)
- Marks, A. M., "Randomised Items in Computer-based Tests: Russian Roulette in Assessment?", Educational Technology & Society, 11(4), pp.41~50 (2008)
- RM Luecht, "Test models for complex CBT - Computer-based testing: Building the foundation for future assessments", pp.67~88 (2002), Erlbaum
- Haskell Sie, "Utilizing Response Times in Computerized Classification Testing", Psychological Measurement, 39(5), pp.389~405 (2015)
- Kreiter, C., "The effects of testing in shifts on a clinical in-course computerized exam", Med Educ(ASME), 37(3), pp.202~204 (2003)
- Tsong Yueh Chen, "Adaptive Random Testing: The ART of test case diversity", Journal of Systems and Software, 83(1), pp.60~66 (2010)