마킹 기능이 컴퓨터 기반 읽기 평가의 결과 및 수험자의 인식에 미치는 영향
The effect of the marking function on test takers’ performance and their perception in a computer-based reading test
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
컴퓨터 기반 읽기 평가의 타당도를 연구한 선행 연구에서 많은 수험자들이 지면과는 달리 컴퓨터 화면에 글자를 쓰거나 표시를 하는 등의 마킹 전략을 사용하지 못하는 불편함 때문에 점수가 낮아졌다고 인식하는 것으로 보고되고 있다. 이는 수험자의 언어 능력이 아닌 평가가 실시되는 방식이 평가 결과에 결과를 미칠 가능성을 시사하므로 컴퓨터기반 평가의 구인 타당도를 확보하기 위해서는 마킹 전략의 사용 여부가 평가 결과에 미치는 영향에 대한 연구가 필요하다. 컴퓨터와는 달리 테블릿의 경우 디지털 잉크 기능을 활용하여 밑줄을 긋거나 표시를 하는 디지털 펜 기능을 제공할 수 있기 때문에 본 연구에서는 마킹 전략이 가능한 테블릿기반 읽기 시험을 개발하여 마킹 기능 제시 여부가 평가 결과와 수험자의 인식에 미치는 영향을 분석하였다. 지필 평가 상황에서 수험자가 마킹 하는 정도를 알아보기 위해 사전 검사로 실시한 지필검사에 수험자가 사용한 마킹의 정도를 분석한 결과 전체 시험의 20%정도 마킹한 것으로 드러나 평가 상황에서 수험자가 지문과 문항에 마킹하는 비율이 높지 않은 것으로 나타났다. 이어서 마킹이 허용된 태블릿 컴퓨터 집단 수험자가 지필평가와 테블릿 평가에 한 마킹의 정도에 차이가 없는 것으로 나타나 테블릿 읽기 평가 환경이 지필 평가와 유사한 평가 환경을 만들어 낸 것으로 밝혀졌다. 마지막으로 마킹 허용 여부가 평가 결과에 미친 영향을 분석해 본 결과 마킹이 허용된 집단과 허용되지 않은 집단의 평가 결과에 유의미한 차이는 없는 것으로 드러났다.
Abstract
Prior studies on computer-based reading tests reported that test-takers believed that their testperformance was adversely affected because they were not able to employ marking strategies. The purpose of this study was to examine the effects of the marking function on test-takers’performance and their perception in a computer-based reading test. The participants were 46college students, and they were divided into an experimental group and a control groups. Theanalyses of the amount of marking on a paper-based reading test showed that the amount ofmarking was less than 20%. The results also revealed that there was no statistically significantdifference in the amount of marking the experimental group made on the paper-based and thetablet-based tests, indicating that similar testing conditions had been created. Finally, theanalysis of the participants’ performance on the tablet-based test showed that the provision ofthe marking function did not have any significant effects on the test scores.
참고문헌 (41)
- 고보라, "컴퓨터 기반 TOEIC 시험에서의 영어 읽기 불안", 현대영어영문학, 53(1), pp.19~40 (2009), 한국현대영어영문학회
- 노윤오, "고등학생의 영어 독해력 측정을 위한 컴퓨터기반 평가와 지필기반 평가 결과 비교", 석사, 영어교육, pp.2011
- 장진태, "중학생 영어학습자의 상·하위권 수준별 독해전략", 교과교육학연구, 14(4), pp.737~758 (2010), 교과교육연구소
- 정현준, "인터넷 학습을 활용한 영어 읽기 교수-학습 방안에 관한 연구", Multimedia Assisted Language Learning, 2(2), pp.207~244 (1999)
- 진수경, "컴퓨터기반 평가와 지필 평가 수행 결과 비교 : 한국 대학생의 영어 독해 평가 중심으로", 석사, 영어교육학, pp.2006
- 천귀영, "컴퓨터 활용 초등영어 듣기·읽기평가의 적용 가능성에 관한 연구", 석사, 초등영어교육, pp.2002
- Alderson, C., "Assessing reading" (2000), Cambridge University Press
- Bachman, L. F., "Fundamental considerations in language testing" (1990), Oxford University Press
- Bachman, L. F., "Language testing in practice" (1996), Oxford University Press
- Bachman, L. F., "Modern language testing at the turn of the century : Assuring that what we count counts", Language testing, 17(1), pp.1~42 (2000)
- Boo, J., "Computerized versus paper-and-pencil assessment of educational development: Score comparability and examinee preferences", doctor, pp.1997
- Effects of screen size, screen resolution, and display rate on computer-based test performance, "Bridgeman, B.", ETS, ~, pp.ETS RR-01-23 (2001)
- Chapelle, C. A., "Computer applications in second language acquisition" (2001), Cambridge University Press
- Chapelle, C. A., "English language learning and technology" (2003), John Benjamins Publishing
- Chapelle, C. A., "Assessing language through computer technology" (2006), Cambridge University Press
- Choi, I-C., "Comparability of a paper-based language test and a computer-based language test", Language Testing, 20(3), pp.295~320 (2003)
- Choi, S. W., "Evaluating comparability of paper-and-pencil and computer-based assessment in a K-12 setting", Paper presented at the annual meeting of the National Council on Measurement in Education (2002)
- Cohen, A., "On taking language tests : What the students report", Language Testing, 1, pp.70~81 (1984)
- De Ridder, I., "Are we conditioned to follow links? Highlights in CALL material and their impact on the reading process", Computer Assisted Language Learning, 13(2), pp.183~195 (2000)
- Dillon, A., "Reading from paper versus screens : A critical review of the empirical literature", Ergonomics, 35(10), pp.1297~1326 (1992)
- Educational Testing Service, "The Official Guide to the TOEFL Test" (1996), Educational Testing Service
- Educational Testing Service., "The Official Guide to the TOEFL® Test" (2012), Educational Testing Service
- Fulcher, G., "Interface design in computer based language testing", Language Testing, 20(4), pp.384~408 (2003)
- Higgins, J., "Examining the Effect of computer-based passage presentation on reading test performance", The Journal of Technology, Learning, and Assessment, 3(4), pp.4~35 (2005)
- Khalifa, H., "Examining reading: Studies in language testing 29" (2009), Cambridge University Press
- Kobrin, J. L., "The cognitive equivalence of reading comprehension test items via computerized and paper-and-pencil administration", Applied Measurement in Education, 16(2), pp.115~140 (2003)
- Lee, H. W., "Does digital handwriting of instructors using the iPad enhance student learning?", The Asia-Pacific Education Researcher, 22(3), pp.241~245 (2013)
- Lee, A. J., "The effects of mode of test administration on test performance", Educational and Psychological Measurement, 46(2), pp.467~474 (1986)
- Lee, Soyoung, "A Study on Comparability of Paper-based and Computer-based Reading Test Scores", 영어교육, 59(2), pp.165~178 (2004), 한국영어교육학회
- Leeson, H. V., "The mode effect : A literature review of human and technological issues in computerized testing", International Journal of Testing, 6(1), pp.1~24 (2006)
- Ockey, G. J., "Construct implications of including still image or video in computer-based listening tests", Language Testing, 24(4), pp.517~537 (2007)
- Ockey, G. J., "Developments and Challenges in the Use of Computer‐Based Testing for Assessing Second Language Ability", The Modern Language Journal, 93(1), pp.836~847 (2009)
- O'Hara, K., "A comparison of reading paper and on-line documents", Proceedings of the ACM SIGCHI Conference on Human factors in computing systems, pp.335~342 (1997), ACM
- Pino-Silva, J., "Student perceptions of computerized tests", ELT Journal, 62(2), pp.148~156 (2008)
- Pommerich, M., "From simulation to application: Examinees react to computerized testing", Paper presented at the annual meeting of the National Council on Measurement in Education (2000)
- Pomplun, M., "The score equivalence of paper and computerized versions of a speeded test of reading comprehension", Educational and Psychological Measurement, 62(2), pp.337~354 (2002)
- Rawson, R. E., "Evaluation of a computer-based approach to teaching acid", base physiology, 2002, pp.26(2), 85~97
- Siozos, P., "Computer based testing using"digital ink" : Participatory design of a tablet PC based assessment application for secondary education", Computers & Education, 52(4), pp.811~819 (2009)
- Taylor, C., "Examining the relationship between computer familiarity and performance on computer-based language tasks", Language Testing, 49(2), pp.219~274 (1999)
- Tseng, H-M., "Computer anxiety : A comparison of pen-based personal digital assistants, conventional computer and paper assessment of mood and performance", British Journal of Psychology, 89, pp.599~610 (1998)
- Willis, C. L., "Tablet PC's as instructional tools or the pen is mightier than the'board!", Proceedings of the 5th conference on Information technology education, pp.153~159 (2004)