A Computerized Testing system that Reduces Backward Reasoning in Multiple-choice Items
1
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
A new computerized testing system, called the Computerized Multiple-choice Testing (CMMT) system, was introduced. In this system, questions of multiple choice (MC) items are presented first without options, so that students must generate answers for themselves. They can click for the options when they are ready, and can respond within a brief, specified time period. The present study was performed to examine whether this system is effective in reducing backward reasoning, I. e., using the options of MC items as cues to find the correct answer. One hundred and seventy-seven 6th grade students (12 year olds) were divided into two groups so that mean scores from a prior test were equal: The experimental group took an intervening computerized test in the new format, and the control group in the MC format. Five days after the computerized intervening test, a short answer paper-and-pencil final test was given. Testing effect was greater in the new system than in the MC system. Analysis of the final test response in relation to the intervening test response showed that i) the students retained the correct answer in the new system more than in the MC testing system, and that ii) students corrected their previous failures in the intervening CMMT format more than those in the MC format. These results suggest that the new system is effective in reducing backward reasoning.
Abstract
A new computerized testing system, called the Computerized Multiple-choice Testing (CMMT) system, was introduced. In this system, questions of multiple choice (MC) items are presented first without options, so that students must generate answers for themselves. They can click for the options when they are ready, and can respond within a brief, specified time period. The present study was performed to examine whether this system is effective in reducing backward reasoning, I. e., using the options of MC items as cues to find the correct answer. One hundred and seventy-seven 6th grade students (12 year olds) were divided into two groups so that mean scores from a prior test were equal: The experimental group took an intervening computerized test in the new format, and the control group in the MC format. Five days after the computerized intervening test, a short answer paper-and-pencil final test was given. Testing effect was greater in the new system than in the MC system. Analysis of the final test response in relation to the intervening test response showed that i) the students retained the correct answer in the new system more than in the MC testing system, and that ii) students corrected their previous failures in the intervening CMMT format more than those in the MC format. These results suggest that the new system is effective in reducing backward reasoning.
참고문헌 (15)
- Parshall, C. G, "Innovative item types for computerized testing. In Computerized adaptive testing: Theory and Practice", pp.129~148 (2000), Kluwer Academic Publishers
- Sireci, S. G, "Innoviative item formats in computer-based testing: In pursuit of construct representation ㅑㅜ Handbook of test development" (2006), Lawrence Earlbaum Associate
- Landauer, T. K, "Introduction to Latent Semantic Analysis", Discourse Processes,, 25, pp.259~284 (1998)
- Rudner, L. M, "Automated essay scoring using Bayes' theorem", Journal of Technology, Learning, and Assessment, 1(2) (2002)
- Veloski, J. J, "Patients don’t present with five choices: An alternative to multiple-choice tests in assessing physician’s competence", Academic Medicine, 74, pp.539~546 (1999)
- Braswell, J, "Item formats for assessment in mathematics. In Construction versus Choice in cognitive Measurement." (1993), Lawrence Erlbaum Associate
- Leacock & Chodrow, "C-rater: Automatied scoring of the short-answer questions", Computers and the Humanities, 37, pp.389~405 (2003)
- Park,J, "Learning in a new computerized testing system", Journal of Educational Psychology, 97(3), pp.436~443 (2005)
- Park, J, "Higher retentention after a new take-home computerized test", British Journal of Educational Technology, 39(3), pp.538~547 (2008)
- Glover,J.A, "The “testing” phenomonon: Not gone but nearly forgotten", Journal of Educational Psychology, 81(3), pp.392~399 (1989)
- Roediger, H. L, "The power of testing memory: Basic research and implications for educational practice", Psychological Science in the Public Interest, 2, pp.31~74 (2006)
- Carpenter, S. K, "Impoverished cue support enhances subsequent retention: Support for the elaborative retrieval explanation of the testing effect", Memory & Cognition, 34, pp.268~276 (2006)
- Kulhavy, R. W, "Delay-retention effect with multiple-choice tests", Journal of Educational Psychology, 63(5), pp.505~512 (1972)
- Surber, J. R, "Delay-retention effect in natural classroom settings", Journal of Educational Psychology, 67(2), pp.170~172 (1976)
- Blaxton,T, "Investigating dissociations among memory measures: Support for a transfer appropriate processing framework", Journal of Experimental Psychology: Learning, Memory and Cogntion, 15, pp.657~668 (1989)