풀이 과정을 답지로 이용한 시험 방식의 학습 효과
The Learning Effect of Test that Worked Examples Used as Options
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
본 연구에서는 수학 학습을 위한 평가 도구로 풀이 과정을 답지로 이용한 시험 방식이 제안되었고, 그 효과가 검증되었다. 풀이된 예제 연구에 따르면, 학생들에게 문제에 대한 단계적인 해결책인 풀이된 예제를 문제 사이에 제시할 경우, 문제만 풀 때보다 효과적으로 학습한다. 그러나 풀이된 예제의 단순한 제시는 학습 효과가 제한적이라는 최근의 발견들이 있었다. 이에 따라 본 연구에서는 학습자가 풀이된 예제를 더 적극적으로 탐구하게 하는 방법으로 풀이 과정을 선다형의 답지로 제시하였다. 이 시험 방식은 컴퓨터화 시험으로 구현되었으며, 학생들이 컴퓨터에서 단답형으로 문제를 풀고 나서 답지를 요청하면 선다형 답지가 제시되었다. 이 때 실험 집단은 답지가 풀이 과정으로, 비교 집단은 전통적 선다형과 같이 최종 정답으로 구성되었다. 초등학교 6학년 학생들을 대상으로 실험이 수행되었다. 사후 검사 결과 실험집단의 평균 점수가 비교집단의 평균 점수보다 높았다. 이 결과는 풀이 과정을 답지로 이용한 시험 방식이 교실현장에서 학습을 촉진하기 위한 도구로 활용될 수 있음을 시사한다. 끝으로 후속 연구의 방향성이 논의되었다.
Abstract
The present study proposes and examines a new type of multiple-choice math test. In this format, the options are the intermediate derivatives of the math problem solution process rather than the final answers. This idea originates from the studies on the effect of worked-out examples. In these studies, it has been shown that students learn better when they were presented with worked-out examples than when presented with final answers by themselves. In line with these findings, we introduced the intermediate derivatives of the solution process as the options of multiple-choice items so that the test-taker will have a chance to examine the solution process. The test was implemented as a computerized test in which students can solve problems in a short answer format, and then pick a multiple-choice option which appears when requested. The experimental group had multiple-choice options which were intermediate derivatives of the solution process, and the control group had the final answers as the options as in most multiple-choice tests. The participants were 6th graders in elementary school. The posttest results revealed that the average score of the experimental group was higher than that of the control group. The results suggest that tests that use intermediate derivatives of the problem solution process as options can be used as learning tools in the classrooms. Finally, directions for further studies were discussed.
참고문헌 (48)
- 교육과학기술부, "초등학교 교육과정 해설(Ⅳ)" (2008), 교육과학기술부
- 박주용, "구성적 선다형 검사에서 선다형과 단답형의 문항 특성 비교", 교육평가연구, 22(2), pp.451~469 (2009), 한국교육평가학회
- 박주용, "초등학생용 컴퓨터화 개방형 수학 시험 방식의 사용가능성 검증", 인지과학, 21(2), pp.283~307 (2010), 한국인지과학회
- 이종성, "행동과학연구를 위한 측정이론의 기초" (1985), 중앙적성출판사
- Becker, W. E., "The relationship between multiple choice and essay response questions in assessing economics understanding", Economic Record, 75, pp.348~357 (1999)
- Betts, L. R., "Does correction for guessing reduce student' performance on multiple-choice examination? yes? no? sometime?", Assessment & Evaluation in Higher Education, 34(1), pp.1~15 (2009)
- Black, P., "Assessment and classroom learning", Assessment in Education, 5(1), pp.7~73 (1998)
- Bible, L., "Using multiple-choice tests to evaluate students' understanding of accounting", Accounting Education: an international journal, 17, pp.55~68 (2008)
- Boud, D., "Aligning assessment with long-term learning", Assessment & Evaluation in Higher Education, 31(4), pp.399~413 (2006)
- Boud, D., "Rethinking assessment in higher education" (2007), London and New York
- Bush, M., "A multiple choice test that rewards partial knowledge", Journal of Further and Higher Education, 25(2), pp.157~163 (2001)
- Butler, A. C., "Testing improves long-term retention in a simulated classroom setting", European Journal of Cognitive Psychology, 19, pp.514~527 (2007)
- Carpenter, S. K., "Using tests to enhance 8th grade students’ retention of U.S. history facts", Applied Cognitive Psychology, 23(6), pp.760~771 (2009)
- Clark, R. C., "Efficiency in learning: evidence-based guidelines to manage cognitive load" (2006), Pfeiffer
- Chandler, P., "Cognitive load theory and the format of instruction", Cognition and Instruction, 8(4), pp.293~332 (1991)
- Delgado, A. R., "The effect of item feedback on multiple-choice test responses", British Journal of Psychology, 94(1), pp.73~85 (2003)
- Earl, M. L., "Assessment as learning: Using classroom assessment to maximize student learning" (2003), Corwin Press
- Entwistle, A., "Experiences of understanding in revising for degree examinations", Learning and Instruction, 2, pp.1~22 (1992)
- Frary, R. B., "NCME instructional module on formula scoring of multiple-choice tests(correction for guessing)", Educational Measurement: Issues and Practice, 7, pp.33~38 (1988)
- Glover, J., "The “testing” phenomenon: Not gone, but nearly forgotten", Journal of Education Psychology, 81(3), pp.392~399 (1989)
- Große, C. S., "Effects of multiple solution methods in mathematics learning", Learning and Instruction, 16, pp.122~138 (2006)
- Große, C. S., "Finding and fixing errors in worked examples: Can this foster learning outcomes?", Learning and Instruction, 17, pp.612~634 (2007)
- Holder, W. W., "Pencils down, computers up: The new CPA exam", Journal of Accountancy, 96(3), pp.57~60 (2001)
- Huff, K. L., "Validity issues in computer-based testing", Educational Measurement: Issues and Practice, 20, pp.16~25 (2001)
- Kalyuga, S., "Levels of expertise and instructional design", Human Factors, 40, pp.1~17 (1998)
- Kalyuga, S., "Learner experience and efficiency of instructional guidance", Educational Psychology, 21, pp.5~23 (2001)
- Kalyuga, S., "The expertise reversal effect", Educational Psychologist, 38(1), pp.23~31 (2003)
- Kvale, S., "Contradictions of assessment for learning in institutions of higher learning, in: Rethinking assessment in higher education" (2007), London and New York
- Lee, I., "Feedback in Hong Kong secondary writing classrooms: Assessment for learning or assessment of learning?", Assessing Writing, 12, pp.180~198 (2007)
- Marsh, E. J., "The memorial consequences of multiple-choice testing", Psychonomic Bulletin & Review, 14(2), pp.194~199 (2007)
- Moreno, R., "When worked examples don't work: Is cognitive load theory at an impasses?", Learning and Instruction, 16, pp.170~181 (2006)
- Nicol, D., "E-assessment by design: using multiple-choice tests to good effect", Journal of Further and Higher Education, 31, pp.53~64 (2007)
- Park, J., "Learning in a new computerized testing system", Journal of Educational Psychology, 97(3), pp.436~443 (2005)
- Renkl, A., "Learning mathematics from worked-out examples: Analyzing and fostering self-explanations", European Journal of Psychology of Education,, 14, pp.477~488 (1999)
- Renkl, A., "Structuring the transition from example study to problem solving in cognitive skill acquisition: A cognitive load perspective", Educational Psychologist, 38(1), pp.15~22 (2003)
- Reisslein, J., "Encountering the expertise reversal effect with a computer-based environment on electrical circuit analysis", Learning and Instruction, 16(2), pp.92~103 (2006)
- Roediger, H. L., "The positive and negative consequences of multiple-choice testing", Journal of Experiment Psychology: Learning, Memory, and Cognition, 31(5), pp.1155~1159 (2005)
- Roediger, H. L., "The power of testing memory: Basic research and implications for educational practice", Psychological Science, 1(3), pp.181~210 (2006)
- Rohrer, D., "The effects of overlearning and distributed practise on the retention of mathematics knowledge", Applied Cognitive Psychology, 20, pp.1209~1224 (2006)
- Salden, R., "Worked examples and tutored problem solving: Redundant or synergistic forms of support?", Topics in Cognitive Science, 1, pp.203~213 (2009)
- Santos-Trigo, M., "Mathematical problem solving: An evolving research and practice domain", ZDM - The International Journal on Mathematics Education, 39, pp.523~536 (2007)
- Schoenfeld, A, "Handbook for research on mathematics teaching and learning" (1992), Macmillan
- Simkin, M. G., "Multiple-choice tests and student understanding: What is the connection?", Decision Sciences Journal of Innovative Education, 3, pp.73~97 (2005)
- Sweller, J., "The use of worked examples as a substitute for problem solving in learning algebra", Cognition and Instruction, 2, pp.59~89 (1985)
- Sweller, J., "The worked example effect and human cognition", Learning and Instruction, 16, pp.165~169 (2006)
- Sweller, J., "Cognitive architecture and instructional design", Educational Psychology Review, 10, pp.196~251 (1998)
- Tillema, H. H., "Assessment for learning to teach: Appraisal of practice teaching lessons by mentors, supervisors, and student teachers", Journal of Teacher Education, 60, pp.155~167 (2009)
- Williams, R. L., "College students' ratings of student effort, student ability and teacher input as correlates of student performance on multiple-choice exams", Educational Research, 46, pp.229~239 (2004)