대학 수업에서 누적 동료평가 점수를 활용한 성적 산출 방법의 타당성
The validity of using cumulative peer assessed scores for final grades in college courses
1
조회
0
다운로드
16
인용
0
참고문헌
키워드
초록
동료평가 (peer assessment)란 통상 교수자가 주관하는 평가를 학생들로 하여금 서로에 대해 하도록 하는 활동을 가리킨다. 동료평가는 고등교육에서 글쓰기를 훈련시키기 위한 도구 혹은 배운 지식을 적용하거나 확장하는 학습 활동을 위한 도구로 사용된다. Park(2016)은 최근 동료평가를 예습 활동의 한 부분으로 확장하는 방안을 제안하였다. 학생들은 매주의 수업에 앞서 스스로 공부하고, 공부한 내용을 바탕으로 하여 대답할 수 있는 질문에 대해 한 페이지 글을 쓰고 다른 학생들의 글을 평가하였다. 본 연구에서는, 이 시스템을 S 대학의 학부 수업에 두 학기에 걸쳐 적용한 결과가 분석되었다. 학생들 간의 채점 신뢰도와, 학생들의 채점 결과와 교수자에 의한 최종 보고서 평가 간의 상관이 분석되었다. 매주의 동료평가에서 학생들이 부여한 점수간의 신뢰도는 그리 높지 않았지만, 이들이 누적된 점수와 교수가 평가한 기말 보고서 점수간의 상관은 두 수업 모두에서 유의미하게 높았다. 논의에서는 이 결과를 바탕으로 대학에서 예습을 위한 동료평가의 결과를 성적에 반영하는 방안의 확장 가능성이 다루어졌다.
Abstract
Peer assessment refers to having students, rather than the instructor, make assessments of one another’s work. Peer assessment is often used as a tool to train writing skills or a tool to apply or extend learning in higher education. Park(2016) recently proposed a system which utilizes peer assessment as a part of preparatory activity for college courses. Before weekly class, students studied given material on their own, wrote a one page essay on a given question based on their reading, and assessed the essays of other students. In this study, the system was implemented in undergraduate courses at S University over 2 semesters and the results were analyzed. The reliability of weekly scores given by students was not very high, but the correlation was high between the cumulative scores given by students across weeks and the scores of the end of the term paper assessed by the instructor. Based on these findings, the possibility of utilizing the results of the peer assessments as part of the final grades was discussed.
참고문헌 (41)
- Boud, D., "The role of self‐assessment in student grading", Assessment in Higher Education, 14(1), pp.20~30 (1989)
- Brown, S., "Getting to grips with assessment" (1997), SEDA
- Cheng, W., "Peer and teacher assessment of the oral and written tasks of a group project", Assessment & Evaluation in Higher Education, 24(3), pp.301~314 (1999)
- Cho, K., "Peer-based computer-supported knowledge refinement: An empirical investigation", Communications of the ACM, 51(3), pp.83~88 (2008)
- Cho, K., "Learning by reviewing", Journal of Educational Psychology, 103(1), pp.73~ (2011)
- Cho, K., "Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system", Computers & Education, 48(3), pp.409~426 (2007)
- Cho, K., "Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives", Journal of Educational Psychology, 98(4), pp.891~ (2006)
- Cho, Y. H., "Peer reviewers learn from giving comments", Instructional Science, 39(5), pp.629~643 (2011)
- Cohen, L., "Research methods in education" (2000), Falmer
- Davies, P., "Computerized peer assessment", Innovations in Education and Teaching International, 37(4), pp.346~355 (2000)
- Davis, A., "The experimental method in psychology", Research methods in psychology, 2, pp.42~58 (2000)
- Fabos, B., "Telecommunication in the classroom: Rhetoric versus reality", Review of educational research, 69(3), pp.217~259 (1999)
- Falchikov, N., "Product comparisons and process benefits of collaborative peer group and self assessments", Assessment and Evaluation in Higher Education, 11(2), pp.146~166 (1986)
- Falchikov, N., "Improving feedback to and from students", Assessment for learning in higher education, 1 (1995)
- Falchikov, N., "Improving assessment through student involvement: Practical solutions for aiding learning in higher and further education" (2005), Routledge
- Falchikov, N., "Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks", Review of educational research, 70(3), pp.287~322 (2000)
- Freeman, M., "Peer assessment by groups of group work", Assessment & Evaluation in Higher Education, 20(3), pp.289~300 (1995)
- Gielen, S., "Improving the effectiveness of peer feedback for learning", Learning and Instruction, 20(4), pp.304~315 (2010)
- Hamer, J., "Quality of peer assessment in CS1", Proceedings of the fifth international workshop on Computing education research workshop, pp.27~36 (2009), ACM
- Hamer, J., "A comparison of peer and tutor feedback", Assessment & Evaluation in Higher Education, 40(1), pp.151~164 (2015)
- Hunter, J. E., "Performance measurement and theory", pp.257~266 (1983), Performance measurement and theory
- Karpicke, J. D., "The critical importance of retrieval for learning", science, 319(5865), pp.966~968 (2008)
- Kwok, R. C., "Use of a group support system for collaborative assessment", Computers & Education, 32(2), pp.109~125 (1999)
- Liu, E. Z. F., "Web-based peer review: the learner as both adapter and reviewer", Education, IEEE Transactions on, 44(3), pp.246~251 (2001)
- Lynch, D. H., "Peer evaluation of writing in business communication classes", Journal of Education for Business, 68(1), pp.44~48 (1992)
- Magin, D., "Reciprocity as a source of bias in multiple peer assessment of group work", Studies in Higher Education, 26(1), pp.53~63 (2001)
- Moskal, B. M., "Validity, reliability and the assessment of engineering education", Journal of Engineering Education, 91(3), pp.351~354 (2002)
- Nunnally, J. C., "Psychometric theory (Vol. 226)" (1967), McGraw-Hill
- Park, J., "ClassPrep: A peer review system for class preparation", British Journal of Educational Technology (2016)
- Rada, R., "Efficiency and effectiveness in computer-supported peer-peer learning", Computers and Education, 30(3), pp.137~146 (1998)
- Rosenthal, R., "Essentials of behavioral research: Methods and data analysis" (1991), McGraw-Hill Book Company
- Rushton, C., "Peer Assessment in a Collaborative Hypermedia Environment: A Case Study", Journal of Computer-Based Instruction, 20(3), pp.75~80 (1993)
- Sadler, D. R., "Formative assessment and the design of instructional systems", Instructional science, 18(2), pp.119~144 (1989)
- Shrout, P. E., "Intraclass correlations: uses in assessing rater reliability", Psychological bulletin, 86(2), pp.420~ (1979)
- Stefani, L. A., "Peer, self and tutor assessment: relative reliabilities", Studies in Higher Education, 19(1), pp.69~75 (1994)
- Stiggins, R. J., "Student-involved classroom assessment" (2001), Prentice Hall
- Strachan, I. B., "Peer and self assessment of group work: developing an effective response to increased enrolment in a third‐year course in microclimatology", Journal of Geography in Higher Education, 20(3), pp.343~353 (1996)
- Suen, H. K., "Peer assessment for massive open online courses (MOOCs)", The International Review of Research in Open and Distributed Learning, 15(3) (2014)
- Swanson, D. B., "The challenge of problem based learning", pp.260~273 (1991)
- "An introduction to intraclass correlation that resolves some common confusions" (2010)[URL]
- Topping, K., "Peer assessment between students in colleges and universities", Review of educational Research, 68(3), pp.249~276 (1998)