통계적 기법을 이용한 집단 협업 프로젝트에서의 공정한 동료 평가 방법론에 대한 연구
Equitable Peer Assessment Method in Collaboration Project Using Statistical Technique
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
For evaluating participation in collaboration project, the peer assement method is mostly used and various scoring methods have been proposed. But, the reliability and validity of the peer assessment method are still doubted for all most method. In order to overcome these weaknesss, some guidelines and training methods have been recommended. In this article, however,statistical technique is proposed for measuring individual contributions to collaboration projects considering each assessor’s reliability. The gist of our proposed algorithm is that an assessor’s reliability depends on the evaluation policy, and this reliability is evaluated by an analysis of variance of the scores assigned by the assessor. We also show that the proposed method is very efficient by case study in university class.
Abstract
For evaluating participation in collaboration project, the peer assement method is mostly used and various scoring methods have been proposed. But, the reliability and validity of the peer assessment method are still doubted for all most method. In order to overcome these weaknesss, some guidelines and training methods have been recommended. In this article, however,statistical technique is proposed for measuring individual contributions to collaboration projects considering each assessor’s reliability. The gist of our proposed algorithm is that an assessor’s reliability depends on the evaluation policy, and this reliability is evaluated by an analysis of variance of the scores assigned by the assessor. We also show that the proposed method is very efficient by case study in university class.
참고문헌 (11)
- Freeman, M., "Peer assessment by groups of group work", Assessment and Evaluation in Higher Education, 20, pp.289~299 (1995)
- Gehringer, E. F., "Assessing Studentsʼ Wiki Contributions", 2008 American Society for Engineering Education Annual Conference and Exposition (2008)
- Herbet, N., "Peer assessment : Is it fair?", In Uniserve science assessment symposium proceeding (2006)
- Kennedy, J.G., "-assessment in Group Projects : Is It Worth It?", Australian Computer Society, 42 (2005)
- 고성석, "온라인 협업 시스템의 품질관리 체계에 대한 연구", 산업경영시스템학회지, 33(2), pp.127~132 (2010), 한국산업경영시스템학회
- Marjo van Zundert, "Effective peer assessment processes : Research findings and future directions", Learning and Instruction, 20, pp.270~279 (2009)
- Michaelsen, L. K., "Team learning : a comprehensive approach for harnessing the power of small groups in higher education", To Improve the Academy, 11, pp.107~122 (1994)
- Panchal, J., "Product Realization in The Age of Mass Collaboration, Proc", ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, pp.3~6 (2008)
- Parsons, D., "Justice in the Classroom : Peer Assessment of Contributions in Group Projects, Proc", 17th NACCQ, pp.145~151 (2004)
- Raban, R., "Supporting peer assessment of individual contributions in groupwork, Proc", 23rd Annual Ascilite Conference, pp.685~694 (2007)
- Topping, K.J., "Peer Assessment", Theory Into Practice, 20~27 (2009)