진료수행평가에서 가교-스테이션을 이용한 점수 동등화
Equating Scores Using Bridging Stations on the Clinical Performance Examination
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Purpose: This study examined the use of the Tucker linear equating method in producing an individual student’s score in 3 groups with bridging stations over 3 consecutive days of the clinical performance examination (CPX) and compared the differences in scoring patterns by bridging number. Methods: Data were drawn from 88 examinees from 3 different CPX groups―DAY1, DAY2, and DAY3―each of which comprised of 6 stations. Each group had 3 common stations, and each group had 2 or 3 stations that differed from other groups. DAY1 and DAY3 were equated to DAY2. Equated mean scores and standard deviations were compared with the originals. DAY1 and DAY3 were equated again, and the differences in scores (equated score-raw score) were compared between the 3 sets of equated scores. Results: By equating to DAY2, DAY1 decreased in mean score from 58.188 to 56.549 and in standard deviation from 4.991 to 5.046, and DAY3 fell in mean score from 58.351 to 58.057 and in standard deviation from 5.546 to 5.856, which demonstrates that the scores of examinees in DAY1 and DAY2 were accentuated after use of the equation. The patterns in score differences between the equated sets to DAY1, DAY2, and DAY3 yielded information on the soundness of the equating results from individual and overall comparisons. Conclusion: To generate equated scores between 3 groups on 3 consecutive days of the CPX, we applied the Tucker linear equating method. We also present a method of equating reciprocal days to the anchoring day as much as bridging stations.
Abstract
Purpose: This study examined the use of the Tucker linear equating method in producing an individual student’s score in 3 groups with bridging stations over 3 consecutive days of the clinical performance examination (CPX) and compared the differences in scoring patterns by bridging number. Methods: Data were drawn from 88 examinees from 3 different CPX groups―DAY1, DAY2, and DAY3―each of which comprised of 6 stations. Each group had 3 common stations, and each group had 2 or 3 stations that differed from other groups. DAY1 and DAY3 were equated to DAY2. Equated mean scores and standard deviations were compared with the originals. DAY1 and DAY3 were equated again, and the differences in scores (equated score-raw score) were compared between the 3 sets of equated scores. Results: By equating to DAY2, DAY1 decreased in mean score from 58.188 to 56.549 and in standard deviation from 4.991 to 5.046, and DAY3 fell in mean score from 58.351 to 58.057 and in standard deviation from 5.546 to 5.856, which demonstrates that the scores of examinees in DAY1 and DAY2 were accentuated after use of the equation. The patterns in score differences between the equated sets to DAY1, DAY2, and DAY3 yielded information on the soundness of the equating results from individual and overall comparisons. Conclusion: To generate equated scores between 3 groups on 3 consecutive days of the CPX, we applied the Tucker linear equating method. We also present a method of equating reciprocal days to the anchoring day as much as bridging stations.
참고문헌 (11)
- Harden RM, "Assessment of clinical competence using an objective structured clinical examination", Med Educ, 13, pp.41~54 (1979)
- Adamo G, "Simulated and standardized patients in OSCEs: achievements and challenges 1992-2003", Med Teach, 25, pp.262~270 (2003)
- Nam HW, "Geomsa dongdeunghwa bangbeop", pp.45~50 (2001), Kyoyookbook
- 김현철, "모의실험에 의한 대학입학수학능력시험 선택과목 점수 동등화 방법들의 적합성 비교(II):동등화 점수의 표준편차와 공통과목 점수별 선택과목 평균점수의 분석", 교육학연구, 41(2), pp.6~133 (2003), 한국교육학회
- 김재철, "가교문항 수직적 동등화 방법을 통한 중학생의 학년별 수학 학력 변화 탐색", 교육과정평가연구, 9(1), pp.275~298 (2006), 한국교육과정평가원
- 부재율, "가교문항 수직적 동등화를 이용한 국어, 영어, 수학 학업성취도의 학년 간 비교 연구", 교육평가연구, 18(1), pp.81~100 (2005), 한국교육평가학회
- 김연정, "An Investigation of the Effect of Anchor Test Length and Non-equivalency of Equating Groups on Equating", 교육평가연구, 22(4), pp.1133~1160 (2009), 한국교육평가학회
- 전경희, "동등화를 이용한 대학수학능력시험 외국어영역의 검사특성과 피험자 능력의 비교", 교육평가연구, 16(1), pp.119~139 (2003), 한국교육평가학회
- Boo JY, "Issues in equating: equivalency, equating errors, equating pre-test and post-test", J Educ Eval, 12, pp.43~64 (1999)
- Kolenn MJ, "Test equating, scaling, and linking: methods and practices", pp.320~323 (2004), Springer
- Park HK, "3-year experience of Seoul·Gyeonggi CPX consortium", Paper presented at: CPX Symposium (2006)