Using the Angoff method to set a standard on mock exams for the Korean Nursing Licensing Examination
2
조회
0
다운로드
5
인용
0
참고문헌
키워드
초록
Purpose: This study explored the possibility of using the Angoff method, in which panel experts determine the cut score of an exam,for the Korean Nursing Licensing Examination (KNLE). Two mock exams for the KNLE were analyzed. The Angoff standard settingprocedure was conducted and the results were analyzed. We also aimed to examine the procedural validity of applying the Angoff method in this context. Methods: For both mock exams, we set a pass-fail cut score using the Angoff method. The standard setting panel consisted of 16 nursing professors. After the Angoff procedure, the procedural validity of establishing the standard was evaluated by investigating the responses of the standard setters. Results: The descriptions of the minimally competent person for the KNLE were presented at the levels of general and subject performance. The cut scores of first and second mock exams were 74.4 and 76.8, respectively. These were higher than the traditional cut score(60% of the total score of the KNLE). The panel survey showed very positive responses, with scores higher than 4 out of 5 points on aLikert scale. Conclusion: The scores calculated for both mock tests were similar, and were much higher than the existing cut scores. In the secondsimulation, the standard deviation of the Angoff rating was lower than in the first simulation. According to the survey results, proceduralvalidity was acceptable, as shown by a high level of confidence. The results show that determining cut scores by an expert panel is an applicable method.
Abstract
Purpose: This study explored the possibility of using the Angoff method, in which panel experts determine the cut score of an exam,for the Korean Nursing Licensing Examination (KNLE). Two mock exams for the KNLE were analyzed. The Angoff standard settingprocedure was conducted and the results were analyzed. We also aimed to examine the procedural validity of applying the Angoff method in this context. Methods: For both mock exams, we set a pass-fail cut score using the Angoff method. The standard setting panel consisted of 16 nursing professors. After the Angoff procedure, the procedural validity of establishing the standard was evaluated by investigating the responses of the standard setters. Results: The descriptions of the minimally competent person for the KNLE were presented at the levels of general and subject performance. The cut scores of first and second mock exams were 74.4 and 76.8, respectively. These were higher than the traditional cut score(60% of the total score of the KNLE). The panel survey showed very positive responses, with scores higher than 4 out of 5 points on aLikert scale. Conclusion: The scores calculated for both mock tests were similar, and were much higher than the existing cut scores. In the secondsimulation, the standard deviation of the Angoff rating was lower than in the first simulation. According to the survey results, proceduralvalidity was acceptable, as shown by a high level of confidence. The results show that determining cut scores by an expert panel is an applicable method.
참고문헌 (17)
- Guemin Lee, "A Pychometric Approach to Setting a Passing Score on Korean National Medical Licensing Examination", Journal of Educational Evaluation for Health Professions, 1, pp.5~ (2004), Korea Health Personnel Licensing Examination Institute[DOI]
- "Test plan for the National Council Licensure Examination for Registered Nurses" (2019)[URL]
- A study of policy suggestions for nurturing and distributing excellent nurses, "Seo YO", Korea Health Personnel Licensing Examination, ~, pp.Report No.: research report RE02-1706-05 (2017)
- A study on improvement of qualification system for graduates from foreign universities, "Jung SY", Korea Health Personnel Licensing Examination, ~, pp.Report No.: research report RE12-1907-00 (2019)
- A study on item management system of NCLEX-RN in USA, "Kwak CY", Korea Health Personnel Licensing Examination, ~, pp.Report No.: research report RE02-1004-05 (2010)
- A study on the minimum competency for nursing university graduates and application of national licensing examination, "Kang SY", Korea Health Personnel Licensing Examination, ~, pp.Report No.: research report RE02-1607-05 (2015)
- Cizek G, "Standard setting" (2011), Hakjisa
- Angoff WH, "Educational measurement", pp.508~600 (1971), American Council on Education
- Ronald A. Berk, "A Consumer’s Guide to Setting Performance Standards on Criterion-Referenced Tests", Review of Educational Research, 56(1), pp.137~172 (2016), American Educational Research Association (AERA)[DOI]
- Cizek GJ, "Setting performance standards: concepts, methods, and perspectives" (2001), Lawrence Erlbaum Associate
- "Item analysis of 58th National Licensing Examination for Nurse in 2018" (2018)[URL]
- Kim MA, "7-Day National Licensing Examination for Nurse" (2018), EDUPD
- Mikyoung Yim, "Comparison of results between modified-Angoff and bookmark methods for estimating cut score of the Korean medical licensing examination", Korean Journal of Medical Education, 30(4), pp.347~357 (2018), 한국의학교육학회[DOI]
- A study about standard setting for national licensing exams for health professions, "Ahn DS", Korea Health Personnel Licensing Examination, ~, pp.Report No.: research report RE12-1815-00 (2018)
- Janghee Park, "Comparison of standard-setting methods for the Korean Radiological Technologist Licensing Examination: Angoff, Ebel, bookmark, and Hofstee", Journal of Educational Evaluation for Health Professions, 15, pp.32~ (2018), Korea Health Personnel Licensing Examination Institute[DOI]
- Abdullah A. Ferdous, "The Use of Subsets of Test Questions in an Angoff Standard-Setting Method", Educational and Psychological Measurement, 65(2), pp.185~201 (2016), SAGE Publications[DOI]
- Buckendahl CW, "Recommending cut scores with a subset of items: an empirical illustration", Pract Assess Res Eval, 15, pp.6~ (2010)[DOI]