Item difficulty index, discrimination index, and reliability of the 26 health professions licensing examinations in 2022, Korea: a psychometric study
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Purpose This study presents item analysis results of the 26 health personnel licensing examinations managed by the Korea Health Personnel Licensing Examination Institute (KHPLEI) in 2022. Methods The item difficulty index, item discrimination index, and reliability were calculated. The item discrimination index was calculated using a discrimination index based on the upper and lower 27% rule and the item-total correlation. Results Out of 468,352 total examinees, 418,887 (89.4%) passed. The pass rates ranged from 27.3% for health educators level 1 to 97.1% for oriental medical doctors. Most examinations had a high average difficulty index, albeit to varying degrees, ranging from 61.3% for prosthetists and orthotists to 83.9% for care workers. The average discrimination index based on the upper and lower 27% rule ranged from 0.17 for oriental medical doctors to 0.38 for radiological technologists. The average item-total correlation ranged from 0.20 for oriental medical doctors to 0.38 for radiological technologists. The Cronbach α, as a measure of reliability, ranged from 0.872 for health educators-level 3 to 0.978 for medical technologists. The correlation coefficient between the average difficulty index and average discrimination index was -0.2452 (P=0.1557), that between the average difficulty index and the average item-total correlation was 0.3502 (P=0.0392), and that between the average discrimination index and the average item-total correlation was 0.7944 (P<0.0001). Conclusion This technical report presents the item analysis results and reliability of the recent examinations by the KHPLEI, demonstrating an acceptable range of difficulty index and discrimination index values, as well as good reliability.
Abstract
Purpose This study presents item analysis results of the 26 health personnel licensing examinations managed by the Korea Health Personnel Licensing Examination Institute (KHPLEI) in 2022. Methods The item difficulty index, item discrimination index, and reliability were calculated. The item discrimination index was calculated using a discrimination index based on the upper and lower 27% rule and the item-total correlation. Results Out of 468,352 total examinees, 418,887 (89.4%) passed. The pass rates ranged from 27.3% for health educators level 1 to 97.1% for oriental medical doctors. Most examinations had a high average difficulty index, albeit to varying degrees, ranging from 61.3% for prosthetists and orthotists to 83.9% for care workers. The average discrimination index based on the upper and lower 27% rule ranged from 0.17 for oriental medical doctors to 0.38 for radiological technologists. The average item-total correlation ranged from 0.20 for oriental medical doctors to 0.38 for radiological technologists. The Cronbach α, as a measure of reliability, ranged from 0.872 for health educators-level 3 to 0.978 for medical technologists. The correlation coefficient between the average difficulty index and average discrimination index was -0.2452 (P=0.1557), that between the average difficulty index and the average item-total correlation was 0.3502 (P=0.0392), and that between the average discrimination index and the average item-total correlation was 0.7944 (P<0.0001). Conclusion This technical report presents the item analysis results and reliability of the recent examinations by the KHPLEI, demonstrating an acceptable range of difficulty index and discrimination index values, as well as good reliability.
참고문헌 (7)
- Cangelosi JS, "Designing test for evaluation student achievement" (1990), Longman
- Ebel RL, "Essential of educational measurement" (1986), Prentice-Hall
- Lim EY, "Comparison of item analysis results of Korean Medical Licensing Examination according to classical test theory and item response theory", J Educ Eval Health Prof, 1, pp.67~76 (2004)[DOI]
- Meng KH, "Analysis of Korean National Medical Licensing Examination question items of 1992-1993 on their levels of cognitive domain, types of multiple choice questions and the contents of medical knowledge tested", Korean J Med Educ, 5, pp.11~17 (1994)[DOI]
- Item analysis of Korean National Health Personnel Licensing Examination in 2022, "Kim JK", Korea Health Personnel Licensing Examination Institute, ~ (2023)
- Jeong GH, "Applicability of item response theory to the Korean Nurses’ Licensing Examination", J Educ Eval Health Prof, 2, pp.23~29 (2005)[DOI]
- 임미경, "문항반응이론을 의사국가시험에 적용하기 위한 일차원성 및 적합도 검정", Korean Journal of Medical Education, 19(2), pp.163~169 (2007), 한국의학교육학회