본문 바로가기
KERD
논문KCI 등재

The legality and appropriateness of keeping Korean Medical Licensing Examination items confidential: a comparative analysis and review of court rulings

홍대운|이주연|김재선
한국보건의료인국가시험원 (Korea Health Personnel Licensing Examiniation Institute)|2024.01|Journal of Educational Evaluation for Health Professions|제21권 |pp. 1-10|DOI https://doi.org/10.3352/jeehp.2024.21.28

1

조회

0

다운로드

0

인용

0

참고문헌

키워드

Republic of KoreaDisclosureConfidentialityHealth personnelMedical licensure

초록

This study examines the legality and appropriateness of keeping the multiple-choice question items of the Korean Medical Licensing Examination (KMLE) confidential. Through an analysis of cases from the United States, Canada, and Australia, where medical licensing exams are conducted using item banks and computer-based testing, we found that exam items are kept confidential to ensure fairness and prevent cheating. In Korea, the Korea Health Personnel Licensing Examination Institute (KHPLEI) has been disclosing KMLE questions despite concerns over exam integrity. Korean courts have consistently ruled that multiple-choice question items prepared by public institutions are non-public information under Article 9(1)(v) of the Korea Official Information Disclosure Act (KOIDA), which exempts disclosure if it significantly hinders the fairness of exams or research and development. The Constitutional Court of Korea has upheld this provision. Given the time and cost involved in developing high-quality items and the need to accurately assess examinees’ abilities, there are compelling reasons to keep KMLE items confidential. As a public institution responsible for selecting qualified medical practitioners, KHPLEI should establish its disclosure policy based on a balanced assessment of public interest, without influence from specific groups. We conclude that KMLE questions qualify as non-public information under KOIDA, and KHPLEI may choose to maintain their confidentiality to ensure exam fairness and efficiency.

Abstract

This study examines the legality and appropriateness of keeping the multiple-choice question items of the Korean Medical Licensing Examination (KMLE) confidential. Through an analysis of cases from the United States, Canada, and Australia, where medical licensing exams are conducted using item banks and computer-based testing, we found that exam items are kept confidential to ensure fairness and prevent cheating. In Korea, the Korea Health Personnel Licensing Examination Institute (KHPLEI) has been disclosing KMLE questions despite concerns over exam integrity. Korean courts have consistently ruled that multiple-choice question items prepared by public institutions are non-public information under Article 9(1)(v) of the Korea Official Information Disclosure Act (KOIDA), which exempts disclosure if it significantly hinders the fairness of exams or research and development. The Constitutional Court of Korea has upheld this provision. Given the time and cost involved in developing high-quality items and the need to accurately assess examinees’ abilities, there are compelling reasons to keep KMLE items confidential. As a public institution responsible for selecting qualified medical practitioners, KHPLEI should establish its disclosure policy based on a balanced assessment of public interest, without influence from specific groups. We conclude that KMLE questions qualify as non-public information under KOIDA, and KHPLEI may choose to maintain their confidentiality to ensure exam fairness and efficiency.

참고문헌 (63)

  1. "Seoul High Court 2004Nu17145 Judgment (Sep 2, 2005)" (2011)[URL]
  2. "Decision made to release controversial ‘Medical License National Exam’ questions" (2011)[URL]
  3. "Past exam questions of Korea Health Personnel Licensing Examination" (2023)[URL]
  4. "Bill for a Partial Amendment to the Korea Health Personnel Licensing Examination Institute Act (Bill No. 6853)" (2017)[URL]
  5. "Review Report on the Bill for a Partial Amendment to the Korea Health Personnel Licensing Examination Institute Act (Bill No. 6853)" (2017)[URL]
  6. "Korean Medical Student Association expresses regret over Korean Medical Association’s opposition to disclosure of Korean Medical Licensing Examination questions" (2024)[URL]
  7. "Korean Medical Licensing Examination questions: information imbalance must be addressed, regardless of disclosure" (2024)[URL]
  8. Yang EB, "Perceptions on item disclosure for the Korean medical licensing examination", Korean J Med Educ, 27, pp.167~175 (2015)[DOI]
  9. Huh S, "Application of computer-based testing in the Korean Medical Licensing Examination, the emergence of the metaverse in medical education, journal metrics and statistics, and appreciation to reviewers and volunteers", J Educ Eval Health Prof, 19, pp.2~ (2022)[DOI]
  10. Meijer RR, "Computerized adaptive testing : overview and introduction", Appl Psychol Meas, 23, pp.187~194 (1999)[DOI]
  11. "Computerized adaptive testing (CAT): an introduction" (2023)[URL]
  12. "Korea Health Personnel Licensing Examination Institute: discussing the implementation and current status of the ‘computer adaptive test’ for Korean Medical Licensing and Nurse Licensing Examinations" (2024)[URL]
  13. Huh S, "Can computerized tests be introduced to the Korean Medical Licensing Examination?", J Korean Med Assoc, 55, pp.124~130 (2012)[DOI]
  14. Xu L, "Developing computerized adaptive testing for a National Health Professionals Exam : an attempt from psychometric simulations", Perspect Med Educ, 12, pp.462~471 (2023)[DOI]
  15. Van Wijk EV, "Computer adaptive vs. non-adaptive medical progress testing: feasibility, test performance, and student experiences", Perspect Med Educ, 13, pp.406~416 (2024)[DOI]
  16. "Why the chairperson of the Korean Medical Licensing Examination Committee asks for an end to the disclosure of Korean Medical Licensing Examination questions" (2024)[URL]
  17. "Request for copy of judgment" (2023)[URL]
  18. Galbraith R, "Computerized testing and the United States Medical Licensing Examination", Med Sci Educ, 10, pp.32~36 (2001)
  19. Dillon GF, "The introduction of computer-based case simulations into the United States medical licensing examination", Acad Med, 77(10Suppl), pp.S94~S96 (2002)[DOI]
  20. "Exam rules and conduct:common questions" (2024)[URL]
  21. "Practice materials common questions 1996-2024" (1996)[URL]
  22. "2025 USMIE bulletin of information"[URL]
  23. "NBME v Optima University: No. 09-1043, 2011 WL 761507(W.D. Tenn. Sept. 29, 2011)" (2011)[URL]
  24. "Thomas v. NbME Nat'l Bd. of Med. Examiners, No. 13–3946, 2015 WL 667077 (E.D. Penn. Feb. 13, 2015)" (2015)[URL]
  25. "Giri v. National Board of Medical Examiners, No. 24-cv-410(CRC), 2024 WL 756604 (D.C. February 23, 2024)" (2024)[URL]
  26. "MCCQE Part I: how is the MCCQE Part I delivered?" (2024)[URL]
  27. "AMC computer adaptive test (CAT) multiple choice question (MCQ) examination" (2024)[URL]
  28. "Exam day: conduct and behaviour" (2024)[URL]
  29. "Multiple choice question examination specifications" (2023)[URL]
  30. "Exam security: examples of security breaches" (2024)[URL]
  31. "Exam orientations" (2024)[URL]
  32. "AMC MCQ Online Trial Examination" (2024)[URL]
  33. Kim BW, "Case analysis and review on the constitutional foundations of the right to know", J Const Justice, 2, pp.173~217 (2015)[DOI]
  34. "Constitutional Court of Korea 88Hun-ma22 Decision (Sep 4, 1989)" (1989)[URL]
  35. "Official Information Disclosure Act, Act No. 19408 (May 16, 2023)" (2023)[URL]
  36. "Korea Health Personnel Licensing Examination Institute Act, Act No. 15022 (Oct 31, 2017)" (2023)[URL]
  37. "Enforcement Decree of the Official Information Disclosure Act, Presidential Decree No. 33866 (Nov 16, 2023)" (2023)[URL]
  38. "Seoul Administrative Court 99Gu2788 Judgment (Jul 2, 1999)" (1999)[URL]
  39. "Seoul High Court 99Nu9232 Judgment (Nov 24, 1999)" (2011)[URL]
  40. "Supreme Court of Korea 99Du12205 Judgment (Feb 23, 2000)" (2011)[URL]
  41. "Seoul Administrative Court 99Gu7004 Judgment (Oct 15, 1999)" (2011)[URL]
  42. "Seoul Administrative Court 2003Gu-hap13830 Judgment (Sep 3, 2003)" (2011)[URL]
  43. "Seoul High Court 2003Nu17155 Judgment (Jul 22, 2004)" (2011)[URL]
  44. "Supreme Court of Korea 2004Du9890 Judgment (Dec 10, 2004)" (2011)[URL]
  45. "Seoul Administrative Court 2004Gu-hap8071 Judgment (Jul 27, 2004)" (2011)[URL]
  46. "Seoul Administrative Court 2005Gu-hap18570 Judgment (Jan 6, 2006)" (2011)[URL]
  47. "Seoul High Court 2006Nu3522 Judgment (Sep 22, 2006)" (2011)[URL]
  48. "Supreme Court of Korea 2006Du15936 Judgment ( Jun 15, 2007)" (2007)[URL]
  49. "Seoul High Court 2007Nu15805 Judgment (Sep 14, 2007)" (2011)[URL]
  50. "Supreme Court of Korea 2007Du21723 Judgment (Dec 27, 2007)" (2011)[URL]
  51. "Constitutional Court of Korea 2007Hun-ba107 Decision (Sep 24, 12007)" (2007)[URL]
  52. "Seoul Administrative Court 2008Gu-hap15534 Judgment (Jul 30, 2008)" (2011)[URL]
  53. "Seoul High Court 2008Nu22947 Judgment ( Jun 24, 2010)" (2011)[URL]
  54. "Supreme Court of Korea 2010Du12927 Judgment (Sep 9, 2010)" (2011)[URL]
  55. "Constitutional Court of Korea 2010 Hun-ba291 Decision (Mar 31, 2011)" (2011)[URL]
  56. "Seoul Eastern District Court 2011Go-dan1583 Judgment (Jan 19, 2012)" (2012)[URL]
  57. "Seoul Administrative Court 2016Gu-hap60393 Judgment (Oct 20, 2016)" (2016)[URL]
  58. "Seoul High Court 2016Nu69361 Judgment ( Jan 23, 2017)" (2017)[URL]
  59. "Supreme Court of Korea 2017Du36625 Judgment (Apr 27, 2017)" (2011)[URL]
  60. "Seoul Administrative Court 2018Gu-hap64139 Judgment (Oct 12, 2018)" (2011)[URL]
  61. "Jeju District Court 2020Gu-hap5885 Judgment (May 11, 2021)" (2021)[URL]
  62. "Seoul Administrative Court 2021Gu-hap56848 Judgment (Jul 15, 2022)" (2022)[URL]
  63. "Seoul Administrative Court 2023Gu-hap67798 Judgment (Jul 11, 2024)" (2011)[URL]

관련 논문AI추천

의사면허국가시험 출제문제 공개에 관한 인식양은배한국의학교육학회 · Korean Journal of Medical Education2015 · 제27권 제3호Item difficulty index, discrimination index, and reliability of the 26 health professions licensing examinations in 2022, Korea: a psychometric study김보현, 김윤희, 김준기, 배상영, 정보경한국보건의료인국가시험원 · Journal of Educational Evaluation for Health Professions2023 · 제20권 Possibility of independent use of the yes/no Angoff and Hofstee methods for the standard setting of the Korean Medical Licensing Examination written test: a descriptive study강예지, 김도환, 박훈기한국보건의료인국가시험원 · Journal of Educational Evaluation for Health Professions2022 · 제19권 의학교육에서 컴퓨터바탕검사와 문항은행 데이터베이스 구축허선연세대학교 의과대학 · 의학교육논단2014 · 제16권 제1호Similarity of the cut score in test sets with different item amounts using the modified Angoff, modified Ebel, and Hofstee standard-setting methods for the Korean Medical Licensing Examination김나진, 김영민, 박장희, 안덕선, 임미경한국보건의료인국가시험원 · Journal of Educational Evaluation for Health Professions2020 · 제17권 Comparison of results between modified-Angoff and bookmark methods for estimating cut score of the Korean medical licensing examinationMikyoung Yim한국의학교육학회 · Korean Journal of Medical Education2018 · 제30권 제4호

이 간행물의 다른 논문 (40건)

Discovering social learning ecosystems during clinical clerkship from United States medical students’ feedback encounters: a content analysisAnna Therese Cianciolo, Heeyoung Han, Lydia Anne Howes, Debra Lee Klamen, Sophia Matospp. 1-8Redesigning a faculty development program for clinical teachers in Indonesia: a before-and-after studyRita Mustika, Nadia Greviana, Dewi Anggraeni Kusumoningrum, Anyta Pinasthikapp. 1-8Impact of a change from A–F grading to honors/pass/fail grading on academic performance at Yonsei University College of Medicine in Korea: a cross-sectional serial mediation analysis김혜원, 김민경pp. 1-7The 6 degrees of curriculum integration in medical education in the United StatesJulie Youm, Jennifer Christner, Kevin Hittle, Paul Ko, Cinda Stone, Angela D. Blood, Samara Ginzburgpp. 1-7Development and validity evidence for the resident-led large group teaching assessment instrument in the United States: a methodological studyYoon Soo Park, Ariel Shana Frey-Vogel, Kristina Dzara, Kimberly Anne Gifford, Justin Berk, Allison Heinly, Darcy Wolcott, Daniel Adam Hall, Shannon Elliott Scott-Vernaglia, Katherine Anne Sparger, Erica Ye-pyng Chungpp. 1-8
원문 보기