베이지언 네트워크를 이용한 영어 관사 학습의 인지진단 평가
An Application of Bayesian Networks to Cognitive Diagnostic Modeling of English Article Learning
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
The English article system has been known one of the most challenging components of English grammar for foreign learners to master, which needs continuous learning and feedback through assessments. However, current cognitive diagnostic models(CDMs) show some serious limitations: heavy reliance on large scale data, inability to model skill hierarchies and insufficient flexibility to efficiently handle small but repeated measurements. The purpose of the current study was to examine the potential of Bayesian network-based cognitive diagnostic modeling(BN-CDM) as an alternative to the current CDMs. A group of 124 college students(98 females and 26 males) joined a weekly 10-min learning session of the English article system throughout a semester and were administered a series of diagnostic tests. The test data were analyzed using conventional CDMs and BN-CDM. The results show that BN-CDM can handle small but repeated test data much more efficiently than conventional CDMs with a full consideration of hierarchical structures of the subject domain. The study also discusses some pedagogical implications of the results.
Abstract
The English article system has been known one of the most challenging components of English grammar for foreign learners to master, which needs continuous learning and feedback through assessments. However, current cognitive diagnostic models(CDMs) show some serious limitations: heavy reliance on large scale data, inability to model skill hierarchies and insufficient flexibility to efficiently handle small but repeated measurements. The purpose of the current study was to examine the potential of Bayesian network-based cognitive diagnostic modeling(BN-CDM) as an alternative to the current CDMs. A group of 124 college students(98 females and 26 males) joined a weekly 10-min learning session of the English article system throughout a semester and were administered a series of diagnostic tests. The test data were analyzed using conventional CDMs and BN-CDM. The results show that BN-CDM can handle small but repeated test data much more efficiently than conventional CDMs with a full consideration of hierarchical structures of the subject domain. The study also discusses some pedagogical implications of the results.
참고문헌 (48)
- 조규희, "예비 초등영어교사의 과정중심평가 계획 작성 경험 분석", 외국어교육연구, 36(2), pp.1~22 (2022), 외국어교육연구소[DOI]
- 박찬호, "Cognitive Diagnostic Writing Assessment for Korean Learners of English", 외국어교육연구, 34(2), pp.1~24 (2020), 외국어교육연구소[DOI]
- 교육과정 개정에 따른 영어과내용 교수 지식(PCK) 연구, "장경숙", 한국교육과정평가원, ~, pp.RRI 2007-3-7 (2007)
- Akakura, M., "Evaluating the Effectiveness of Explicit Instruction on Implicit and Explicit L2 Knowledge", Language Teaching Research, 16(1), pp.9~37 (2012)
- Almond, R. G., "Bayesian Networks in Educational Assessment" (2015), Springer-Verlag
- Barber, D., "Bayesian Reasoning and Machine Learning" (2012), Cambridge University Press
- Chan, J. Y. H., "Towards English as an International Language: The Evolving ELT Curricula and Textbooks in Hong Kong", International Journal of Applied Linguistics, 30(2), pp.244~263 (2020)
- Chiu, C. Y., "Statistical Refinement of the Q-matrix in Cognitive Diagnosis", Applied Psychological Measurement, 37(8), pp.598~618 (2013)
- Choi, I. C., "The Impact of EFL Testing on EFL Education in Korea", Language Testing, 25(1), pp.39~62 (2008)
- Choi, T., "Analyzing the Context Which Affects the Implementation and Impact of Educational Reforms Insights from Hong Kong and South Korean Cases", World Voices Nexus: The WCCES Chronicle, 1 (2017)
- Conati, C., "Advances in Intelligent Tutoring Systems", pp.281~299 (2010), Springer
- Cowell, R. G., "Fast Retraction of Evidence in a Probabilistic Expert System", Statistics and Computing, 2(1), pp.37~40 (1992)
- Culbertson, M. J., "Bayesian Networks in Educational Assessment: The State of the Field", Applied Psychological Measurement, 40(1), pp.3~21 (2016)
- Culpepper, S. A., "An Improved Strategy for Bayesian Estimation of the Reduced Reparameterized Unified Model", Applied Psychological Measurement, 42(2), pp.99~115 (2018)
- de la Torre, J., "The Generalized DINA Model Framework", Psychometrika, 76, pp.179~199 (2011)
- Geiger, D., "d-Separation: From Theorems to Algorithms", UCLA, Computer Science Dept, ~ (2013)
- Gelman, A., "Posterior Predictive Assessment of Model Fitness via Realized Discrepancies", Statistica Sinica, 6, pp.733~760 (1996)
- George, A. C., "Cognitive Diagnosis Models in R : A Didactic", The Quantitative Methods for Psychology, 11(3), pp.189~205 (2015)
- Haertel, E. H., "Using Restricted Latent Class Models to Map the Skill Structure of Achievement Items", Journal of Educational Measurement, 26, pp.301~321 (1989)
- Han, N. R., "Detecting Errors in English Article Usage by Non-native Speakers", Natural Language Engineering, 12(2), pp.115~129 (2006)
- Hawkins, J., "On (in)Definite Articles: Implicatures and (un)Grammaticality Prediction", Journal of Linguistics, 27(2), pp.405~442 (1991)
- Henson, R. A., "Defining a Family of Cognitive Diagnosis Models Using Log-linear Models with Latent Variables", Psychometrika, 74(2), pp.191~210 (2009)
- Ionin, T., "The Interpretation of the: A New Look at Articles in L2English", Proceedings of the 27th Boston University Conference on Language Development, pp.346~357 (2003)
- Ionin, T., "Article Semantics in L2 Acquisition:The Role of Specificity", Language Acquisition, 12(1), pp.3~69 (2004)
- Jang, E. E., "A Review of Cognitive Diagnostic Assessment for Education : Theory and Application", International Journal of Testing, 8(3), pp.290~295 (2008)
- Lee, I., "Research into Practice : Written Corrective Feedback", Language Teaching, 46(1), pp.108~119 (2013)
- Lee, I., "Feedback Revolution : What Gets in the Way?", ELT Journal, 65(1), pp.1~12 (2011)
- Lee, Y. W., "Cognitive Diagnosis and Q-Matrices in Language Assessment", Language Assessment Quarterly, 6(3), pp.169~171 (2009)
- Wenchao Ma, "GDINA: An R Package for Cognitive Diagnosis Modeling", Journal of Statistical Software, 93(14) (2020), Foundation for Open Access Statistic[DOI]
- Ma, W., "Category-level Model Selection for the Sequential G-DINA Model", Journal of Educational and Behavioral Statistics, 44(1), pp.45~77 (2019)
- Master, P., "Information Structure and English Article Pedagogy", System, 30(3), pp.331~348 (2002)
- Master, P., "The English Article System : Acquisition, Function and Pedagogy", System, 25(2), pp.215~232 (1997)
- Master, P., "Perspectives on Pedagogical Grammar", pp.229~252 (1994), Cambridge University Press
- Norris, J. M., "Effectiveness of L2 Instruction : A Research Synthesis and Quantitative Meta-analysis", Language Learning, 50(3), pp.417~528 (2000)
- Palmer, H., "English Article-Usage", ELT Journal, 2(3), pp.62~73 (1947)
- "CDM: Cognitive Diagnosis Modeling" (2022)[URL]
- Scutari, M., "Learning Bayesian Networks with the bnlearn R Package", Journal of Statistical Software, 35(3), pp.1~22 (2010)
- Sessoms, J., "Applications of Diagnostic Classification Models : A Literature Review and Critical Commentary", Measurement : Interdisciplinary Research and Perspectives, 16(1), pp.1~17 (2018)
- Snape, N., "Addressing Fluctuation in Article Choice by Japanese Learners of L2 English Through Explicit Instruction", Instructed Second Language Acquisition, 2(2), pp.164~188 (2018)
- Snape, N., "Universal Grammar and the Second Language Classroom", pp.161~183 (2013), Springer
- Takahashi, T., "Japanese Learners' Acquisition and Use of the English Article System", Edinburgh Working Papers in Applied Linguistics, 8, pp.98~110 (1997)
- Fang Tang, "Does Diagnostic Feedback Promote Learning? Evidence From a Longitudinal Cognitive Diagnostic Assessment", AERA Open, 7, pp.233285842110608~ (2021), SAGE Publications[DOI]
- Tatsuoka, K., "Cognitive Assessment : An Introduction to the Rule Space Method" (2009), Routledge
- Trenkic, D., "The Representation of English Articles in Second Language Grammars : Determiners or Adjectives?", Bilingualism : Language and Cognition, 11(1), pp.1~18 (2008)
- Umeda, Y., "The Long-term Effect of Explicit Instruction on Learners’ Knowledge on English Articles", Language Teaching Research, 23(2), pp.179~199 (2019)
- Yilmaz, Y., "The Relative Effectiveness of Mixed, Explicit and Implicit Feedback in the Acquisition of English Articles", System, 41(3), pp.691~705 (2013)
- Yi, Y. S., "In Search of Optimal Cognitive Diagnostic Model(s) for ESL Grammar Test Data", Applied Measurement in Education, 30(2), pp.82~101 (2017)
- Yoo, I. W, "The English Definite Article : What ESL", EFL Grammars Say and What Corpus Findings Show, 2009, pp.8(4), 267~278
