본문 바로가기
KERD
논문KCI 등재

Evaluation on the Application of Factor Analysis Method in the Field of English Education in Korea

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

주제분류영어와문학

초록

This paper evaluates the use of Factor Analysis (FA) in English education research in Korea and suggests improvements in methodology. A detailed coding protocol was used to review 179 FA cases from 12 major English education journals (2014-2023). The review identified several key issues, including small sample sizes and lenient criteria for sample size selection, insufficient reporting on data appropriateness and normality, confusion between principal component analysis and FA, overreliance on the Eigenvalue > 1 criterion for determining the number of factors, inappropriate factor rotation methods, inconsistency between factor rotation and extraction methods, inadequate reporting on factor loadings and cross loadings criteria, and excessive reliance on SPSS as a statistical tool for FA. This study provides specific guidelines for applying FA appropriately and reporting results accurately.

Abstract

This paper evaluates the use of Factor Analysis (FA) in English education research in Korea and suggests improvements in methodology. A detailed coding protocol was used to review 179 FA cases from 12 major English education journals (2014-2023). The review identified several key issues, including small sample sizes and lenient criteria for sample size selection, insufficient reporting on data appropriateness and normality, confusion between principal component analysis and FA, overreliance on the Eigenvalue > 1 criterion for determining the number of factors, inappropriate factor rotation methods, inconsistency between factor rotation and extraction methods, inadequate reporting on factor loadings and cross loadings criteria, and excessive reliance on SPSS as a statistical tool for FA. This study provides specific guidelines for applying FA appropriately and reporting results accurately.

참고문헌 (146)

  1. An, H. S., "A profile of in-service Korean EFL teachers’ attitudes toward world Englishes", Studies in English Education, 22(3), pp.1~26 (2017)
  2. Aum, C. J., "Analysis of communication strategies in high school English textbooks", Applied Linguistics Association of Korea, 22(1), pp.227~301 (2006)
  3. Bae, J., "High school students’ use of learning strategies and affective domains : Focusing on digital English learning environment", Journal of Research in Curriculum & Instruction, 22(6), pp.447~461 (2018)
  4. Baek, J. Y., "Effectiveness of learner-centered reading activities through movie appreciation on Korean college students’ reading achievement", Foreign Languages Education, 26(3), pp.161~185 (2019)
  5. Baek, J. Y., "Analyzing the effectiveness of a film-based class in a college setting : How can a language-culture integrated English reading class be implemented", Foreign Languages Education, 28(1), pp.123~143 (2021)
  6. Bailey, D., "Competitiveness in EFL : The mediating effect of competition self-efficacy on the relationship between engagement and self-determination", English Teaching, 78(2), pp.3~28 (2023)
  7. Bartlett, M. S., "A note on the multiplying factors for various χ2 approximations", Journal of the Royal Statistical Society. Series B (Methodological), 16(2), pp.296~298 (1954)
  8. Boomsma, A., "Nonconvergence, improper solutions, and starting values in LISREL maximum likelihood estimation", Psychometrika, 50(2), pp.229~242 (1985)
  9. Byun, J. H., "Investigating the suitability of vocabulary strength test framework to EFL context", Foreign Languages Education, 23(1), pp.133~168 (2016)
  10. Byun, J. H., "Exploring the potential of integrating mobile augmented reality(AR)into speaking performance assessment", STEM Journal, 21(1), pp.65~93 (2020)
  11. Chang, J. Y., "A comparison of 2017-2018 CSAT reading passages via coh-metrix : Focusing on descriptive, readability, and easibility measures", Foreign Languages Education, 25(4), pp.81~106 (2018)
  12. Cheng, J., "Attitudes towards English language learning apps from Korean and Chinese EFL students", English Teaching, 74(4), pp.205~224 (2019)
  13. Cho, E. S., "Evaluating the use of exploratory factor analysis : Journal of Korean Marketing Association 1986-2006", Korean Marketing Review, 22(3), pp.179~208 (2007)
  14. Cho, H. W., "English learning beliefs of English majors and non-English majors", Modern English Education, 17(4), pp.201~219 (2016)
  15. Cho, H. W., "The variation of language anxiety in relation to learner variables and language performance", Foreign Languages Education, 25(4), pp.1~22 (2018)
  16. Cho, H. W., "Exploration of non-English majors’ instrumental motivation, interest, and their learning behaviors", Foreign Languages Education, 27(1), pp.1~21 (2020)
  17. Cho, M. Y., "L2 motivational self system of Korean high school and university learners of English", Korean Journal of Applied Linguistics, 32(1), pp.27~50 (2016)
  18. Cho, M. Y., "English learners’ orientations towards complexity, accuracy, and fluency : Learner factors and L2 writing performance", Studies in English Education, 26(4), pp.507~531 (2021)
  19. Cho, M. Y., "Strategy, affect, and L2 ability in integrated writing", English Teaching, 71(2), pp.87~110 (2016)
  20. Cho, Y. K., "The effects of Korean high school students’ perceptions of grammar learning and their use of grammar learning strategies on English grammatical knowledge", Secondary English Education, 10(2), pp.91~114 (2017)
  21. Choi, I. C., "Task characteristics of a computerized TTS dictation test and diagnostic interpretability of qualitative error analysis", Multimedia-Assisted Language Learning, 20(4), pp.11~43 (2017)
  22. Choi, J. H., "Structural equation modeling of Korean secondary and college students’willingness to communicate in English", Modern English Education, 22(1), pp.1~10 (2021)
  23. Chon, Y. V., "What if learners are not involved in reading? Reading ability and reading motivation of EFL learners", English Teaching, 74(1), pp.75~94 (2019)
  24. Chon, Y. V., "Adolescent EFL learners’ perceived use of listening testtaking strategies and L2 proficiency", English Language and Literature Education, 22(2), pp.1~22 (2016)
  25. Comrey, A. L., "A first course in factor analysis" (1992), Erlbaum
  26. Costello, A. B., "Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis", Practical Assessment, Research, and Evaluation, 10(7), pp.1~9 (2005)
  27. Crawford, A. V., "Evaluation of parallel analysis methods for determining the number of factors", Educational and Psychological Measurement, 70(6), pp.885~901 (2010)
  28. Eom, M., "Interplay of a learner’s regulatory focus and genre on second language writing", English Teaching, 77(1), pp.41~66 (2022)
  29. Field, A., "Discovering statistics using IBM SPSS statistics" (2018), SAGE Publications
  30. Goo, J., "Preservice elementary school teachers’ foreign language enjoyment, foreign language anxiety, and foreign language teaching anxiety", Studies in English Education, 27(4), pp.503~532 (2022)
  31. Gorsuch, R. L., "Factor analysis" (1983), Erlbaum
  32. Gorsuch, R. L., "Factor analysis: Classic edition" (2014), Routledge
  33. Hahn, H. R., "Affective factors underlying peer feedback in L2 English writing", English Language and Literature Education, 22(4), pp.339~367 (2016)
  34. Hahn, H. R., "The constructs of cloze test and face validity", English Language and Literature Education, 24(4), pp.221~243 (2018)
  35. Harlow, L. L., "Book review of using multivariate statistics by Barbara G. Tabachnick and Linda S. Fidell", Structural Equation Modeling, 9(4), pp.621~636 (2002)
  36. Havlicek, L. L., "Robustness of the Pearson correlation against violations of assumptions", Perceptual and Motor Skills, 43(3), pp.1319~1334 (1976)
  37. Hinkin, T. R., "A review of scale development practices in the study of organizations", Journal of Management, 21(5), pp.967~988 (1995)
  38. Hoekstra, R., "Are assumptions of well-known statistical techniques checked, and why (not)?", Frontiers in Psychology, 3, pp.137~ (2012)[DOI]
  39. Hong, K. H., "An exploration of Korean high school students’motivation in learning English", English Language Teaching, 27(1), pp.1~20 (2015)
  40. Hwang, I. S., "Foreign language reading anxiety and reading comprehension of Korean secondary EFL students", Secondary English Education, 15(4), pp.35~58 (2022)
  41. Hwang, M. H., "A study on the relations between grit, self-efficacy, and language proficiency among Korean high school students", English Language Teaching, 29(2), pp.145~164 (2017)
  42. Hwang, S., "A study on the factors influencing students’ learning flow and learning outcomes of real-time online learning in a Korean university", Multimedia-Assisted Language Learning, 24(2), pp.130~153 (2021)
  43. Jang, S. M., "Exploratory factor analysis for the development of Likert scales", The Korean Journal of Clinical Psychology, 34(4), pp.1079~1100 (2015)
  44. Jang, S. Y., "The dimensions of the foreign language enjoyment scale : A validation study", Studies in English Education, 28(4), pp.55~80 (2023)
  45. Jeon, J. H., "Elementary learners’ vocabulary according to CEFR basic user level", Primary English Education, 29(2), pp.47~67 (2023)
  46. Jeon, J. H., "A study on the application of AI voice recognition programs as a communication mediator", Primary English Education, 27(2), pp.145~167 (2021)
  47. Jeong, D. W., "A Study on the influence of English learners’ emotional intelligence and personal traits on English learning flow", Studies in English Education, 21(4), pp.153~174 (2016)
  48. Jeong, D. W., "A study on the mediating effect of self-efficacy on the relationship between their personality traits and job satisfaction of the English teachers", Studies in English Education, 22(2), pp.173~196 (2017)
  49. Jong, Y. K., "EFL learners’ self-perceptions of TOEIC classes based on the pass", non-pass evaluation system : Focusing on a pilot study, 2018, pp.30(2), 1~20
  50. Joo, M. J., "An investigation of perceptions of and performance on interview, pair, and group oral tests", English Language Teaching, 27(1), pp.137~156 (2015)
  51. Jung, D. Y., "A study on high school students’ use of digital English learning strategies according to learner variables", English Language Teaching, 33(1), pp.87~109 (2021)
  52. Jung, H. J., "An exploration of English teachers’ resistance to technological innovation", Multimedia-Assisted Language Learning, 21(1), pp.35~56 (2018)
  53. Jung, H. J., "Learners’ resistance to mobile-assisted language learning(MALL)", English Language Teaching, 30(1), pp.1~18 (2018)
  54. Jung, H. S., "A study on the relationship between grammar learning strategies and receptive knowledge of English grammar", Secondary English Education, 10(1), pp.107~127 (2017)
  55. Jung, M. A., "Korean EFL university students’ perceptions of using English automatic translators", Studies in English Education, 25(3), pp.411~438 (2020)
  56. Kaiser, H. F., "An index of factorial simplicity", Psychometrika, 39(1), pp.31~36 (1974)
  57. Kang, D., "An exploratory factor analysis of L2 motivational self system in Korean EFL college contexts", Foreign Languages Education, 24(1), pp.1~21 (2017)
  58. Kang, H. D., "Development of creativity test items for English education in the EFL context", Primary English Education, 22(3), pp.5~33 (2016)
  59. Kang, M. K., "ESP needs analysis for Korean law school", Foreign Languages Education, 21(2), pp.205~229 (2014)
  60. Kang, S. S., "Factors affecting willingness to communicate of young EFL learners", Foreign Languages Education, 22(4), pp.101~132 (2015)
  61. Kang, T. H., "A study on the use-realities of exploratory factor analysis in educational research", The Korean Journal of Educational Methodology Studies, 25(3), pp.521~541 (2013)
  62. Kim, C. T., "Misuse of exploratory factor analysis and its remedies", Survey Research, 17(1), pp.1~29 (2016)
  63. Kim, D. Y., "The effects of self-efficacy, self-regulation, and social support on English achievement", English Language Teaching, 31(4), pp.23~43 (2019)
  64. Kim, E. J., "A study on the English vocabulary level of engineering students in a compulsory English program", Studies in English Education, 22(2), pp.105~127 (2017)
  65. Kim, G. M., "An analysis of factor influencing Korean university students’ use of mobile-assisted language learning environment", Multimedia-Assisted Language Learning, 22(2), pp.29~49 (2019)
  66. Kim, G. N., "A study on English language learning strategy use by university students in Korea", English Language and Literature Education, 21(2), pp.41~63 (2015)
  67. Kim, H. D., "Practicality of performance assessment using a picture based narrative task in computer-based testing", STEM Journal, 17(1), pp.221~239 (2016)
  68. Kim, H. J., "Non-English-major pre-service elementary school teachers’ teacher cognition : With focus on English teacher efficacy and perceived English teaching competence", Modern English Education, 23(1), pp.83~94 (2022)
  69. Kim, H. S., "Effects of using socrative on speaking and listening performance of EFL university students", STEM Journal, 20(2), pp.109~134 (2019)
  70. Kim, H. S., "Exploring the relationships between learner attitude, participation, performance, and satisfaction in an LMS-assisted face-to-face L2 class", Multimedia-Assisted Language Learning, 21(3), pp.39~62 (2018)
  71. Kim, H. S., "Learner perception of an online L2-course summative exam", Multimedia-Assisted Language Learning, 23(3), pp.258~279 (2020)
  72. Kim, H. S., "A study of Korean English teachers’ future readiness for the fourth industrial revolution", Multimedia-Assisted Language Learning, 20(3), pp.179~205 (2017)
  73. Kim, I. D., "Reading strategies and attitudes of young learners of English during online extensive reading", Primary English Education, 28(1), pp.5~31 (2022)
  74. Kim, J. H., "Korean EFL students’ perceptions of English grammar learning across school levels", Secondary English Education, 16(4), pp.1~21 (2023)
  75. Kim, K., "Korean culinary college students’ desired careers and English proficiency needs", English Teaching, 73(1), pp.161~181 (2018)
  76. Kim, N. B., "Public speaking strategies for improving English speaking skills in the EFL college context", English Language and Literature Education, 24(2), pp.69~88 (2018)
  77. Kim, N. H., "EFL university students’ expectations of the use of machine translators for language learning", Studies in English Education, 27(3), pp.327~352 (2022)
  78. Kim, N. Y., "A study on the validity of the English learning style scale for Korean high school students in a native teacher’s class based on multimedia", STEM Journal, 19(4), pp.149~165 (2018)
  79. Kim, S. A., "High school teachers’ and students’ perceptions of and attitudes toward English writing", Studies in English Education, 24(4), pp.521~549 (2019)
  80. Kim, S. H., "Asymmetry of L2 learners’ implicit and explicit knowledge of unpaired English unaccusatives", English Teaching, 71(1), pp.47~71 (2016)
  81. Kim, S. K., "Effects of listeners’ communicative experiences in Thai English on the intelligibility of Thai English", English Teaching, 72(3), pp.69~90 (2017)
  82. Kim, T. Y., "A study of early childhood English teachers’ motivation and demotivation", Foreign Languages Education, 23(2), pp.171~199 (2016)
  83. Kim, T. Y., "Domestic English learning motivation research : Changes and prospects by theory and topic", English Language Teaching, 25(1), pp.121~144 (2013)
  84. Kim, T. Y., "Demotivators and remotivation strategies in L2 learning : A case study of Korean EFL students", Foreign Languages Education, 24(2), pp.45~74 (2017)
  85. Kim, Y., "Secondary school pre-service teachers’ anxiety on English language learning and teaching", Secondary English Education, 10(4), pp.71~96 (2017)
  86. Kim, Y. K., "An investigation on male high school students’ motivation and achievement in English learning", English Teaching, 73(1), pp.135~160 (2018)
  87. Kim, Y. S., "The effect of the flipped class on the affective experience, learning achievement, and class satisfaction of college English language learners", Foreign Languages Education, 22(1), pp.227~254 (2015)
  88. Kim, Y. S., "The development of an instrument to assess an ideal L2 self", Foreign Languages Education, 24(1), pp.233~259 (2017)
  89. Kim, Y. W., "A study of Korean primary school students’ use of English and their willingness to communicate in English", English Language Teaching, 26(3), pp.89~112 (2014)
  90. Kline, P., "An easy guide to factor analysis" (1994), Routledge
  91. Kwon, S. H., "A study on the diagnosis of EFL English teachers’ intercultural communicative competence", Foreign Languages Education, 22(4), pp.155~179 (2015)
  92. Kwon, S. H., "A study on intercultural communicative competence of EFL adult learners", English Language Teaching, 30(4), pp.101~120 (2018)
  93. Lee, D. J., "The effects of input-based and output-based planning on English speaking anxiety", Korean Journal of Applied Linguistics, 31(3), pp.123~148 (2015)
  94. Lee, E. J., "Developing a measurement tool to explore Korean English teachers’ transparency", English Language Teaching, 35(4), pp.39~61 (2023)
  95. Lee, J. H., "EFL young adolescents’ reading motivation and reading comprehension in their first and second language", English Teaching, 70(4), pp.55~80 (2015)
  96. Lee, J. H., "Mismatches between student and teacher perceptions of current and ideal foreign language classroom practices", Korean Journal of Applied Linguistics, 35(3), pp.77~102 (2019)
  97. Lee, J. H., "Analyzing the correlation between attitudes towards classroom language uses and individual learner variables of EFL learners", Korean Journal of Applied Linguistics, 33(2), pp.81~105 (2017)
  98. Lee, J. S., "Importance-performance analysis on Korean secondary English teachers’task-based language teaching", Secondary English Education, 12(3), pp.175~200 (2019)
  99. Lee, J. S., "Novice English teachers’ initial career motives and demotivation in South Korea", English Language and Literature Education, 24(3), pp.1~20 (2018)
  100. Lee, K. M., "The development and validation of a self-directed learning ability scale for elementary English learners", Primary English Education, 25(2), pp.5~25 (2019)
  101. Lee, K. S., "A case of critical pedagogy to promote EFL learners’ critical thinking : Flipped humanities convergence class", STEM Journal, 20(3), pp.115~143 (2019)
  102. Lee, K. S., "A strategy for SNS-based writing practice to leverage less proficient students’ participation and pedagogical performance", STEM Journal, 15(2), pp.115~145 (2014)
  103. Lee, S. D., "An application and development of psychological structural modeling for the improvement of English learning proficiency", English Language Teaching, 27(3), pp.219~239 (2015)
  104. Lee, S. E., "English for specific purposes(ESP) : Needs analysis of secondary school student athletes", Foreign Languages Education, 25(2), pp.165~187 (2018)
  105. Lee, S. M., "Exploratory factor analysis : How has it chagned", Korean Journal of Psychology : General, 35(1), pp.217~255 (2016)
  106. Lee, S. W., "Exploring the evaluating determinants of general English courses using structural equation model", English Language Teaching, 26(3), pp.187~201 (2014)
  107. Lee, S. W., "Suggesting a pre-service English teacher practicum course to improve teacher efficacy", English Language Teaching, 30(3), pp.77~98 (2018)
  108. Lim, J. W., "A study of college English education majors’ perceptions on online class operations in the midst COVID-19 pandemic", English Language and Literature Education, 27(3), pp.109~128 (2021)
  109. Lim, J. Y., "The mediating effect of interaction between mentoring function and English learning motivation", Foreign Languages Education, 28(3), pp.1~27 (2021)
  110. Loewen, S., "Advancing quantitative methods in second language research", pp.182~212 (2015), Routledge
  111. Maeng, U. K., "The use of motivational strategy of Korean primary English teachers", Modern English Education, 15(4), pp.145~168 (2014)
  112. Maeng, U. K., "Secondary teacher motivation : Developing a motivational strategy evaluation questionnaire and the behavior of using motivational strategies", Secondary English Education, 12(2), pp.53~77 (2019)
  113. Mahmoudi, S., "Internal and external variables in EFL learning: An exploratory study", Journal of Literature, Languages, and Linguistics, 20, pp.56~65 (2016)
  114. Matsunaga, M., "How to factor-analyze your data right : Do’s, don’t, and how-to’s", International Journal of Psychological Research, 3(1), pp.97~110 (2010)
  115. Mirabelli, J., "Exploring the exploratory factor analysis : Comparisons and insights from applying five procedures to determining EFA item retention", Paper presented at the 2022 Annual Conference and Exposition of the American Society for Engineering Education (2022)
  116. Mum, C. Y., "Effects of online video support on listening comprehension and EFL learners’ perceptions", STEM Journal, 15(2), pp.147~166 (2014)
  117. Noh, H. J., "Principal component analysis & factor analysis" (2014), HANOL
  118. Oh, J., "Effects of vocabulary learning involvement on vocabulary achievement among Korean university learners of English as a foreign language", Studies in English Education, 20(2), pp.247~270 (2015)
  119. Park, E. S., "Practice and improvement of factor analysis in criminal justice research", Korean Association of Public Safety and Criminal Justice Review, 통권 : 90, pp.85~116 (2022)
  120. Park, Y. R., "Teaching with YouTube video clips in the college classroom : Providing background knowledge to English newspaper articles", STEM Journal, 18(1), pp.207~231 (2017)
  121. Park, Y. Y., "An analysis of the English language teaching anxiety of non-native preservice elementary school teachers in micro-teaching sessions", Primary English Education, 25(3), pp.31~52 (2019)
  122. Pett, M. A., "Making sense of factor analysis: The use of factor analysis for instrument development in health care research" (1999), Sage
  123. Plonsky, L., "Methodological synthesis in L2 quantitative research: A review of reviews and a case study of exploratory factor analysis", Language Learning, 65(S1), pp.9~36 (2015)
  124. Preacher, K. J., "Choosing the optimal number of factors in exploratory factor analysis : A model selection persepctive", Multivariate Behavioral Research, 48, pp.28~56 (2013)
  125. Ryu, H. Y., "A comparative study of motivational orientations between Korean and German college English learners in English as a global language context", Modern English Education, 20(1), pp.42~52 (2019)
  126. Seo, W. J., "Exploratory factor analysis in psychological research : Current status and suggestions for methodological improvements", Journal of Social Science, 29(1), pp.177~193 (2018)
  127. Seong, T. J., "Research methodology" (2023), HAKJISA
  128. Shin, I. Y., "Autonomy of undergraduate students in an asynchronous EFL program in Korea", Modern English Education, 17(4), pp.263~287 (2016)
  129. Shoukat, S. J., "Analyzing COVID-19 impact on the researchers productivity through their perceptions", Computers, Materials & Continua, 67(2), pp.1835~1847 (2021)
  130. Song, H., "Development of a group-based English book reading program for elementary students using school library books based on the social cognitive theory and an examination of factors influencing book reading behavior", Foreign Languages Education, 22(2), pp.23~49 (2015)
  131. Spearman, C., "General intelligence : Objectively determined and measured", The American Journal of Psychology, 15(2), pp.201~292 (1904)
  132. Stevens, J. P., "Applied multivariate statistics for the social sciences" (1992), Erlbaum
  133. Strome, D. M., "Student perceptions toward the use of media for extensive study purposes", English Language Teaching, 32(3), pp.21~45 (2020)
  134. Tabachnick, B. G., "Using multivariate statistics" (2001), Allyn & Bacon
  135. Uehara, S., "English language study and goals : An East Asian perspective", English Language Teaching, 26(1), pp.85~112 (2014)
  136. Watterson, M. C., "Should fluency be coupled with coherence in second language speech assessment? A pilot study using exploratory factor analysis", Korean Journal of Applied Linguistics, 39(4), pp.125~156 (2023)
  137. Won, S. H., "Effects of Korean college students’ learning styles on English phrasal verbs", English Language Teaching, 26(1), pp.193~218 (2014)
  138. Yang, H. Y., "An investigation of elementary EFL teachers’ awareness of teaching professionalism and language assessment literacy", Studies in English Education, 25(3), pp.529~558 (2020)
  139. Yim, S. Y., "Affective factors affecting primary English teacher’s professionalism", Foreign Languages Education, 21(2), pp.153~175 (2014)
  140. Yim, S. Y., "Development of an affective scale to measure primary English teachers’professionalism", English Teaching, 69(2), pp.221~246 (2014)
  141. Yim, S. Y., "Needs analysis of English teachers for competencyenhancing teacher training program", Foreign Languages Education, 24(4), pp.63~86 (2017)
  142. Yim, S. Y., "Development and validation of competency inventory for English teachers", Studies in English Education, 24(1), pp.205~232 (2019)
  143. Yoon, H. M., "A study on the relationship between self-directed English learning abilities and learning strategy use by school level", Foreign Languages Education, 21(3), pp.73~97 (2014)
  144. Yun, J. H., "The effect of extensive reading on Korean EFL learners’reading ability", Modern English Education, 18(2), pp.161~182 (2017)
  145. Zhang, X., "Exploring college students’ expectations, satisfaction, and perceived improvements by gender, major and academic year towards EMI writing course in a Korean university", English Language Teaching, 35(4), pp.85~110 (2023)
  146. Zygmont, C., "Robust factor analysis in the presence of normality violations, missing data, and outliers : Empirical questions and possible solutions", The Quantitative Methods for Psychology, 10(1), pp.40~55 (2014)

관련 논문AI추천

이 간행물의 다른 논문 (7건)