본문 바로가기
KERD
논문KCI 등재

Examining the Internal Structure of a TOEIC Practice Test: Bifactor and Two-tier Model Approaches

최세일
한국언어과학회 (The Korean Association Of Language Sciences)|2012.05|언어과학 (Journal of Language Sciences)|제19권 제2호|pp. 141-165|DOI http://dx.doi.org/

1

조회

0

다운로드

2

인용

0

참고문헌

키워드

요인분석bifactor modelfactor structure토익TOEICdimensionality차원성two-tier modelscore reporting안전정보요인분석이요인분석 모형2단 분석 모형점수 보고
주제분류언어학

초록

This study investigated the factor structure of the listening and reading sections of a TOEIC practice test using a bifactor model and a two-tier model that are based on a full-information item factor analysis. The data was drawn from 3158 college students’ responses to a TOEIC practice test. The results showed that the listening factor is essentially unidimensional whereas the reading factor is bidimensional: one primary factor for reading comprehension and a minor factor for vocabulary and grammar. The analyses also suggested that the listening and reading factors are highly correlated but distinctive skills. Subsequently these factor structures were compared and contrasted to the results from previous validation studies of the TOEIC test in the literature, Finally pedagogical implications were discussed

Abstract

This study investigated the factor structure of the listening and reading sections of a TOEIC practice test using a bifactor model and a two-tier model that are based on a full-information item factor analysis. The data was drawn from 3158 college students’ responses to a TOEIC practice test. The results showed that the listening factor is essentially unidimensional whereas the reading factor is bidimensional: one primary factor for reading comprehension and a minor factor for vocabulary and grammar. The analyses also suggested that the listening and reading factors are highly correlated but distinctive skills. Subsequently these factor structures were compared and contrasted to the results from previous validation studies of the TOEIC test in the literature, Finally pedagogical implications were discussed

참고문헌 (47)

  1. Bae, J., "A Latent Variable Approach to Listening and Reading: Testing Factorial Invariance Across Two Groups of Children in the Korean", English Two-Way Immersion Program, 1998, pp.6, 14~29
  2. Bandalos, D. L., "Item Parceling Issues in Structural Equation Modeling, In New Developments and Techniques in Structural Equation Modeling Mahwah", pp.269~296 (2001), Lawrence Erlbaum Associates, Inc
  3. Bandalos, D. S., "The Effects of Item Parceleing on Goodness-of-fit and Parameter Estimate Bias in Structural Equation Modeling", Structural Equation Modeling, 9(1), pp.78~102 (2002)
  4. Bartholomew, D. J., "Factor Analysis for Categorical Data", Journal of the Royal Statistical Society, 42, pp.293~321 (1980)
  5. Betts, J., "Investigating Early Literacy and Nnumeracy: Exploring the Utility of the Bifactor Model", School Psychology Quarterly, 26(2), pp.97~107 (2011)
  6. Bock, R. D., "Marginal Maximum Likelihood Estimation of Item Parameters: Application of an EM Algorithm", Psychometrika, 46, pp.443~459 (1981)
  7. Bock, R. D., "Full-Information Item Factor Analysis", Applied Psychological Measurement, 12, pp.261~280 (1988)
  8. TOEIC Test as a Function of Training Time and Type, "Boldt R. R", ~, pp.TOEIC Research Report No. 3 (1998)
  9. Brown, T. A., "Confirmatory Factor Analysis for Applied Research" (2006), Guilford Press
  10. Buck,G, "The Testing of Second Language Listening Comprehension", 박사, pp.1990
  11. Buck, G., "Listening Comprehension: Construct Validity and Trait Characteristics", Language Learning, 42, pp.313~357 (1992)
  12. Cai, L., "A Two-Tier Full-Information Item Factor Analysis Model with Applications", Psychometrika, 75(4), pp.581~612 (2010)
  13. Cai, L., (2010), SSI International
  14. Cattel, R. B., "The Radial Parceling Double Factoring Design: a Solution to Item-vs.-parcel Controversy", Multivariate Behavioral Research, 10, pp.165~179 (1975)
  15. "An Over-Reliance on Discrete Item Testing in the Japanese" (2012)[URL]
  16. Chapman, M., "TOEIC: Tried but Undertested", Shiken: JALT Testing and Evaluation SIG Newletter, 7, pp.2~7 (2003)
  17. de Bot, K., "Toward a Lexical Processing Model for the Study of Second Language Vocabulary Acquisition: Evidence form ESL Reading", Studies in Second Language Acquisition, 19, pp.309~329 (1997)
  18. DeMars, C. E., "Application of the Bi-factor Multidimensional Item Response Theory Model to Testlet-based Tests", Journal of Educational Measurement, 43, pp.145~168 (2006)
  19. "TOEIC Examinee Handbook – Listening and Reading" (2009)[URL]
  20. Freedenthal, S., "Evaluation of the Psychometric Properties of the Interpersonal Needs Questionnaire-12 in Samples of Men and Women", Journal of Clinical Psychology, 67(6), pp.609~623 (2011)
  21. Gilbert, S., "A Review of TOEIC", The Internet TESL Journal, 8, pp.1~8 (2010)
  22. Gibbosn, R. D., "Full-Information Item Bifactor Analysis for Graded Response Data", Applied Psychological Measurement, 31, pp.4~19 (2007)
  23. Gibbons, R. D., "Full-Information Item Bi-Factor Analysis.", Psychometrika, 57, pp.423~436 (1992)
  24. Gorsuch, R. L., "Factor Analysis (2nd ed.)" (1983), Erlbaum
  25. Hambleton, R. K., "Assessing the Dimensionality of a Set of Test Items", Applied Psychological Measurement, 10, pp.287~302 (1986)
  26. Hirai, A., "The Relationship between Listening and Reading Rates of Japanese EFL Learners", Modern Language Journal, 83, pp.367~384 (1999)
  27. Immekus, J. C., "Dimensionality Assessment Using the Full-Information Item Bifactor Analysis for Graded Response Data: An Illustration with the State Metacognitive Inventory", Educational and Psychological Measurement, 68(4), pp.695~709 (2008)
  28. In’nami, Y., "Factor Structure of the Revised TOEIC Test: A Multiple-Sample Analysis", Language Testing, 29(1), pp.131~152 (2011)
  29. Kishton, J. M., "Unidimensional Versus Domain Representative Parceling of Questionnaire Items: An Empirical Example.", Educational and Psychological Measurement, 54, pp.757~765 (1994)
  30. McCrosite, J., "The TOEIC in Japan: A Scandal made in Heaven", Shiken: JALT Testing and Evaluation SIG Newslettter, 14(1), pp.2~10 (2010)
  31. McLeod, L. D., "Factor Analysis for Items Scored in Two Categories, In Test Scoring", pp.189~216 (2001), Erlbaum
  32. The Redesigned TOEIC Test: Relation to Test-Taker Perceptions of Proficiency in English, "Powers, D. E.", Educational Testing Service, ~, pp.ETS Research Report No. ETS RR-08-56 (2008)
  33. Rechase, M. D., "Unifactor Latent Trait Models Applied to Multifactor Tests: Results and Implications", Journal of Educational Statistics, 4, pp.207~230 (1979)
  34. Reckase, M. D., "Multidimensional Item Response Theory" (2009), Springer
  35. Reise, S. P., "The Role of the Bifactor Model in Resolving Dimensionality Issues in Health Outcomes Measures", Quality of Life Research, 16, pp.19~31 (2007)
  36. Reise, S. P., "Bifactor Models and Rotations: Exploring the Extent to which Multidimensional Data Yield Univocal Scale Scores", Journal of Personality Assessment, 92(6), pp.544~559 (2011)
  37. Reves, T., "The FL Receptive Skills: Same or Different?", System, 16, pp.326~336 (1988)
  38. Sawaki, Y., "Factor Structure of the TOEFL Internet-Based Test", Language Testing, 26, pp.5~30 (2009)
  39. Song, M.-Y., "Do Visible Subskills Exist in Second Language(L2) Comprehension? A Structural Equating Modeling Approach", Language Testing, 25, pp.435~464 (2008)
  40. Factor Structure of the TOEFL Internet-based Test Across Subgroups, "Stricker, L. J.", Educational Testing Service, ~, pp.TOEFL iBT Research Report No. RR-08-66 (2008)
  41. Factor Structure of the LanguEdge Test Across Language Groups, "Stricker, L. J.", Educational Testing Service, ~, pp.TOEFL Monograph Series No. RR-05-12 (2005)
  42. Suzuki, M., "A Review of the Readings Section of the TOEIL", TESL Canadian Journal, 22(1), pp.16~24 (2004)
  43. An Exploratory Dimensionality Assessement of the TOEIC Test, "Wilson. K. M.", Educational Testing Service., ~, pp.ETS RR-00-14 (2000)
  44. Overestimation of LPI Ratings for Native-Korean Speakers in the TOEIC Testing Context: Search for Explanation, "Wilson, K. M.", Educational Testing Service., ~, pp.TOEIC Research Report No. RR-01-15 (2001)
  45. "Wood, R.", Scientific Software International, Inc., ~ (2003)
  46. An Introduction to TOEIC: The Initial Validity Study, "Woodford, P. E.", Educational Testing Service., ~, pp.TOEIC Research Summary No.0 (1982)
  47. Zhang, S., "Investigting the Relative Effects of Person, Items, Sections, and Languages on TOEIC Score Dependability", Language Testing, 23, pp.351~369 (2006)

관련 논문AI추천

The Validity of Subscores for a Reading Comprehension Test: A Bifactor Approach최세일21세기영어영문학회 · 영어영문학212012 · 제25권 제1호Correlations and Predictability between the Subsections of the TOEIC Listening and Reading Test박태자, 서명아외국학연구소 · 외국학연구2016 · 제36호The Comparison of Effects in 3PL Model and 3PL Testlet Model on the TOEIC김재철, 라종민교육연구소 · 교육문화연구2013 · 제19권 제3호Examining Measurement Characteristics of an English Listening Comprehension Test김영수, 최세일21세기영어영문학회 · 영어영문학212014 · 제27권 제4호The Effects of Test Method on L2 Reading and Listening Performance박시원범태평양 응용언어학회 · Journal of Pan-Pacific Association of Applied Linguistics2017 · 제21권 제1호Investigating Underlying Factors in Measuring Lexical- Grammatical Knowledge for English Tests서명아팬코리아영어교육학회 · 영어교육연구2012 · 제24권 제4호

이 간행물의 다른 논문 (10건)

영어 자음군 단순화: 어휘음운론과 최적성이론의 비교강민순pp. 1-23영국식 영어 발음에 대한 대학생의 인식 및 청취교육 효과김수정, 주미진pp. 25-40중세 프랑스어의 자질계승과 동사이동에 따른 어순변화김신호pp. 41-59스페인어 접어 SE에 관한 연구 : 비인칭, 수동 구문을 중심으로서소영pp. 61-77영어 쓰기 학습에 있어 교사 피드백에 관한 인식과 학습동기의 연관성에 관한 연구이상교, 전지현pp. 79-95
원문 보기