본문 바로가기
KERD
논문KCI 등재

CAF와 영어 말하기 능력 간의 관련성 연구: CAF 측정 항목 분석 및 모형구축을 중심으로

A Study on the Relationship Between CAF and English Speaking Proficiency: Focused on Analysis of CAF Measurement Components and Model Construction

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

주제분류언어학

초록

The purpose of this study is to explore an alternative model for the TOEIC speaking test based on language ‘Complexity’, ‘Accuracy’ and ‘Fluency’ (CAF) by drawing comparisons between task-based CAF (Model 1) and communicative adequacy-based CAF (Model 2). Thirty-two college students participated in the study and carried out CAF based English speaking tests. The results of Pearson analysis revealed that Model 2 has a higher correlation with the TOEIC speaking scores than Model 1. Based on factor analysis, Model 2 was restructured, to create a new format, NCAF (New CAF). Under the NCAF model, ‘Complexity’ has three sub-items: sentence length, sentence elaboration, and lexical density; ‘Accuracy’ has error accuracy 1, and error accuracy 2; and ‘Fluency’ includes pause distribution, speed fluency, and pause frequency. To assess the relationship between the NCAF model and TOEIC speaking scores, a regression analysis was performed. The results showed that NCAF could account for 76.1% of the TOEIC speaking scores. Pedagogical implications and discussions are suggested.

Abstract

The purpose of this study is to explore an alternative model for the TOEIC speaking test based on language ‘Complexity’, ‘Accuracy’ and ‘Fluency’ (CAF) by drawing comparisons between task-based CAF (Model 1) and communicative adequacy-based CAF (Model 2). Thirty-two college students participated in the study and carried out CAF based English speaking tests. The results of Pearson analysis revealed that Model 2 has a higher correlation with the TOEIC speaking scores than Model 1. Based on factor analysis, Model 2 was restructured, to create a new format, NCAF (New CAF). Under the NCAF model, ‘Complexity’ has three sub-items: sentence length, sentence elaboration, and lexical density; ‘Accuracy’ has error accuracy 1, and error accuracy 2; and ‘Fluency’ includes pause distribution, speed fluency, and pause frequency. To assess the relationship between the NCAF model and TOEIC speaking scores, a regression analysis was performed. The results showed that NCAF could account for 76.1% of the TOEIC speaking scores. Pedagogical implications and discussions are suggested.

참고문헌 (54)

  1. 신순란, "CAF 기반 토익스피킹 대안 모형 구현을 위한 기초연구", 영어교육연구, 36(2), pp.91~111 (2024)
  2. Ahmadian, M. J., "The Effects of Simultaneous Use of Careful Online Planning and Task Repetition on Accuracy, Complexity, and Fluency in EFL Learners’ Oral Production", Language Teaching Research, 15(1), pp.35~59 (2011)[DOI]
  3. Albert, A., "Creativity and Narrative Task Performance : An Exploratory Study", Language Learning, 54(2), pp.277~310 (2004)
  4. Bartz, A. E, "Basic Statistical Concepts" (1999), Prentice Hall
  5. Bosker, H. R., "What Makes Speech Sound Fluent? The Contributions of Pauses, Speed and Repairs", Language Testing, 30(2), pp.159~175 (2013)
  6. Bulte, B., "Defining and Operationalising L2 Complexity" (2012), John Benjamins Publishing
  7. "The Compleat Lexical Tutor" (2011)[URL]
  8. Crossley, S. A., "Analyzing Discourse Processing Using a Simle Natural Language Processing Tool", Discourse Processes, 51(5-6), pp.511~534 (2014)
  9. De Jong, N. H, "Fluency in Second Language Assessment" (2016), Berlin Publishing
  10. De Jong, N. H., "Linguistic Skills and Speaking Fluency in a Second Language", Applied Psycholinguistics, 34, pp.893~916 (2013)
  11. Derwing, T., "The Effects of Pronunciation Instruction on the Accuracy, Fluency, and Complexity of L2 Accented Speech", Applied Language Learning, 13(1), pp.1~17 (2003)
  12. Derwing, T. M., "Second Language Fluency : Judgments on Different Tasks", Language Learning, 54(4), pp.655~679 (2004)[DOI]
  13. Ellis, R, "The Differential Effects of Three Types of Task Planning on the Fluency, Complexity, and Accuracy in L2 Oral Production", Applied Linguistics, 30(4), pp.474~509 (2009)[DOI]
  14. Ellis, R., "Analyzing Learner Language" (2005), Oxford University Press
  15. Ellis, R., "The Effects of Planning on Fluency, Complexity, and Accuracy in Second Language Narrative Writing", Studies in Second Language Acquisition, 26(1), pp.59~84 (2004)[DOI]
  16. Evans, N. W., "Contextualizing Corrective Feedback in Second Language Writing Pedagogy", Language Teaching Research, 14, pp.445~464 (2010)
  17. Evans, N. W., "Measuring Written Linguistic Accuracy with Weighted Clause Ratios : A Question of Validity", Journal of Second Language Writing, 24, pp.33~50 (2014)
  18. Fazio, L. L, "The Effect of Corrections and Commentaries on the Journal Writing Accuracy of Minority-and Majority-language Students", Journal of Second Language Writing, 10, pp.235~249 (2001)
  19. Ferrari, S, "Dimensions of L2 Performance and Proficiency", pp.277~297 (2012), John Benjamins Publishing
  20. Foster, P., "The Influence of Planning and Task Type on Second Language Performance", Studies in Second Language Acquisition, 18(3), pp.299~323 (1996)
  21. Foster, P., "Measuring Spoken Language : A Unit for all Reasons", Applied Linguistics, 21(3), pp.354~375 (2000)
  22. Housen, A., "Complexity, Accuracy and Fluency in Second Language A quisition", Applied Linguistics, 30(4), pp.461~473 (2009)
  23. Grammatical Structures Written at three Grade Levels. NCTE research report 3, "Hunt, K. W", National Council of Teachers of English, ~ (1965)
  24. Iwashita, N., "Assessed Levels of Second Language Speaking Proficiency : How Distinct?", Applied Linguistics, 29(1), pp.24~49 (2008)
  25. Kahng, J, "Exploring Utterance and Cognitive Fluency of L1 and L2 English Speakers : Temporal Measures and Stimulated Recall", Language Learning, 64(4), pp.809~854 (2014)[DOI]
  26. Kahng, J, "The Effect of Pause Location on Perceived Fluency", Applied Psycholinguistics, 39(3), pp.569~591 (2018)
  27. Kormos, J., "Exploring Measures and Perceptions of Fluency in the Speech of Second Language Learners", System, 32(2), pp.145~164 (2004)
  28. Kormos, J, "Task Complexity and Linguistic and Discourse Features of Narrative Performance", Journal of Second Language Writing, 20(2), pp.148~161 (2011)
  29. Kuiken, F., "Cognitive Task Complexity and Written Output in Italian and French as a Foreign Languge", Journal of Second Language Writing, 17(1), pp.48~60 (2008)
  30. Larsen-Freeman, D, "The Emergence of Complexity, Fluency, and Accuracy in the Oral and Written Production of Five Chinese Learners of English", Applied Linguistics, 27(4), pp.590~619 (2006)[DOI]
  31. Larsen-Freeman, D, "Adjusting Expectations : The Study of Complexity, Accuracy and Fluency in Second Language Acquisition", Applied Linguistics, 30(4), pp.579~589 (2009)
  32. Lennon, P, "Investigating Fluency in EFL : A Quantitative Approach", Language Learning, 40(3), pp.387~417 (1990)
  33. Lennon, P, "Perspectives on Fluency", pp.25~42 (2000), The University of Michigan Press
  34. Levkina, M., "The Effects of Cognitive Task Complexity on L2 Oral Production" (2012), John Benjamins Publishing
  35. McNamara, D. S., "Evaluation of Text and Discourse with Coh-Metrix" (2014), Cambridge University Press
  36. Michel, M. C., "The Influence of Complexity in Monologic versus Dialogic Tasks in Dutch L2", International review of Applied Linguistics in Language Teaching, 45(3), pp.241~259 (2007)
  37. Norris, J., "Towards an Organic Approach to Investigating CAF in Instructed SLA : The Case of Complexity", Applied Linguistics, 30(4), pp.555~578 (2009)
  38. Pallotti, G, "CAF : Defining, Refining and Differentiating Constructs", Applied Linguistics, 30(4), pp.590~601 (2009)
  39. Pekka, L, "Measuring Syntactic Complexity in Spoken and Written Learner Language: Comparing the Incomparable?", Research in Language, 12(4), pp.377~399 (2014)
  40. Révész, A., "The Effects of Complexity, Accuracy, and Fluency on Communicative Adequacy in Oral Task Performance", Applied Linguistics, 37(6), pp.828~848 (2014)[DOI]
  41. Robinson, P, "Task Complexity, Task Difficulty, and Task Production : Exploring Interactions in Componential Framework", Applied Linguistics, 22(1), pp.27~51 (2001)
  42. Robinson, P, "Cognitive Complexity and Task Sequencing : Studies in a Component Framework for Second Language Task Design", IRAL-International Review of Applied Linguistics in Language Teaching, 43(1), pp.1~2 (2005)
  43. Robinson, P., "Time and Motion : Measuring the Effects of the Conceptual Demands of Tasks on Second Language Speech Production", Applied Linguistics, 30(4), pp.533~554 (2009)
  44. Segalowitz, N, "Cognitive Base of Second Language Fluency" (2000), Routledge
  45. Skehan, P, "A Framework for the Implementation of Task-based Instruction", Applied Linguistics, 17(1), pp.38~62 (1996)
  46. Skehan, P, "A Cognitive Approach to Language Learning" (1998), Oxford University Press
  47. Skehan, P., "Planning and Task Performance in a Second Language", pp.193~216 (2005), John Benjamins
  48. Skehan, P, "Modelling Second Language Performance Integrating Complexity, Accuracy, Fluency, and Lexis", Applied Linguistics, 30(4), pp.510~532 (2009)
  49. Suzuki, S., "Linguistic Dimensions of Comprehensibility and Perceived Fluency : An Investigation of Complexity, Accuracy, and Fluency in Second Language Augmentative Speech" (2019), Cambridge University Press
  50. Tavakoli, P., "Planning and Task Performance in a Second Language", pp.239~273 (2005), John Benjamins
  51. Tonkyn, A, "Dimensions of L2 Performance and Proficiency", pp.222~245 (2012), John Benjamins Publishing
  52. Towell, R, "Dimensions of L2 Performance and Proficiency", pp.47~69 (2012), John Benjamins Publishing
  53. Wolfe-Quintero, K., "Second Language Development in Writing : Measures of Fluency, Accuracy, and Complexity" (1998), University of Hawai’ Press
  54. Yuan, F., "The Effects of Pre-task Lanning and On-line Planning on Fluency, Complexity and Accuracy in L2 Monologic Oral Production", Applied Linguistics, 24(1), pp.51~27 (2003)

관련 논문AI추천

이 간행물의 다른 논문 (7건)