CAF기반 토익스피킹 대안모델 구현을 위한 기초연구
Exploratory research on developing an alternative TOEIC speaking model based on ‘Complexity’, ‘Accuracy’ and ‘Fluency’
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
The purpose of this study is to explore the concurrent validity between TOEIC SPEAKING and English speaking ability based on language ‘Complexity’, ‘Accuracy’ and ‘Fluency’, and to analyze the difference of CAF between upper and lower English speaking groups. In total 29 university students participated in the study and carried out the speaking test. The results of Pearson analysis revealed a high correlation (.796) between the TOEIC speaking scores and CAF. Specifically, ‘Complexity’ and ‘Fluency’ showed a high correlation and ‘Accuracy’ showed a moderate correlation with TOEIC speaking scores. There were also statistical differences between the upper and lower groups in correlation with CAF. ‘Complexity’ was the highest correlation in upper group whereas ‘Accuracy’ was the highest correlation in the lower group. To assess causal relationship of CAF on TOEIC speaking score, the study performed regression analysis between TOIEC speaking score and CAF. The results showed the English speaking ability based on CAF had 63.1% effect size on TOEIC speaking score. This suggests TOEIC speaking test can be replaced by CAF. Individual CAF regression analysis revealed Fluency’ had the strongest causal relationship (62.5%) followed by ‘Complexity’ (54.6%), and the ‘Accuracy’ had the least (10.4%). There was a statistical difference between upper and lower speaking ability groups: upper group had 34.3% whereas lower group had 16%, which means higher English speaking group can get the higher TOEIC speaking score.
Abstract
The purpose of this study is to explore the concurrent validity between TOEIC SPEAKING and English speaking ability based on language ‘Complexity’, ‘Accuracy’ and ‘Fluency’, and to analyze the difference of CAF between upper and lower English speaking groups. In total 29 university students participated in the study and carried out the speaking test. The results of Pearson analysis revealed a high correlation (.796) between the TOEIC speaking scores and CAF. Specifically, ‘Complexity’ and ‘Fluency’ showed a high correlation and ‘Accuracy’ showed a moderate correlation with TOEIC speaking scores. There were also statistical differences between the upper and lower groups in correlation with CAF. ‘Complexity’ was the highest correlation in upper group whereas ‘Accuracy’ was the highest correlation in the lower group. To assess causal relationship of CAF on TOEIC speaking score, the study performed regression analysis between TOIEC speaking score and CAF. The results showed the English speaking ability based on CAF had 63.1% effect size on TOEIC speaking score. This suggests TOEIC speaking test can be replaced by CAF. Individual CAF regression analysis revealed Fluency’ had the strongest causal relationship (62.5%) followed by ‘Complexity’ (54.6%), and the ‘Accuracy’ had the least (10.4%). There was a statistical difference between upper and lower speaking ability groups: upper group had 34.3% whereas lower group had 16%, which means higher English speaking group can get the higher TOEIC speaking score.
참고문헌 (48)
- Ahmadian, M. J., "The effects of simultaneous use of careful online planning and task repetition on accuracy, complexity, and fluency in EFL learners’ oral production", Language Teaching Research, 15(1), pp.35~59 (2011)
- Albert, A., "Creativity and narrative task performance : An exploratory study", Language Learning, 54(2), pp.277~310 (2004)
- Barkaoui, K., "Test-takers’ strategic behaviors in independent and integrated speaking tasks", Applied Linguistics, 34(3), pp.304~324 (2013)
- Bosker, H. R., "The perception of fluency in native and nonnative speech", Language Learning, 64(3), pp.579~614 (2014)
- Bulte, B., "Defining and operationalizing L2 complexity" (2012), John Benjamins Publishing Company
- Crookes, G., "Planning and interlanguage variation", Studies in Second Language Acquisition, 11(4), pp.367~383 (1989)
- De Jong, H., "What makes speech sound fluent? The contributions of pauses, speed and repairs", Language Testing, 30(2), pp.159~175 (2012)
- De Jong, N. H., "Linguistic skills and speaking fluency in a second language", Applied Psycholinguistics, 34(5), pp.893~916 (2013)
- Derwing, T. M., "Accent, intelligibility, and comprehensibility", Studies in Second Language Acquisition, 19(1), pp.1~16 (1997)
- Derwing, T. M., "The effects of pronunciation instruction on the accuracy, fluency, and complexity of L2 accented speech", Applied Language Learning, 13(1), pp.1~17 (2003)
- Ellis, R., "Analyzing learner language" (2005), Oxford University Press
- Evans, N. W., "Contextualizing corrective feedback in second language writing pedagogy", Language Teaching Research, 14(4), pp.445~463 (2010)
- Fazio, L. L., "The effect of corrections and commentaries on the journal writing accuracy of minority-and majority-language students", Journal of Second Language Writing, 10(4), pp.235~249 (2001)
- Fillmore, C. J., "On fluency: Individual differences in language ability and language behavior" (1979), Academic Press, Inc
- Foster, P., "Measuring spoken language : A unit for all reasons", Applied Linguistics, 21(3), pp.354~375 (2000)
- Housen, A., "Complexity, accuracy and fluency in second language acquisition", Applied Linguistics, 30(4), pp.461~473 (2009)
- Housen, A., "Complexity, accuracy and fluency" (2012), John Benjamins Publishing Company
- Iwashita, N., "Assessed levels of second language speaking proficiency : How distinct", Applied Linguistics, 29(1), pp.24~49 (2008)
- Kahng, J., "Exploring utterance and cognitive fluency of L1 and L2 English speakers : Temporal measures and stimulated recall", Language Learning, 64(4), pp.809~854 (2014)
- Kim, Y., "Impacts of task complexity on the development of L2 oral performance over time", International Review of Applied Linguistics in Language Teaching, 55(2), pp.197~220 (2017)
- Kormos, J., "Exploring measures and perceptions of fluency in the speech of second language learners", System, 32(2), pp.145~164 (2004)
- Kuiken, F., "Cognitive task complexity and written output in Italian and French as a foreign language", Journal of Second Language Writing, 17(1), pp.48~60 (2008)
- Larsen-Freeman, D., "The emergence of complexity, fluency, and accuracy in the oral and written production of five Chinese learners of English", Applied Linguistics, 27(4), pp.590~619 (2006)
- Lennon, P., "Investigating fluency in EFL : A quantitative approach", Language Learning, 40(3), pp.387~417 (1990)
- Lennon, P., "Perspectives on fluency", pp.25~42 (2000), The University of Michigan Press
- Levkina, M., "The effects of cognitive task complexity on L2 oral production" (2012), John Benjamins Publishing Company
- Michel M. C., "The influence of complexity in monologic versus dialogic tasks in Dutch L2", International Review of Applied Linguistics in Language Teaching, 45(3), pp.241~259 (2007)
- Nagy, P., "The 2010 revision of the TOEIC speaking test", Shiken : JALT Testing &Evaluation SIG Newsletter, 15(2), pp.10~19 (2011)
- Norris, J., "Towards an organic approach to investigating CAF in instructed SLA : The case of complexity", Applied Linguistics, 30(4), pp.555~578 (2009)
- Pallotti, G., "CAF : Defining, refining and differentiating constructs", Applied Linguistics, 30(4), pp.590~601 (2009)
- Pekka, L., "Measuring syntactic complexity in spoken and written learner language : Comparing the incomparable", Research in Language, 12(4), pp.377~399 (2014)
- Polio, C., "An investigation into current measures of linguistic accuracy in second language writing research", Journal of Second Language Writing, 26, pp.10~27 (2014)
- The TOEIC speaking and writing tests: Relations to test-taker perceptions of proficiency in English, "Powers, D.", ETS, ~ (2009)
- Révés, A., "The effects of complexity, accuracy, and fluency on communicative adequacy in oral task performance", Applied Linguistics, 37(6), pp.828~848 (2014)
- Robinson, P., "Investigating second language task complexity", RELC Journal, 26(2), pp.62~79 (1995)
- Robinson, P., "Task complexity, task difficulty, and task production : Exploring interactions in componential framework", Applied Linguistics, 22(1), pp.27~51 (2001)
- Robinson, P., "Cognitive complexity and task sequencing : Studies in a componential framework for second language task design", IRAL-International Review of Applied Linguistics in Language Teaching, 43(1), pp.1~32 (2005)
- Segalowitz, N., "Cognitive base of second language fluency" (2000), Routledge
- Skehan, P., "A cognitive approach to language learning" (1998), Oxford University Press
- Skehan, P., "Task-based instruction", Language Teaching, 36(1), pp.1~14 (2003)
- Skehan, P., "Complexity, accuracy, and fluency in second language use, learning & teaching", pp.207~226 (2007), University of Brussels Press
- Suzuki, S., "Linguistic dimensions of comprehensibility and perceived fluency: An investigation of complexity, accuracy, and fluency in second language argumentative speech" (2019), Cambridge University Press
- Suzuki, Y., "Does the reuse of constructions promote fluency development in task repetition? A usage-based perspective", TESOL Quarterly, 56(4), pp.1290~1319 (2022)
- Suzuki, S., "How does creativity affect second language speech production? The moderating role of speaking task type", TESOL Quarterly, 56(4), pp.1320~1344 (2022)
- Tavakoli, P., "Planning and task performance in a second language", pp.239~277 (2005), John Benjamins Publishing Company
- Tavakoli, P., "Pausing patterns : Differences between L2 learners and native speaker", ELT Journal, 65(1), pp.71~79 (2011)
- Wolfe-Quintero, K., "Second language development in writing: Measures of fluency, accuracy, and complexity" (1998), University of Hawaii’ Press
- Yuan, F., "The effects of pre-task planning and on-line planning on fluency, complexity and accuracy in L2 monologic oral production", Applied Linguistics, 24(1), pp.1~27 (2003)