Critical Linguistic Measurements of EFL Oral Proficiency by Korean Adults in Dialogic and Monologic Tasks
1
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
This study investigates the relationship between EFL Korean adult learners’ oral proficiency achievements and linguistic measurements in dialogic and monologic tasks. To determine which linguistic measurements are practically helpful for identifying L2 learners’ oral proficiency, the researcher collected speech data from 57 Korean college students in Korea and examined the linguistic features that teachers find to be relatively easily manageable. Using statistical analyses, the study found significant differences between the two tasks in terms of English oral proficiency, number of clause types, number of errors per 100 words, word type counts, type-token ratios, and number of word tokens per minute. In addition, the two highest correlations with English oral proficiency for the dialogic task were found for word type counts and number of error-free verb phrases (VPs). For the monologic task, they were number of word tokens per minute and number of error-free VPs. Considering the results, the study proposes pairs of linguistic measurements for each type of task that are more appropriate for examining the oral proficiency of English as foreign language learners in classroom settings. The results may also help testing developers for EFL speech determine more balanced weights among critical linguistic measurements.
Abstract
This study investigates the relationship between EFL Korean adult learners’ oral proficiency achievements and linguistic measurements in dialogic and monologic tasks. To determine which linguistic measurements are practically helpful for identifying L2 learners’ oral proficiency, the researcher collected speech data from 57 Korean college students in Korea and examined the linguistic features that teachers find to be relatively easily manageable. Using statistical analyses, the study found significant differences between the two tasks in terms of English oral proficiency, number of clause types, number of errors per 100 words, word type counts, type-token ratios, and number of word tokens per minute. In addition, the two highest correlations with English oral proficiency for the dialogic task were found for word type counts and number of error-free verb phrases (VPs). For the monologic task, they were number of word tokens per minute and number of error-free VPs. Considering the results, the study proposes pairs of linguistic measurements for each type of task that are more appropriate for examining the oral proficiency of English as foreign language learners in classroom settings. The results may also help testing developers for EFL speech determine more balanced weights among critical linguistic measurements.
참고문헌 (49)
- Boulton, A., "Corpus linguistics, computer tools, and applications: State of the art", pp.581~598 (2008), Peter Lang
- Brown, H. D., "Language assessment principles and classroom practices" (2004), Longman
- Brown, A., "An examination of rater orientations and test taker performance on English for academic purposes speaking tasks", Educational Testing Service, ~ (2005)
- Bulantová, B., "Syntactic complexity in the speech of learners of English:Issues in operationalization", master, pp.2020
- Bulté, B., "Dimensions of L2 performance and proficiency: Complexity, accuarcy, and fluency in SLA", pp.21~46 (2012), John Benjamins Publishing Company
- Chapman, M., "An over-reliance on discrete item testing in the Japanese business context", International Conference on English Instruction and Assessment (2006)
- Council of Europe, "Common European framework of reference for languages: Learning, teaching, assessment" (2001), Cambridge University Press
- Crossley, S., "Applications of text analysis tools for spoken response grading", Language Learning and Technology, 17(2), pp.171~192 (2013)
- de Jong, N., "Dimensions of L2 performance and proficiency: Investigating complexity, accuracy and fluency in SLA", pp.121~142 (2012), John Benjamins Publishing Company
- Ellis, R., "Task-based language learning and teaching" (2003), Oxford University Press
- Ferrari, S., "Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA", pp.277~297 (2012), John Benjamins Publishing Company
- Foster, P., "Measuring spoken language : A unit for all reasons", Applied Linguistics, 21, pp.354~375 (2000)[DOI]
- Foster, P., "Capturing accuracy in second language performance : The case for a weighted clause ratio", Annual Review of Applied Linguistics, 36, pp.98~116 (2016)[DOI]
- Fulcher, G., "Testing second language speaking" (2003), Pearson Education Limited
- Granena, G., "Cognitive aptitudes and L2 speaking proficiency : Links between LLAMA and HI-LAB", Studies in Second Language Acquisition, 41(2), pp.313~336 (2019)[DOI]
- Hassanali, K., "Automatic scoring of non-native children's spoken language proficiency", SLaTE 2015-Workshop on Speech and Language Technology in Education, pp.13~18 (2015)
- Housen, A., "Complexity, accuracy, and fluency in second language acquisition", Applied Linguistics, 30(4), pp.461~473 (2009)[DOI]
- Housen, A., "Dimensions of L2 performance and proficiency: Complexity, accuracy, and fluency in SLA", pp.1~20 (2012), John Benjamins Publishing Company
- Huensch, A., "Understanding second language fluency behavior : The effects of individual differences in first language fluency, cross-linguistic differences, and proficiency over time", Applied Psycholinguistics, 38(4), pp.755~785 (2017)[DOI]
- Shin’ichiro Ishikawa, "The ICNALE Spoken Dialogue: A New Dataset for the Study of Asian Learners’ Performance in L2 English Interviews", 영어교육, 74(4), pp.153~177 (2019), 한국영어교육학회
- Iwashita, N., "Assessed levels of second language speaking proficiency: How distinct?", Applied Linguistics, 29(1), pp.24~49 (2008)[DOI]
- Kellogg, D., "Assessing oral language proficiency: Cognitive traits vs. performance-based categories", English Teaching, 56(3), pp.45~68 (2001)
- 김정옥, "온라인상 대학생 영어 말하기 수업 설계", 영어교과교육, 20(3), pp.119~138 (2021), 한국영어교과교육학회[DOI]
- 김소정, "EFL 학습자의 영어 발화에 나타난담화표지어의 사용 양상과 인식", 영어교과교육, 20(2), pp.49~74 (2021), 한국영어교과교육학회[DOI]
- Kim, Y., "Implementation of a localized task-based course in an EFL context : A study of students’ evolving perceptions", TESOL Quarterly, 51(3), pp.632~660 (2017)[DOI]
- Lee, W. -K., "Assessing Korean university students’ spoken English proficiency", English Testing, 50(1), pp.37~63 (1995)
- Lin, J., "A structural relationship model for L2 oral proficiency, L2interest, perceived importance of speaking, and out-of-class L2 contact", Language Teaching Research (2022)[DOI]
- Luoma, S., "Assessing speaking" (2004), Cambridge University Press
- McCarthy, M., "Spoken fluency revisited", English Profile Journal, 1, pp.1~15 (2010)
- Michel, M. C., "Second language task complexity:Researching the cognition hypothesis of language learning and performance", pp.141~173 (2011), John Benjamins Publishing Company
- Michel, M. C., "The influence of complexity in monologic versus dialogic tasks in Dutch L2", International Review of Applied Linguistics in Language Teaching, 45(3), pp.241~259 (2007)[DOI]
- Mostafa, T., "The relationships between second language speakers’ oral productions, oral proficiency, and their individual differences: A longitudinal study", doctor, pp.2021
- Ogawa, C., "CAF indices and human ratings of oral performances in an opinion-based monologue task", Language Testing in Asia, 12(4), pp.2~18 (2022)[DOI]
- Pallotti, G., "CAF : Defining, refining and differentiating constructs", Applied Linguistics, 30(4), pp.590~601 (2009)[DOI]
- Park, T. -J., "A comparative analysis of the validity of English speaking performance test tasks", doctor, pp.2012
- 박유정, "Task-in-process During Information-gap Activities in Korean Middle School English Classrooms", 영어교육, 73(2), pp.59~86 (2018), 한국영어교육학회[DOI]
- Révész A., "The effects of complexity, accuracy, and fluency on communicative adequacy in oral task performance", Applied Linguistics, 37(6), pp.828~848 (2016)[DOI]
- Rimmer, W., "Measuring grammatical complexity : The Gordian knot", Language Testing, 23(4), pp.497~519 (2006)[DOI]
- Roca-Varela, M. L., "How are spoken skills assessed in proficiency tests of general English as a foreign language? A preliminary survey", International Journal of English Studies, 13(2), pp.53~68 (2013)[DOI]
- Segalowitz, N., "Cognitive bases of second language fluency" (2010), Routledge
- Skehan, P., "Individual differences in second language learning" (1989), Edward Arnold
- Skehan, P., "Researching pedagogic tasks: Second language learning, teaching, and testing", pp.167~185 (2001), Pearson Education
- Tavakoli, P., "Fluency in monologic and dialogic task performance : Challenges in defining and measuring L2 fluency", International Review of Applied Linguistics in Language Teaching, 54(2), pp.133~150 (2016)[DOI]
- Tavakoli, P., "Planning and task performance in a second language", pp.239~276 (2005), John Benjamins Publishing Company
- Tonkyn, A., "Dimensions of L2 performance and proficiency: Complexity, accuracy, and fluency in SLA", pp.221~245 (2012), John Benjamins Publishing Company
- Ulker, V., "The design and use of speaking assessment rubrics", Journal of Education and Practice, 8(32), pp.135~141 (2017)
- Vercellotti, M. L., "The development of complexity, accuracy, and fluency in second language performance : A longitudinal study", Applied Linguistics, 38(1), pp.90~111 (2017)[DOI]
- Vercellotti, M. L., "Finding variation : assessing the development of syntactic complexity in ESL speech", International Journal of Applied Linguistics, 29(2), pp.233~247 (2019)[DOI]
- 원용국, "The Effect of Task Complexity on Test-takers’ Performance in a Performance-based L2 Oral Communication Test for International Teaching Assistants", 영어교과교육, 19(1), pp.27~52 (2020), 한국영어교과교육학회[DOI]
