English Oral Proficiency Measured by Holistic and Analytic Assessments in Dialogic and Monologic Tasks
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This study compared Korean adult learners’ English speech in dialogic and monologic tasks, measuring 57 college students’ oral proficiency in terms of holistic and analytic grades. The statistical analyses were focused on two questions: 1) how much do the holistic grades of oral proficiency and analytic grades of the four linguistic features function differently across the tasks? and 2) which linguistic feature has the strongest correlation with the holistic grades of English oral proficiency? The study found significant differences between the two tasks in five aspects (English oral proficiency, topic development, fluency, range, and accuracy). It also showed that a monologic task resulted in lower achievements in those five aspects. In the comparison of the correlations with English proficiency, the range reached the top in both tasks, followed by topic development. The study provides some helpful information regarding which types of speech tasks and linguistic features of EFL oral proficiency are more desirable for targeting in teaching and assessment.
Abstract
This study compared Korean adult learners’ English speech in dialogic and monologic tasks, measuring 57 college students’ oral proficiency in terms of holistic and analytic grades. The statistical analyses were focused on two questions: 1) how much do the holistic grades of oral proficiency and analytic grades of the four linguistic features function differently across the tasks? and 2) which linguistic feature has the strongest correlation with the holistic grades of English oral proficiency? The study found significant differences between the two tasks in five aspects (English oral proficiency, topic development, fluency, range, and accuracy). It also showed that a monologic task resulted in lower achievements in those five aspects. In the comparison of the correlations with English proficiency, the range reached the top in both tasks, followed by topic development. The study provides some helpful information regarding which types of speech tasks and linguistic features of EFL oral proficiency are more desirable for targeting in teaching and assessment.
참고문헌 (44)
- Boulton, A., "Corpus linguistics, computer tools, and applications: State of the art", pp.581~598 (2008), Peter Lang
- Brookhart, S. M., "How to create and use rubrics for formative assessment and grading" (2013), ASCD
- Brown, A., "An examination of rater orientations and test taker performance on English for academic purposes speaking tasks" (2005), Educational Testing Service
- Brown, H. D., "Language assessment principles and classroom practices" (2004), Longman
- Brown, J. D., "Developing, using, and analyzing rubrics in language assessment with case studies in Asian and Pacific languages" (2012), National Foreign Language Resource Center, University of Hawai‘i at Mānoa
- Bulantová, B., "Syntactic complexity in the speech of learners of English: Issues in operationalization", master, pp.2020
- "An over-reliance on discrete item testing in the Japanese business context" (2006)[URL]
- Council of Europe, "Common European framework of reference for languages : Learning, teaching, assessment" (2001), Cambridge University Press
- Crossley, S., "Applications of text analysis tools for spoken response grading", Language Learning and Technology, 17(2), pp.171~192 (2013)
- Ferrari, S., "Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA", pp.277~297 (2012), John Benjamins Publishing Company
- Foster, P., "Measuring spoken language : A unit for all reasons", Applied Linguistics, 21(3), pp.354~375 (2000)
- Fulcher, G., "Testing second language speaking" (2003), Pearson Education Limited
- Granena, G., "Cognitive aptitudes and L2 speaking proficiency : Links between LLAMA and HI-LAB", Studies in Second Language Acquisition, 41(2), pp.313~336 (2019)
- Hassanali, K., "SLaTE 2015-Workshop on Speech and Language Technology in Education", pp.13~18 (2015), ISCA Special Interest Group SLaTE
- Housen, A., "Complexity, accuracy, and fluency in second language acquisition", Applied Linguistics, 30(4), pp.461~473 (2009)
- Huensch, A., "Understanding second language fluency behavior : The effects of individual differences in first language fluency, crosslinguistic differences, and proficiency over time", Applied Psycholinguistics, 38(4), pp.755~785 (2017)
- Iwashita, N., "Assessed levels of second language speaking proficiency: How distinct?", Applied Linguistics, 29(1), pp.24~49 (2008)
- Kellogg, D., "Assessing oral language proficiency : Cognitive traits vs. performance-based categories", English Teaching, 56(3), pp.45~68 (2001)
- 김현옥, "A Historical Review of Research on Speaking in English Teaching", 영어교육, 70, pp.299~328 (2015), 한국영어교육학회[DOI]
- Kim, Y., "Implementation of a localized task-based course in an EFL context : A study of students’ evolving perceptions", TESOL Quarterly, 51(3), pp.632~660 (2017)
- 고현숙, "Critical Linguistic Measurements of EFL Oral Proficiency by Korean Adults in Dialogic and Monologic Tasks", 영어교과교육, 21(4), pp.1~25 (2022), 한국영어교과교육학회
- Koizumi, R., "Comparison between holistic and analytic rubrics of a paired oral test", JLTA Journal, 23, pp.57~77 (2020)
- Lee, W. -K., "Assessing Korean university students’ spoken English proficiency", English Testing, 50(1), pp.37~63 (1995)
- Lin, J., "A structural relationship model for L2 oral proficiency, L2 interest, perceived importance of speaking, and out-of-class L2 contact", Language Teaching Research (2022), Advance online publication[DOI]
- Luoma, S., "Assessing speaking" (2004), Cambridge University Press
- McCarthy, M., "Spoken fluency revisited", English Profile Journal, 1(1), pp.1~15 (2010)
- Michel, M. C., "Second language task complexity: Researching the cognition hypothesis of language learning and performance", pp.141~173 (2011), John Benjamins Publishing Company
- Michel, M. C., "The influence of complexity in monologic versus dialogic tasks in Dutch L2", International Review of Applied Linguistics in Language Teaching, 45(3), pp.241~259 (2007)
- Mostafa, T., "The relationships between second language speakers’ oral productions, oral proficiency, and their individual differences: A longitudinal study", doctor, pp.2021
- Ogawa, C., "CAF indices and human ratings of oral performances in an opinionbased monologue task", Language Testing in Asia, 12(4), pp.2~18 (2022)
- Pallotti, G., "CAF : Defining, refining and differentiating constructs", Applied Linguistics, 30(4), pp.590~601 (2009)
- Tae-Ja Park, "(A)comparative analysis of the validity of English speaking performance test tasks", 박사, Dept. of English Education, pp.2013
- 박유정, "Task-in-process During Information-gap Activities in Korean Middle School English Classrooms", 영어교육, 73(2), pp.59~86 (2018), 한국영어교육학회[DOI]
- Park, Y., "Task type completion in lower level EFL classes: A conversation analytic study", Language Teaching Research (2021), Advance online publication[DOI]
- Révész A., "The effects of complexity, accuracy, and fluency on communicative adequacy in oral task performance", Applied Linguistics, 37(6), pp.828~848 (2016)
- Roca-Varela, M. L., "How are spoken skills assessed in proficiency tests of general English as a foreign language? A preliminary survey", International Journal of English Studies, 13(2), pp.53~68 (2013)
- Shin, S.-K., "Research methods in foreign language education" (2014), Hankukmunhwasa
- Skehan, P., "Individual differences in second language learning" (1989), Edward Arnold
- Skehan, P., "Researching pedagogic tasks: Second language learning, teaching, and testing", pp.167~185 (2001), Pearson Education
- Supakorn, S., "Topic development in Thai EFL classes: A conversation analytic perspective", doctor, pp.2017
- Tavakoli, P., "Fluency in monologic and dialogic task performance : Challenges in defining and measuring L2 fluency", International Review of Applied Linguistics in Language Teaching, 54(2), pp.133~150 (2016)
- Tonkyn, A., "Dimensions of L2 performance and proficiency: Complexity, accuracy, and fluency in SLA", pp.221~245 (2012), John Benjamins Publishing Company
- Ulker, V., "The design and use of speaking assessment rubrics", Journal of Education and Practice, 8(32), pp.135~141 (2017)
- Vercellotti, M. L., "Finding variation : Assessing the development of syntactic complexity in ESL speech", International Journal of Applied Linguistics, 29(2), pp.233~247 (2019)