말하기 과업별 한국인 성인의 영어 말하기 능숙도와 분석적 채점 영역의 관계
Relationships of EFL oral proficiency and analytic evaluation components for Korean adults among different tasks
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This study investigates the relationships between Korean adult learners’ English as foreign language (EFL) oral proficiency and evaluation components for three types of monologic tasks based on giving opinions, describing pictures, and retelling. To determine which evaluation components are helpful practically in identifying EFL learners’ oral proficiency, the researcher collected speech data from 57 Korean college students in Korea and examined the results of a holistic scoring and an analytic scoring with four evaluation components: topic development, fluency, range, and accuracy. Using statistical analyses, the study found significant differences in terms of English oral proficiency between the opinion-giving and the retelling tasks as well as between the picture-describing and the retelling tasks. In addition, the highest achievements with respect to English oral proficiency were found in the opinion-giving task, followed by the picture-describing task and the retelling task, in that order. The highest correlations with English oral proficiency were also found in range for the opinion-giving task, accuracy for the picture-describing task, and topic development for the retelling task. Considering the results, the study proposes pairs of evaluation components for each type of task that are appropriate for examining EFL oral proficiency. The results may also help testing developers determine more balanced weights among evaluation components and task types.
Abstract
This study investigates the relationships between Korean adult learners’ English as foreign language (EFL) oral proficiency and evaluation components for three types of monologic tasks based on giving opinions, describing pictures, and retelling. To determine which evaluation components are helpful practically in identifying EFL learners’ oral proficiency, the researcher collected speech data from 57 Korean college students in Korea and examined the results of a holistic scoring and an analytic scoring with four evaluation components: topic development, fluency, range, and accuracy. Using statistical analyses, the study found significant differences in terms of English oral proficiency between the opinion-giving and the retelling tasks as well as between the picture-describing and the retelling tasks. In addition, the highest achievements with respect to English oral proficiency were found in the opinion-giving task, followed by the picture-describing task and the retelling task, in that order. The highest correlations with English oral proficiency were also found in range for the opinion-giving task, accuracy for the picture-describing task, and topic development for the retelling task. Considering the results, the study proposes pairs of evaluation components for each type of task that are appropriate for examining EFL oral proficiency. The results may also help testing developers determine more balanced weights among evaluation components and task types.
참고문헌 (51)
- 신상근, "외국어교육연구방법론" (2014), 한국문화사
- 이완기, "대학생의 영어 말하기 능력 평가 모형", 영어교육, 50(1), pp.37~63 (1995)
- Boulton, A, "Corpus linguistics, computer tools, and applications: State of the art", pp.581~598 (2008), Peter Lang
- Brown, H. D, "Language assessment principles and classroom practices" (2004), Longman
- Developing, using, and analyzing rubrics in language assessment with case studies in Asian and Pacific languages (Nflrc Monograph) (Illustrated), "Brown, J. D.", National Foreign Language Resource Center, ~ (2012)
- "An over-reliance on discrete item testing in the Japanese business context" (2006)[URL]
- Chen, J., "Holistic versus analytic scoring of spoken-language interpreting : A multi-perspectival comparative analysis", The Interpreter and Translator Trainer, 16(4), pp.558~576 (2022)[DOI]
- Council of Europe., "Common European framework of reference for languages : Learning, teaching" (2001), assessment. Cambridge University Press
- "Improving awarding: 2018/2019 pilots" (2019)[URL]
- Theoretical underpinnings of the test of spoken English revision project, "Douglas, D.", ETS, ~, pp.TOEFL Monograph Series No. 9 (1997)
- Ekiert, M., "The effects of task type and L2 proficiency on discourse appropriacy in oral task performance", Task-based approaches to teaching and assessing pragmatics, 10, pp.247~ (2018)
- Ferrari, S, "Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA", pp.277~297 (2012), John Benjamins Publishing Company
- Fulcher, G, "Testing second language speaking" (2003), Pearson Education Limited
- Han, C., "Assessing spoken-language interpreting : The method of comparative judgement", Interpreting, 24(1), pp.59~83 (2022)
- Hirai, A., "Development of a practical speaking test with a positive impact on learning using a story retelling technique", Language Assessment Quarterly, 6, pp.151~167 (2009)[DOI]
- Harsch, C., "Comparing holistic and analytic scoring methods: issues of validity and reliability", Assessment in Education:Principles, Policy & Practice, 20(3), pp.281~307 (2013)[DOI]
- Hassanali, K., "SLaTE 2015-Workshop on Speech and Language Technology in Education", pp.13~18 (2015)
- Housen, A., "Dimensions of L2 performance and proficiency: Complexity, accuracy, and fluency in SLA", pp.1~20 (2012), John Benjamins Publishing Company
- In’nami, Y., "Task and rater effects in L2 speaking and writing : A synthesis of generalizability studies", Language Testing, 33(3), pp.341~366 (2016)[DOI]
- Kim, H.-J., "Investigating the effects of context and task type on second language speaking ability", doctoral, pp.2009
- 김정옥, "온라인상 대학생 영어 말하기 수업 설계", 영어교과교육, 20(3), pp.119~138 (2021), 한국영어교과교육학회[DOI]
- 김소정, "EFL 학습자의 영어 발화에 나타난담화표지어의 사용 양상과 인식", 영어교과교육, 20(2), pp.49~74 (2021), 한국영어교과교육학회[DOI]
- Kim, Y., "Implementation of a localized task-based course in an EFL context : A study of students’ evolving perceptions", TESOL Quarterly, 51(3), pp.632~660 (2017)[DOI]
- 고현숙, "Critical Linguistic Measurements of EFL Oral Proficiency by Korean Adults in Dialogic and Monologic Tasks", 영어교과교육, 21(4), pp.1~25 (2022), 한국영어교과교육학회
- Lambert, C., "Task repetition and second language speech processing", Studies in Second Language Acquisition, 39(1), pp.167~196 (2017)[DOI]
- Dependability of scores for a new ESL speaking test: Evaluating prototype tasks, "Lee, Y.-W.", ETS, ~, pp.Monograph Series, MS-28 (2005)
- Luoma, S., "Assessing speaking" (2004), Cambridge University Press
- Markstein, L., "Developing reading skills: Advanced" (1983), Heinle & Heinle Publishers
- McCarthy, M., "Spoken fluency revisited", English Profile Journal, 1, pp.1~15 (2010)
- Michel, M. C., "The influence of complexity in monologic versus dialogic tasks in Dutch L2", International Review of Applied Linguistics in Language Teaching, 45(3), pp.241~259 (2007)[DOI]
- Mostafa, T., "The relationships between second language speakers’ oral productions, oral proficiency, and their individual differences: A longitudinal study", doctoral, pp.2021
- Norris, J. M., "Towards an organic approach to investigating CAF in instructed SLA : The case of complexity", Applied Linguistics, 30(4), pp.555~578 (2009)
- Park, T.-J., "A comparative analysis of the validity of English speaking performance test tasks", doctoral, pp.2012
- 박유정, "Task-in-process During Information-gap Activities in Korean Middle School English Classrooms", 영어교육, 73(2), pp.59~86 (2018), 한국영어교육학회[DOI]
- Ogawa, C., "CAF indices and human ratings of oral performances in an opinion-based monologue task", Language Testing in Asia, 12(4), pp.2~18 (2022)[DOI]
- Ounis, M., "A comparison between holistic and analytic assessment of speaking", Journal of Language Teaching and Research, 8(4), pp.679~690 (2017)[DOI]
- Ribeiro, N., "Archie’s double digest magazine" (2003), Archie Comic Publications, Inc
- Roca-Varela, M. L., "How are spoken skills assessed in proficiency tests of general English as a foreign language? A preliminary survey", International Journal of English Studies, 13(2), pp.53~68 (2013)[DOI]
- Sato, M., "Context matters : Learner beliefs and interactional behaviors in an EFL vs. ESL context", Language Teaching Research, 26(5), pp.919~942 (2022)[DOI]
- Sawaki, Y., "Construct validation of analytic rating scales in a speaking assessment : Reporting a score profile and a composite", Language Testing, 24(3), pp.355~390 (2007)[DOI]
- Skehan, P, "Researching pedagogic tasks: Second language learning, teaching, and testing", pp.167~185 (2001), Pearson Education
- Suzuki, S., "How does creativity affect second language speech production? The moderating role of speaking task type", TESOL Quarterly, 56(4), pp.1083~1510 (2022)[DOI]
- Taguchi, N., "Task difficulty in oral speech act production", Applied linguistics, 28(1), pp.113~135 (2007)
- Tavakoli, P., "Fluency in monologic and dialogic task performance : Challenges in defining and measuring L2 fluency", International Review of Applied Linguistics in Language Teaching, 54(2), pp.133~150 (2016)[DOI]
- Tavakoli, P., "Planning and task performance in a second language", pp.239~276 (2005), John Benjamins Publishing Company
- Tin, T. B., "Towards creativity in ELT : The need to say something new", ELT Journal, 67, pp.385~397 (2013)
- Ulker, V., "The design and use of speaking assessment rubrics", Journal of Education and Practice, 8(32), pp.135~141 (2017)
- Wang, H. C., "The influence of creative task engagement on English L2learners’ negotiation of meaning in oral communication tasks", System, 80, pp.83~94 (2019)
- 원용국, "The Effect of Task Complexity on Test-takers’ Performance in a Performance-based L2 Oral Communication Test for International Teaching Assistants", 영어교과교육, 19(1), pp.27~52 (2020), 한국영어교과교육학회[DOI]
- Investigating the utility of analytic scoring for the TOEFL Academic Speaking Test (TAST), "Xi, X", ETS, ~, pp.TOEFL iBT Research Report, RR-06-07 (2006)
- Soo Jung Youn, "Grammar as validity evidence for assessing L2 interactional competence", Applied Pragmatics, 5(2), pp.174~201 (2023), John Benjamins Publishing Company[DOI]
