본문 바로가기
KERD
논문KCI 등재

Salient Linguistic Features of EFL Learner Spoken Corpus Elicited by a Computerized Speaking Test

2

조회

0

다운로드

2

인용

0

참고문헌

키워드

주제분류영어와문학

초록

This study attempted to identify the linguistic features (utterance, vocabulary, and syntactic) of English that are recognized as salient elements by native speakers. The oral responses of 60 EFL postsecondary learners comprised of six levels collected from a standardized computer-based speaking test were first transcribed to build a spoken corpus and were then analyzed for utterance, vocabulary, and syntactic features. In addition, scores of holistic and analytic scoring methods were compared. The findings were as follows: (1) Most of the indices of utterance, vocabulary, and syntactic structure demonstrated a significant difference between upper and lower proficiency groups. (2) The majority of indices had significant correlations with speaking proficiency, and the highest correlations with vocabulary indices. (3) The indices of all three categories accounted significantly for the variance of the speaking ability. (4) A very high correlation was found between holistic and analytic scoring methods. Based on the results that indicated which linguistic factors are considered significant by native speakers, meaningful implications could be drawn for effective methods of teaching speaking in the EFL environment focusing on vocabulary and willingness to communicate. Finally, the issue of comparability between holistic or analytic scoring methods was discussed.

Abstract

This study attempted to identify the linguistic features (utterance, vocabulary, and syntactic) of English that are recognized as salient elements by native speakers. The oral responses of 60 EFL postsecondary learners comprised of six levels collected from a standardized computer-based speaking test were first transcribed to build a spoken corpus and were then analyzed for utterance, vocabulary, and syntactic features. In addition, scores of holistic and analytic scoring methods were compared. The findings were as follows: (1) Most of the indices of utterance, vocabulary, and syntactic structure demonstrated a significant difference between upper and lower proficiency groups. (2) The majority of indices had significant correlations with speaking proficiency, and the highest correlations with vocabulary indices. (3) The indices of all three categories accounted significantly for the variance of the speaking ability. (4) A very high correlation was found between holistic and analytic scoring methods. Based on the results that indicated which linguistic factors are considered significant by native speakers, meaningful implications could be drawn for effective methods of teaching speaking in the EFL environment focusing on vocabulary and willingness to communicate. Finally, the issue of comparability between holistic or analytic scoring methods was discussed.

참고문헌 (40)

  1. Ai, H., "A web-based system for automatic measurement of lexical complexity", Paper presented at the 27th Annual Symposium of the Computer-Assisted Language Instruction Consortium (2010)
  2. Al Hosni, S., "Speaking difficulties encountered by young EFL learners", International Journal on Studies in English Language and Literature(IJSELL), 2(6), pp.22~30 (2014)
  3. Bachman, L. F., "Problems in examining the validity of the ACTFL oral proficiency interview", Studies in Second Language Acquisition, 10(2), pp.149~164 (1988)
  4. Bachman, L. F., "Fundamental considerations in language testing" (1990), Oxford University Press
  5. Bachman, L. F., "The construct validation of some components of communicative proficiency", TESOL Quarterly, 16(4), pp.449~465 (1982)
  6. Bachman, L. F., "Language testing in practice: Designing and developing useful language tests (Vol. 1)" (1996), Oxford University Press
  7. Bachman, L. F., "The evaluation of communicative language proficiency : A critique of the ACTFL oral interview", The Modern Language Journal, 70(4), pp.380~390 (1986)
  8. Brown, J. D., "A categorical instrument for scoring second language writing skills", Language Learning, 34(4), pp.21~42 (1984)
  9. Brown, A., "Getting the balance right:Criteria in the integrated speaking test", Paper presented at the 24th Language Testing Research Colloquium (2003)
  10. Carr, N., "A comparison of the effects of analytic and holistic rating scale types in the context of composition texts", Issues in Applied Linguistics, 11(2), pp.207~241 (2000)
  11. Choi, I-C., "Language testing methods in the 21st century : Prospects on computer adaptive testing and performance testing", Language Research, 36(1), pp.205~241 (2000)
  12. Choi, I-C., "The impact of EFL testing on EFL education in Korea", Language Testing, 25(1), pp.39~62 (2008)
  13. 주혜라, "A Study of Rating Criteria for Speaking Assessment: Using Empirical Data of EFL Learners", 영어어문교육, 21(1), pp.75~96 (2015), 한국영어어문교육학회
  14. Chuang, Y. Y., "Foreign language speaking assessment : Taiwanese college English teachers’scoring performance in the holistic and analytic rating methods", The Asian EFL Journal Quarterly, 11(1), pp.150~173 (2009)
  15. Crowdy, S., "Spoken English on Computer: Transcription, Mark-Up and Application", pp.116~127 (1995), Routledge
  16. Dil, Y., "EFL Learners’ communication obstacles", Electronic Journal of Social Sciences, 8(29), pp.84~100 (2009)
  17. Douglas, D., "Theoretical underpinnings of the Test of Spoken English revision project" (1997), Educational Testing Service
  18. Fletcher, P., "Spoken English on Computer:Transcription, Mark-Up and Application", pp.224~234 (1995), Routledge
  19. Hamp-Lyons, L., "Assessing second-language writing in academic contexts", pp.241~276 (1991), Ablex
  20. Huot, B., "Reliability, validity, and holistic scoring : What we know and what we need to know", College Composition and Communication, 41(2), pp.201~213 (1990)
  21. Iwashita, N., "Features of oral proficiency in task performance by EFL and JFL learners", Selected Proceedings of the 2008 Second Language Research Forum, pp.32~47 (2010), Cascadilla Proceedings Project
  22. Iwashita, N., "Assessed levels of second language speaking proficiency: How distinct?", Applied Linguistics, 29(1), pp.24~49 (2008)
  23. Iwashita, N., "A comparison of analytic and holistic scales in the context of a specific-purpose speaking test", Prospect, 18(3), pp.25~35 (2003)
  24. Kang, O., "Linguistic features distinguishing examinees’ speaking performances at different proficiency levels", Journal of Language Testing Assessment, 1, pp.24~39 (2018)
  25. Kim, H. S., "The types of speaking assessment tasks used by Korean Junior Secondary school English teachers", The Asian EFL Journal, 5(4), pp.1~11 (2003)
  26. Lee, E. L., "Linguistic and cultural factors in East Asian students' oral participation in US university classrooms", International Education, 36(2), pp.27~47 (2007)
  27. Leong, L. M., "An analysis of factors influencing learners’ English speaking skill", International Journal of Research in English Education, 2(1), pp.34~41 (2017)
  28. Littlewood, W., "Communicative language teaching" (1981), Cambridge University Press
  29. Lu, X., "Automatic analysis of syntactic complexity in second language writing", International Journal of Corpus Linguistics, 15(4), pp.474~496 (2010)
  30. Lu, X., "The relationship of lexical richness to the quality of ESL learners’ oral narratives", The Modern Language Journal, 96(2), pp.190~208 (2012)
  31. Orr, M., "The FCE speaking test : Using rater reports to help interpret test scores", System, 30(2), pp.143~154 (2002)
  32. Ortega, L., "Planning and focus on form in L2 oral performance", Studies in Second Language Acquisition, 21(1), pp.109~148 (1999)
  33. O’Sullivan, B., "Using observation checklists to validate speaking-test tasks", Language Testing, 19(1), pp.33~56 (2002)
  34. Pollitt, A., "Calibrating graded assessments : Rasch partial credit analysis of performance in writing", Language Testing, 4(1), pp.72~92 (1987)
  35. Ur, P., "A course in language teaching" (1996), Cambridge University Press
  36. Weir, C. J., "Communicative language testing" (1990), Prentice-Hall
  37. Woodrow, L., "Anxiety and speaking English as a second language", RELC Journal, 37(3), pp.308~328 (2006)
  38. Xi, X., "Evaluating analytic scoring for the TOEFL Academic Speaking Test(TAST)for operational use", Language Testing, 24(2), pp.251~286 (2007)
  39. Investigating the utility of analytic scoring for the TOEFL Academic Speaking Test (TAST), "Xi, X.", ETS, ~, pp.TOEFL iBT Research Report, No. 1 (2006)
  40. Zhang, S., "The role of input, interaction, and output in the development of oral fluency", English Language Teaching, 2(4), pp.91~100 (2009)

관련 논문AI추천

이 간행물의 다른 논문 (7건)