본문 바로가기
KERD
논문KCI 등재

Interlanguage Pragmatic Test Tasks: Does a Low-Stakes Test Have Washback to L2 Teachers and Learners?

Ali Dabbagh|Zia Tajeddin
아시아테플 (AsiaTEFL (The Asian Association of Teachers of English As a Foreign Language))|2015.12|Journal of Asia TEFL|제12권 제4호|pp. 129-158

0

조회

0

다운로드

3

인용

0

참고문헌

키워드

interlanguage pragmaticspragmatic competencepragmatic testswashbackdiscourse completion tasks

초록

Despite the international surge of interest in the measurement of L2 pragmatic competence, the washback of pragmatic test tasks has remained a noticeably under-researched issue. To bridge this gap, this study sought to investigate the washback of a written discourse completion task (WDCT), as a pragmatic measure, to L2 teachers and learners in two different testing contexts, i.e., one with the addition of WDCT as part of summative assessment (pragmatic testing context) and the other with no such addition to the tests (non-pragmatic testing context). Data from teacher and learner interviews and classroom observations were subjected to content analysis. The results revealed various aspects of pragmatic assessment washback. First, the added pragmatic test tasks in the pragmatic testing context enhanced learners’ noticing of pragmatic aspects of listening materials and teacher talk, whereas learners in the non-pragmatic testing context expressed more concern for lexical and grammatical features. Second, pragmatic context learners specified the production of pragmatically appropriate discourse as the ultimate objective of language learning. Finally, most teachers in the pragmatic testing context emphasized the utility of pragmatic-based teaching activities. The findings indicate that lowstakes pragmatic assessment has a positive washback to learning and teaching activities.

Abstract

Despite the international surge of interest in the measurement of L2 pragmatic competence, the washback of pragmatic test tasks has remained a noticeably under-researched issue. To bridge this gap, this study sought to investigate the washback of a written discourse completion task (WDCT), as a pragmatic measure, to L2 teachers and learners in two different testing contexts, i.e., one with the addition of WDCT as part of summative assessment (pragmatic testing context) and the other with no such addition to the tests (non-pragmatic testing context). Data from teacher and learner interviews and classroom observations were subjected to content analysis. The results revealed various aspects of pragmatic assessment washback. First, the added pragmatic test tasks in the pragmatic testing context enhanced learners’ noticing of pragmatic aspects of listening materials and teacher talk, whereas learners in the non-pragmatic testing context expressed more concern for lexical and grammatical features. Second, pragmatic context learners specified the production of pragmatically appropriate discourse as the ultimate objective of language learning. Finally, most teachers in the pragmatic testing context emphasized the utility of pragmatic-based teaching activities. The findings indicate that lowstakes pragmatic assessment has a positive washback to learning and teaching activities.

참고문헌 (54)

  1. Alderson, J. C., "TOEFL preparation courses : A study of washback", Language Testing, 13(3), pp.280~297 (1996)
  2. Alderson, J. C., "Does washback exist?", Applied Linguistics, 14(2), pp.115~129 (1993)
  3. Andrews, S., "Bringing about change in language education", pp.67~82 (1995), University of Hong Kong
  4. Andrews, S., "Washback in language testing: Research, context and method", pp.37~53 (2004), Lawrence Erlbaum Associates
  5. Andrews, S., "Targeting washback : A case study", System, 30(2), pp.207~223 (2002)
  6. Bachman, L. F., "Fundamental considerations in language testing" (1990), Oxford University Press
  7. Bachman, L. F., "Language testing in practice" (1996), Oxford University Press
  8. Bardovi-Harlig, K., "L2 pragmatic assessment : Evidence from the ESL classroom", System, 33(3), pp.401~415 (2005)
  9. Bracey, G. W., "Measurement-driven instruction : Catchy phrase, dangerous practice", Phi Delta Kappan, 68, pp.683~686 (1987)
  10. Brown, J. D., "Pragmatics in language teaching", pp.301~325 (2001), Cambridge University Press
  11. Brown, J. D., "Variables that affect the dependability of L2 pragmatics tests", Journal of Pragmatics, 43(1), pp.198~217 (2011)
  12. Chang, Y., "‘I no say you say is boring’ : The development of pragmatic competence in L2 apology", Language Sciences, 32(3), pp.408~424 (2010)
  13. Cheng, L., "Impact of a public English examination change on students’ perceptions and attitudes toward their English learning", Studies in Educational Evaluation, 24(3), pp.279~301 (1998)
  14. Cheng, L., "Washback in language testing: Research, context and method", pp.3~18 (2004), Lawrence Erlbaum Associates
  15. Denman, B. R., "In contact" (2000), Pearson Education
  16. Frederiksen, N., "The real test bias : Influences of testing on teaching and learning", American Psychologist, 39(3), pp.193~202 (1984)
  17. Green, A., "Washback to the learner : learner and teacher perception and IELTS preparation course expectations and outcome", Assessing Writing, 11(2), pp.113~134 (2006)
  18. Hamp-Lyons, L., "Washback, impact and validity : ethical concerns", Language Testing, 14(3), pp.295~303 (1997)
  19. Hamp-Lyons, L., "Ethical test preparation practice : The case of the TOEFL", TESOL Quarterly, 32(2), pp.329~337 (1998)
  20. Hawkey, R., "Impact theory and practice: Studies of the IELTS test and Progetto Lingue 2000" (2006), Cambridge University Press
  21. Hayes, B., "Washback in language testing: Research, context and method", pp.97~112 (2004), Lawrence Erlbaum Associates
  22. Developing prototypic measures of cross-cultural pragmatics, "Hudson, T.", University of Hawaii, Second Language Teaching and Curriculum Center, ~, pp.Technical Report 7 (1995)
  23. Kasper, G., "Pragmatic development in a second language" (2002), Blackwell
  24. Kwon, J., "Expressing refusals in Korean and in American English", Multilingua, 23(4), pp.339~364 (2004)
  25. Lee, W. W. C., "The beneficial washback of the school-based assessment component on the speaking performance of students", Hong Kong Teachers’ Centre Journal, 8, pp.18~29 (2009)
  26. Long, M. H., "Native language and foreign language acquisition", pp.259~278 (1981), New York Academy of Sciences
  27. Long, M. H., "Linguistic and conversational adjustments to non-native speakers", Studies in Second Language Acquisition, 5(2), pp.177~193 (1983)
  28. Long, M. H., "Handbook of second language acquisition", pp.413~468 (1996), Academic Press
  29. Luxia, Q., "Stakeholders' conflicting aims undermine the washback function of a high-stakes test", Language Testing, 22(2), pp.142~173 (2005)
  30. Madaus, G. F., "Critical issues in curriculum: Eighty-seventh yearbook of the national society for the study of education", pp.83~121 (1988), University of Chicago Press
  31. Muñoz, A. P., "Washback of an oral assessment system in the EFL classroom", Language Testing, 27(1), pp.33~49 (2010)
  32. Özmen, K. S., "Washback effects on the inter-university foreign language examination on foreign language competences of candidate academics", Novitas-ROYAL(Research on Youth and Language), 5(2), pp.215~228 (2011)
  33. Purpura, J., "Assessing grammar" (2004), Cambridge University Press
  34. Roever, C., "Testing ESL pragmatics" (2005), Peter Lang
  35. Roever, C., "Validation of a web-based test of ESL pragmalinguistics", Language Testing, 23(2), pp.299~256 (2006)
  36. Rose, K. R., "An exploratory cross-sectional study of interlanguage pragmatic development", Studies in Second Language Acquisition, 22(1), pp.27~67 (2000)
  37. Rose, K. R., "Interlanguage pragmatic development in Hong Kong, phase 2", Journal of Pragmatics, 41(11), pp.2345~2364 (2009)
  38. Saslow, J., "Top Notch: English for today's world" (2006), Pearson Education
  39. Saville, N., "Washback in language testing: Research, context and method", pp.73~96 (2004), Lawrence Erlbaum Associates
  40. Schmidt, R., "Cognition and second language instruction", pp.3~32 (2001), Cambridge University Press
  41. Sharwood Smith, M., "Consciousness-raising and the second language learner", Applied linguistics, 2(2), pp.159~168 (1981)
  42. Shepard, L. A., "The place of testing reform in educational reform : A reply to Cizek", Educational Researcher, 22(4), pp.10~14 (1993)
  43. Shohamy, E., "Test impact revisited : Washback effect over time", Language Testing, 13(3), pp.298~317 (1996)
  44. Spratt, M., "Washback and the classroom : The implications for teaching and learning of studies of washback from exams", Language Teaching Research, 9(1), pp.5~29 (2005)
  45. Swain, M., "Input in second language acquisition", pp.235~256 (1985), Newbury House
  46. Swain, M., "Principle and practice in applied linguistics: Studies in honor of H. G. Widdowson", pp.125~144 (1995), Oxford University Press
  47. Swain, M., "Problems in output and the cognitive processes they generate : A step towards second language learning", Applied Linguistics, 16(3), pp.371~391 (1995)
  48. Taylor, L., "Washback and impact", ELT Journal, 59(2), pp.154~155 (2005)
  49. Wall, D., "The impact of high-stakes testing on teaching and learning: can this be predicted or controlled?", System, 28(4), pp.499~509 (2000)
  50. Wall, D., "Examining washback : The Sri Lankan impact study", Language Testing, 10(1), pp.41~69 (1993)
  51. Widen, M. F., "High-stakes testing and the teaching of science", Canadian Journal of Education, 22(4), pp.428~444 (1997)
  52. Xiao, Y., "Washback of national matriculation English test on students’ learning in the Chinese secondary school context", Asian EFL Journal, 13(3), pp.103~129 (2011)
  53. Six measures of JSL pragmatics, "Yamashita, S. O.", University of Hawaii, Second Language Teaching and Curriculum Center, ~, pp.Technical Report 14 (1996)
  54. Yamashita, S. O., "Pragmatics in language learning: Theory and practice", pp.119~136 (2005), The Japan Association for Language Teaching

관련 논문AI추천

An Investigation into the Effects of Pragmatic Instruction and Feedback on the Development of Pragmatic Competence o f Korean University Students김혜경한국영어교과교육학회 · 영어교과교육2019 · 제18권 제3호The Effect of Instruction on Pragmatic Competence한지원사단법인 한국언어학회 · 언어학2013 · 제67호Grammatical competency or pragmatic competency: An examination of the language features related to proficiency scores in oral interviews김혜경, Robert Kerr팬코리아영어교육학회 · 영어교육연구2016 · 제28권 제3호Effects of Pragmatic Instruction for Korean EFL College Students in Request Acts김혜림담화·인지언어학회 · 담화와 인지2014 · 제21권 제3호Analysis of the Effects and Durability of Implicit and Explicit Pragmatic Instruction김혜경외국어교육연구소 · 외국어교육연구2018 · 제32권 제2호A Washback Effect Model for Investigating the Impact of High-Stakes Language Testing on Teaching and LearningHan Gil Kim현대영어교육학회 · 현대영어교육2023 · 제24권

이 간행물의 다른 논문 (4건)

Supplementive Participle Clauses in Science Journal Papers by Korean Graduate Students: A Corpus-based Study for Pedagogical Purposes박정영, 조동완pp. 1-36A Corpus-based Study of To-Infinitive Errors in Korean College Freshmen’s WritingYoo Isaiah Wonho, 김정은pp. 37-60Exploring Motivational Changes for Short In-class Extensive ReadingMitsuko Tanakapp. 61-91A Pedagogical Framework for Contentlanguage Integrated Teaching at Middle School LevelStella Kongpp. 93-127
원문 보기