Native- and Nonnative-English-Speaking Raters’ Assessment Behavior in the Evaluation of NEAT Essay Writing Samples
2
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
This study examines the assessment behaviors between Native-English-speaking rater (NESR) and Non-native-English-speaking rater (NNESR) in the evaluation of National English Ability Test (NEAT) writing samples. Their assessment behaviors are similar in overall achievement but differ from one domain to another. The participants of this study were 110 freshmen high school students in Gyeonggi, Korea, who learned English essay writing from a NNES teacher for six months. 110 students received an instruction of an English-persuasive-essay-writing, and each participant composed a five-paragraph persuasive essay given by NEAT before and after the instruction. Both NESR and NNESR assigned the scores on each student’s essay and analyzed the data based on the given criteria composed of the following four domains in NEAT writing tasks: (1) task completion, (2) content, (3)organization, and (4) language use. Findings portray that NESR assigned a relatively low score and was stringent about three domains of content, organization, and language use while NNESR was generous in grading all four domains. The results showed that NESR and NNESR demonstrated different assessment behaviors about each domain due to diverse variables. The findings suggest that ways to improve the reliability between NESR and NNESR need to be further studied.
Abstract
This study examines the assessment behaviors between Native-English-speaking rater (NESR) and Non-native-English-speaking rater (NNESR) in the evaluation of National English Ability Test (NEAT) writing samples. Their assessment behaviors are similar in overall achievement but differ from one domain to another. The participants of this study were 110 freshmen high school students in Gyeonggi, Korea, who learned English essay writing from a NNES teacher for six months. 110 students received an instruction of an English-persuasive-essay-writing, and each participant composed a five-paragraph persuasive essay given by NEAT before and after the instruction. Both NESR and NNESR assigned the scores on each student’s essay and analyzed the data based on the given criteria composed of the following four domains in NEAT writing tasks: (1) task completion, (2) content, (3)organization, and (4) language use. Findings portray that NESR assigned a relatively low score and was stringent about three domains of content, organization, and language use while NNESR was generous in grading all four domains. The results showed that NESR and NNESR demonstrated different assessment behaviors about each domain due to diverse variables. The findings suggest that ways to improve the reliability between NESR and NNESR need to be further studied.
참고문헌 (54)
- Barkaoui, K., "Do ESL essay raters’ evaluation criteria change with experience? A mixed-methods, cross-sectional study", TESOL Quarterly, 44(1), pp.31~57 (2010)
- Brown, J. D., "Do English and ESL faculties rate writing samples differently?", TESOL Quarterly, 25(4), pp.587~603 (1991)
- Bygate, M., "Quality of language and purpose of tasks: Patterns of learners’ interaction on two oral communication tasks", Language Teaching Research, 3(3), pp.185~214 (1999)
- Canagarajah, A. S., "Interrogating the “Native Speaking Fallacy”: Non-linguistic roots, non-pedagogical results, In Non-native educators in English language teaching", pp.77~92 (1999), Lawrence Erlbaum
- 장경숙, "영어교사 심화연수 프로그램 개발을 위한 기초 연구", Foreign Languages Education, 18(1), pp.175~207 (2011), 한국외국어교육학회
- Cheong, S. H., "The role of listener affiliated socio-cultural factors in perceiving native accented versus foreign accented speech", 박사, pp.2007
- 정성희, "국가영어능력평가 쓰기 영역 교수 및 평가를 위한 한국인 영어교사의 역할 적절성 연구", 교육과정평가연구, 15(1), pp.187~208 (2012), 한국교육과정평가원
- Connor, U., "Contrastive rhetoric: Cross-cultural aspects of second-language writing" (1996), Cambridge University Press
- Connor-Linton, J., "Crosscultural comparison of writing standards : American ESL and Japanese EFL", World Englishes, 14, pp.99~115 (1995)
- Cumming, A., "Expertise in evaluating second language compositions", Language Testing, 7, pp.31~51 (1990)
- Cumming, A., "Decision making while rating ESL", EFL writing tasks : A descriptive framework, 2002, pp.86, 67~96
- Davis, A., "The native speaker in applied linguistics" (1991), Edinburgh University Press
- Goulden, N. R., "Relationship of analytic and holistic methods to raters’ scores for speeches", The Journal of Research and Development in Education, 27, pp.73~82 (1994)
- 홍사만, "연역적 논증과 귀납적 추론", 어문론총, 46(46), pp.131~172 (2007), 한국문학언어학회
- Jeffery, J. V., "Subjectivity, intentionality, and manufactured moves: Teachers’ perceptions of voice in the evaluation of secondary students’ writing", Research in the Teaching of English, 46(1), pp.92~127 (2011)
- 전인재, "Exploring the Co-teaching Practice of Native and Non-native English Teachers in Korea", 영어교육, 65(3), pp.43~67 (2010), 한국영어교육학회
- Kachru, B. B., "The other tongue: English across cultures" (1982), Pergamon
- Kachru, B. B., "The alchemy of English: The spread, functions and models of nonnative Englishes" (1986), Pergamon
- Kachru, B. B., "English as an Asian language", Links and Letters, 5, pp.89~108 (1998)
- 김성연, "원어민 교사의 언어적, 문화적, 교육적 역량 평가", Foreign Languages Education, 18(2), pp.209~232 (2011), 한국외국어교육학회
- 김현정, "Investigating Rater Behavior across Diverse English Speaking Tasks", Foreign Languages Education, 18(2), pp.99~125 (2011), 한국외국어교육학회
- Kobayashi, H., "Task response and text construction across L1 and L2 writing", Journal of Second Language Writing, 17, pp.7~29 (2008)
- Lippi-Green, R., "English with an accent" (1997), Routledge
- Mackey, A., "Task familiarity and interactional feedback in child ESL classrooms", TESOL Quarterly, 41(2), pp.285~312 (2007)
- Matsuda, A., "Incorporating world Englishes in teaching English as an international language", TESOL Quarterly, 37(4), pp.719~729 (2003)
- McKay, S., "Teaching English as an International Language" (2002), Oxford University Press
- Medgyes, P., "Native or non-native: Who’s worth more?", ELT Journal, 46(4), pp.340~349 (1992)
- Mendelsohn, D., "Professors’ ratings of language use and rhetorical organization in ESL compositions", TESL Canada Journal, 5, pp.9~26 (1987)
- "The study about linking English curriculum to National English Ability Test" (2011)[URL]
- Moussu, L., "Influence of teacher-contact time and other variables on ESL students’ attitude towards native-and nonnative-English-speaking teachers", TESOL Quarterly, 44(4), pp.746~768 (2010)
- O’Laughlin, K., "The assessment of writing by English and ESL teachers", Australian Review of Applied Linguistics, 17, pp.23~44 (1994)
- Paikeday, T. M., "The native speaker is dead!" (1985), Paikeday Publishing Inc
- Peirce, B. N., "Social identity, investment, and language learning", TESOL Quarterly, 29(1), pp.9~31 (1995)
- Peirce, B. N., "Language identity and ownership of English", TESOL Quarterly, 31(3), pp.409~429 (1997)
- Pennycook, A., "Towards a critical applied linguistics for the 1990s", Issues in Applied Linguistics, 1(1), pp.8~28 (1990)
- Phillipson, R., "Linguistic imperialism" (1992), Oxford University Press
- Phillipson, R., "ELT: The native speaker’s burden, In Power, pedagogy & practice", pp.23~30 (1996), Oxford University Press
- Rampton, M. B. H., "Displacing the"native speaker" : expertise, affiliation, and inheritance", ELT Journal, 45(2), pp.97~101 (1990)
- Richards, J., "Longman dictionary of applied linguistics" (1985), Longman
- Rinnert, C., "Differing perceptions of EFL writing among readers in Japan", The Modern Language Journal, 85, pp.189~209 (2001)
- Ruegg, R., "Rater sensitivity to qualities of lexis in writing", TESOL Quarterly, 45(1), pp.63~80 (2011)
- Samimy, K. K., "To be a native or non-native speaker: Perceptions of “non-native” students in a graduate TESOL program, In Non-native educators in English language teaching", pp.197~210 (1999), Lawrence Erlbaum
- Santos, T., "Professors’ reactions to the academic writing of non-native-speaking students", TESOL Quarterly, 22(1), pp.69~90 (1988)
- Shi, L., "Native-and nonnative-speaking EFL teachers’ evaluation of Chinese students’ English writing", Language Testing, 18, pp.303~325 (2001)
- 신미경, "Effects of Output Tasks on Korean EFL Learners’ Noticing and Learning of English Grammar", Foreign Languages Education, 18(2), pp.127~163 (2011), 한국외국어교육학회
- Singer, B. D., "Developmental variations in writing composition skills, In Handbook of language and literacy: Development and disorders", pp.559~582 (2004), Guilford Press
- Song, C. B., "Do English and ESL faculty differ in evaluating the essays of native English-speaking and ESL students?", Journal of Second Language Writing, 5, pp.163~182 (1996)
- Sweedler-Brown, C. O., "The influence of training and experience on holistic essay evaluation", English Journal, 74, pp.49~55 (1985)
- "Introduction about National English Ability Test" (2011)[URL]
- (2011)[URL]
- "The Korea Institute for Curriculum and Evaluation" (2012)[URL]
- Uysal, H. H., "Tracing the culture behind writing : Rhetorical patterns and bidirectional transfer in L1 and L2 essays of Turkish writers in relation to educational context", Journal of Second Language Writing, 17, pp.183~207 (2008)
- Weigle, S. C., "Assessing writing" (2002), Cambridge University Press
- Yano, Y., "World Englishes in 200 and beyond", World Englishes, 20, pp.119~131 (2001)
