본문 바로가기
KERD
논문KCI 등재

Validity of Self- and Peer-ratings in an EFL Essay-writing Test

이호
한국영어교육학회 (Korea Association Of Teachers Of English)|2005.09|영어교육 (English Teaching)|제60권 제3호|pp. 195-219

0

조회

0

다운로드

13

인용

0

참고문헌

주제분류영어와문학

초록

Abstract

The current study investigates the validity of a self- and peer-rating in a second language (L2) essay-writing test in Korea. The current study suggests that the Korean EFL students whose major is English education should conduct the rating tasks that they will encounter in the post-secondary school in their future career. Each of 104 Korean EFL learners at the intermediate level sequentially rated three sample essays, his/her own essay, and his/her partner’s essay after he/she was provided with the same benchmark as two experts would refer to. Each essay was rated on a 5-scale in terms of 4 writing features (organization, content, language use, and holistic feature). After students finished the ratings tasks, the students’ ratings were compared to expert ratings, using Multi-facet Rasch model. As a result, peer raters were so lenient that they showed unpredictable rating pattern. This research is dedicated to seek an innovative testing system in which trained students participate in a test as a complementary rater specifically in the EFL context.

참고문헌 (41)

  1. "The construct validation of self-ratings of communicative language ability", pp.14~29 (1989)
  2. "Self-assessment of foreign language skills Implications for teachers and researchers", pp.313~340 (1989)
  3. "Implementing student self-assessment" (1991), HERDSA
  4. "Assessment" (2004)
  5. "Strategies for diversifying assessments in higher education In Involving students in the assessment process from Oxford Centre for Staff and Learning Development Web site" (2004)
  6. "Peer and teacher assessment of the oral and written tasks of a group project", 24, pp.301~314 (1999)
  7. "A self-rating scale of English difficulty", pp.164~179 (1985)
  8. "Moving toward learner-directed assessment. Learner-directed assessment in ESL", pp.1~11 (2000), Lawrence Erlbaum Associates
  9. "Test of English as a foreign language(TOEFL)" (2000), Princeton
  10. "Peer feedback marking:Developing peer-assessment", 32, pp.175~187 (1995)
  11. "Peer-assessment by groups of group work", 20, pp.289~299 (1995)
  12. "Perspectives on validity: a historical analysis of language testing conference abstracts. Validation in Language Assessment", pp.253~276 (1998), Lawrence Erlbaum Associates
  13. "Self-assessment of second language ability The role of response effects", pp.172~198 (1990)
  14. "Staff and peer-group assessment of oral communication skills Studies in Higher Education", 18, pp.379~385 (1993)
  15. "The development of a test of Dutch as a second language:The validity of self-assessments by inexperienced subjects", 6, pp.30~46 (1989)
  16. "Computer-delivered ESL placement test at the University of Illinois . Unpublished masters thesis" (2003)
  17. "Self-assessment as a second language placement instrument", pp.73~87 (1985), & Painchaud
  18. "Many-faceted Rasch measurement" (1989), MESA Press
  19. , 1999, 17~3, pp.MESA Press
  20. "Autonomy: An anatomy and a framework", 24, pp.427~435 (1996)
  21. "Creating a self-rating instrument for second language writing: from idea to implementation", 20, pp.440~465 (2003)
  22. "Rethinking assessment from a critical perspective", 18, pp.351~372 (2001)
  23. "Biases in self-ratings of second language proficiency: The role of language anxiety", 47, pp.265~287 (1997)
  24. "Reciprocity as a source of bias in multiple peer-assessment of group work", 26, pp.53~63 (2001)
  25. "Peer and teacher assessments of oral presentation skills: How reliable are they?", 26, pp.287~298 (2001)
  26. "Rater training guide book" (1998), Sookmyung Womens University Press
  27. "Measuring second language performance" (1996)
  28. "Using self and peer-assessment to improve students essay writing A case study from geography Innovations in Education and Training International", 32, pp.324~335 (1995)
  29. "Defining a flexible common measurement scale: Descriptors for self and teacher assessment. Learner-directed assessment in ESL", pp.12~47 (2000), Lawrence Erlbaum Associates
  30. "Self-assessment of language proficiency:Rationale and applications", 6, pp.1~13 (1989)
  31. "The influence of peer feedback on self- and peer-assessment of oral skills", 19, pp.109~131 (2002)
  32. "and locus of control", pp.25~42 (1993)
  33. "Autonomy at all costs: An ethnography of metacognitive self- assessment and self-management among experienced language learners", 85, pp.279~290 (2001)
  34. "Self-assessment in second language testing: A meta-analysis and analysis of experiential factors", 15, pp.1~20 (1998)
  35. "The role of assessment in a learning culture", 29, pp.4~14 (2000)
  36. , 2003, ~, pp.Hankuk Munwhasa Press
  37. "The power of tests" (2001), Longman
  38. "Studies in Higher Education", pp.69~75 (1994)
  39. "Exploring the effectiveness of self-assessment strategies in ESL placement. Learner-directed assessment in ESL", pp.49~73 (2000), Lawrence Erlbaum Associates
  40. "Formative peer-assessment of academic writing between postgraduate students", pp.149~169 (2000)
  41. "The development of large-scale portfolio placement assessment at the University of Michigan: 1992- 1998", 6, pp.41~84 (1999)

관련 논문AI추천

Promoting Fairness in EFL Writing Assessment: Are There Any Effects of the Writers’ Awareness of the Rating Criteria?Nasim Ghanbari아시아테플 · Journal of Asia TEFL2019 · 제16권 제2호Peer Feedback Interactions in EFL Compositions: Written Feedback versus Oral FeedbackSuh, JaeSuk한국영어교육학회 · 영어교육2005 · 제60권 제3호Comparison of Grading Task Between ESL and Field Raters on Content-Field EssaysLee, Hee-Kyung한국영어교육학회 · 영어교육2004 · 제59권 제4호영작문 평가 상황에서 학생들의 평가 과정에 대한 연구이호팬코리아영어교육학회 · 영어교육연구2005 · 제17권 제3호The Effectiveness of Peer Feedback in Korean EFL Writing Classrooms조윤경팬코리아영어교육학회 · 영어교육연구2005 · 제17권 제4호Reliability of a Repeated Testing Design: a Handwritten and Computerized ESL Writing Test이호한국멀티미디어언어교육학회 · 멀티미디어 언어교육2004 · 제7권 제2호

이 간행물의 다른 논문 (12건)

An Analysis of Cross-cultural Practices of Communicative FunctionsKim, Jeong-ryeolpp. 3-16Factors Related to the Difficulty of College Scholastic Ability Test English Items진경애, 박정pp. 17-25A Comparative Study of the National English Curricula of Korea, China and Japan: Educational Policies and Practices in the Teaching of EnglishKim, Eun-Ju, Jeon, Jihyeonpp. 27-48The Effect of Elementary School English Education on Korean High School Students' English AbilitiesKwon, Oryangpp. 49-66Peer-assisted Learning: Implications for Content-based English Classes김성연pp. 67-89
원문 보기