Agreement rates between automated essay scoring systems and human raters: Meta-analysis

키워드

참고문헌 (53)

1. Attali, Y., "Exploring the feedback and revision features of Criterion", Paper presented at the National Council on Measurement in Education (NCME) (2004)
2. Attali, Y., "Automated essay scoring with e-raterⓇ V. 2", Journal of Technology, Learning, and Assessment, 4(3), pp.1~29 (2006)
3. Bennett, R. E., "Technology and writing assessment: lessons learned from the US national assessment of educational progress", Annual Conference of the International Association for Educational Assessment (2006)
4. Bereiter, C., "Automated essay scoring: A cross disciplinary approach (vii–ix)" (2003), Lawrence Erlbaum Associates
5. Bergstrom, B., "Ability measure equivalence of computer adaptive and pencil and paper tests: A research synthesis", Paper presented at the annual meeting of the American Educational Research Association (1992)
6. Borenstein, M., "Introduction to meta-anaylsis" (2009), Wiley
7. Burstein, J., "Automatedessay scoring for nonnative English speakers", Proceedings of the ACL99 Workshop on Computer-Mediated Language Assessment and Evaluation of Natural Language Processing (1999)
8. Burstein, J., "Computer analysis of essays", Proceedings of the NCME Symposium on Automated Scoring (1998)
9. Enriching automated essay scoring using discourse marking, "Burstein, J.", ~ (2001)
10. Card, N. A., "Applied meta-analysis for social science research" (2011), The Guilford Press
11. Chen, Y., "An unsupervised automated essay scoring system", Intelligent Sytems, IEEE, 25(5), pp.61~67 (2010)
12. Beyond essay length: Evaluating e-rater’s performance on TOEFL essays, "Chodorow, M.", ETS, ~, pp.RR-04-04. (2004)
13. Chung, G. K., "Methodological approaches to online scoring of essays" (1997)
14. Coniam, D., "Experimenting with a computer essay-scoring program based on ESL student writing scripts", ReCALL, 212(2), pp.259~279 (2009)
15. Cooper, H. M., "Research synthesis and meta-analysis : A step-by-step approach" (2010), Sage
16. Dikli, S., "An overview of automated scoring of essays", Journal of Technology, Learning, and Assessment, 5(1), pp.1~34 (2006)
17. Elliot, S., "Automated essay scoring: A cross disciplinary approach", pp.71~86 (2003), Lawrence Erlbaum Associates
18. Enright, M. K., "Complementing human judgment of essays written by English language learners with e-rater scoring", Language Testing, 27, pp.317~334 (2010)
19. Hamp-Lyons, L., "On second language writing" (2001), Lawrence Erlbaum Associates, Inc
20. Hedges, L. V., "Statistical methods for meta-analysis" (1985), Academic Press
21. Higgins, J., "Cochrane handbook for systematic review of interventions", John Wiley & Sons (2009)
22. Hutchison, D., "An evaluation of computerized essay marking for national curriculum assessment in the UK for 11-year-olds", British Journal of Educational Technology, 38(6), pp.977~989 (2007)
23. Kelly, P. A., "Computerizing scoring of essays for analytical writing", Paper presented at the Annual Meeting of the National Council on Measurement in Education (2001)
24. Kelly, P. A., "Review of the book automated essay scoring : A cross-disciplinary perspective", Applied Psychological Measurement, 30(1), pp.66~68 (2006)
25. Kim, J., "Meta-analysis of equivalence of computerized and P&P tests on ability measures", Paper presented at the annual meeting of the Mid-Western Educational Research Association (1999)
26. Landauer, T. K., "Automated essay scoring: A cross-disciplinary perspective", pp.87~112 (2003), Lawrence Erlbaum Associates
27. Landauer, T. K., "How well can passage meaning be derived without using word order? A comparison of Latent Semantic Analysis and humans", Proceedings of the 19th Annual Conference of the Cognitive Science Society, pp.412~417 (1997)
28. Larkey, L. S., "Automatic essay grading using text categorization techniques", Proceedings of the 21st ACM-SIGIR Conference on Research and Development in Information Retrieval (90-95) (1998)
29. Lonsdale, D., "Automated rating of ESL essays" (2003)
30. The equivalence of scores from automated and conventional educational and psychological tests: A review of the literature, "Mazzeo, J.", Educational Testing Service, ~, pp.College Board Rep. No. 88-8, ETS RR No. 88-21 (1988)
31. McCurry, D., "Can machine scoring deal with broad and open writing tests as well as human readers?", Assessing Writing, 15, pp.118~129 (2010)
32. Mead, A. D., "Equivalence of computerized and paper-and-pencil cognitive ability tests : A meta-analysis", Psychological Bulletin, 9, pp.287~304 (1993)
33. Nichols, P. D., "Evidence for the interpretation and use of scores from an automated essay scorer", Paper presented at the Annual Meeting of the American Educational Research Association (AERA) (2004)
34. Evidence for the interpretation and use of scores from an automated essay scorer, "Nichols, P. D.", Pearson Educational Measurement, ~, pp.Research Report. RR-05-02 (2005)
35. Page, E. B., "Automated essay scoring: A cross-disciplinary perspective" (2003), Lawrence Erlbaum Associates
36. Page, E. B., "The computer moves into essay grading : updating the ancient test", Phi Delta Kappa, 76, pp.561~565 (1995)
37. Evaluation of the e-rater scoring engine for the GRE issue and argument prompts, "Raminenia, C.", ETS, ~, pp.Research Report, RR-12-06 (2012)
38. Evaluation of the e-rater scoring engine for the TOEFL independent and integrated prompts, "Raminenia, C.", ETS, ~, pp.Research Report, RR-12-02 (2012)
39. Rudner, L., "An overview of three approaches to scoring written essays by computer" (2001)
40. Shermis, M., "Exit assessments: Evaluating writing ability through automated essay scoring" (2002)
41. Shermis, M., "Automated essay scoring : A cross disciplinary perspective." (2003), Lawrence Erlbaum Associates
42. Sirin, S. R., "Socioeconomic status and academic achievement : A meta-analytic review of research", Review of Educational Research, 75(3), pp.417~453 (2005)
43. A study of expert scoring and IntelliMetric scoring accuracy for dimensional scoring of grade 11 student writing responses, "Vantage Learning.", ~, pp.RB-397 (2000)
44. A true score study of IntelliMetric accuracy for holistic and dimensional scoring of college entry-level writing program, "Vantage Learning", ~, pp.RB-407 (2000)
45. Vantage Learning., "About IntelliMetric" (2001), Vantage Learning
46. Applying IntelliMetric technology to the scoring of 3rd and 8th grade standardized writing assessments, "Vantage Learning.", ~, pp.RB-524 (2001)
47. A study of expert scoring, standard human scoring and IntelliMetric scoring accuracy for statewide eighth grade writing responses, "Vantage Learning.", ~, pp.RB-726 (2002)
48. Assessing the accuracy of IntelliMetric for scoring a district-wide writing assessment, "Vantage Learning.", ~, pp.RB-806 (2003)
49. How does IntelliMetric score essay responses?, "Vantage Learning.", ~, pp.RB-929 (2003)
50. A true score study of 11th grade student writing responses using IntelliMetric version 9.0, "Vantage Learning.", ~, pp.RB-786) (2003)
51. Wang, S., "A meta-analysis of testing mode effects in grade K–12 mathematics tests", Educational and Psychological Measurement, 67, pp.219~238 (2007)
52. Wang, S., "Comparability of computer-based and paper-and-pencil testing in K-12 reading assessment : A meta-analysis of testing mode effects", Educational and Psychological Measurement, 68(1), pp.5~24 (2008)
53. Yang, Y., "A review of strategies for validating computer-automated scoring", Applied Measurement in Education, 15, pp.391~412 (2002)

관련 논문AI추천