Comparing Cross-disciplinary Test Takers’ Performance between Internet-based and Paper-based Diagnostic Writing Tests in EFL College English Classrooms
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
This study explores differences between EFL students’ performance in Internet-based and Paper-based Diagnostic Writing Tests. A recently developed e-learning app Rain Classroom is used to conduct the Internet-based diagnostic English writing test to 95 college students and an equivalent paper-based test is set for comparison. The students’ scores on these two tests are analyzed through t-test and no statistically significant difference is found between these two test modes, which implies that some new means should be worth trying for Internet-based diagnostic English writing assessment in college. However, to provide more precise suggestions, students in the study are further divided into three groups according to the disciplines to which they belong. With the aid of t-test and one-way ANOVA, it is revealed that students in the discipline of international business perform better in the Internet-based test, whereas students in the discipline of art design display a contrary tendency. Additionally, students from the discipline of urban planning demonstrate no salient performance difference between the two test modes. Therefore, some pedagogical implications are then made for the Internet-based diagnostic assessment for L2 college English writing.
Abstract
This study explores differences between EFL students’ performance in Internet-based and Paper-based Diagnostic Writing Tests. A recently developed e-learning app Rain Classroom is used to conduct the Internet-based diagnostic English writing test to 95 college students and an equivalent paper-based test is set for comparison. The students’ scores on these two tests are analyzed through t-test and no statistically significant difference is found between these two test modes, which implies that some new means should be worth trying for Internet-based diagnostic English writing assessment in college. However, to provide more precise suggestions, students in the study are further divided into three groups according to the disciplines to which they belong. With the aid of t-test and one-way ANOVA, it is revealed that students in the discipline of international business perform better in the Internet-based test, whereas students in the discipline of art design display a contrary tendency. Additionally, students from the discipline of urban planning demonstrate no salient performance difference between the two test modes. Therefore, some pedagogical implications are then made for the Internet-based diagnostic assessment for L2 college English writing.
참고문헌 (45)
- Alderson, C. J., "Diagnosing foreign language proficiency : The interface between learning and assessment" (2005), Bloomsbury Academic
- Alderson, J., "Can research into the diagnostic testing of reading in a second or foreign language contribute to SLA research?", EUROSLA Yearbook, 11, pp.30~52 (2011)
- Barkaoui, K., "Examining the impact of L2 proficiency and keyboarding skills on scores on TOEFL-iBT writing tasks", Language Testing, 31(2), pp.241~259 (2013)
- Barkaoui, K., "The effects of writing mode and computer ability on L2 test-takers’ essay characteristics and scores", Assessing Writing, 36, pp.19~31 (2018)
- Bourke, S., "University students’ writing : Types of errors and some comparisons across disciplines", Higher Education Research & Development, 11(2), pp.119~134 (1992)
- Brunfaut, T., "Going online : The effect of mode of delivery on performances and perceptions on an English L2 writing test suite", Assessing Writing, 36, pp.3~18 (2018)
- Chan, S., "Researching the comparability of paper-based and computer-based delivery in a high-stakes writing test", Assessing Writing, 36, pp.32~48 (2018)
- Chih-Ming Chen, "The effects of video-annotated listening review mechanism on promoting EFL listening comprehension", Interactive Learning Environments, 29(1), pp.83~97 (2021), Informa UK Limited[DOI]
- Jing Cheng, "Attitudes Towards English Language Learning Apps from Korean and Chinese EFL Students", 영어교육, 74(4), pp.205~224 (2019), 한국영어교육학회
- Choi, I. -C., "Efficacy of an ICALL tutoring system and process-oriented corrective feedback", Computer Assisted Language Learning, 29(2), pp.334~364 (2016)
- Peter Crosthwaite, "An error analysis of L2 English discourse reference through learner corpora analysis", 언어연구, 30(2), pp.163~193 (2013), 언어정보연구소[DOI]
- de Chazal, E., "English for academic purposes: A comprehensive overview of EAP and how it is best taught and learnt in a variety of academic contexts (Oxford handbooks for language teachers)" (2014), Oxford University Press
- Ebadi, S., "An exploration into EFL learners’ writing skills via mobile-based dynamic assessment", Education and Information Technologies, 26(2), pp.1995~2016 (2020)
- Fernando, W., "Show me your true colours : Scaffolding formative academic literacy assessment through an online learning platform", Assessing Writing, 36, pp.63~76 (2018)
- Gardner, S., "Discipline, level, genre : Integrating situational perspectives in a new MD analysis of university student writing", Applied Linguistics, 40(4), pp.646~674 (2019)
- Gikandi, J., "Online formative assessment in higher education : A review of the literature", Computers & Education, 57(4), pp.2333~2351 (2011)
- Gu, Y. H., "Enhancement of college English teachers’ information literacy in information environment", International Education Studies, 13(4), pp.106~112 (2020)
- Gregg, N., "Timed essay writing : Implications for high-stakes tests", Journal of Learning Disabilities, 40(4), pp.306~318 (2007)
- Ken Hyland, "As can be seen: Lexical bundles and disciplinary variation", English for Specific Purposes, 27(1), pp.4~21 (2008), Elsevier BV[DOI]
- Jacobs, C., "Testing ESL composition: a practical approach" (1981), Newbury House
- Jin, Y., "Computer literacy and the construct validity of a high-stakes computer-based writing assessment", Language Assessment Quarterly, 14(2), pp.101~119 (2017)
- Jones, C., "Are students’ learning styles discipline specific?", Community College Journal of Research and Practice, 27(5), pp.363~375 (2003)
- 김혜영, "Exploring Smartphone Applications for Effective Mobile-Assisted Language Learning", 멀티미디어 언어교육, 15(1), pp.31~57 (2012), 한국멀티미디어언어교육학회[DOI]
- Kim, H. R., "Examining the comparability between paper-and computer-based versions of an integrated writing placement test", Assessing Writing, 36, pp.49~62 (2018)
- Knoch, U., "Diagnostic assessment of writing : A comparison of two rating scales", Language Testing, 26(2), pp.275~304 (2009)
- 이영주, "The Potential of Automated Writing Evaluation Feedback in the Korean University Context", 멀티미디어 언어교육, 23(4), pp.91~108 (2020), 한국멀티미디어언어교육학회[DOI]
- Lee, Y. -W., "Diagnosing diagnostic language assessment", Language Testing, 32(3), pp.299~316 (2015)
- Li, H., "A comparison of EFL raters’ essay-rating processes across two types of rating scales", Language Assessment Quarterly, 12(2), pp.178~212 (2015)
- Li, J., "Learning vocabulary via computer-assisted scaffolding for text processing", Computer Assisted Language Learning, 23(3), pp.253~275 (2010)
- Li, J. L., "Establishing comparability across writing tasks with picture prompts of three alternate tests", Language Assessment Quarterly, 15(4), pp.368~386 (2018)
- Li, X. M., "Mobile technology affordance and its social implications: A case of “Rain Classroom”", British Journal of Educational Technology, 49(2), pp.276~291 (2018)
- Mohamadi, Z., "Comparative effect of online summative and formative assessment on EFL student writing ability", Studies in Educational Evaluation, 59, pp.29~40 (2018)
- Mohammadi, M., "Comparability of computer-based and paper-based versions of writing section of PET in Iranian EFL context", The Journal of Applied Linguistics, 3(2), pp.144~167 (2010)
- Qian, L., "Evaluating China’s automated essay scoring system iWrite", Journal of Educational Computing Research, 58(4), pp.771~790 (2019)
- Rad, H. S., "Exploring use of mobile-mediated hybrid dynamic assessment in improving EFL learners' descriptive writing skills", Computer Assisted Language Learning Electronic Journal, 22(1), pp.111~132 (2021)
- Ranalli, J., "Exploring the potential of process-tracing technologies to support assessment for learning of L2 writing", Assessing Writing, 36, pp.77~89 (2018)
- Schuck, S., "Exploring mobile learning in the Third Space", Technology, Pedagogy and Education, 26(2), pp.121~137 (2017)
- Taylor, C., "Examining the relationship between computer familiarity and performance on computer-based language tasks", Language Learning, 49(2), pp.219~274 (1999)
- Thomas, N., "Idea sharing: Are analytic assessment scales more appropriate than holistic assessment scales for L2 writing and speaking?", PASAA, 59, pp.236~251 (2020)
- Uğur, N. G., "Mobile phones as distracting tools in the classroom : College students perspective", Alphanumeric Journal, 3(2), pp.57~64 (2015)
- Wang, S., "Rain Classroom facilitating commencing the era of smart teaching", Modern Educational Technology, 27, pp.26~32 (2017)
- Weir, C. J., "Establishing test form and individual task comparability : A case study of a semi-direct speaking test", Language Testing, 23(2), pp.167~197 (2006)
- Zhang, H. B., "Application of Rain Classroom to college English writing", Journal of Physics : Conference Series, 1486, pp.1~10 (2020)
- Zhang, L., "Rain Classroom-based smart class construction : Taking advanced business English courses as an example", Social Sciences, 9(4), pp.98~101 (2020)
- Zhang, Z. V., "Student engagement with teacher and automated feedback on L2 writing", Assessing Writing, 36, pp.90~102 (2018)
