Different Chat Modes of a Chatbot and EFL Students’ Writing Skills Development
2
조회
0
다운로드
14
인용
0
참고문헌
키워드
초록
The purpose of this study was to investigate the relationship between different chat modes of a chatbot and EFL writing. 46 Korean students, with intermediate-level of proficiency, participated in the current study. Over the 10-week experiment, all participants were divided into two groups and they joined in interactive communications for ten minutes every day with two different chat modes - text-chat and voice-chat - of a chatbot. Based on TOEIC writing tests, pre- and post-writing tests were administered with two task types: descriptive writing and argumentative writing. In order to further compare these group's differences in affective factors, a questionnaire-based survey was conducted to measure the affective factors in regard to self-esteem, self-perception, and interest. T-test and ANCOVA results displayed that engaging in both text-chat and voice-chat, with a chatbot, was beneficial. In descriptive writing, the voice-chat group outperformed the text-chat group. However, in argumentative writing, the text-chat group performed better than the voice-chat group. In terms of the affective factors, participants in the text-chat group responded more positively to self-perception than did the voice-chat group. Whereas, the voice-chat group showed more interest than did the text-chat group. Based on these results, both pedagogical implications and suggestions are made.
Abstract
The purpose of this study was to investigate the relationship between different chat modes of a chatbot and EFL writing. 46 Korean students, with intermediate-level of proficiency, participated in the current study. Over the 10-week experiment, all participants were divided into two groups and they joined in interactive communications for ten minutes every day with two different chat modes - text-chat and voice-chat - of a chatbot. Based on TOEIC writing tests, pre- and post-writing tests were administered with two task types: descriptive writing and argumentative writing. In order to further compare these group's differences in affective factors, a questionnaire-based survey was conducted to measure the affective factors in regard to self-esteem, self-perception, and interest. T-test and ANCOVA results displayed that engaging in both text-chat and voice-chat, with a chatbot, was beneficial. In descriptive writing, the voice-chat group outperformed the text-chat group. However, in argumentative writing, the text-chat group performed better than the voice-chat group. In terms of the affective factors, participants in the text-chat group responded more positively to self-perception than did the voice-chat group. Whereas, the voice-chat group showed more interest than did the text-chat group. Based on these results, both pedagogical implications and suggestions are made.
참고문헌 (46)
- Abrams, Z. I., "The effect of synchronous and asynchronous CMC on oral performance in German", Modern Language Journal, 87(2), pp.157~167 (2003)
- Bae, J., "An investigation of four writing traits and two tasks across two languages", Language Testing, 27(2), pp.213~234 (2010)
- Barkhuizen, G. P., "Discovering learners' perceptions of ESL classroom teaching", learning activities in a South African context, 1998, pp.32(1), 85~108
- Beauvois, M. H., "New ways of learning and teaching:Issues in language program direction", pp.93~115 (1997), Heinle &Heinle
- Chiu, T. -S., "A study of web-based oral activities enhanced by automatic speech recognition for EFL college learning", Computer-Assisted Language Learning, 20(3), pp.209~234 (2007)
- Clark, J., "College students’ knowledge and beliefs: A survey of global understanding", pp.87~100 (1981), Change Magazine Press
- Coniam, D., "Evaluating the language resources of chatbots for their potential in English as a second language", ReCALL Journal, 20(1), pp.98~116 (2008)
- Dastjerdi, H. V., "Quality of Iranian EFL learners’argumentative essays: Cohesive devices in focus", Mediterranean Journal of Social Sciences, 2(2), pp.65~76 (2011)
- Derwing, T. M., "Second language fluency: Judgments on different tasks", Language Learning, 54(4), pp.655~679 (2004)
- Field, Y., "A comparison of internal conjunctive cohesion in English essay writing of Cantonese speakers and native speakers of English", RELC Journal, 23(1), pp.15~28 (1992)
- Floridi, L., "Turing’s imitation game : Still an impossible challenge for all machines and some judges? An evaluation of the 2008 Loebner Contest", Minds and Machines, 19(1), pp.145~150 (2009)
- Fryer, L., "Bots as language learning tools", Language Learning & Technology, 10(3), pp.8~14 (2006)
- Gilmore, A., "Using online corpora to develop students' writing skills", ELT Journal, 63(4), pp.363~372 (2008)
- Halliday, M., "Cohesion in English" (1976), Longman
- 한종임, "The Effects of Post-Task CMC Activities and Task Types on Korean EFL Learners’ Oral Performance", 영상영어교육, 17(2), pp.107~133 (2016), 영상영어교육학회[DOI]
- Hassan, B. A., "The relationship of writing apprehension and self-esteem to the writing quality and quantity of EFL university students", ERIC Document, 7(3), pp.2~39 (2001)
- Hinkel, E., "Second language writers’ text" (2002), Erlbaum
- Holland, V. M., "Preliminary tests of language learning in a speech-interactive graphics microworld", CALICO Journal, 16(3), pp.339~359 (1999)
- Hughes, A., "Testing for English teachers" (2003), Cambridge University Press
- Hyland, K., "Second language writing" (2003), Cambridge University Press
- Jia, J., "CSIEC : A computer assisted English learning chatbot based on textual knowledge and reasoning", Knowledge-Based Systems, 22(4), pp.249~255 (2009)
- Kerly, A., "Bringing chatbots into education : Towards natural language negotiation of open learner models", Knowledge-based Systems, 20(2), pp.177~185 (2007)
- Kim, N. -Y., "Effects of different voice-chat conditions on Korean EFL learners’ speaking ability, oral interaction, and affective factors", doctoral, pp.2016
- 김나영, "Effects of Different Types of Chatbots on EFL Learners' Speaking Competence and Learner Perception", 비교문화연구, 48, pp.223~252 (2017), 비교문화연구소[DOI]
- 김나영, "Effects of Different Types of Text-Based Chat on Korean EFL Students’ Writing Performance", 언어, 42(3), pp.277~301 (2017), 한국언어학회[DOI]
- 김태영, "The Dynamics of L2 Self and L2 Learning Motivation: A Qualitative Case Study of Korean ESL Students", 영어교육, 64(3), pp.133~154 (2009), 한국영어교육학회[DOI]
- Kitano, K., "Anxiety in the college Japanese language classroom", The Modern Language Journal, 85, pp.549~566 (2001)
- 이희경, "An Exploratory Study on an English Diagnostic Test of Speaking and Writing Skills for Korean College Freshmen", 영어교육, 64(4), pp.269~290 (2009), 한국영어교육학회[DOI]
- Lehtinen, B., "Accessing language using online chatbots", Peer Spectives, 1, pp.3~6 (2008)
- Liao, C. W., "TOEIC listening and reading test scale anchoring study" (2010), Educational Testing Service
- Liao, C. W., "The relationships of test scores measured by the TOEIC listening and reading test and TOEIC speaking and writing tests" (2010), Educational Testing Service
- Light, R., "Making the most of college" (2001), Harvard University Press
- Luo, Q., "The effects of data-driven learning activities on EFL learners’writing development", Springer Plus, 5(1), pp.1255~ (2016)
- Shah, H., "Can machines talk? Comparison of Eliza with modern dialogue systems", Computers in Human Behavior, 58, pp.278~295 (2016)
- Shawar, B. A., "Chatbots: Are they really useful?", LDV Forum, 22(1), pp.29~49 (2007)
- Stewart, I. A., "Let’s chat: A conversational dialogue system for second language practice", Computer-Assisted Language Learning, 20(2), pp.97~116 (2007)
- Swain, M., "Input in second language acquisition", pp.235~253 (1985), Newbury House
- Takahashi, A., "Self-perception of English ability: Is it related to proficiency and", or class performance?, 2009, pp.14, 39~48
- Walker, A., "Technology enhanced language learning: Connecting theory and practice" (2013), Oxford University Press
- Wang, Y., "Designing chatbot interfaces for language learning:ethnographic research into affect and users' experiences", doctoral, pp.2008
- Wang, Y., "Using learning analytics to understand the design of an intelligent language tutor? Chatbot Lucy", International Journal of Advanced Computer Science and Applications, 4(11), pp.124~131 (2013)
- Weizenbaum, J., "ELIZA – A computer program for the study of natural language communication between man and machine", Communications of the ACM, 9(1), pp.36~45 (1966)
- Westlund, J. K., "Telling stories with green the DragonBot: A showcase of children's interactions over two months", Paper presented at the conference on HRI '15 (2015)
- Zakos, J., "Proceedings of 5th Hellenic Conference on Artificial Intelligence", pp.437~442 (2008), Springer
- Zhang, X., "Dealing with learner reticence in the speaking class", ELT Journal, 64(1), pp.1~9 (2010)
