Analyzing Sentiment and Syntactic Complexity in L2 Writing: A Computational Approach
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This study investigated the effect of sentiment in second language (L2) writing prompts on the syntactic complexity and emotionality in essays written by English as a Foreign Language (EFL) learners. The research analyzed a dataset of 1,004 essays written by Korean adolescent students to examine the relationship between the sentiment scores of writing prompts and learner essays. The study used computational tools to measure various dimensions of syntactic complexity. The findings indicated that the sentiment of writing prompts is a significant predictor of the emotionality scores of L2 students' essays. The positive correlation suggested that more positive prompts are more likely to elicit overall more positive essays. Additionally, the study identified significant differences in baseline sentiment values between writing prompts and learner essays. Even when responding to highly negative prompts, L2 students tended to use neutral sentiment in their essays. This study demonstrated how emotional prompts can impact cognitive load, resulting in simpler syntactic structures. It also highlighted the potential risks in educational assessment due to construct-irrelevant variance. Among the indices used to measure syntactic complexity, mean length of clauses (MLC) and coordinate phrases per clause (CP/C) showed significant effects influenced by the emotionality of writing prompts and learner essays. The implications of this study are discussed.
Abstract
This study investigated the effect of sentiment in second language (L2) writing prompts on the syntactic complexity and emotionality in essays written by English as a Foreign Language (EFL) learners. The research analyzed a dataset of 1,004 essays written by Korean adolescent students to examine the relationship between the sentiment scores of writing prompts and learner essays. The study used computational tools to measure various dimensions of syntactic complexity. The findings indicated that the sentiment of writing prompts is a significant predictor of the emotionality scores of L2 students' essays. The positive correlation suggested that more positive prompts are more likely to elicit overall more positive essays. Additionally, the study identified significant differences in baseline sentiment values between writing prompts and learner essays. Even when responding to highly negative prompts, L2 students tended to use neutral sentiment in their essays. This study demonstrated how emotional prompts can impact cognitive load, resulting in simpler syntactic structures. It also highlighted the potential risks in educational assessment due to construct-irrelevant variance. Among the indices used to measure syntactic complexity, mean length of clauses (MLC) and coordinate phrases per clause (CP/C) showed significant effects influenced by the emotionality of writing prompts and learner essays. The implications of this study are discussed.
참고문헌 (48)
- Abdi Tabari, M., "The effects of prompt types on L2 learners’ textual emotionality and lexical complexity", Journal of Second Language Studies, 5(1), pp.34~57 (2022)
- Andringa, S., "Determinants of success in native and non-native listening comprehension : An individual differences approach", Language Learning, 62, pp.49~78 (2012)
- Bach, D. R., "Algorithms for survival : A comparative perspective on emotions", Nature Reviews Neuroscience, 18(5), pp.311~319 (2017)
- Balahur, A., "Computational approaches to subjectivity and sentiment analysis : Present and envisaged methods and applications", Computer Speech & Language, 28(1), pp.1~6 (2014)
- (2015)[URL]
- Clachar, A., "It’s not just cognition : The effect of emotion on multiple-level discourse processing in second-language writing", Language Sciences, 21(1), pp.31~60 (1999)
- Crossley, S. A., "Text readability and intuitive simplification : A comparison of readability formulas", Reading in a Foreign Language, 23(1), pp.84~101 (2011)
- Crossley, S. A., "A large-scaled corpus for assessing text readability", Behavioral Research Methods, 55, pp.491~507 (2023)
- Crossley, S. A., "Sentiment Analysis and Social Cognition Engine(SEANCE) : An automatic tool for sentiment, social cognition, and social-order analysis", Behavior Research Methods, 49, pp.803~821 (2017)
- Crossley, S., "Argumentation features and essay quality : Exploring relationships and incidence counts", Journal of Writing Research, 14(1), pp.1~34 (2022)
- Dewaele, J. M., "Does the effect of enjoyment outweigh that of anxiety in foreign language performance?", Studies in Second Language Learning and Teaching, 8(1), pp.21~45 (2018)
- Dewaele, J. M., "Emotion vocabulary in interlanguage", Language Learning, 52(2), pp.263~322 (2002)
- Dong, Y., "A study on the relationship between syntactic complexity and quality of English argumentative writing based on syntactic analysis tool TAASSC", Proceedings of the 3rd International Conference on Internet Technology and Educational Informatization, pp.1~10 (2024), EAI
- Ellis, N. C., "Frequency effects in language acquisition : A review with implications for theories of implicit and explicit language acquisition", Studies in Second Language Acquisition, 24, pp.143~188 (2002)
- Goldberg, A. E., "Constructions: A construction grammar approach to argument structure" (1995), University of Chicago Press
- Hwang, Eunkyung, "Syntactic complexity EFL learners’ argumentative writing", Modern English Education, 13(2), pp.123~143 (2013)
- Kaur, J., "Emotion detection and sentiment analysis in text corpus : A differential study with informal and formal writing styles", International Journal of Computer Applications, 101(9), pp.1~9 (2014)
- Kean, D. K., "Writing persuasive documents : The role of students’ verbal aptitude and evaluation anxiety", The Journal of Experimental Education, 55(2), pp.95~102 (1987)
- Kormos, J., "The role of individual differences in L2 writing", Journal of Second Language Writing, 21(4), pp.390~403 (2012)
- Krashen, S. D., "The “fundamental pedagogical principle” in second language teaching", Studia Linguistica, 35(1‐2), pp.50~70 (1981)
- "lmerTest: Tests in linear mixed effects models. R package version 2.0-29" (2015)[URL]
- Kyle, K., "Assessing syntactic sophistication in L2 writing : A usage-based approach", Language Testing, 34(4), pp.513~535 (2017)
- Kyle, K., "Measuring syntactic complexity in L2 writing using fine-grained clausal and phrasal indices", The Modern Language Journal, 102(2), pp.333~349 (2018)
- Kyle, K., "Measuring longitudinal writing development using indices of syntactic complexity and sophistication", Studies in Second Language Acquisition, 43(4), pp.781~812 (2021)
- Langacker, R. W., "Cognitive(construction)grammar", Cognitive Linguistics, 20(1), pp.167~176 (2009)
- Li, L., "How textual quality of online reviews affect classification performance : A case of deep learning sentiment analysis", Neural Computing and Applications, 32, pp.4387~4415 (2020)
- Liu, B., "Sentiment analysis and opinion mining" (2012), Morgan & Claypool Publishers
- Liu, B., "Sentiment analysis: Mining opinions, sentiments, and emotions" (2015), Cambridge University Press
- Llanes, À., "Examining the role of learning context and individual differences in gains in L2 writing performance : The case of teenagers on an intensive study-abroad programme", The Language Learning Journal, 46(2), pp.201~216 (2018)
- Lu, X., "Automatic analysis of syntactic complexity in second language writing", International Journal of Corpus Linguistics, 15(4), pp.474~496 (2010)
- Lu, X., "A Corpus-based evaluation of syntactic complexity measures as indices of college-level ESL writers’ language development", TESOL Quarterly, 45(1), pp.36~62 (2011)
- MacIntyre, P. D., "The subtle effects of language anxiety on cognitive processing in the second language", Language Learning, 44(2), pp.283~305 (1994)
- Norris, J. M., "Towards an organic approach to investigating CAF in instructed SLA : The case of complexity", Applied Linguistics, 30(4), pp.555~578 (2009)
- Ortega, L., "Syntactic complexity measures and their relationship to L2 proficiency : A research synthesis of college-level L2writing", Applied Linguistics, 24(4), pp.492~518 (2003)
- Pang, B., "Opinion mining and sentiment analysis", Foundations and Trends® in Information Retrieval, 2(1-2), pp.1~135 (2008)
- Park, S., "Syntactic complexity of EFL learners’ casual conversation, monologue, and writing", The Journal of Studies in Language, 37(1), pp.75~89 (2021)
- Pekrun, R., "The control-value theory of achievement emotions : Assumptions, corollaries, and implications for educational research and practice", Educational Psychology Review, 18, pp.315~341 (2006)
- Pekrun, R., "Academic emotions in students' self-regulated learning and achievement : A program of qualitative and quantitative research", Educational Psychologist, 37(2), pp.91~105 (2002)
- Pishghadam, R., "A quantitative analysis of the relationship between emotional intelligence and foreign language learning", Electronic Journal of Foreign Language Teaching, 6(1), pp.31~41 (2009)
- Provoost, S., "Validating automated sentiment analysis of online cognitive behavioral therapy patient texts : An exploratory study", Frontiers in Psychology, 10 (2019)[DOI]
- "R: A language and environment for statistical computing" (2024)[URL]
- Slavkov, N., "Sociocultural theory, the L2 writing process, and google drive: Strange bedfellows?", TESL Canada Journal, 32(2), pp.80~94 (2015)
- Stone, P. J., "The general inquirer : A computer system for content analysis and retrieval based on the sentence as a unit of information", Behavioral Science, 7(4), pp.484~498 (1962)
- Storch, N., "Written corrective feedback from sociocultural theoretical perspectives : A research agenda", Language Teaching, 51(2), pp.262~277 (2018)
- Thongyoi, K., "Phrasal complexity measures as predictors of EFL university students’ English academic writing proficiency", Reflections, 27(1), pp.44~61 (2020)
- Wang, Y., "Emotion and syntactic complexity in L2 writing : A corpus-based study on Chinese college-level students’ English writing", The Asian Journal of Applied Linguistics, 7(1), pp.1~17 (2020)
- Wind, A. M., "DEAL 2020: A snapshot of diversity in applied linguistics", pp.39~70 (2020), Eötvös University Press
- Wolfe-Quintero, K., "Second language development in writing: Measures of fluency, accuracy, &complexity" (1998), University of Hawaii
