Reactivity of Concurrent Verbal Reports in Second Language Acquisition Research: A Methodological Synthesis
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
As a research method to collect concurrent, real-time data about learners’ cognitive processes, concurrent verbal reports have been widely used in second language acquisition (SLA) research. However, concerns have also been expressed about their validity. A substantial number of studies in SLA have empirically investigated whether concurrent verbal reports are reactive (i.e., whether the act of verbalizing changes the thought processes under investigation) over the last fifteen years or so. Building upon the growing body of research syntheses in second language research (e.g., Plonsky, 2013), this paper presents a methodological synthesis which systematically reviews the primary empirical investigations into the reactivity of concurrent verbalization in SLA. Eighteen unique published study reports qualified for inclusion were retrieved. Each study report was then coded for methodological features related to sampling, study design, statistical analyses, and data reporting practices. The results indicate some strengths and a number of areas in need of attention and improvements in methodological practices and reporting transparency. In addition, the findings point to several directions for future empirical studies to advance our understanding of the important methodological issue of reactivity.
Abstract
As a research method to collect concurrent, real-time data about learners’ cognitive processes, concurrent verbal reports have been widely used in second language acquisition (SLA) research. However, concerns have also been expressed about their validity. A substantial number of studies in SLA have empirically investigated whether concurrent verbal reports are reactive (i.e., whether the act of verbalizing changes the thought processes under investigation) over the last fifteen years or so. Building upon the growing body of research syntheses in second language research (e.g., Plonsky, 2013), this paper presents a methodological synthesis which systematically reviews the primary empirical investigations into the reactivity of concurrent verbalization in SLA. Eighteen unique published study reports qualified for inclusion were retrieved. Each study report was then coded for methodological features related to sampling, study design, statistical analyses, and data reporting practices. The results indicate some strengths and a number of areas in need of attention and improvements in methodological practices and reporting transparency. In addition, the findings point to several directions for future empirical studies to advance our understanding of the important methodological issue of reactivity.
참고문헌 (49)
- Adrada-Rafael, S., "The Routledge handbook of second language research in classroom learning", pp.201~213 (2019), Routledge
- Barkaoui, K., "Think-aloud protocols in research on essay rating: An empirical study of their veridicality and reactivity", Language Testing, 28(1), pp.51~75 (2011)
- Bowles, M., "Task type and reactivity of verbal reports in SLA: A first look at a L2 task other than reading", Studies in Second Language Acquisition, 30(3), pp.359~387 (2008)
- Bowles, M., "The think-aloud controversy in second language research" (2010), Routledge
- Bowles, M., "Concurrent verbal reports in second language acquisition research", Annual Review of Applied Linguistics, 30, pp.111~127 (2010)
- Bowles, M., "The Routledge handbook of second language research in classroom learning", pp.31~43 (2019), Routledge
- Bowles, M., "Selected proceedings of the 2007 second language research forum" (2008), Cascadilla Proceedings Project
- Bowles, M., "Reactivity and type of verbal report in SLA research methodology: Expanding the scope of investigation", Studies in Second Language Acquisition, 27(4), pp.15~40 (2005)
- Cerezo, L., "Type and amount of input-based practice in CALI: The revelations of a triangulated research design", Language Learning &Technology, 20(1), pp.100~123 (2016)
- Cerezo, L., "Effectiveness of guided induction versus deductive instruction on the development of complex Spanish “gustar” structures: An analysis of learning outcomes and processes", Studies in Second Language Acquisition, 38, pp.265~291 (2016)
- Cooper, H., "The handbook of research synthesis", pp.3~14 (1994), Russell Sage Foundation
- Ericsson, K. A., "Protocol analysis: Verbal reports as data" (1993), MIT Press
- Goo, J., "Working memory and reactivity", Language Learning, 43, pp.245~254 (2010)
- Hama, M., "Learning without awareness revisited:Extending Williams (2005)", Studies in Second Language Acquisition, 32(3), pp.465~491 (2010)
- Keck, C., "Synthesizing research on language learning and teaching", pp.91~131 (2006), John Benjamins
- Kim, H. R., "How deeply do second language learners process written corrective feedback? Insights gained from think-alouds", TESOL Quarterly, 53(4), pp.913~938 (2019)
- Larson-Hall, J., "A guide to doing statistics in second language research using SPSS" (2010), Routledge
- Leow, R. P., "The role of attention in second", foreign language classroom research: Methodological issues, 1999, 60~71[DOI]
- Leow, R. P, "The Routledge handbook of second language research in classroom learning" (2019), Routledge
- Leow, R. P., "Concurrent data elicitation procedures, processes, and the early stages of L2 learning: A critical overview", Second Language Research, 30, pp.111~127 (2014)
- Leow, R. P., "To think aloud or not to think aloud:The issue of reactivity in SLA research methodology", Studies in Second Language Acquisition, 26(1), pp.35~57 (2004)
- Leung, J. H. C., "Constraints on implicit learning of grammatical form-meaning connections", Language Learning, 62(2), pp.634~662 (2011)
- Liu, Q., "Methodological synthesis of research on the effectiveness of corrective feedback in L2 writing", Journal of Second Language Writing, 30, pp.66~81 (2015)
- Mackey, A, "Conversational interaction in second language" (2007), Oxford University Press
- Marsden, E., "A methodological synthesis of self-paced reading in second language research", Applied Psycholinguistics, 39(5), pp.861~904 (2018)
- Medina, A., "The Routledge handbook of second language research in classroom learning", pp.183~216 (2019), Routledge
- Morgan-Short, K., "Allocation of attention to second language form and meaning: Issues of think-alouds and depth of processing", Studies in Second Language Acquisition, 34, pp.659~685 (2012)
- Norris, J. M., "Synthesizing research on language learning and teaching" (2006), John Benjamins
- Plonsky, L., "Study quality in SLA: An assessment of designs, analyses, and reporting practices in quantitative L2 research", Studies in Second Language Acquisition, 35(4), pp.655~687 (2013)
- Plonsky, L., "Study quality in quantitative L2 research (1990-2010): A methodological synthesis and call for reform", Modern Language Journal, 98, pp.450~470 (2014)
- Plonsky, L, "Quantitative research methods, study quality, and outcomes: The case of interaction research", Language Learning, 61, pp.325~366 (2011)
- Plonsky, L, "Task-based learner production: A substantive and methodological review", Annual Review of Applied Linguistics, 36, pp.73~97 (2016)
- Plonsky, L., "A methodological synthesis and meta-analysis of judgment tasks in second language research", Second Language Research, pp.1~39 (2019)
- Plonsky, L., "Advancing quantitative methods in second language research", pp.106~128 (2015), Routledge
- Rebuschat, P., "Triangulating measures of awareness: A contribution to the debate on learning without awareness", Studies in Second Language Acquisition, 37(2), pp.299~334 (2015)
- Rossomondo, A. E., "The role of lexical temporal indicators and text interaction format in the incidental acquisition of the Spanish future tense", Studies in Second Language Acquisition, 29(1), pp.39~66 (2007)
- Sachs, R., "Learners’ uses of two types of written feedback on an L2 writing revision task", Studies in Second Language Acquisition, 29(1), pp.67~100 (2007)
- Sachs, R., "Conversational interaction in second language acquisition:A collection of empirical studies", pp.197~227 (2007), Oxford University Press
- Sanz, C., "Concurrent verbalizations, pedagogical conditions, and reactivity: Two CALL studies", Language Learning, 59, pp.33~71 (2009)
- Stafford, C., "Optimizing language instruction: Matters of explicitness, practice, and cue learning", Language Learning, 62(3), pp.741~768 (2012)
- Stratman, J. F, "Speaking about writing: Reflections on research methodology", pp.89~112 (1994), Sage
- Suh, B-R., "A psycholinguistic approach to technology and language learning", pp.69~83 (2016), De Gruyter Mouton
- 서보람, "Textual Enhancement in L2 Spanish Learning: A Methodological Synthesis", 이중언어학, (78), pp.59~86 (2020), 이중언어학회[DOI]
- Swain, M., "Inference and generalizability in applied linguistics:Multiple perspectives", pp.97~103 (2006), John Benjamins
- Yang, C., "Reactivity of concurrent verbal reporting in second language writing", Journal of Second Language Writing, 24, pp.51~70 (2014)
- Yang, C., "The reactivity of think-alouds in writing research: Quantitative and qualitative evidence from writing in English as a foreign language", Reading and Writing, 33, pp.451~483 (2020)
- Yanguas, I., "Is thinking aloud reactive when writing in the heritage language?", Foreign Language Annals, 45(3), pp.380~399 (2012)
- Yoshida, M., "Selected proceedings of the 2007 second language research forum", pp.109~209 (2008), Cascadilla Proceedings
- Ziegler, N., "Synchronous computer-mediated communication and interaction: A meta-analysis", Studies in Second Language Acquisition, 38, pp.553~586 (2016)