Some Observations on the Construct Validity of Psycholinguistic Measures in Foreign Language Learning Research
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Psycholinguistic measures in the context of foreign language (L2) learning research isolate the phenomenon of interest from irrelevant factors and thereby increase the likelihood of scientific observations. This article is a critical review of the issues concerning the construct validity of some of the traditional measures, focusing specifically on three measurement variables: response time, eye movement, and dysfluency. The advantages and liabilities of several task types are discussed in some detail. Furthermore, two widely recognized problems in assessing and validating constructs, construct misrepresentation and intervention of extraneous variance, are recapitulated. In conclusion, it is suggested that a single measure cannot provide strong evidence for the explanandum in L2 research, and thus the triangulation of methodological tools in both their applications and interpretations should be given priority over efforts to extend their individual validity.
Abstract
Psycholinguistic measures in the context of foreign language (L2) learning research isolate the phenomenon of interest from irrelevant factors and thereby increase the likelihood of scientific observations. This article is a critical review of the issues concerning the construct validity of some of the traditional measures, focusing specifically on three measurement variables: response time, eye movement, and dysfluency. The advantages and liabilities of several task types are discussed in some detail. Furthermore, two widely recognized problems in assessing and validating constructs, construct misrepresentation and intervention of extraneous variance, are recapitulated. In conclusion, it is suggested that a single measure cannot provide strong evidence for the explanandum in L2 research, and thus the triangulation of methodological tools in both their applications and interpretations should be given priority over efforts to extend their individual validity.
참고문헌 (36)
- Interfaces between second language acquisition and language testing research, "Bachman, L. F.", Ernst Klett Sprachen, ~ (1998)
- Bachman, L. F., "Language assessment in practice: Developing language assessments and justifying their use in the real world" (2010), Oxford University Press
- Carroll, W. D., "Psychology of language" (2008), Thomson Wadsworth
- Chapelle, C. A., "Validity argument for language assessment", Language Testing, 29(1), pp.19~27 (2012)
- Clifton Jr, C., "Eye movements in reading and information processing: Keith Rayner’s 40 year legacy", Journal of Memory and Language, 86, pp.1~19 (2016)
- Clifton Jr, C., "Eye Movements", pp.341~371 (2007), Elsevier
- Crossley, S. A., "Predicting text comprehension, processing, and familiarity in adult readers: New approaches to readability formulas", Discourse Processes, 54(5-6), pp.340~359 (2017)
- Doughty, C. J., "Optimal psycholinguistic environments for distance foreign language learning", Language Learning & Technology, 7(3), pp.50~80 (2003)
- Ellis, A. W., "The psychology of language and communication" (2017), Routledge
- Eskildsen, S. W., "What counts as a developmental sequence? Exemplar‐based L2 learning of English questions", Language Learning, 65(1), pp.33~62 (2015)
- Felser, C., "Experimental psycholinguistic approaches to second language acquisition", Second Language Research, 21(2), pp.95~97 (2005)
- Ferreira, F., "The problem of comprehension in psycholinguistics", Discourse Processes, 56(7), pp.485~495 (2019)
- Firth, A., "On discourse, communication, and (some) fundamental concepts in SLA research", The Modern Language Journal, 81(3), pp.285~300 (1997)
- Garrod, S., "Language processing" (2016), Psychology Press
- Hino, Y., "Effects of polysemy in lexical decision and naming: An alternative to lexical access accounts", Journal of Experimental Psychology : Human Perception and Performance, 22(6), pp.1331~ (1996)
- Hoedemaker, R. S., "Planning and coordination of utterances in a joint naming task", Journal of Experimental Psychology: Learning, Memory, and Cognition, 45(4), pp.732~ (2019)
- Hyönä, J., "Morphological structure influences the initial landing position in words during reading Finnish", Quarterly Journal of Experimental Psychology, 71(1), pp.122~130 (2018)
- Kieras, D. E., "New methods in reading comprehension research" (2018), Routledge
- Koornneef, A., "On the shallow processing (dis-)advantage: Grammar and economy", Frontiers in Psychology, 7, pp.82~ (2016)
- Lafford, B. A., "Second language acquisition reconceptualized? The impact of Firth and Wagner (1997)", The Modern Language Journal, 91, pp.735~756 (2007)
- MacDonald, M. C., "Are There Really Syntactic Complexity Effects in Sentence Production? A Reply to Scontras et al. (2015)", Cognitive Science, 40(2), pp.513~518 (2016)
- McKoon, G., "Adults with poor reading skills, older adults, and college students: The meanings they understand during reading using a diffusion model analysis", Journal of Memory and Language, 102, pp.115~129 (2018)
- Messick, S., "Validity and washback in language testing", Language Testing, 13, pp.241~256 (1996)
- Monsell, S., "Task switching", Trends in Cognitive Sciences, 7(3), pp.134~140 (2003)
- Morsella, E., "Evidence for a cascade model of lexical access in speech production", Journal of Experimental Psychology: Learning, Memory, and Cognition, 28(3), pp.555~ (2002)
- Mueller, M. L., "The effect of identical word pairs on people's metamemory judgments: What are the contributions of processing fluency and beliefs about memory?", The Quarterly Journal of Experimental Psychology, 69(4), pp.781~799 (2016)
- Norris, J. M., "Effectiveness of L2 instruction: A research synthesis and quantitative meta‐analysis", Language learning, 50(3), pp.417~528 (2000)
- Poulisse, N., "Some words in defense of the psycholinguistic approach: A response to Firth and Wagner", The Modern Language Journal, 81(3), pp.324~328 (1997)
- Rebuschat, P., "Triangulating measures of awareness: A contribution to the debate on learning without awareness", Studies in Second Language Acquisition, 37(2), pp.299~334 (2015)
- Robinson, P., "Cognitive complexity and task sequencing: Studies in a componential framework for second language task design", IRAL-International Review of Applied Linguistics in Language Teaching, 43(1), pp.1~32 (2005)
- Skehan, P., "Second language task-based performance: Theory, research, assessment" (2018), Routledge
- Smith, C. M., "What does “it” mean, anyway? Examining the time course of semantic activation in reference resolution", Language, Cognition and Neuroscience, 34(1), pp.115~136 (2019)
- Su, S., "Improving the Predictive Validity of Reading Comprehension Using Response Times of Correct Item Responses", Applied Measurement in Education, 32(2), pp.166~182 (2019)
- Tremblay, A., "Processing advantages of lexical bundles: Evidence from self‐paced reading and sentence recall tasks", Language Learning, 61(2), pp.569~613 (2011)
- Trofimovich, P., "Applying priming methods to L2 learning, teaching and research: Insights from psycholinguistics (Vol. 30)" (2011), John Benjamins Publishing
- VanPatten, B., "Missing verbal inflections as a representational problem: Evidence from self-paced reading", Linguistic Approaches to Bilingualism, 2(2), pp.109~140 (2012)