본문 바로가기
KERD
논문KCI 등재

Individual Differences in the Expectation-based Comprehension: An ERP Study

남윤주|Hongoak Yun|Dongsu Lee
인지과학연구소 (Institute of Cognitive Science)|2022.03|Journal of Cognitive Science|제23권 제1호|pp. 57-94|DOI 10.17791/jcs.2022.23.1.57

2

조회

0

다운로드

1

인용

0

참고문헌

키워드

working memory capacityexpectationword predictabilityindividual differencesrole predictabilityKorean dative sentences

초록

Readers’ active use of linguistic cues from a given context elicits anticipatory processing of yet-to-be-encountered information. In this study, we aimed to examine whether the patterns of anticipatory comprehension would systematically differ by the degree of readers’ working memory capacity. Readers’ evoked responses potentials (ERPs) in response to words were recorded in the processing of Korean dative sentences (i.e., subject+[recipient+theme]/[theme-recipient]+adverb+verb) in which the presentation order of arguments (i.e., role predictability) and the likelihood corresponding to argument role fillers (i.e., word predictability) were manipulated. We found quantitative and qualitative differences in ERPs among readers during sentence comprehension. The N400 emerged in the integration of unpredictable words, and it occurred more frequently among readers with low working memory. Of our interest, we observed the asymmetrical distribution of the negativity and the positivity, attributable to the differences in readers’ working memory, at adverbs and verbs in which readers were busy with integrating previously-presented arguments into sentences and processing incoming words. Our results suggested that readers with low working memory are more involved in the lexical retrieval process, whereas those with high working memory are more attentive to the structural or semantic integration process. In short, we argued that the lack of working memory capacity could make readers fall behind in using lexical and structural information during sentence processing, particularly for argument integration.

Abstract

Readers’ active use of linguistic cues from a given context elicits anticipatory processing of yet-to-be-encountered information. In this study, we aimed to examine whether the patterns of anticipatory comprehension would systematically differ by the degree of readers’ working memory capacity. Readers’ evoked responses potentials (ERPs) in response to words were recorded in the processing of Korean dative sentences (i.e., subject+[recipient+theme]/[theme-recipient]+adverb+verb) in which the presentation order of arguments (i.e., role predictability) and the likelihood corresponding to argument role fillers (i.e., word predictability) were manipulated. We found quantitative and qualitative differences in ERPs among readers during sentence comprehension. The N400 emerged in the integration of unpredictable words, and it occurred more frequently among readers with low working memory. Of our interest, we observed the asymmetrical distribution of the negativity and the positivity, attributable to the differences in readers’ working memory, at adverbs and verbs in which readers were busy with integrating previously-presented arguments into sentences and processing incoming words. Our results suggested that readers with low working memory are more involved in the lexical retrieval process, whereas those with high working memory are more attentive to the structural or semantic integration process. In short, we argued that the lack of working memory capacity could make readers fall behind in using lexical and structural information during sentence processing, particularly for argument integration.

참고문헌 (99)

  1. Akeroyd M. A., "Are individual differences in speech reception related to individual differences in cognitive ability?", International Journal Audiology, 47(2), pp.S53~S71 (2008)
  2. Altmann, G. T. M., "Incremental interpretation at verbs : restricting the domain of subsequent reference", Cognition, 73, pp.247~264 (1999)
  3. Altmann, G. T. M., "Incrementality and prediction in human sentence processing", Cognitive Science, 33, pp.583~609 (2009)
  4. Ashby, J., "Eye movements of highly skilled and average readers: Differential effects of frequency and predictability", The Quarterly Journal of Experimental Psychology A: Human Experimental Psychology, 58A(6), pp.1065~1086 (2005)
  5. Aurnhammer, C., "Retrieval (N400) and integration (P600) in expectation-based comprehension", PLoS ONE, 16(9), pp.e0257430~ (2021)[DOI]
  6. Balota, D. A., "The interaction of contextual constraints and parafoveal visual information in reading", Cognitive Psychology, 17(3), pp.364~390 (1985)
  7. Bell, L. C., "Reading skill : some adult comparisons", Journal of Educational Psychology, 86, pp.244~255 (1994)[DOI]
  8. Bicknell, K., "Effects of event knowledge in processing verbal arguments", Journal of Memory and Language, 63(4), pp.489~505 (2010)
  9. Bornkessel, I. D, "On the cost of syntactic ambiguity in human language comprehension: An individual differences approach", Cognitive Brain Research, 21, pp.11~21 (2004)[DOI]
  10. Boston, M. F., "Parsing costs as predictors of reading difficulty: An evaluation using the Potsdam Sentence Corpus", Journal of Eye Movement Research, 2(1), pp.1~12 (2008)
  11. Brothers, T., "Effects of prediction and contextual support on lexical processing : Prediction takes precedence", Cognition, 136, pp.135~149 (2015)
  12. Burkhardt, P., "Inferential bridging relations reveal distinct neural mechanisms : Evidence from event-related brain potentials", Brain and Language, 98(2), pp.159~168 (2006)
  13. Burkhardt, P., "The P600 reflects cost of new information in discourse memory", Neuroreport, 18(17), pp.1851~1854 (2007)
  14. Clifton Jr, C., "The use of thematic role information in parsing : Syntactic processing autonomy revisited", Journal of Memory and Language, 49(3), pp.317~334 (2003)
  15. Cummings, A., "Auditory semantic networks for words and natural sounds", Brain Research, 1115, pp.92~107 (2006)
  16. Daneman, M., "Individual differences in working memory and reading", Journal of Verbal Learning and Verbal Behavior, 19, pp.450~466 (1980)[DOI]
  17. Delogu, F., "On the predictability of event boundaries in discourse : An ERP investigation", Memory & Cognition, 46(2), pp.315~325 (2018)
  18. DeLong, K. A., "Pre-processing in sentence comprehension : Sensitivity to likely upcoming meaning and structure", Language and Linguistics Compass, 8(12), pp.631~645 (2014)
  19. DeLong, K. A., "Probabilistic word pre-activation during language comprehension inferred from electrical brain activity", Nature Neuroscience, 8, pp.1117~1121 (2005)
  20. Demberg, V., "Data from eye-tracking corpora as evidence for theories of syntactic processing complexity", Cognition, 109(2), pp.193~210 (2008)
  21. Demberg, V., "Incremental, predictive parsing with psycholinguistically motivated tree-adjoining grammar", Computational Linguistics, 39(4), pp.1025~1066 (2013)
  22. Elman, J. L., "Finding Structure in Time", Cognitive Science, 14, pp.179~211 (1990)
  23. Elman, J. L., "On the meaning of words and dinosaur bones : Lexical knowledge without a lexicon", Cognitive Science, 33, pp.547~582 (2009)
  24. Elman, J. L., "Lexical knowledge with a lexicon?", The Mental Lexicon, 60, pp.1~33 (2012)
  25. Ehrlich, S. F., "Contextual effects on word perception and eye movements during reading", Journal of Verbal Learning and Verbal Behavior, 20, pp.641~655 (1981)
  26. Ericsson, K. A., "Long-term working memory", Psychological Review, 102, pp.211~245 (1995)[DOI]
  27. Federmeier K., "Thinking ahead : the role and roots of prediction in language comprehension", Psychophysiology, 44(4), pp.491~505 (2007)[DOI]
  28. Federmeier K., "A rose by any other name : Long-term memory structure and sentence processing", Journal of Memory and Language, 41(4), pp.469~495 (1999)[DOI]
  29. Federmeier K., "Age-related and individual differences in the use of prediction during language comprehension", Brain Language, 115(3), pp.149~161 (2010)[DOI]
  30. Federmeier, K. D., "Multiple effects of sentential constraint on word processing", Brain Research, 1146, pp.75~84 (2007)
  31. Ferreira, F., "The independence of syntactic processing", Journal of Memory and Language, 25(3), pp.348~368 (1986)
  32. Ferreira, F., "The ‘good enough’approach to language comprehension", Language and Linguistics Compass, 1(1-2), pp.71~83 (2007)
  33. Ferreira, F., "Misinterpretations of garden-path sentences : Implications for models of sentence processing and reanalysis", Journal of Psycholinguistic Research, 30(1), pp.3~20 (2001)
  34. Frank, S. L., "Insensitivity of the human sentence-processing system to hierarchical structure", Psychological Science, 22(6), pp.829~834 (2011)
  35. Friederici, A.D., "First-pass versus second-pass parsing processes in a Wernicke’s and a Broca’s aphasic: electro-physiological evidence for a double dissociation", Brain and Language, 62, pp.311~341 (1998)
  36. Frisson, S., "Effects of contextual predictability and transitional probability on eye movements during reading", Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(5), pp.862~877 (2005)
  37. Futrell, R., "Noisy-context surprisal as a human sentence processing cost model", Proceedings of the 15th conference of the European chapter of the Association for Computational Linguistics, 1, pp.688~698 (2017)
  38. Garnsey, S. M., "The contributions of verb bias and plausibility to the comprehension of temporarily ambiguous sentences", Journal of Memory and Language, 37(1), pp.58~93 (1997)
  39. Hagoort P., "The Cognitive Neurosciences", pp.819~836 (2009), MIT Press
  40. Hagoort, P., "The syntactic positive shift (SPS) as an ERP measure of syntactic processing", Language and Cognitive Processes, 8(4), pp.439~483 (1993)[DOI]
  41. Hale, J., "A probabilistic Earley parser as a psycholinguistic model", Proceedings of the Second Meeting of the North American Chapter of the Association for Computational Linguistics, pp.1~8 (2001), Carnegie Mellon University
  42. Hamilton, S. T., "Modeling reader and text interactions during narrative comprehension: a test of the lexical quality hypothesis", Discourse Process, 50, pp.139~163 (2013)[DOI]
  43. Herron, J. E., "Decomposition of the ERP late posterior negativity: Effects of retrieval and response fluency", Psychophysiology, 44(2), pp.233~244 (2007)
  44. Hoeks, J. C., "Seeing words in context : the interaction of lexical and sentence level information during reading", Cognitive Brain Research, 19(1), pp.59~73 (2004)
  45. Hoeks, J. C., "Questions left unanswered: How the brain responds to missing information", PloS ONE, 8(10), pp.e73594~ (2013)
  46. Itoh, K., "Electrophysiological correlates of absolute pitch and relative pitch", Cerebral Cortex, 15(6), pp.760~769 (2005)
  47. Johansson, M., "The late posterior negativity in ERP studies of episodic memory: action monitoring and retrieval of attribute conjunctions", Biological Psychology, 64(1-2), pp.91~117 (2003)
  48. Just, M. A., "A capacity theory of comprehension : Individual differences in working memory", Psychological Review, 99, pp.122~149 (1992)
  49. Kaan, E., "The P600 as an index of syntactic integration difficulty", Language and Cognitive Processes, 15(2), pp.159~201 (2000)
  50. Kim, A., "Individual Differences in Verbal Working Memory Underlie a TradeoffBetween Semantic and Structural Processing Difficulty During Language Comprehension: An ERP Investigation", Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(3), pp.406~420 (2018)
  51. Kim, A., "The independence of combinatory semantic processing : Evidence from event-related potentials", Journal of Memory and Language, 52(2), pp.205~225 (2005)
  52. King, J., "Individual differences in syntactic processing : The role of working memory", Journal of Memory and Language, 30(5), pp.580~602 (1991)
  53. King, J., "Who Did What and When? Using Word-and Clause-Level ERPs to Monitor Working Memory Usage in Reading", Journal of Cognitive Neuroscience, 7(3), pp.376~395 (1995)
  54. Koelsch, S., "Children processing music : electric brain responses reveal musical competence and gender differences", Journal of Cognitive Neuroscience, 15(5), pp.683~693 (2003)
  55. Koelsch, S., "Electric brain responses reveal gender differences in music processing", Neuroreport, 14(5), pp.709~713 (2003)
  56. Kuperberg, G., "Neural mechanisms of language comprehension : Challenges to syntax", Brain Research, 1146, pp.23~49 (2007)
  57. Kuperberg, G., "A Tale of Two Positivities and the N400 : Distinct neural signatures are evoked by confirmed and violated predictions at different levels of representation", Journal of Cognitive Neuroscience, 32(1), pp.12~35 (2020)[DOI]
  58. Kutas, M., "Thirty years and counting : finding meaning in the N400 component of the event-related brain potential(ERP)", Annual Review of Psychology, 62, pp.621~647 (2011)
  59. Kutas, M., "Brain potentials during reading reflect word expectancy and semantic association", Nature, 307, pp.161~163 (1984)[DOI]
  60. Kutas, M., "Event-related brain potentials to semantically inappropriate and surprisingly large words", Biological Psychology, 11(2), pp.99~116 (1980)
  61. Lau, E. F., "A cortical network for semantics : (de)constructing the N400", Nature Reviews Neuroscience, 9(12), pp.920~933 (2008)
  62. Levy, R., "Expectation-based syntactic comprehension", Cognition, 106, pp.1126~1177 (2008)
  63. Lewis, R. L., "An activation-based model of sentence processing as skilled memory retrieval", Cognitive Science, 29(3), pp.375~419 (2005)
  64. Luck, S. J., "An Introduction to the Event-related Potential Technique" (2005), MIT Press
  65. MacDonald, M., "Context effects in syntactic ambiguity resolution: Discourse and semantic influences in parsing reduced relative clauses. Canadian", Journal of Experimental Psychology, 1993, pp.47(2), 276~
  66. Matzke, M., "The costs of freedom: An ERP-study of non-canonical sentences", Clinical Neurophysiology, 113, pp.844~852 (2002)
  67. McDonald, S. A., "Low-level predictive inference in reading : The influence of transitional probabilities on eye movements", Vision Research, 43(16), pp.1735~1751 (2003)
  68. Mecklinger, A., "Source-retrieval requirements influence late ERP and EEG memory effects", Brain Research, 1172, pp.110~123 (2007)
  69. Mecklinger, A., "Reconstructing the past : The late posterior negativity(LPN)in episodic memory studies", Neuroscience &Biobehavioral Reviews, 68, pp.621~638 (2016)
  70. Mirman, D., "Theories of spoken word recognition deficits in Aphasia : evidence from eye-tracking and computational modeling", Brain & Language, 117(2), pp.53~68 (2011)[DOI]
  71. Miyake, A., "A capacity approach to syntactic comprehension disorders : Making normal adults perform like aphasic patients", Cognitive Neuropsychology, 11, pp.671~717 (1994)
  72. Moreno, E.M, "Processing semantic anomalies in two languages: an electrophysiological exploration in both languages of Spanish–English bilinguals", Cognitive Brain Research, 22(2), pp.205~220 (2005)
  73. Nakano, H., "Speech and span : Working memory capacity impacts the use of animacy but not of world knowledge during spoken sentence comprehension", Journal of Cognitive Neuroscience, 22, pp.2886~2898 (2010)[DOI]
  74. Nozari, N., "The ventrolateral prefrontal cortex facilitates processing of sentential context to locate referents", Brain & Language, 157–158, pp.1~13 (2016)[DOI]
  75. Nozari, N., "The interplay of local attraction, context and domain-general cognitive control in activation and suppression of semantic distractors during sentence comprehension", Psychological Bulletin Review, 23(6), pp.1942~1953 (2016)
  76. Osterhout, L., "Event-related brain potentials elicited by syntactic anomaly", Journal of Memory and Language, 31(6), pp.785~806 (1992)
  77. Osterhout, L., "Event-related brain potentials elicited by failure to agree", Journal of Memory and Language, 34(6), pp.739~773 (1995)
  78. Otten, M., "Discourse-based lexical anticipation : prediction or priming", Discourse Processes, 45(6), pp.464~496 (2008)
  79. Perfetti, C. A., "Reading ability: lexical quality to comprehension", Scientific Studies of Reading, 11, pp.357~383 (2007)[DOI]
  80. Perfetti, C. A., "Word learning and individual differences in word learning reflected in event-related potentials", Journal of Experimental Psychology, 31, pp.1281~1292 (2005)[DOI]
  81. Rayner, K., "Effects of contextual constraint on eye movements in reading : A further examination", Psychonomic Bulletin &Review, 3(4), pp.504~509 (1996)
  82. Rayner, K., "Eye movement control in reading : Word predictability has little influence on initial landing positions in words", Vision Research, 41(7), pp.943~954 (2001)
  83. Regel, S., "Isn't it ironic? An electrophysiological exploration of figurative language processing", Journal of Cognitive Neuroscience, 23(2), pp.277~293 (2011)
  84. Roland, D., "Semantic similarity, predictability, and models of sentence processing", Cognition, 122, pp.267~279 (2012)
  85. Rönnberg. J, "The Ease of Language Understanding (ELU) model: theoretical,empirical, and clinical advances", Frontier System Neuroscience (2013)[DOI]
  86. Ryskin, R., "Do domain-general executive resources play a role in linguistic prediction? Re-evaluation of the evidence and a path forward", Neuropsychologia, 136, pp.107258~ (2020)
  87. Smith, N. J., "The effect of word predictability on reading time is logarithmic", Cognition, 128(3), pp.302~319 (2013)
  88. Spotorno, N., "What’s behind a P600? Integration operations during irony processing", PloS ONE, 8(6), pp.e66839~ (2013)
  89. Staub, A., "The effect of lexical predictability on distributions of eye fixation durations", Psychonomic Bulletin & Review, 18(2), pp.371~376 (2011)
  90. Staub, A., "The effect of lexical predictability on eye movements in reading : Critical review and theoretical interpretation", Language and Linguistics Compass, 9(8), pp.311~327 (2015)
  91. Tanner, D., "Individual differences and streams of processing", Linguistic Approaches to Bilingualism, 3, pp.350~356 (2013)
  92. Van Berkum, J. J. A., "Anticipating upcoming words in discourse: Evidence from ERPs and reading times", Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, pp.443~467 (2005)
  93. Van Petten, C., "Prediction during language comprehension : Benefits, costs, and ERP components", International Journal o f Psychophysiology, 83, pp.176~190 (2012)
  94. Van Petten, C., "Working memory capacity dissociates lexical and sentential context effects", Psychological Science, 8(3), pp.238~242 (1997)
  95. Vos, S. H., "Working memory constraints on syntactic processing : An electrophysiological investigation", Psychophysiology, 38, pp.41~63 (2001)[DOI]
  96. Waters, G. S., "Processing resource capacity and the comprehension of garden path sentences", Memory & Cognition, 24, pp.342~355 (1996)[DOI]
  97. Yoon, J., "Observations of Observations of the N400 Event Related Potential and the Gamma the Gamma Band Activities related to the familiarity during visual word perception", Master, pp.2008
  98. 윤홍옥, "The Effect of Role Predictability and Word Predictability on Sentence Comprehension", Journal of Cognitive Science, 15(3), pp.349~390 (2014), 인지과학연구소[DOI]
  99. 윤홍옥, "The predictability effect on eye movement in reading Korean dative sentences", 언어와 정보, 21(1), pp.73~99 (2017), 한국언어정보학회

관련 논문AI추천

The Effect of Role Predictability and Word Predictability on Sentence Comprehension윤홍옥, 홍우평인지과학연구소 · Journal of Cognitive Science2014 · 제15권 제3호Linear Precedence in Morphosyntactic and Semantic Processes in Korean Sentential Processing as Revealed by Event-related Potential김충명한국콘텐츠학회 · International Journal of Contents2014 · 제10권 제4호The Effects of Word Predictability and Contextual Uncertainty in the Processing of Korean Dative Sentences: An Eye-Movement Reading Comprehension Study윤홍옥, 이동수, 홍우평인지과학연구소 · Journal of Cognitive Science2017 · 제18권 제2호Repair, Revision, and Complexity in the Syntactic Analysis of Dependency Relations for the three Korean Anaphors: An ERP-based Neurophysiological Differentiation박명관, 정원일, 조의연한국생성문법학회 · 생성문법연구2014 · 제24권 제4호집행기능, 작업기억 그리고 통계적 학습 능력이 한국어 모어 독자의 관형절 중의성 해소에 미치는 영향이솔빈, 이은하담화·인지언어학회 · 담화와 인지2022 · 제29권 제2호Are Quantifying Expressions Interpreted Incrementally?박범식, 오세랑한국생성문법학회 · 생성문법연구2014 · 제24권 제2호

이 간행물의 다른 논문 (3건)

Misconceptions — Johnson-Laird and Piaget on ReasoningM. A. Winstanleypp. 1-32Brain Tumor Detection Using Wavelet Transform and Convolution Neural Network in Magnetic Resonance ImagingZahra Einalou, Sahar Solaymanpour, Mehrdad Dadgostar, Hamidreza Hosseinzadehpp. 33-56A Realizational Approach to Light Verb Ellipsis in Korean: Non-constituent Ellipsis as Zero Vocabulary Insertion임창국pp. 95-122
원문 보기