A Neuro-Computational Approach to Understanding the Mental Lexicon
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Human lexical knowledge does not appear to be organised to minimise storage, but rather to maximise processing efficiency. The way lexical information is stored reflects the way it is dynamically processed, accessed and retrieved. A detailed analysis of the way words are memorised, of the dynamic interaction between lexical representations and distribution and degrees of regularity in input data, can shed some light on the emergence of structures and relations within fully-stored words. We believe that a bottom-up investigation of low-level memory and processing functions can help understand the cognitive mechanisms that govern word processing in the mental lexicon. Neuro-computational models can play an important role in this inquiry, as they help understand the dynamic nature of lexical representations by establishing an explanatory connection between lexical structures and processing models dictated by the micro-functions of human brain. Starting from some linguistic, psycholinguistic and neuro-physiological evidence supporting a dynamic view of the mental lexicon as an integrative system, we illustrate Temporal Self Organising-Maps (TSOMs), artificial neural networks that can model such a view by memorising time series of symbolic units (words) as routinized patterns of short-term node activation. On the basis of a simple pool of principles of adaptive Hebbian synchronisation, TSOMs can perceive possible surface relations between word forms and store them by partially overlapping activation patterns, reflecting gradient levels of lexical specificity, from holistic to decompositional lexical representations. We believe that TSOMs offer an algorithmic model of the emergence of high-level, global and language-specific morphological structure through the working of low-level, language-aspecific processing functions, thus promising to bridge the persisting gap between high-level principles of grammar architecture (lexicon vs. rules), computational correlates (storage vs. processing) and low-level principles and localisations of brain functions. Extensions of the current TSOM architecture are envisaged and their theoretical implications are discussed.
Abstract
Human lexical knowledge does not appear to be organised to minimise storage, but rather to maximise processing efficiency. The way lexical information is stored reflects the way it is dynamically processed, accessed and retrieved. A detailed analysis of the way words are memorised, of the dynamic interaction between lexical representations and distribution and degrees of regularity in input data, can shed some light on the emergence of structures and relations within fully-stored words. We believe that a bottom-up investigation of low-level memory and processing functions can help understand the cognitive mechanisms that govern word processing in the mental lexicon. Neuro-computational models can play an important role in this inquiry, as they help understand the dynamic nature of lexical representations by establishing an explanatory connection between lexical structures and processing models dictated by the micro-functions of human brain. Starting from some linguistic, psycholinguistic and neuro-physiological evidence supporting a dynamic view of the mental lexicon as an integrative system, we illustrate Temporal Self Organising-Maps (TSOMs), artificial neural networks that can model such a view by memorising time series of symbolic units (words) as routinized patterns of short-term node activation. On the basis of a simple pool of principles of adaptive Hebbian synchronisation, TSOMs can perceive possible surface relations between word forms and store them by partially overlapping activation patterns, reflecting gradient levels of lexical specificity, from holistic to decompositional lexical representations. We believe that TSOMs offer an algorithmic model of the emergence of high-level, global and language-specific morphological structure through the working of low-level, language-aspecific processing functions, thus promising to bridge the persisting gap between high-level principles of grammar architecture (lexicon vs. rules), computational correlates (storage vs. processing) and low-level principles and localisations of brain functions. Extensions of the current TSOM architecture are envisaged and their theoretical implications are discussed.
참고문헌 (109)
- Ackerman, F., "Analogy in Grammar", pp.54~82 (2009), Oxford University Press
- Aflalo, T. N., "Possible origins of the complex topographic organization of motor cortex: Reduction of a multidimensional space onto a two-dimensional array", Journal of Neuroscience, 26, pp.6288~6297 (2006)
- Aitchison, J., "Words in the Mind: An Introduction to the Mental Lexicon" (1994), Blackwell Publishers
- Althaus, N., "Modeling Cross-Modal Interactions in Early Word Learning", IEEE Transactions on Autonomous Mental Development, 5(4), pp.288~297 (2013)
- Baayen, R. H., "The CELEX lexical database (CD-ROM)", Linguistic Data Consortium, ~ (1995)
- Baayen, R. H., "The morphological complexity of simplex nouns", Linguistics, 35, pp.861~877 (1997)
- Baayen, R. H., "Morphological influences on the recognition of monosyllabic monomorphemic words", Journal of Memory and Language, 55(2), pp.290~313 (2006)
- Baddeley, A. D, "Immediate memory and the “perception” of letter sequences", Quarterly Journal of Experimental Psychology, 16, pp.364~367 (1964)
- Baddeley, A. D., "Working Memory" (1986), Oxford University Press
- Baddeley, A. D., "Working memory, thought and action" (2007), Oxford University Press
- Baddeley, A. D., "Working memory", The psychology of learning and motivation: Advances in research and theory, 8, pp.47~89 (1974), Academic Press
- Badre, D., "Selection, integration, and conflict monitoring;assessing the nature and generality of prefrontal cognitive control mechanisms", Neuron, 41, pp.473~487 (2004)
- Bailey, T. M., "Determinants of wordlikeness: Phonotactics or lexical neighborhoods?", Journal of Memory and Language, 44(4), pp.568~591 (2001)
- Bittner, D., "Development of Verb Inflection in First Language Acquisition: a cross-linguistic perspective" (2003), Mouton de Gruyter
- Blevins J. P, "Word-based morphology", Journal of Linguistics, 42, pp.531~573 (2006)
- Bloch, B, "English verb inflection", Language, 23, pp.399~418 (1947)
- Bloomfield, L., "Language" (1933), Henry Holt
- Bybee, J., "Morphology. A Study of the Relation between Meaning and Form" (1985), John Benjamins
- Bybee, J, "Regular Morphology and the Lexicon", Language and Cognitive Processes, 10(5), pp.425~455 (1995)
- Bybee, J, "The Evolution of Language out of Pre-Language", pp.107~132 (2002), John Benjamins
- Bybee, J., "Rules and Schemas in the development and use of the English Past Tense", Language, 58, pp.265~289 (1982)
- Bybee, J., "Morphological Classes as Natural Categories", Language, 9, pp.251~270 (1983)
- Carstairs, A., "A processing constraint on inflectional homonymy", Linguistics, 26, pp.601~618 (1988)
- Catani, M., "Perisylvian language networks of the human brain", Annals of Neurology, 57, pp.8~16 (2005)
- Chomsky, N., "The sound pattern of English" (1968), Harper and Row
- Clahsen, H, "Advances in the Theory of the Lexicon", pp.355~388 (2006), Mouton de Gruyter
- Colombo, L., "Regularity and", or consistency in the production of the past participle?, 2004, pp.90, 128~142
- Cowan, N, "The magical number 4 in short-term memory: A reconsideration of mental storage capacity", Behavioral and Brain Sciences, 24, pp.87~185 (2001)
- Dabrowska. E, "Rules or schemata? Evidence from Polish", Language and cognitive processes, 19(2), pp.225~271 (2004)
- Dabrowska. E, "Productivity and beyond: mastering the Polish genitive inflection", Journal of child language, 32, pp.191~205 (2005)
- D’Esposito, M, "From cognitive to neural models of working memory. Philosophical Transactions of the Royal Society B", Biological Sciences, 362, pp.761~772 (2007)
- D’Esposito, M., "Maintenance and manipulation of information held in working memory: an event-related fMRI study", Brain and Cognition, 41, pp.66~86 (1999)
- Morphology I, "Morphologie", pp.2000, Dressler, W. U.
- Elman, J. L, "Mind as motion: Explorations in the dynamics of cognition", pp.496~518 (1995), MIT Press
- Elman, J. L, "An Alternative view of the Mental Lexicon", Trends of Cognitive Science, 8(7), pp.301~306 (2004)
- Ferro M., "Morphology, Memory and the Mental Lexicon", Lingue e Linguaggio IX(2) Interdisciplinary aspects to understanding word processing and storage, pp.199~238 (2010)
- Ferro M., "A Self-Organizing Model of Word Storage and Processing: Implications for Morphology Learning", Lingue e Linguaggio, 10(2), pp.209~226 (2011)
- Finkel, R., "Principal parts and morphological typology", Morphology, 17, pp.39~75 (2007)
- Ford, M. A., "Morphological structure in language processing", pp.89~124 (2003), Mouton de Gruyter
- Friederici, A. D, "The cortical language circuit: from auditory perception to sentence comprehension", Trends in Cognitive Sciences, 16(5), pp.262~268 (2012)[DOI]
- Frost, R., "What can we learn from the morphology of Hebrew? A masked-priming investigation of morphological representation", Journal of Experimental Psychology: Learning, Memory, and Cognition, 23, pp.829~856 (1997)
- Gathercole, S. E., "Evaluation of the role of phonological STM in the development of vocabulary in children: A longitudinal study", Journal of memory and language, 28(2), pp.200~213 (1989)
- Gathercole, S. E., "The influence of syllables and wordlikeness on children’s repetition of nonwords", Applied Psycholinguistics, 12, pp.349~367 (1991)
- Gathercole, S. E., "Phonological shortterm memory and new word learning in children", Developmental Psychology, 33, pp.966~979 (1997)
- Hay, J. B., "Lexical frequency in morphology: is everything relative?", Linguistics, 39, pp.1041~1070 (2001)
- Hay, J. B., "Yearbook of Morphology 2001", pp.203~235 (2002), Kluwer Academic Publishers
- Hebb, D., "The Organization of Behavior" (1949), Wiley
- Hay, J. B., "Shifting paradigms: gradient structure in morphology", Trends in Cognitive Sciences, 9(7), pp.342~348 (2005)
- Henson, R, "Short-term memory for serial order: The start-end model", Cognitive psychology, 36(2), pp.73~137 (1998)
- Hickok, G., "Auditory-motor interaction revealed by fMRI: speech, music, and working memory in area Spt", Journal of Cognitive Neuroscience, 15, pp.673~682 (2003)
- Hickok, G., "Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language", Cognition, 92(1), pp.67~99 (2004)
- Houghton, G., "Current research in natural language generation", pp.287~319 (1990), Academic Press
- Hulme, C., "Memory for familiar and unfamiliar words: evidence for a long−term memory contribution to short−term span", Journal of Memory and Language, 30, pp.685~701 (1991)
- Hulme, C., "Word frequency effects on short-term memory tasks: Evidence for a redintegration process in immediate serial recall", Journal of Experimental Psychology: Learning, Memory, and Cognition, 23(5), pp.1217~ (1997)
- Kimberg, D. Y., "Cognitive functions in the prefrontal cortex-working memory and executive control", Current Directions in Psychological Science, 6, pp.185~192 (1997)
- Labelle, M., "The acquisition of a verbal paradigm: Verb Morphology in French L1 children. Prépublication. (Montréal, Québec, Canada, UQAM, département de linguistique)", ~ (2011)
- Levelt, W. J., "Do speakers have access to a mental syllabary?", Cognition, 50(1), pp.239~269 (1994)
- Levelt, W. J., "A theory of lexical access in speech production", Behavioral and Brain Sciences, 22, pp.1~38 (1999)
- Li, P, "Lexical Organization and Competition in First and Second Languages:Computational and Neural Mechanism", Cognitive Science, 33, pp.629~664 (2009)
- Li, P., "Dynamic Self-Organization and Early Lexical Development in Children", Cognitive Science, 31, pp.581~612 (2007)
- Libben, G, "Everything is psycholinguistics: Material and methodological considerations in the study of compound processing", Canadian Journal of Linguistics, 50, pp.267~283 (2005)
- Libben, G., "Compound words, semantic transparency, and morphological transcendence", New impulses in word formation, Linguistische Berichte, Sonderheft, 17, pp.317~330 (2010)
- Lieber, R., "On the organization of the lexicon", 박사, pp.1980
- Luce, P., "Recognizing Spoken Words: The Neighborhood Activation Model", Ear and hearing, 19(1), pp.1~36 (1998)
- Lüdeling, A., "Verb-particle explorations", pp.315~333 (2002), Mouton de Gruyter
- Ma, W. J., "Changing concepts of working memory", Nature neuroscience, 17(3), pp.347~356 (2014)
- Marantz, A, "No escape from morphemes in morphological processing", Language and Cognitive Processes, 28(7), pp.905~916 (2013)
- Marslen-Wilson, W, "Functional parallelism in spoken word recognition", Cognition, 25, pp.71~102 (1987)
- Marzi, C., "Word alignment and paradigm induction", Lingue e Linguaggio, 11(2), pp.251~274 (2012)
- Marzi, C., "Morphological structure through lexical parsability", Lingue e Linguaggio, 13(2), pp.263~290 (2014)
- Marzi, C., "Lexical emergentism and the “frequencyby-regularity” interaction", Word Structure and Word Usage. Proceedings of the NetWordS Final Conference, pp.37~41 (2015)
- Matthews, P. H., "Morphology" (1991), Cambridge University Press
- Mayor, J., "A neuro-computational account of taxonomic responding and fast mapping in early word learning", Psychological Review, 117(1), pp.1~31 (2010)
- McClelland, J.L., "The TRACE model of speech perception", Cognitive Psychology, 18, pp.1~86 (1986)
- MacWhinney, B., "Handbook of bilingualism: Psycholinguistic approaches" (2004), Oxford University Press
- Milin, P., "The simultaneous effects of inflectional paradigms and classes on lexical recognition: Evidence from Serbian", Journal of Memory and Language, 60(1), pp.50~64 (2009)
- Miller, G. A, "The magical number seven, plus or minus two: Some limits on our capacity for processing information", Psychological Review, 63(2), pp.81~97 (1956)
- Moscoso del Prado Martín, F., "Morphological Family Size in a Morphologically Rich Language: The Case of Finnish Compared With Dutch and Hebrew", Journal of Experimental Psychology: Learning, Memory and Cognition, 30(6), pp.1271~1278 (2004)
- Norris, D, "Shortlist: A connectionist model of continuous speech recognition", Cognition, 52, pp.189~234 (1994)
- Norris, D, "Twenty-First Century Psycholinguistics: Four Cornerstones", Lawrence Erlbaum, pp.331~346 (2005)
- Orsolini, M., "Universals in morphological representation: Evidence from Italian", Language and Cognitive Processes, pp.121~147 (1997)
- Orsolini, M., "Acquiring regular and irregular inflections in a language with verb classes", Language and cognitive processes, 13(4), pp.425~464 (1998)
- Papagno, C., "Phonological short-term memory and foreign-language vocabulary learning", Journal of Memory and Language, 30, pp.331~347 (1991)
- Pinker, S., "The past and future of the past tense", Trends in Cognitive Science, 6, pp.456~463 (2002)
- Pirrelli, V, "Psycho-computational issues in Morphology Learning and Processing: an Overture", Lingue e Linguaggio, 6(2), pp.131~138 (2007)
- Pirrelli, V., "The paradigmatic dimension of stem allomorphy in Italian verb inflection", Italian Journal of Linguistics, 12(2), pp.307~380 (2000)
- Pirrelli, V., "Two-dimensional Wordlikeness Effects in Lexical Organisation", Proceedings of the First Italian Conference on Computational Linguistic, pp.301~305 (2014), Pisa University Press
- Pitt, M. A., "compensation for coarticulation mediated by the lexicon?", Journal of Memory and Language, 39(3), pp.347~370 (1998)
- Post, B., "The processing of English regular inflections: Phonological cues to morphological structure", Cognition, 109, pp.1~17 (2008)
- Price, C. J., "Brain mapping: the disorders", pp.181~200 (2000), Academic Press
- Pulvermüller, F., "From sensorimotor learning to memory cells in prefrontal association cortex: A neuorcomputational study of disembodiment", Cortex, 57, pp.1~21 (2014)
- Rastle, K., "The broth in my brother’s brothel:Morpho-orthographic segmentation in visual word recognition", Psychonomic Bulletin and Review, 11(6), pp.1090~1098 (2004)
- Rumelhart, D., "On learning the past tense of English verbs", Parallel distributed processing:Explanations in the microstructure of cognition, pp.216~271 (1986), The MIT Press
- Sadock, J. M., "Autolexical syntax: A theory of parallel grammatical representations" (1991), University of Chicago Press
- Saur, D., "Ventral and dorsal pathways for language", Proceedings of the National Academy of Sciences of the United States of America, 105, pp.18035~18040 (2008)
- Seidenberg, M. S., "A probabilistic constraints approach to language acquisition and processing", Cognitive Science, 23(4), pp.569~588 (1999)
- Selkirk, E., "Phonolgy and Syntax" (1984), The MIT Press
- Shalom, D. B., "Functional Anatomic Models of Language:Assembling the Pieces", The Neuroscientist, 14, pp.119~127 (2008)
- Sibley, D. E., "Large-Scale Modeling of Wordform Learning and Representation", Cognitive Science, 32, pp.741~754 (2008)
- Stemberger, J. P., "Vowel dominance and morphological processing", Language and Cognitive Processes, 18(4), pp.369~404 (2003)
- Tabak, W., "Linguistic Evidence", pp.529~555 (2005), Mouton de Gruyter
- Taft, M, "Recognition of affixed words and the word frequency effect", Memory and Cognition, 7, pp.263~272 (1979)
- Ullman, M. T, "Contributions of memory circuits to language: the declarative", procedural model, 2004, pp.92, 231~270
- Vitevich, M, "Naturalistic and experimental analyses of word frequency and neighbourhood density effects in slips of the ear", Language and Speech, 45(4), pp.407~434 (2002)
- Vitevitch, M. S., "Phonotactics and syllable stress: Implications for the processing of spoken nonsense words", Language and speech, 40(1), pp.47~62 (1997)
- Vitevitch, M. S., "When words compete: levels of processing in perception of spoken words", Psychological Science, 9, pp.325~329 (1998)
- Wagner, A. D, "Working memory contributions to human learning and remembering", Neuron, 22, pp.19~22 (1999)
- Westermann, G., "A new model of sensorimotor coupling in the development of speech", Brain and language, 89(2), pp.393~400 (2004)
- Wilson, M, "The case of sensorimotor coding in working memory", Psychonomic Bulletin and Review, 8(1), pp.44~57 (2001)