Talking Space: Inference from Spatial Linguistic Meanings
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This paper concerns the intersection of natural language and the physical space around us in which we live, that we observe and/or imagine things within. Many important features of language have spatial connotations, for example, many prepositions (like in, next to, after, on, etc.) are fundamentally spatial. Space is also a key factor of the meanings of manywords/phrases/sentences/text, and space is a, if not the key, context for referencing (e.g. pointing) and embodiment. We propose a mechanism for how space and linguistic structure can be made to interact in a matching compositional fashion. Examples include Cartesian space, subway stations, chesspieces on a chess-board, and Penrose’s staircase. The starting point for our construction is the DisCoCat model of compositional natural language meaning, which we relax to accommodate physical space. We address the issue of having multiple agents/objects in a space, including the case that each agent has different capabilities with respect to that space, e.g. the specific moves each chesspiece can make, or the different velocities one may be able to reach. Once our model is in place, we show how inferences drawing from the structure of physical space can be made. We also show how our linguistic model of space can interact with other such models related to our senses and/or embodiment, such as the conceptual spaces of colour, taste and smell, resulting in a rich compositional model of meaning that is close to human experience and embodiment in the world.
Abstract
This paper concerns the intersection of natural language and the physical space around us in which we live, that we observe and/or imagine things within. Many important features of language have spatial connotations, for example, many prepositions (like in, next to, after, on, etc.) are fundamentally spatial. Space is also a key factor of the meanings of manywords/phrases/sentences/text, and space is a, if not the key, context for referencing (e.g. pointing) and embodiment. We propose a mechanism for how space and linguistic structure can be made to interact in a matching compositional fashion. Examples include Cartesian space, subway stations, chesspieces on a chess-board, and Penrose’s staircase. The starting point for our construction is the DisCoCat model of compositional natural language meaning, which we relax to accommodate physical space. We address the issue of having multiple agents/objects in a space, including the case that each agent has different capabilities with respect to that space, e.g. the specific moves each chesspiece can make, or the different velocities one may be able to reach. Once our model is in place, we show how inferences drawing from the structure of physical space can be made. We also show how our linguistic model of space can interact with other such models related to our senses and/or embodiment, such as the conceptual spaces of colour, taste and smell, resulting in a rich compositional model of meaning that is close to human experience and embodiment in the world.
참고문헌 (46)
- Ajdukiewicz, K., "Die syntaktische Konnexität", Studia Philosophica, 1, pp.1~27 (1937)
- Bankova, D., "Graded hyponymy for compositional distributional semantics", Journal of Language Modelling, 6(2), pp.225~260 (2019)
- Yehoshua Bar-Hillel, "A Quasi-Arithmetical Notation for Syntactic Description", Language, 29(1), pp.47~ (1953), JSTOR[DOI]
- Bolt, J., "Concepts and their Applications, Synthese Library, Studies in Epistemology, Logic, Methodology, and Philosophy of Science" (2018), Springer
- Casati, R., "Spatial and Temporal Reasoning", pp.73~96 (1997), Springer
- Clark, S., "Acompositional distributional model of meaning", Proceedings of the Second Quantum Interaction Symposium (QI-2008), pp.133~140 (2008)
- Clark, S., "Combining symbolic and distributional models of meaning", Proceedings of AAAI Spring Symposium on Quantum Interaction (2007), AAAI Press
- Coecke, B., "Uniqueness of composition in quantum theory and linguistics", Proceedings of QPL (2018)
- Coecke, B., "Generalized relations in linguistics and cognition. In Juliette Kennedy and Ruy J. G. B. de Queiroz, (eds.), Logic, Language, Information, and Computation - 24th International Workshop, WoLLIC 2017, London, UK, July 18-21, 2017, Proceedings", Lecture Notes in Computer Science, 10388, pp.256~270 (2017), Springer[DOI]
- Coecke, B., "Picturing Quantum Processes. A First Course in Quantum Theory and Diagrammatic Reasoning" (2017), Cambridge University Press
- Coecke, B., "Meaning updating of density matrices", arXiv:2001.00862, ~ (2020)
- Coecke, B., "Categories for the practicing physicist", New Structures for Physics, Lecture Notes in Physics, pp.167~271 (2011), Springer[DOI]
- Coecke, B., "A Festschrift for Jim Lambek, volume 36 of Linguistic Analysis", pp.345~384 (2010)
- Coecke, B, "Distilling grammar into circuits (or, de-humanising grammar for efficient machine use)", ~ (2021)
- Coecke, B., "Grammar equations", arXiv preprint arXiv:2106.07485, ~ (2021)
- Coecke, Bob, "Joachim Lambek: The Interplay of Mathematics, Logic, and Linguistics", pp.181~217 (2021), Springer International Publishing
- Collell, G., "Learning Representations Specialized in Spatial Knowledge : Leveraging Language and Vision", Transactions of the Association for Computational Linguistics, 6, pp.133~144 (2018)
- Dawson, C., "A generative probabilistic framework for learning spatial language", 2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL) (2013)
- de Felice, G., "Montague semantics for Lambek pregroups", Proceedings Applied Category Theory 2019, ACT 2019 of EPTCS, 323, pp.84~94 (2019), University of Oxford
- Fodor, J. A., "Concepts: Where Cognitive ScienceWentWrong" (1998), Oxford University Press
- Gärdenfors, P, "Conceptual spaces: the geometry of thought" (2000), MIT Press
- Gärdenfors, P, "The Geometry of Meaning: Semantics Based on Conceptual Spaces" (2014), MIT Press
- Peter Gärdenfors, "The Geometry Of Preposition Meanings", Baltic International Yearbook of Cognition, Logic and Communication, 10(1) (2015), New Prairie Press[DOI]
- Gazdar, G, "Computing Tomorrow: Future Research Directions in Computer Science", pp.88~109 (1996), Cambridge University Press
- Grefenstette, E., "Experimental support for a categorical compositional distributional model of meaning", The 2014 Conference on Empirical Methods on Natural Language Processing, pp.1394~1404 (2011)
- Herskovits, A, "Spatial and Temporal Reasoning", pp.155~202 (1997), Springer Netherlands
- Hofstadter, D., "Surfaces and Essences" (2013), Basic Books
- Janssen, T. M. V., "Foundations and applications of Montague grammar" (1986), CWI Tracts
- Kartsaklis, D., "A study of entanglement in a categorical framework of natural language", Proceedings of the 11thWorkshop on Quantum Physics and Logic (QPL) (2014)
- Lakoff, G., "Metaphors We Live By" (2003), University of Chicago Press
- Joachim Lambek, "The Mathematics of Sentence Structure", The American Mathematical Monthly, 65(3), pp.154~170 (2018), Informa UK Limited[DOI]
- Lambek, J, "Type grammar revisited", Logical Aspects of Computational Linguistics, 1582 (1999)[DOI]
- Lambek, J., "From word to sentence" (2008), Polimetrica
- Lewis, M., "Compositional hyponymy with positive operators", Proceedings of Recent Advances in Natural Language Processing, pp.638~647 (2019)
- Montague, R., "Universal grammar", Theoria, 36, pp.373~398 (1970)
- Montague, R., "Approaches to natural language", pp.221~242 (1973), Springer
- Sadrzadeh, M., "The Frobenius anatomy of word meanings I: subject and object relative pronouns", Journal of Logic and Computation, 23, pp.1293~1317 (2013)[DOI]
- Sadrzadeh, M., "The Frobenius anatomy of word meanings II: possessive relative pronouns", Journal of Logic and Computation, 26, pp.785~815 (2016)[DOI]
- Camilo Miguel Signorelli, "Cognitive Structures of Space-Time", Frontiers in Psychology, 11 (2020), Frontiers Media SA[DOI]
- Steedman, M., "Combinatory grammars and parasitic gaps", Natural Language & Linguistic Theory, 5, pp.403~439 (1987)
- Tull, S, "Monoidal categories for formal concept analysis", arXiv preprint arXiv:2012.08268, ~ (2020)
- Tull, S., "A Categorical Semantics of Fuzzy Concepts in Conceptual Spaces", ~ (2021)
- Vieu, L, "Spatial and Temporal Reasoning", pp.5~41 (1997), Springer Netherlands
- Wang, V., "Concept Functionals", Journal of Applied Logics, 7(5), pp.725~744 (2020)
- Yeung, Richie, "A CCG-based version of the DisCoCat framework", Proceedings of the 2021 Workshop on Semantic Spaces at the Intersection of NLP, Physics, and Cognitive Science (SemSpace), pp.20~31 (2021), Association for Computational Linguistics
- Joost Zwarts, "Locative and Directional Prepositions in Conceptual Spaces: The Role of Polar Convexity", Journal of Logic, Language and Information, 25(1), pp.109~138 (2016), Springer Science and Business Media LLC[DOI]