본문 바로가기
KERD
논문KCI 등재

Analysing Ambiguous Nouns and Verbs with Quantum Contextuality Tools

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

초록

Psycholinguistic research uses eye-tracking to show that polysemous words are disambiguated differently from homonymous words, and that ambiguous verbs are disambiguated differently than ambiguous nouns. Research in Compositional Distributional Semantics uses cosine distances to show that verbs are disambiguated more efficiently in the context of their subjects and objects than when on their own. These two frameworks both focus on one ambiguous word at a time and neither considers ambiguous phrases with two (or more) ambiguous words. We borrow methods and measures from Quantum Information Theory, the framework of Contextuality-by-Default and degrees of contextual influences, and work with ambiguous subject-verb and verb-object phrases of English, where both the subject/object and the verb are ambiguous. We show that differences in the processing of ambiguous verbs versus ambiguous nouns, as well as between different levels of ambiguity in homonymous versus polysemous nouns and verbs can be modelled using the averages of the degrees of their contextual influences.

Abstract

Psycholinguistic research uses eye-tracking to show that polysemous words are disambiguated differently from homonymous words, and that ambiguous verbs are disambiguated differently than ambiguous nouns. Research in Compositional Distributional Semantics uses cosine distances to show that verbs are disambiguated more efficiently in the context of their subjects and objects than when on their own. These two frameworks both focus on one ambiguous word at a time and neither considers ambiguous phrases with two (or more) ambiguous words. We borrow methods and measures from Quantum Information Theory, the framework of Contextuality-by-Default and degrees of contextual influences, and work with ambiguous subject-verb and verb-object phrases of English, where both the subject/object and the verb are ambiguous. We show that differences in the processing of ambiguous verbs versus ambiguous nouns, as well as between different levels of ambiguity in homonymous versus polysemous nouns and verbs can be modelled using the averages of the degrees of their contextual influences.

참고문헌 (64)

  1. "Distributed by Bodleian Libraries, University of Oxford, on behalf of the BNC Consortium" (2007)[URL]
  2. Abramsky, Samson, "Contextuality, Cohomology and Paradox", 24th EACSL Annual Conference on Computer Science Logic (CSL 2015)of Leibniz International Proceedings in Informatics (LIPIcs), 41, pp.211~228 (2015), Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik
  3. Abramsky, Samson, "The sheaf-theoretic structure of non-locality and contextuality", New J. Phys, 13, pp.113036~ (2011)
  4. Abramsky, Samson, "Semantic Unification. In Categories and Types in Logic, Language, and Physics", Lecture Notes in Computer Science, 8222 (2014), Springer
  5. Barker, Chris, "Continuations and Natural Language" (2015), Oxford Scholarship
  6. Marco Baroni, "The WaCky wide web: a collection of very large linguistically processed web-crawled corpora", Language Resources and Evaluation, 43(3), pp.209~226 (2009), Springer Science and Business Media LLC[DOI]
  7. Irina Basieva, "True contextuality beats direct influences in human decision making", Journal of Experimental Psychology: General, 148(11), pp.1925~1937 (2019), American Psychological Association (APA)[DOI]
  8. Basile, Ivano, "Towards quantum language models", Proceedings of the 2017 Conference on Empirical Methods in Natural Lan-guage Processing, pp.1840~1849 (2017), Association for Computational Linguistics
  9. J. S. Bell, "On the Einstein Podolsky Rosen paradox", Physics Physique Fizika, 1(3), pp.195~200 (1964), American Physical Society (APS)[DOI]
  10. Binder, K., "Eye movements and lexical ambiguity resolution: effects of prior encounter and discourse topic", Journal of experimental psychology. Learning, memory, and cognition, 21(5), pp.1186~1196 (1995)
  11. Blacoe, William, "A quantum-theoretic approach to distributional semantics", Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies, pp.847~857 (2013), Association for Computational Linguistics
  12. Bruza, Peter D., "Is there something quantum-like about the human mental lexicon?", Journal of Mathematical Psychology, 53, pp.362~377 (2009)
  13. Peter D. Bruza, "A probabilistic framework for analysing the compositionality of conceptual combinations", Journal of Mathematical Psychology, 67, pp.26~38 (2015), Elsevier BV[DOI]
  14. Eric G. Cavalcanti, "Classical Causal Models for Bell and Kochen-Specker Inequality Violations Require Fine-Tuning", Physical Review X, 8(2), pp.021018~ (2018), American Physical Society (APS)[DOI]
  15. Cervantes, Víctor H., "Snow Queen is Evil and Beautiful: Experimental Evidence for Probabilistic Contextuality in Human Choices", ~ (2018)
  16. Coecke, Bob, "Mathematical foundations for a compositional distributional model of meaning", CoRR abs, 2010
  17. Correia, A. D., "Density matrices with metric for derivational ambiguity", Journal of Applied Logics, 7(5), pp.795~822 (2020)
  18. Correia, A. D., "Putting a spin on language: A quantum interpretation of unary connectives for linguistic applications", 17th International Conference on Quantum Physics and Logic (QPL) ’20 of Electronic Proceedings of Theoretical Computer Science, 340, pp.114~140 (2021)
  19. Devlin, Jacob, "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding", Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1, pp.4171~4186 (2019), Association for Computational Linguistics
  20. Dopkins, Stephen, "Lexical ambiguity and eye fixations in reading: A test of competing models of lexical ambiguity resolution*1", Journal of Memory and Language, 31(4), pp.461~476 (1992), Elsevier BV[DOI]
  21. Susan A Duffy, "Lexical ambiguity and fixation times in reading", Journal of Memory and Language, 27(4), pp.429~446 (1988), Elsevier BV[DOI]
  22. E. N. Dzhafarov, "Is there contextuality in behavioural and social systems?", Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 374(2058), pp.20150099~ (2016), The Royal Society[DOI]
  23. Ehtibar N. Dzhafarov, "On contextuality in behavioural data", Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 374(2068), pp.20150234~ (2016), The Royal Society[DOI]
  24. Dzhafarov, Ehtibar N., "Samson Abramsky on Logic and Structure in Computer Science and Beyond, Outstanding Contributions to Logic" (2020), Springer
  25. Ehtibar N. Dzhafarov, "Context–content systems of random variables: The Contextuality-by-Default theory", Journal of Mathematical Psychology, 74, pp.11~33 (2016), Elsevier BV[DOI]
  26. Ehtibar N. Dzhafarov, "Contextuality and noncontextuality measures and generalized Bell inequalities for cyclic systems", Physical Review A, 101(4) (2020), American Physical Society (APS)[DOI]
  27. Ehtibar N. Dzhafarov, "Contextuality in Three Types of Quantum-Mechanical Systems", Foundations of Physics, 45(7), pp.762~782 (2015), Springer Science and Business Media LLC[DOI]
  28. A. Einstein, "Can Quantum-Mechanical Description of Physical Reality Be Considered Complete?", Physical Review, 47(10), pp.777~780 (1935), American Physical Society (APS)[DOI]
  29. Ekaterini Klepousniotou, "Making sense of word senses: The comprehension of polysemy depends on sense overlap", Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, pp.1534~1543 (2008)
  30. Firth, J. R, "A synopsis of linguistic theory 1930-55. 1952-59", 1~32 (1957)
  31. Frazier, Lyn, "Taking on semantic commitments: Processing multiple meanings vs. multiple senses", Journal of Memory and Language, 29(2), pp.181~200 (1990)[DOI]
  32. Steven Frisson, "Semantic Underspecification in Language Processing", Language and Linguistics Compass, 3(1), pp.111~127 (2009), Wiley[DOI]
  33. Gogioso, Stefano, "The sheaf-theoretic structure of definite causality", ~ (2021)
  34. Grefenstette, Edward, "Experimenting with transitive verbs in a discocat", CoRR abs, 2011
  35. Zellig S. Harris, "Distributional Structure", WORD, 10(2-3), pp.146~162 (2015), Informa UK Limited[DOI]
  36. B. Hensen, "Loophole-free Bell inequality violation using electron spins separated by 1.3 kilometres", Nature, 526(7575), pp.682~686 (2015), Springer Science and Business Media LLC[DOI]
  37. Matt Jones, "Relating causal and probabilistic approaches to contextuality", Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 377(2157), pp.20190133~ (2019), The Royal Society[DOI]
  38. Ekaterini Klepousniotou, "The Processing of Lexical Ambiguity: Homonymy and Polysemy in the Mental Lexicon", Brain and Language, 81(1-3), pp.205~223 (2002), Elsevier BV[DOI]
  39. Kochen, S., "The Problem of Hidden Variables in Quantum Mechanics", Journal of Mathematics and Mechanics, 17(1), pp.59~87 (1967)
  40. Janne V. Kujala, "Proof of a Conjecture on Contextuality in Cyclic Systems with Binary Variables", Foundations of Physics, 46(3), pp.282~299 (2016), Springer Science and Business Media LLC[DOI]
  41. Janne V. Kujala, "Measures of contextuality and non-contextuality", Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 377(2157), pp.20190149~ (2019), The Royal Society[DOI]
  42. Li, Qiuchi, "Quantum-inspired neural network for conversational emotion recognition", Thirty-Fifth AAAI Conference on Artificial Intelligence (2020)
  43. Li, Qiuchi, "Quantum-Inspired Complex Word Embedding", Proceedings of The Third Workshop on Representation Learning for NLP, pp.50~57 (2018), Association for Computational Linguistics
  44. Li, Qiuchi, "CNM: An Interpretable Complex-valued Network for Matching", Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies, 1, pp.4139~4148 (2019), Association for Computational Linguistics
  45. Meichanetzidis, Konstantinos, "Quantum Natural Language Processing on Near-Term Quantum Computers", ~ (2020)
  46. Meyer, Francois, "Modelling lexical ambiguity with density matrices", Proceedings of the 24th Conference on Computational Natural Language Learning, pp.276~290 (2020), Association for Computational Linguistics
  47. Mitchell, Jeff, "Vector-based models of semantic composition", Proceedings of ACL-08: HLT, pp.236~244 (2008), Association for Computational Linguistics
  48. Pearl, Judea, "Causality" (2000), Cambridge University Press
  49. Pickering, Martin, "The processing of metonymy : evidence from eye movements", Journal of Experimental Psychology : Learning, Memory, and Cognition, 25, pp.1347~1365 (1999)
  50. Pickering, Martin, "Obtaining a figurative interpretation of a word: support for underspecification", Metaphor and Symbol, 16, pp.149~171 (2001)
  51. Martin J. Pickering, "Processing ambiguous verbs: Evidence from eye movements", Journal of Experimental Psychology: Learning, Memory, and Cognition, 27(2), pp.556~573 (2001), American Psychological Association (APA)[DOI]
  52. Piedeleu, Robin, "Open system categorical quantum semantics in natural language processing", CoRR abs, 2015
  53. Pustejovsky, James, "The Generative Lexicon" (1995), The MIT Press
  54. Keith Rayner, "Lexical complexity and fixation times in reading: Effects of word frequency, verb complexity, and lexical ambiguity", Memory & Cognition, 14(3), pp.191~201 (1986), Springer Science and Business Media LLC[DOI]
  55. Sadrzadeh, Mehrnoosh, "The Frobenius anatomy of word meanings I: subject and object relative pronouns", Journal of Logic and Computation, 23(6), pp.1293~1317 (2013)[DOI]
  56. Sadrzadeh, Mehrnoosh, "The Frobenius anatomy of word meanings II: possessive relative pronouns *", Journal of Logic and Computation, 26(2), pp.785~815 (2014)[DOI]
  57. Sadrzadeh, Mehrnoosh, "Exploring semantic incrementality with dynamic syntax and vector space semantics", Proceedings of the 22nd Workshop on the Semantics and Pragmatics of Dialogue - Full Papers (2018), SEMDIAL
  58. Schütze, Hinrich, "Automatic Word Sense Discrimination", Computational Linguistics, 24(1), pp.97~123 (1998)
  59. Shutova, Ekaterina, "Automatic metaphor interpretation as a paraphrasing task", Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp.1029~1037 (2010)
  60. Michael K. Tanenhaus, "Evidence for multiple stages in the processing of ambiguous words in syntactic contexts", Journal of Verbal Learning and Verbal Behavior, 18(4), pp.427~440 (1979), Elsevier BV[DOI]
  61. Wang, Daphne, "Sheaf Theoretic Models of Contextuality from Quantum Measurements to Natural Language", Master, pp.2020
  62. Wang, Daphne, "On the quantum-like contextuality of ambiguous phrases", Proceedings of Workshop on Semantic Spaces at the Intersection of NLP, Physics, and Cognitive Science (SemSpace2021) colocated with 14th International Conference on Computational Semantics (IWCS 2021) (2021), ACL Anthology
  63. Zheng Wang, "A quantum question order model supported by empirical tests of an a priori and precise prediction", Topics in Cognitive Science, 5(4), pp.689~710 (2013), Wiley[DOI]

관련 논문AI추천

이 간행물의 다른 논문 (3건)