본문 바로가기
KERD
논문KCI 등재

Dependency Distance as a Metric of Language Comprehension Difficulty

Haitao Liu
인지과학연구소 (Institute of Cognitive Science)|2008.12|Journal of Cognitive Science|제9권 제2호|pp. 159-191|DOI 10.17791/jcs.2008.9.2.159

0

조회

0

다운로드

1

인용

0

참고문헌

키워드

treebankcognitive costdependency distancecomprehension difficulty

초록

Linguistic complexity is a measure of the cognitive difficulty of human language processing. The present paper proposes dependency distance, in the framework of dependency grammar, as an insightful metric of complexity. Three hypotheses are formulated: (1) The human language parser prefers linear orders that minimize the average dependency distance of the recognized sentence (2) There is a threshold that the average dependency distance of most sentences or texts of human languages does not exceed (3) Grammar and cognition combine to keep dependency distance within the threshold. Twenty corpora from different languages with dependency syntactic annotation are used to test these hypotheses. The paper reports the average dependency distance in these corpora and analyzes the factors which influence dependency distance. The findings — that average dependency distance has a tendency to be minimized in human language and that there is a threshold of less than 3 words in average dependency distance and grammar plays an important role in constraining distance —support all three hypotheses, although some questions are still open for further research.

Abstract

Linguistic complexity is a measure of the cognitive difficulty of human language processing. The present paper proposes dependency distance, in the framework of dependency grammar, as an insightful metric of complexity. Three hypotheses are formulated: (1) The human language parser prefers linear orders that minimize the average dependency distance of the recognized sentence (2) There is a threshold that the average dependency distance of most sentences or texts of human languages does not exceed (3) Grammar and cognition combine to keep dependency distance within the threshold. Twenty corpora from different languages with dependency syntactic annotation are used to test these hypotheses. The paper reports the average dependency distance in these corpora and analyzes the factors which influence dependency distance. The findings — that average dependency distance has a tendency to be minimized in human language and that there is a threshold of less than 3 words in average dependency distance and grammar plays an important role in constraining distance —support all three hypotheses, although some questions are still open for further research.

참고문헌 (63)

  1. Aduriz, I, "Construction of a Basque Dependency Treebank. TLT 2003. Second Workshop on Treebanks and Linguistic Theories", pp.14~15 (2003), Vaxjo
  2. Afonso, S, "Floresta sinta(c)tica”: a treebank for Portuguese. Proc. of LREC-2002", 1698~1703 (2002)
  3. Atalay, N.B, "The annotation process in the Turkish treebank. Proc. of LINC-2003" (2003)
  4. Bosco, C, "Building a treebank for Italian: a data-driven annotation schema. Proc. 2nd International Conference on Language Resources and Evaluation LREC 2000", Athens, pp.99~105 (2000), a data-driven annotation schema.Proc.2nd International Conference on Language Resources and Evaluation LREC 2000,pages 99-105,Athens,2000.
  5. Brants, S, "The TIGER treebank. Proc. of TLT-2002" (2002)
  6. Csendes, D, "The Szeged Treebank. V. Matousek et al. (Eds.): Proceedings of the 8th International Conference on Text, Speech and Dialogue", TSD 2005, 통권 : 3658, pp.123~131 (2005), Proceedings of the 8th International Conference on Text,Speech and Dialogue,TSD 2005,LNAI 3658,pp.123-131,Springer Verlag,2005.
  7. Civit Torruella, M, "Design principles for a Spanish treebank. Proc", TLT-2002 (2002)
  8. Dzeroski, S, "Towards a Slovene dependency treebank. Proc", LREC-2006 (2006)
  9. Hajic, J, "Prague Arabic dependency treebank: Development in data and tools. Proc", NEMLAR-2004, pp.110~117 (2004), Development in data and tools.Proc.of NEMLAR-2004,110-117.
  10. Stylebook for the Japanese treebank in VERBMOBIL. Verbmobil-Report 240, "Kawata, Y", Seminar fur Sprachwissenschaft, Universitat Tubingen., ~ (2000)
  11. Nilsson, J, "MAMBA meets TIGER: Reconstructing a Swedish treebank from antiquity. Proc", the NODALIDA Special Session on Treebanks (2005), Reconstructing a Swedish treebank from antiquity.Proc.of the NODALIDA Special Session on Treebanks.
  12. Oflazer, K, "Building a Turkish treebank. Abeillé A. (ed.) Treebank: Building and using Parsed Corpor", Dordrecht: Kluwer, 15 (2003), Kluwer.chapter 15.
  13. Prokopidis, P, "Theoretical and Practical Issues in the Construction of a Greek Dependency Treebank. Montserrat Civit, Sandra Kübler, and Ma. Antònia Martí, editors, Proceedings of The Fourth Workshop on Treebanks and Linguistic Theories", TLT 2005, pp.149~160 (2005)
  14. Simov, K, "Practical annotation scheme for an HPSG treebank of Bulgarian. Proc", LINC-2003, pp.17~24 (2003)
  15. van der Beek, L, "The Alpino dependency treebank. Computational Linguistics in the Netherlands", CLIN (2002)
  16. Xue, "The Penn Chinese TreeBank: Phrase Structure Annotation of a Large Corpus", Natural Language Engineering, 11(2), pp.207~238 (2005), 207-238.
  17. Buch-Kromann, M, "Discontinuous Grammar. A dependency-based model of human parsing and language acquisition. Dr.ling.merc. dissertation", Copenhagen Business School (2006)
  18. Covington, M, "A fundamental algorithm for dependency parsing. Proceedings of the 39th Annual ACM Southeast Conference", Athens (2001), Georgia
  19. Covington, M, "A Free-Word-Order Dependency Parser in Prolog. Artificial Intelligence Center", The University of Georgia (2003)
  20. Cowan, N, "The magical number 4 in short-term memory: A reconsideration of mental storage capacity", Behavioral and Brain Sciences, 24, pp.87~185 (2001), A reconsideration of mental storage capacity.Behavioral and Brain Sciences,24,87-185.
  21. Cowan, N, "Working memory capacity. Hove" (2005), UK: Psychology Press
  22. Cuetos, F, "Crosslinguistic differences in Parsing: Restrictions on the use of the Late Closure strategy in Spanish", Cognition, 30, pp.73~105 (1988), Restrictions on the use of the Late Closure strategy in Spanish.Cognition,30,73-105.
  23. Ferrer i Cancho, R, "Euclidean distance between syntactically linked words", Physical Review E, 70, pp.056135~ (2004)
  24. Ferrer i Cancho, "Why do syntactic links not cross?", Europhysics Letters, 76, pp.1228~ (2007)
  25. Ferrer i Cancho,R, "Some Limits Of Standard Linguistic Typology", Advances in Complex Systems, 11(3), pp.421~432 (2008)
  26. Frazier, Lyn, "On comprehending sentences: Syntactic parsing strategies. Unpublished doctoral dissertation", ~ (1978)
  27. Frazier, Lyn, "Natural Language Parsing: Psychological, Computational, and Theoretical Perspectives", pp.129~189 (1985), Cambridge: Cambridge University Press
  28. Gibson, E, "Linguistic complexity: locality of syntactic dependencies", Cognition, 68, pp.1~76 (1998), locality of syntactic dependencies.Cognition,68,1-76.
  29. Gibson, E, "Constraints on sentence comprehension", Trends in Cognitive Sciences, 2, pp.262~268 (1998)
  30. Gibson, E, "The dependency locality theory: a distance-based theory of linguistic complexity. In: Image, language", pp.95~126 (2000), MA: The MIT Press
  31. Grodner, D, "Consequences of the serial nature of linguistic input for sentential complexity", Cognitive Science, pp.261~290 (2005)
  32. Hawkins, J. A, "A performance theory of order and constituency. Cambridge" (1994), Cambridge University Press
  33. Hawkins, J.A, "Efficiency and Complexity in Grammars" (2004), Oxford University Press
  34. Hays, D.G, "Dependency Theory: A Formalism and Some Observations", Language, 40, pp.511~525 (1964)
  35. Hellwig, P, "Parsing with Dependency Grammars. in Dependency and Valeny. An International Handbook of Contemporary Research", ~ (2006)
  36. Heringer, H.J, "Syntax: Fragen-Lösungen- Alternativen. München: Wilhelm Fink Verlag", ~ (1980)
  37. Hiranuma, S, "Syntactic Difficulty in English and Japanese: a Textual Study. UCL Working Papers in Linguistics", 309~322 (1999)
  38. Hudson, R, "English Word Grammar", Oxford: Blackwell (1990), Blackwell.
  39. Hudson, R, "Measuring Syntactic Difficulty. Unpublished paper", ~ (1995), http:
  40. Hudson, R, "The difficulty of (so-called) self-embedded structures. UCL Working Papers in Linguistics", 1996, ~ (1996), http:
  41. Hudson, R, "Are determiners heads?", Functions of Language, 11(1), pp.7~43 (2004)
  42. Hudson, R, "Language Networks: The New Word Grammar" (2007), Oxford University Press
  43. Jay, Timothy B, "The Psychology of Language" (2004), Beijing University Press
  44. Jurafsky, D, "Probabilistic Modeling in Psycholinguistics: Linguistic Comprehension and Production. In Rens Bod, Jennifer Hay, and Stefanie Jannedy, (Eds)., Probabilistic Linguistics. Cambridge", pp.39~95 (2003), Massachusetts: The MIT Press
  45. Ke, J.-Y, "Analyzing language development from a network approach", Journal of Quantitative Linguistics, 15(1), pp.70~99 (2008)
  46. King, J, "Individual differences in syntactic processing: The role of working memory", Journal of Memory and Language, 30, pp.580~602 (1991)
  47. Lecerf, Y, "Programme des conflits–modele des conflits", Rapport CETIS, 4, pp.1~24 (1960)
  48. Liu, H, "Probability distribution of dependency distance", Glottometrics, 15, pp.1~12 (2007)
  49. Liu, H, "The complexity of Chinese dependency syntactic networks", Physica A, 387, pp.3048~3058 (2008)
  50. Liu, H, "A quantitative study of Chinese structures based on dependency treebanks", Yangtze River Academic, 3 (2008)
  51. Liu, H, "What role does syntax play in a language network?", Europhysics Letters, 83 (2008)
  52. Liu, H, "Using a Chinese treebank to measure dependency distance. Corpus Linguistics and Linguistic Theory", ~
  53. Miller, "The magical number seven plus or minus two: some limits on our capacity for processing information", Psychological Review, 63, pp.81~97 (1956), some limits on our capacity for processing information.Psychological Review,63,81-97.
  54. Miller, G. A, "Finitary Models of Language Users", ~ (1963), Handbook of Mathematical Psychology
  55. Nivre, J, "Inductive Dependency Parsing" (2006), Springer.
  56. Roelcke, T, "Efficiency of communication", Glottometrics, 4, pp.27~38 (2002)
  57. Schubert, K, "Metataxis: contrastive dependency syntax for machine translation. Dordrecht: Foris", ~ (1987)
  58. Temperley, D, "Minimization of Dependency Length in Written English", Cognition, 105, pp.300~333 (2007)
  59. Temperley, D, "Dependency Length Minimization in Natural and Artificial Languages", Journal of Quantitative Linguistics, 15, pp.256~282 (2008)
  60. Tesnière, L, "Eléments de la syntaxe structurale. Paris: Klincksieck", ~ (1959)
  61. Weckerly, J, "A PDP approach to processing center-embedded sentences. In Proceedings of the Fourteenth Annual Conference of the Cognitive Science Society", Hillsdale, NJ: Erlbaum. (1992), Erlbaum.
  62. Yngve, V, "A model and a hypothesis for language structure", Proceedings of the American Philosophical Society, 통권 : 104, pp.444~466 (1960)
  63. Yngve, V, "From Grammar to Science: New Foundations for General Linguistics. Amsterdam", Philapdelpia: John Benjamins Publishing Company, 1996

이 간행물의 다른 논문 (3건)

Rediscovering Symbols: The Role of Category Labels in Similarity JudgmentNa-Yung Yu, Takashi Yamauchi, Jay Schumacherpp. 89-109Assessment Battery for Communication — ABaCo: A new Instrument for the Evaluation of Pragmatic AbilitiesColle L., Mate D., Bara B.G., Sacco K., Angeleri R., Bosco F.M.pp. 111-157On Idioms: Cornerstones for a Neurological Model of Language ProcessingDieter G. Hillertpp. 193-233
원문 보기