한국어 텍스트 문장정렬을 위한 개체격자 접근법과 LSA 기반 접근법의 활용연구
A comparative study of Entity-Grid and LSA models on Korean sentence ordering
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
본 논문은 텍스트의 응집도 측정과 텍스트 자동생성 시스템을 위한 기초기술 중 하나인 문장정렬 과제에 대한 연구로, 개체기반적(entity-based) 접근의 한 유형인 개체격자 모형(Entity-Grid model)과 벡터공간 모형에 기반한 LSA(Latent Semantic Analysis)를 모두 시도하고 결과를 서로 비교하였다. 개체격자 모형에 대한 기존 연구들에서 논의된 명사들의 통사역(syntactic role) 정보가 한국어 텍스트 정렬과제에 미치는 영향을 실험하고자 하였으며, 기존 독일어권 응용연구 결과와는 달리 긍정적인 결과를 얻었다. 이 과정에서 한국어의 격조사를 활용하는 전략을 취했으며, 이는 한국어의 격표지 정보가 한국어 텍스트의 응집성을 측정하는 데에 유용할 수 있다는 점을 보인 것이다. 그리고 개체격자 모형을 통한 결과를 LSA 기반 모형결과와 비교하여 양 모형의 장단점과 향후 개선점을 아울러 논의하였다.
Abstract
For the task of sentence ordering, this paper attempts to utilize the Entity-Grid model, a type of entity-based modeling approach, as well as Latent Semantic analysis, which is based on vector space modeling, The task is well known as one of the fundamental tools used to measure text coherence and to enhance text generation processes. For the implementation of the Entity-Grid model, we attempt to use the syntactic roles of the nouns in the Korean text for the ordering task, and measure its impact on the result, since its contribution has been discussed in previous research. Contrary to the case of German, it shows a positive result. In order to obtain the information on the syntactic roles, we use a strategy of using Korean case-markers for the nouns. As a result, it is revealed that the cues can be helpful to measure text coherence. In addition, we compare the results with the ones of the LSA-based model, discussing the advantages and disadvantages of the models, and options for future studies.
참고문헌 (22)
- Scott, D., "Getting the message across in RST-based text generation", Current research in natural language generation, 4, pp.47~73 (1990)
- Kibble, R., "Optimizing Referential Coherence in Text Generation", Comput. Linguist, 30(4), pp.401~416 (2004)
- Reiter, E., "Building natural language generation systems" (2000), Cambridge University Press
- McKoon, G., "Inference during reading", Psychological review, 99(3), pp.440~466 (1992)
- Barzilay, R., "Modeling local coherence: An entity-based approach", Computational Linguistics, 34(1), pp.1~34 (2008)
- Foltz, P. W., "The measurement of textual coherence with latent semantic analysis", Discourse Processes, 25(2-3), pp.285~307 (1998)
- Kuno, S., "Functional sentence perspective: A case study from Japanese and English", Linguistic inquiry, 3(3), pp.269~320 (1972)
- Chafe, W., "Givenness, contrastiveness, definiteness, subjects and topics, In Subject and topic", pp.25~56 (1976), Academic Press
- Karttunen, L., "Discourse referents, In Syntax and Semantics: Notes form the linguistic underground (Vol. 7)", pp.363~386 (1976), Academic Press
- Givon, T., "Beyond foreground and background", Coherence and grounding in discourse, 11, pp.175~188 (1987)
- Grosz, B. J., "Centering: a framework for modeling the local coherence of discourse", Comput. Linguist, 21(2), pp.203~225 (1995)
- Prince, E. F., "Toward a taxonomy of given-new information, In Radical pragmatics", pp.223~255 (1981), Academic Press
- 노지은, "중심화 이론을 이용한 텍스트 구조화", 정보과학회논문지 : 소프트웨어 및 응용, 34(6), pp.572~583 (2007), 한국정보과학회
- Filippova, K., "Extending the entity-grid coherence model to semantically related entities", Paper presented at the Proceedings of the Eleventh European Workshop on Natural Language Generation (2007)
- Landauer, T. K., "An introduction to latent semantic analysis", Discourse Processes, 25(2-3), pp.259~284 (1998)
- Dumais, S., "A solution to Platos problem: The latent semantic analysis theory of acquisition, induction and representation of knowledge", Psychological review, 104(2), pp.211~240 (1997)
- Turney, P. D., "From frequency to meaning: Vector space models of semantics", Journal of artificial intelligence research, 37(1), pp.141~188 (2010)
- Salton, G., "The SMART retrieval system-experiments in automatic document processing" (1971)
- Salton, G., "A vector space model for automatic indexing", Communications of the ACM, 18(11), pp.613~620 (1975)
- Deerwester, S., "Indexing by latent semantic analysis", Journal of the American society for information science, 41(6), pp.391~407 (1990)
- Berry, M. W., "Using linear algebra for intelligent information retrieval", SIAM review, 37(4), pp.573~595 (1995)
- Joachims, T., "Training linear SVMs in linear time", Paper presented at the Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining (2006)