형태 분석 말뭉치 구축을 위한 한국어 구어 분석
Analysis of Spoken Korean for Construction of a POS Tagged Corpus
1
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
In this study, I discussed various problems that can occur when constructing a POS Tagged corpus of Korean spoken. The morphological analysis corpus is the most basic annotation corpus, while the study and construction work on the annotation of written corpus is done in various angles, but the research on the spoken corpus has hardly been done. First, I introduce the corpus and the morphological analysis tool, Utagger, which will be used in the analysis. Then, I have examined the construction process of the spoken corpus. Then, I summarized the characteristics of Korean spoken language, especially the contraction which is the most characteristic feature of colloquialism. And I discussed why information about the contraction phenomenon is important in the POS Tagged corpus of spoken language. In this paper, I tried to analyze the various sentences including the spoken variation by using the Utagger used in constructing the large corpus. However, due to the limitations of the tools developed around written language, about half of them did not show correct results. Especially, the contracted forms were rarely processed. Finally, I describe the differences in the distribution of parts of speech that are revealed through comparison with the written corpus for the analyzing of spoken corpus. In this paper, I deal only with morphological analysis, which is the most basic annotation, but I think it is also necessary to study how the distribution of homophonic words in written and spoken corpus differs for the constructing of a annotation corpus separated by lexical meaning.
Abstract
In this study, I discussed various problems that can occur when constructing a POS Tagged corpus of Korean spoken. The morphological analysis corpus is the most basic annotation corpus, while the study and construction work on the annotation of written corpus is done in various angles, but the research on the spoken corpus has hardly been done. First, I introduce the corpus and the morphological analysis tool, Utagger, which will be used in the analysis. Then, I have examined the construction process of the spoken corpus. Then, I summarized the characteristics of Korean spoken language, especially the contraction which is the most characteristic feature of colloquialism. And I discussed why information about the contraction phenomenon is important in the POS Tagged corpus of spoken language. In this paper, I tried to analyze the various sentences including the spoken variation by using the Utagger used in constructing the large corpus. However, due to the limitations of the tools developed around written language, about half of them did not show correct results. Especially, the contracted forms were rarely processed. Finally, I describe the differences in the distribution of parts of speech that are revealed through comparison with the written corpus for the analyzing of spoken corpus. In this paper, I deal only with morphological analysis, which is the most basic annotation, but I think it is also necessary to study how the distribution of homophonic words in written and spoken corpus differs for the constructing of a annotation corpus separated by lexical meaning.
참고문헌 (18)
- 강상호, "조선어입말체연구" (1989), 사회과학출판사
- 김한샘, "한국어 언어 자원 분석의 표준 - 형태 분석을 중심으로 -", 배달말, (58), pp.1~30 (2016), 배달말학회
- 김한샘, "한국어 학습자 말뭉치 주석의 요건과 실제 - 형태 분석 말뭉치 구축을 중심으로 -", 배달말, (61), pp.149~173 (2017), 배달말학회
- 남길임, "구어 비유창성 현상의 주석 체계 연구", 텍스트언어학, 30, pp.45~72 (2011), 한국텍스트언어학회[DOI]
- 노대규, "한국어의 입말과 글말" (1996), 국학자료원
- 민경모, "현대국어 형태 정보 주석 문어 말뭉치의 주석 단위 표기 방안에 대하여", 언어사실과 관점, 12, pp.13 (2003), 69~111[DOI]
- 박석준, "한국어 구어 말뭉치의 형태 주석 방법과 몇 가지 문제에 대하여", 언어와 문화, 2(3), pp.15~37 (2006), 한국언어문화교육학회[DOI]
- 서상규, "한국어 구어 빈도 사전" (2014), 한국문화사
- 서상규, "한국어 구어 말뭉치 연구" (2013), 한국문화사
- 안의정, "구어 어휘의 어종별 분포 연구 - 문어 어휘와의 비교를 중심으로-", 언어사실과 관점, 39, pp.287~304 (2016), 언어정보연구원[DOI]
- 안의정, "한국어 텍스트의 어휘 다양도와 어휘 밀도 분석", 언어사실과 관점, 41, pp.349~365 (2017), 언어정보연구원[DOI]
- 안의정, "구어 전사 말뭉치 구축에 관한 현황과 쟁점", 언어와 문화, 14(3), pp.81~101 (2018), 한국언어문화교육학회[DOI]
- Andersen, Gisle, "Semi-lexical features in corpus transcription: Consistency, comparability, standardisation", International Journal of Corpus Linguistics, 21(3), pp.323~347 (2016)
- Collins, P., "Colloquial features in World Englishes", International Journal of Corpus Linguistics, 18(4), pp.479~505 (2013)
- Leech G., "Word Frequencies in Written and Spoken English" (2001), Longman
- Leech, G., "Change in contemporary English : a grammatical study" (2009), Cambridge Univerisity Press
- Osimk-Teasdale, R., "Accounting for ELF: Categorising the unconventional in POS-tagging the VOICE corpus", International Journal of Corpus Linguistics, 21(3), pp.372~395 (2016)
- Gries, S. T., "Handbook of Linguistic Annotation", pp.379~409 (2017), Springer