トピックモデルを用いた日本語テキスト マイニングの研究 －旧JLPTの読解の既出問題に対する分析を中心に－
Research on Japanese text mining using the Topic Model -Focusing on the analysis of past test reading comprehensionquestions in the previous format of JLPT-
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
In this paper, as one of the attempts to effectively utilize the vast amount of text data, I have introduced a text mining technique called Topic Model into the field of Japanese studies. Concretely, the texts of the reading comprehension parts of the previous format JLPT for the past 20 years were collected, and Topic Model analysis was carried out. The following points were made clear by such a study. First of all, it was confirmed from actual data that the subjects of the previous format JLPT tried to avoid topic-specific biases when selecting and producing the texts for the questions. Next, the text can be statistically classified into four main topics: “Private relationships such as family and work,” “Communications related to schedules,” “Public relations related to the country and society,” and “Economic activity.” The techniques and results of topic model analysis in this paper were empirical analyzes of actual existing questions. It is considered significant in that it can be applied to all fields of Japanese studies that are needed. Of course, the discussion in this paper is limited to the texts of the previous format JLPT, not the new format JLPT, and the amount of data is relatively small, although it covers all the data for the past 20 years. In addition, a comparative analysis with other texts was not possible. Therefore, it seems that there is still room for improvement in this paper, but I would like to address this as a future issue.
Abstract
In this paper, as one of the attempts to effectively utilize the vast amount of text data, I have introduced a text mining technique called Topic Model into the field of Japanese studies. Concretely, the texts of the reading comprehension parts of the previous format JLPT for the past 20 years were collected, and Topic Model analysis was carried out. The following points were made clear by such a study. First of all, it was confirmed from actual data that the subjects of the previous format JLPT tried to avoid topic-specific biases when selecting and producing the texts for the questions. Next, the text can be statistically classified into four main topics: “Private relationships such as family and work,” “Communications related to schedules,” “Public relations related to the country and society,” and “Economic activity.” The techniques and results of topic model analysis in this paper were empirical analyzes of actual existing questions. It is considered significant in that it can be applied to all fields of Japanese studies that are needed. Of course, the discussion in this paper is limited to the texts of the previous format JLPT, not the new format JLPT, and the amount of data is relatively small, although it covers all the data for the past 20 years. In addition, a comparative analysis with other texts was not possible. Therefore, it seems that there is still room for improvement in this paper, but I would like to address this as a future issue.
참고문헌 (19)
- 金明哲, "テキストコーパスマイニングツールMTMineR", 計量国語学, 32(5), pp.265~276 (2020), 計量国語学会
- 김소희, "テキストマイニングを活用した「X{まで}」構文の語彙分析─ 「X{さえ}」「X{も}」との比較・対照を中心に ─", 일본학보, (126), pp.121~143 (2021), 한국일본학회[DOI]
- 김유영, "텍스트마이닝 기법을 활용한 일본 미디어의 한국 뉴스의 감정 추이에 대한 분석-파이썬을 활용한 단어감정극성대응표 분석기법의 수행을 통해-", 일본어학연구, (65), pp.25~43 (2020), 한국일본어학회[DOI]
- 김혜연, "텍스트마이닝을 활용한 한일 어휘・문화 교육의 가능성 - ‘トイレ’, ‘화장실’ 관련 어휘 및 문화를 중심으로 -", 日本語文學, 1(92), pp.139~156 (2022), 한국일본어문학회[DOI]
- 李広微, "トピックモデルに基づいた現代小説の接続表現の分析", 日本行動計量学会大会抄録集, 48, pp.152~153 (2020)
- 李敬淑, "ICT時代の日本語硏究と敎育におけるテキストマイニングの有效性", 韓国日本語教育学会･学術発表論文集, 2018(0), pp.65~69 (2018), 韓国日本語教育学会
- 이경숙, "텍스트마이닝 기법을 활용한 일본어 학습자의 음성에 관한 연구 동향 분석", 일본어학연구, (69), pp.93~106 (2021), 한국일본어학회[DOI]
- 이유희, "텍스트 마이닝을 활용한 일본어능력시험 내용 연구 ― JLPT N3 문자・어휘를 중심으로―", 日本文化學報, (82), pp.5~25 (2019), 한국일본문화학회[DOI]
- 이유희, "텍스트 마이닝을 활용한 일본어능력시험 내용 연구 - JLPT 1급 문자․어휘를 중심으로 -", 일본어문학, (90), pp.155~179 (2020), 일본어문학회[DOI]
- 이유희, "텍스트 마이닝 기법을 통한 일본어능력시험 분석과 학습 교육 ―JLPT 4급 문자・어휘를 중심으로―", 日本文化學報, (91), pp.283~304 (2021), 한국일본문화학회[DOI]
- 류은주, "日本の高齢者の「観光」意識に関するテキストマイニング分析", 일본근대학연구, (46), pp.371~386 (2014), 한국일본근대학회[DOI]
- Top2Vec による小説の探索的研究 : 程小青の作品解読を中心に, "黄晨雯", 大阪大学大学院言語文化研究科, 43~53, pp.言語文化共同研究プロジェクト2020 (2021)
- 落合由治, "AI技術からみた日本語学、日本語教育研究の展望と課題- 日本語教育の繋がりと協働の新領域をめざして-", 일본어교육연구, (50), pp.23~34 (2020), 한국일어교육학회
- トピックモデル可視化ツールの開発に向けて, "黒田絢香", 大阪大学大学院言語文化研究科, 5~13, pp.言語文化共同研究プロジェクト2021 (2021)
- 藤田郁, "LDAトピックモデルによるIPAテキスト分析の試み : アルフレッド･テニスンの韻文を用いて", 言語文化共同研究プロジェクト, 20(1), pp.15~38 (2022), 大阪大学大学院言語文化研究科
- David M. Blei, "Latent Dirichlet Allocation", Journal of Machine Learning Research, 3, pp.993~1022 (2003), the MIT Press
- "｢AJ｣- All about Japanese Study"[URL]
- "SudachiPy v0.5.4"[URL]
- "매일 20조비트…코로나19가 앞당긴 ‘정보 재앙’ 큰 일"[URL]