TOEFL11을 이용한 비지도 토픽 모델링
Unsupervised Topic Modeling using TOEFL11
1
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
This paper aims at modeling topics from TOEFL essay samples in the TOEFL11 corpus. The TOEFL11 corpus is a collection of 12,100 TOEFL writing samples submitted by test-takers from 11 different countries. The paper applied an unsupervised method (i.e. Latent Dirichlet Allocation or LDA) of clustering texts to written samples, with the aim of automatic modeling of topics. For each of the 11 non-native TOEFL test takers, 1,100 TOEFL essays were transformed to a document-term matrix, and then were fed into the LDA function in the R software. The number of potential topics was set to be 8, which was the same number of prompts the test takers had been given when they took the test. The overall accuracy ranged from 83% to 99% depending on the native language of the test takers. Further analysis needs to be conducted to see how reliably the unsupervised LDA method can be used in automatically classifying written samples to potential topics. Nevertheless, the paper provides an empirical foundation that automatic topic modeling can be applied in an unsupervised way even to the writing sample of English learners.
Abstract
This paper aims at modeling topics from TOEFL essay samples in the TOEFL11 corpus. The TOEFL11 corpus is a collection of 12,100 TOEFL writing samples submitted by test-takers from 11 different countries. The paper applied an unsupervised method (i.e. Latent Dirichlet Allocation or LDA) of clustering texts to written samples, with the aim of automatic modeling of topics. For each of the 11 non-native TOEFL test takers, 1,100 TOEFL essays were transformed to a document-term matrix, and then were fed into the LDA function in the R software. The number of potential topics was set to be 8, which was the same number of prompts the test takers had been given when they took the test. The overall accuracy ranged from 83% to 99% depending on the native language of the test takers. Further analysis needs to be conducted to see how reliably the unsupervised LDA method can be used in automatically classifying written samples to potential topics. Nevertheless, the paper provides an empirical foundation that automatic topic modeling can be applied in an unsupervised way even to the writing sample of English learners.
참고문헌 (29)
- 남춘호, "일기자료 연구에서 토픽모델링 기법의 활용가능성 검토", 비교문화연구, 22(1), pp.89~135 (2016), 비교문화연구소
- 백영민, "R을 이용한 텍스트 마이닝" (2017), 한울
- 장세은, "텍스트 마이닝을 통한 셰익스피어 학술논문 영어초록 코퍼스의 토픽모델링 분석", 언어과학, 24(4), pp.55~82 (2017), 한국언어과학회
- 윤태진, "TOEFL11 코퍼스에서 주제 프롬프터의 자동 분류", 인문언어, 20(1), pp.157~177 (2018), 국제언어인문학회[DOI]
- 이성민, "ESP 학술논문의 저자키워드와 코퍼스키워드의 비교 연구", 언어과학, 23(3), pp.201~223 (2016), 한국언어과학회[DOI]
- 최재웅, "대학생 영어 학습자 작문 코퍼스에 대한 주제별 분류: 계층적 군집화", 언어정보, (17), pp.93~115 (2013), 언어정보연구소
- Asgari, E., "Linguistic Resources & Topic Models for the Analysis of Persian Poems", Proceedings of the Second Workshop on Computational Linguistics for Literature, pp.23~31 (2013)
- Blei, D., "Probabilistic Topic Models", Communications of the ACM, 55(4), pp.77~84 (2012)
- Blei D., "Dynamic Topic Models", Proceedings of the 23rd International Conference on Machine Learning, pp.113~120 (2006), ACM
- Blei, D., "Latent Dirichlet Allocation", The Journal of Machine Learning Research, 3, pp.993~1022 (2003)
- TOEFL11: A Corpus of Non-native English, "Blanchard, D.", Educational Testing Service, ~, pp.ETSRR-13-24 (2013)
- Boyd-Graber, J., "Linguistic Extensions of Topic Models", Doctoral, pp.2010
- Boyd-Graber, J., "A Topic Model for Word Sense Disambiguation", EMNLP, 2007, ~
- Burstein, J., "Advanced Capabilities for Evaluating Student Writing: Detecting Off-topic Essays without Topic-specific training", Paper presented at the International Conference on Artificial Intelligence in Education (2005)
- "tm: Text Mining Package. R package version 0.7-5" (2018)[URL]
- Griffiths, T., "Finding Scientific Topics", Proceedings of the National Academy of Sciences of the United States of America, 101, pp.5228~5235 (2004)
- Grün B., "Topicmodels: An R Package for Fitting Topic Models", Journal of Statistical Software, 40(13), pp.1~30 (2011)
- Hall, D., "Studying the History of Ideas Using Topic Models", Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp.363~371 (2008), Association for Computational Linguistics
- Jockers, M., "Text Analysis with R for Students of Literature" (2014), Springer
- Jockers, M., "Macroanalysis: Digital Methods and Literary History" (2013), University of Illinois Press
- Jurafsky, D., "Speech and Language Processing" (2008), Pearson Prentice Hall
- Lewis, D., "Rcv1: A New Benchmark Collection for Text Categorization Research", Journal of Machine Learning Research, 5, pp.361~397 (2004)
- Manning, C., "Foundations of Statistical Natural Language Processing" (1999), The MIT Press
- Newman, D., "Probabilistic Topic Decomposition of an Eighteenth-century American Newspaper", Journal of the American Society for Information Science and Technology, 57(6), pp.753~767 (2006)
- Ponweiser, M., "Latent Dirichlet Allocation in R", pp.2012
- Porter, M., "An Algorithm for Suffix Stripping", Program, 14(3), pp.130~137 (1980)
- "R: A Language and Environment for Statistical Computing" (2015)[URL]
- Rosen-Zvi, M., "The Author-topic Model for Authors and Documents", Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence, pp.487~494 (2004), AUAI Press
- Toutanova, K., "Advances in Neural Information Processing Systems 20", pp.1521~1528 (2008), MIT Press