본문 바로가기
KERD
논문KCI 등재

빅데이터 적정 텍스트 추출을 위한 언어학적 접근-‘학교폭력’ 관련 텍스트를 중심으로-

Linguistic approach for Document Classification on Big Data - focused on ‘School Violence’ texts-

0

조회

0

다운로드

2

인용

0

참고문헌

키워드

주제분류언어학

초록

Discussions of the text types or the issuesabout Korean language processes in the field of big Data studies havebeen unnoticed. This study aims to introduce the methodology of theexclusively collecting the ‘school violence experience’ texts in orderto prevent school violence and to catch some of the signs by analyzingthe unstructured data created in real time on a web. A certain texttype has explicit markers revealing some aspects of the topics or someinformative functions of texts. These markers are able to be appliedto extraction of appropriate texts. Moreover, individual words andmorphemes can be classified into some semantic categories and afrequency of those categories becomes a factor which contributes todistinguish a particular text from the other. This study assumes thatthere are keywords which occur with significantly high frequency atthe level of word or morpheme, and semantic categories which appearsignificance in the level of meaning in our ‘school violence experience’texts, so that these keywords and semantic categories can be usedfor the classification of appropriate texts according to topics. Conclusively, the goal of this study is to examine the way of theclassification of appropriate texts by those linguistic features.

Abstract

Discussions of the text types or the issuesabout Korean language processes in the field of big Data studies havebeen unnoticed. This study aims to introduce the methodology of theexclusively collecting the ‘school violence experience’ texts in orderto prevent school violence and to catch some of the signs by analyzingthe unstructured data created in real time on a web. A certain texttype has explicit markers revealing some aspects of the topics or someinformative functions of texts. These markers are able to be appliedto extraction of appropriate texts. Moreover, individual words andmorphemes can be classified into some semantic categories and afrequency of those categories becomes a factor which contributes todistinguish a particular text from the other. This study assumes thatthere are keywords which occur with significantly high frequency atthe level of word or morpheme, and semantic categories which appearsignificance in the level of meaning in our ‘school violence experience’texts, so that these keywords and semantic categories can be usedfor the classification of appropriate texts according to topics. Conclusively, the goal of this study is to examine the way of theclassification of appropriate texts by those linguistic features.

참고문헌 (25)

  1. 권안나, "랜덤포레스트를 이용한 변수 선택", 석사, 통계학과 통계학전공, pp.2013
  2. 김민희, "문서분류 성능 향상을 위한단어 가중치 기법에 대한 연구", 대한산업공학회 추계학술대회논문집, pp.453~464 (2011), 대한산업공학회
  3. 김성수, "R을 이용한 다변량 분석" (2014), 한국방송통신대학교출판문화원
  4. 남길임, "핵심어 분석의 절차와 쟁점- 국어국문학 분야 학술논문 핵심어를 중심으로 -", 텍스트언어학, 32, pp.89~121 (2012), 한국텍스트언어학회[DOI]
  5. 박단호, "텍스트 분석 및 의사결정 트리 모델을 이용한 웹 문서 분류 시스템", 한국정보과학회 학술발표논문집, 38(2), pp.248~251 (2011), 한국정보과학회
  6. 배동민, "빅데이터 동향 및 정책 시사점", 정보통신정책연구, 25(10), pp.37~74 (2013), 정보통신정책학회
  7. 송길영, "여기에 당신의 욕망이 보인다" (2012), 쌤앤파커스
  8. 송철환, "문서 분류 알고리즘을 이용한 한국어 스팸 문서 분류 성능비교", 한국정보과학회 학술논문발표집, 33(2), pp.222~225 (2006), 한국정보과학회
  9. 윤성희, "웹 사용자 누적 사용정보 기반의 키워드 검색 모델", 한국전자통신학회 논문지, 7(4), pp.777~782 (2012), 한국전자통신학회[DOI]
  10. K. Brinker, "텍스트언어학의 이해" (1994), 한국문화사
  11. 이성훈, "빅데이터의 국내・외 활용 고찰 및 시사점", 디지털융복합연구, 11(2), pp.229~233 (2013), 한국디지털정책학회
  12. 이수진, "핵심어 분석을 통한 학술 핵심어의 어휘 특성 연구", 석사, 국어국문학과 국어학전공, pp.2012
  13. 이정진, "R, SAS, MS-SQL을 활용한 데이터마이닝" (2011), 자유아카데미
  14. 최성, "빅데이터 정의, 활용 및 동향", 정보처리학회지, 19(2), pp.10~19 (2012), 한국정보처리학회
  15. 한국텍스트언어학회, "텍스트언어학의 이해" (2004), 박이정
  16. Baker, P., "The question is how cruel is it? In Keywords, foxhunting and the House of Commons", AHRC ICT Methods Network Expert Seminar on Linguistics, 8 (2006), AHRC ICT Methods Network
  17. Baker, P., "Corpus linguistics and discourse analysis", Lancaster University Corpus Linguistics Workshop (2014)
  18. Bao, L., "Prediction of the phenotypic effects of non-synonymous single nucleotide polymorphisms using structural and evolutionary information", Bioinformatics, 21(10), pp.2185~2190 (2005)
  19. Breiman, L., "Random Forests", Machine Learning, 45(1), pp.5~32 (2001)
  20. Brinker, K., "Linguistische Textanalyse" (1988), Erich Schmitt
  21. Firth, J. R., "Technique of Semantics", Transaction of the Philological Society, pp.36~72 (1935)
  22. Gartner, "Big Data Analytics" (2011), Gartner Group
  23. Scott, M., "PC analysis of key words –and key key words", System, 25(2), pp.233~245 (1997), Elsevier
  24. Williams, R., "Keywords : A Vocabulary of Culture and Society" (1983), Fontana Press

관련 논문AI추천

이 간행물의 다른 논문 (12건)