사용자 의견 추출을 위한 텍스트 마이닝 기반 비정형 데이터 정량화 방안
Unstructured Data Quantification Scheme Based on Text Mining for User Feedback Extraction
0
조회
0
다운로드
5
인용
0
참고문헌
키워드
초록
People write reviews of numerous products or services on the Internet, in their blogs or community bulletin boards. These unstructured data contain important emotions and opinions about the author's product or service, which can provide important information for future product design or marketing. However, this text-based information cannot be evaluated quantitatively, and thus they are difficult to apply to mathematical models or optimization problems for product design and improvement. Therefore, this study proposes a method to quantitatively extract user’s opinion or preference about a specific product or service by utilizing a lot of text-based information existing on the Internet or online. The extracted unstructured text information is decomposed into basic unit words, and positive rate is evaluated by using existing emotional dictionaries and additional lists proposed in this study. This can be a way to effectively utilize unstructured text data, which is being generated and stored in vast quantities, in product or service design. Finally, to verify the effectiveness of the proposed method, a case study was conducted using movie review data retrieved from a portal website. By comparing the positive rates calculated by the proposed framework with user ratings for movies, a guideline on text mining based evaluation of unstructured data is provided.
Abstract
People write reviews of numerous products or services on the Internet, in their blogs or community bulletin boards. These unstructured data contain important emotions and opinions about the author's product or service, which can provide important information for future product design or marketing. However, this text-based information cannot be evaluated quantitatively, and thus they are difficult to apply to mathematical models or optimization problems for product design and improvement. Therefore, this study proposes a method to quantitatively extract user’s opinion or preference about a specific product or service by utilizing a lot of text-based information existing on the Internet or online. The extracted unstructured text information is decomposed into basic unit words, and positive rate is evaluated by using existing emotional dictionaries and additional lists proposed in this study. This can be a way to effectively utilize unstructured text data, which is being generated and stored in vast quantities, in product or service design. Finally, to verify the effectiveness of the proposed method, a case study was conducted using movie review data retrieved from a portal website. By comparing the positive rates calculated by the proposed framework with user ratings for movies, a guideline on text mining based evaluation of unstructured data is provided.
참고문헌 (15)
- Aggarwal, C.C., "Mining Text Data", pp.11~35 (2012), Springer
- 장재영, "온라인 쇼핑몰의 상품평 자동분류를 위한 감성분석 알고리즘", 한국전자거래학회지, 14(4), pp.19~33 (2009), 한국전자거래학회
- Das, T.K., "Big data analytics : A framework for unstructured data analysis", International Journal of Engineering Technology, 5(1), pp.153~156 (2013)
- Gantz, J., "The digital universe in 2020 :Big data, bigger digital shadows, and biggest growth in the far east", IDC iView : IDC Anal. Future, 2007, pp.1~16 (2012)
- Ghose, A., "Estimating the Helpfulness and Economic Impact of Product Reviews : Mining Text and Reviewer Characteristics", IEEE Transactions on Knowledge and Data Engineering, 23(10), pp.1498~1512 (2011)
- Hu, M., "Mining and summarizing customer reviews", ’04 Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pp.168~177 (2004)
- 감미아, "텍스트 마이닝을 활용한 신문사에 따른 내용 및 논조 차이점 분석", 지능정보연구, 18(3), pp.53~77 (2012), 한국지능정보시스템학회
- 김경애, "소셜 분석을 통한 사전제작 드라마의 가능성과 한계에 관한 연구-jtbc <맨투맨>을 중심으로-", 한국산학기술학회논문지, 19(2), pp.164~172 (2018), 한국산학기술학회[DOI]
- 김경훈, "텍스트마이닝을 통한 최고경영자 대상 이러닝 콘텐츠 트렌드 분석", 경영정보학연구, 19(2), pp.1~19 (2017), 한국경영정보학회[DOI]
- Kim, S., "Introduction to Statistics", pp.96~97 (2007), Hakjisa
- Laudauer, T. K., "An Introduction to Latent Semantic Analysis", Journal Discourse Processes, 25(2-3), pp.259~284 (1998)
- Le, Q. V., "Distributed Representations of Sentences and Documents", Proceedings of the 31st International Conference on International Conference on Machine Learning, 32, pp.1188~1196 (2014)
- Tan, A., "Text Mining : The state of the art and the challenges", Proceedings of the PAKDD 1999 Workshop on Knowledge Disocovery from Advanced Databases, pp.65~70 (1999)
- "Wikidipia"[URL]
- 윤장혁, "Quantifying the Process of Patent Right Quality Evaluation : Combined Application of AHP, Text Mining and Regression Analysis", 한국산업경영시스템학회지, 38(2), pp.17~30 (2015), 한국산업경영시스템학회