Evaluation of Co-occurring Terms in Clinical Documents Using Latent Semantic Indexing
2
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Objectives: Measurement of similarities between documents is typically influenced by the sparseness of the term-document matrix employed. Latent semantic indexing (LSI) may improve the results of this type of analysis. Methods: In this study, LSI was utilized in an attempt to reduce the term vector space of clinical documents and newspaper editorials. Results: After applying LSI, document similarities were revealed more clearly in clinical documents than editorials. Clinical documents which can be characterized with co-occurring medical terms, various expressions for the same concepts, abbreviations, and typographical errors showed increased improvement with regards to a correlation between co-occurring terms and document similarities. Conclusions: Our results showed that LSI can be used effectively to measure similarities in clinical documents. In addition, correlation between the co-occurrence of terms and similarities realized in this study is an important positive feature associated with LSI.
Abstract
Objectives: Measurement of similarities between documents is typically influenced by the sparseness of the term-document matrix employed. Latent semantic indexing (LSI) may improve the results of this type of analysis. Methods: In this study, LSI was utilized in an attempt to reduce the term vector space of clinical documents and newspaper editorials. Results: After applying LSI, document similarities were revealed more clearly in clinical documents than editorials. Clinical documents which can be characterized with co-occurring medical terms, various expressions for the same concepts, abbreviations, and typographical errors showed increased improvement with regards to a correlation between co-occurring terms and document similarities. Conclusions: Our results showed that LSI can be used effectively to measure similarities in clinical documents. In addition, correlation between the co-occurrence of terms and similarities realized in this study is an important positive feature associated with LSI.
참고문헌 (11)
- Landauer TK, "LSA as a theory of meaning, in Handbook of latent semantic analysis", pp.3~35 (2007), Lawrence Erlbaum Associates
- Deerwester S, "Indexing by latent semantic analysis", J Am Soc Inf Sci, 41, pp.391~407 (1990)
- Dumais ST, "LSA and information retrieval: back to basics, in Handbook of latent semantic analysis", pp.293~321 (2007), Lawrence Erlbaum Associates
- Hofmann T, "Probabilistic latent semantic indexing, in 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval", pp.50~57 (1999), Association for Computing Machinery
- Hofmann T, "Unsupervised learning by probabilistic latent semantic analysis", Mach Learn, 42, pp.177~196 (2001)
- Blei D, "Latent dirichlet allocation", J Mach Learn Res, 3, pp.993~1022 (2003)
- Steyvers M, "Probabilistic author-topic models for information discovery, in Knowledge Discovery and Data Mining 2004", pp.306~315 (2004), WA
- Wang X, "Topics over time: a non-Markov continuous-time model of topical trends, in Knowledge Discovery and Data Mining 2006" (2006), Association for Computing Machinery
- Blei DM, "Dynamic topic models, in The 23rd International Conference of Machine Learning" (2006), PA
- Manning CD, "Introduction to information retrieval. 1st ed", pp.378~384 (2008), Cambridge University Press
- "Agglutinative language"[URL]