A Method of Chinese and Thai Cross-Lingual Query Expansion Based on Comparable Corpus
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Cross-lingual query expansion is usually based on the relationship among monolingual words. Bilingualcomparable corpus contains relationships among bilingual words. Therefore, this paper proposes a methodbased on these relationships to conduct query expansion. First, the word vectors which characterize thebilingual words are trained using Chinese and Thai bilingual comparable corpus. Then, the correlationbetween Chinese query words and Thai words are computed based on these word vectors, followed withselecting the Thai candidate expansion terms via the correlative value. Then, multi-group Thai queryexpansion sentences are built by the Thai candidate expansion words based on Chinese query sentence. Finally, we can get the optimal sentence using the Chinese and Thai query expansion method, and performthe Thai query expansion. Experiment results show that the cross-lingual query expansion method weproposed can effectively improve the accuracy of Chinese and Thai cross-language information retrieval.
Abstract
Cross-lingual query expansion is usually based on the relationship among monolingual words. Bilingualcomparable corpus contains relationships among bilingual words. Therefore, this paper proposes a methodbased on these relationships to conduct query expansion. First, the word vectors which characterize thebilingual words are trained using Chinese and Thai bilingual comparable corpus. Then, the correlationbetween Chinese query words and Thai words are computed based on these word vectors, followed withselecting the Thai candidate expansion terms via the correlative value. Then, multi-group Thai queryexpansion sentences are built by the Thai candidate expansion words based on Chinese query sentence. Finally, we can get the optimal sentence using the Chinese and Thai query expansion method, and performthe Thai query expansion. Experiment results show that the cross-lingual query expansion method weproposed can effectively improve the accuracy of Chinese and Thai cross-language information retrieval.
참고문헌 (32)
- T. Talvensaari, "Creating and exploiting a comparable corpus in cross-language information retrieval", ACM Transactions on Information Systems (TOIS), 25(1) (2007)
- T. Talvensaari, "Focused web crawling in the acquisition of comparable corpora", Information Retrieval, 11(5), pp.427~445 (2008)
- O. Batarfi, "A distributed query execution engine of big attributed graphs", SpringerPlus, 5(1) (2016)
- H. U. Weiping, "Vehicle license plate recognition method based on threshold segmentation and region growing", Journal of Guangxi Academy of Sciences, 2016(1), pp.54~58 (2016)
- J. Dalton, "Entity query feature expansion using knowledge base links", Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval, pp.365~374 (2014)
- C. Carpineto, "A survey of automatic query expansion in information retrieval", ACM Computing Surveys (CSUR), 44(1) (2012)
- P. Gupta, "Query expansion for mixed-script information retrieval", Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval, pp.677~686 (2014)
- L. Li, "Multi-strategy query expansion method based on semantics", Journal of Digital Information Management, 12(3), pp.183~191 (2014)
- J. Gao, "Clickthrough-based translation models for web search : from word models to phrase models", Proceedings of the 19th ACM International Conference on Information and Knowledge Management, pp.1139~1148 (2010)
- J. Gao, "Towards concept-based translation models using search logs for query expansion", Proceedings of the 21st ACM International Conference on Information and Knowledge Management (2012)
- J. Arguello, "Document representation and query expansion models for blog recommendation", Proceedings of the 2nd International Conference on Weblogs and Social Media (ICWSM) (2008)
- A. Samoilenko, "Linguistic neighbourhoods : explaining cultural borders on Wikipedia through multilingual co-editing activity", EPJ Data Science, 5(1) (2016)
- A. Kotov, "Tapping into knowledge base for concept feedback: leveraging conceptnet to improve search results for difficult queries", Proceedings of the 5th ACM International Conference on Web Search and Data Mining, pp.403~412 (2012)
- M. Lu, "Query expansion via WordNet for effective code search", Proceedings of 2015 IEEE 22nd International Conference on Software Analysis, Evolution and Reengineering (SANER), pp.545~549 (2015)
- V. Klyuev, "Web query expansion : a strategy utilising Japanese WordNet", JoC, 1(1), pp.23~28 (2010)
- C. Xiong, "Query expansion with freebase", Proceedings of the 2015 International Conference on the Theory of Information Retrieval, pp.111~120 (2015)
- M. de Boer, "Knowledge based query expansion in complex multimedia event detection", Multimedia Tools and Applications, 75(15), pp.9025~9043 (2016)
- F. Colace, "Improving relevance feedback‐based query expansion by the use of a weighted word pairs approach", Journal of the Association for Information Science and Technology, 66(11), pp.2223~2234 (2015)
- A. Sordoni, "Learning concept embeddings for query expansion by quantum entropy minimization", Proceedings of the 28th AAAI Conference on Artificial Intelligence, pp.1586~1592 (2014)
- H. B. Hashemi, "Mining a Persian–English comparable corpus for cross-language information retrieval", Information Processing & Management, 50(2), pp.384~398 (2014)
- J. Bhogal, "A review of ontology based query expansion", Information Processing &Management, 43(4), pp.866~886 (2007)
- "Using word embeddings for automatic query expansion" (2016)[URL]
- R. Vaidyanathan, "Query expansion strategy based on pseudo relevance feedback and term weight scheme for monolingual retrieval", International Journal of Computer Applications, 105(8), pp.1~6 (2014)
- J. Singh, "Context window based co-occurrence approach for improving feedback based query expansion in information retrieval", International Journal of Information Retrieval Research(IJIRR), 5(4), pp.31~45 (2015)
- R. Rahimi, "Extracting translations from comparable corpora for Cross-Language Information Retrieval using the language modeling framework", Information Processing & Management, 52(2), pp.299~318 (2016)
- A. Shakery, "Leveraging comparable corpora for cross-lingual information retrieval in resourcelean language pairs", Information Retrieval, 16(1), pp.1~29 (2013)
- J. Yu, "A new approach of rules extraction for word sense disambiguation by features of attributes", Applied Soft Computing, 27, pp.411~419 (2015)
- J. Lafferty, "Document language models, query models, and risk minimization for information retrieval", Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp.111~119 (2001)
- "A lexical analysis tool with ambiguity support" (2012)[URL]
- S. Kim, "Combining lexical and statistical translation evidence for cross‐language information retrieval", Journal of the Association for Information Science and Technology, 66(1), pp.23~39 (2015)
- P. Sorg, "Exploiting Wikipedia for cross-lingual and multilingual information retrieval", Data &Knowledge Engineering, 74, pp.26~45 (2012)
- H. E. Ping, "Design and implementation of a Lucene-based full-text retrieval management system", Journal of Yangtze University(Natural Science Edition), 2014(22), pp.35~38 (2014)