Survey on Out-Of-Domain Detection for Dialog Systems
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
A dialog system becomes a new way of communication between human and computer. The dialog system takes human voice as an input, and gives a proper response in voice or perform an action. Although there are several well-known products of dialog system (e.g., Amazon Echo, Naver Wave), they commonly suffer from a problem of out-of-domain utterances. If it poorly detects out-of-domain utterances, then it will significantly harm the user satisfactory. There have been some studies aimed at solving this problem, but it is still necessary to study about this intensively. In this paper, we give an overview of the previous studies of out-of-domain detection in terms of three point of view: dataset, feature, and method. As there were relatively smaller studies of this topic due to the lack of datasets, we believe that the most important next research step is to construct and share a large dataset for dialog system, and thereafter try state-of-the-art techniques upon the dataset.
Abstract
A dialog system becomes a new way of communication between human and computer. The dialog system takes human voice as an input, and gives a proper response in voice or perform an action. Although there are several well-known products of dialog system (e.g., Amazon Echo, Naver Wave), they commonly suffer from a problem of out-of-domain utterances. If it poorly detects out-of-domain utterances, then it will significantly harm the user satisfactory. There have been some studies aimed at solving this problem, but it is still necessary to study about this intensively. In this paper, we give an overview of the previous studies of out-of-domain detection in terms of three point of view: dataset, feature, and method. As there were relatively smaller studies of this topic due to the lack of datasets, we believe that the most important next research step is to construct and share a large dataset for dialog system, and thereafter try state-of-the-art techniques upon the dataset.
참고문헌 (35)
- "Google"[URL]
- "Yahoo"[URL]
- M. S. Seigel, "Confidence Estimation for Automatic Speech Recognition Hypotheses", Doctoral, pp.2013
- J. C. Chappelier, "Traitement Automatique du Langage Naturel", pp.95~104 (1999)
- A. Graves, "Towards End-to-End Speech Recognition with Recurrent Neural Networks", Proceedings of the 31th International Conference on Machine Learning, pp.1764~1772 (2014)
- H. Khouzaimi, "An Easy Method to Make Dialogue Systems Incremental", Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pp.98~107 (2014)
- C. Shi, "A Conceptual Framework of Online Natural Language Processing Pipeline Application", Proceedings of the Workshop on Open Infrastructures and Analysis Frameworks for HLT, pp.53~59 (2014)
- X. Liu., "Personalized Natural Language Understanding", Proceedings of the 17th Annual Conference of the International Speech Communication Association, pp.1146~1150 (2016)
- D. Wang, "Understanding Computer-Directed Utterances in Multi-User Dialog Systems", Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp.8377~8381 (2013)
- P. Xu., "Contextual Domain Classification in Spoken Language Understanding Systems Using Recurrent Neural Network", Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp.136~140 (2014)
- C. Lee, "Example-Based Dialog Modeling for Practical Multi-Domain Dialog System", Speech Communication, 51, pp.466~484 (2009)
- R. Meena, "Data-Driven Methods for Spoken Dialogue Systems", Doctoral, pp.2016
- B. E. Boser, "A Training Algorithm For Optimal Margin Classifiers", Proceedings of the fifth Annual Workshop on Computational Learning Theory, pp.144~152 (1992)
- G. Tur, "Detecting Out-Of-Domain Utterances Addressed to A Virtual Personal Assistant", Proceedings of the 15th Annual Conference of the International Speech Communication Association, pp.283~287 (2014)
- E. Shriberg, "Learning When to Listen: Detecting System-Addressed Speech in Human-Human-Computer Dialog", Proceedings of the 13th Annual Conference of the International Speech Communication Association, pp.334~337 (2012)
- A. Stolcke, "Dialogue Act Modeling For Automatic Tagging and Recognition of Conversational Speech", Computational Linguistics, 26(3), pp.339~373 (2000)
- M. Core, "Coding Dialogs With the DAMSL Annotation Scheme", Proceedings of the Working Notes of the AAAI Fall Symposium on Communicative Action in Humans and Machines (1997)
- I. R. Lane., "Out-Of-Domain Detection Based On Confidence Measures From Multiple Topic Classification", Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, pp.757~760 (2004)
- I. R. Lane, "Topic Classification and Verification Modeling For Out-Of-Domain Utterance Detection", Proceedings of the 8th International Conference on Spoken Language Processing (2004)
- I. R. Lane, "Incorporating Dialogue Context and Topic Clustering in Out-of-Domain Detection", Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, pp.1045~1048 (2005)
- X. Zhang, "Character-Level Convolutional Networks for Text Classification", Proceedings of the 28th International Conference on Neural Information Processing Systems, pp.649~657 (2015)
- Y. Fujita., "Out-of-Task Utterance Detection Based on Bag-of-Words Using Automatic Speech Recognition Results", Proceedings of the third Annual Summit and Conference of Asia-Pacific Signal and Information Processing Association (2011)
- Y. S. Jeong, "Experimental Analysis for Out-Of-Domain Detection Using Features of Word Positions in Sentence", Proceedings of the Spring Conference of Korean Society for Internet Information, 18(1) (2017)
- "Wordnet"[URL]
- D. Hogan, "SMS Normalisation, Retrieval and Out-of-Domain Detection Approaches for SMS-Based FAQ Retrieval", Multilingual Information Access in South Asian Languages, pp.184~196 (2013)
- S. Ryu, "Exploiting Out-Of-Vocabulary Words For Out-Of-Domain Detection in Dialog Systems", Proceedings of the International Conference on Big Data and Smart Computing, pp.165~168 (2014)
- M. Nakano, "A Two-Stage Domain Selection Framework for Extensible Multi-Domain Spoken Dialogue Systems", Proceedings of the 12th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pp.18~29 (2011)
- T. Hastie, "The Elements of Statistical Learning" (2003), Springer
- S. Deerwester, "Indexing by Latent Semantic Analysis", Journal of the American Society for Information Science, 41(6), pp.391~407 (1990)
- D. A. Freedman, "Statistical Models: Theory and Practice" (2009), Cambridge University Press
- A. L. Berger, "A Maximum Entropy Approach to Natural Language Processing", Computational Linguistics, 22(1), pp.39~71 (1996)
- S. Ryu, "Neural Sentence Embedding Using Only In-Domain Sentences for Out-Of-Domain Sentence Detection in Dialog Systems", Pattern Recognition Letter, 88, pp.26~32 (2017)
- S. Hochreiter, "Long Short-Term Memory", Neural Computation, 9(8), pp.1735~1780 (1997)
- J. K. Kim., "Joint Learning of Domain Classification and Out-of-Domain Detection with Dynamic Class Weighting for Satisficing False Acceptance Rates", Proceedings of 19th Annual Conference of the International Speech Communication Association, pp.556~560 (2018)
- 정영섭, "계층적 디리클레 프로세스를 활용한미지원 도메인 검출", 한국컴퓨터정보학회논문지, 23(1), pp.17~24 (2018), 한국컴퓨터정보학회[DOI]