본문 바로가기
KERD
논문KCI 등재

A Comparative Analysis of Music Similarity Measures in Music Information Retrieval Systems

문양세|Kuldeep Gurjar
한국정보처리학회|2018.02|JIPS(Journal of Information Processing Systems) (Journal of Information Processing Systems)|제14권 제1호|pp. 32-55|DOI https://doi.org/10.3745/JIPS.04.0054

0

조회

0

다운로드

1

인용

0

참고문헌

키워드

Content-Based Music RetrievalMIR SystemMusic Information Retrieval SurveyMusic Similarity Measures

초록

The digitization of music has seen a considerable increase in audience size from a few localized listeners to awider range of global listeners. At the same time, the digitization brings the challenge of smoothly retrievingmusic from large databases. To deal with this challenge, many systems which support the smooth retrieval ofmusical data have been developed. At the computational level, a query music piece is compared with the restof the music pieces in the database. These systems, music information retrieval (MIR systems), work forvarious applications such as general music retrieval, plagiarism detection, music recommendation, andmusicology. This paper mainly addresses two parts of the MIR research area. First, it presents a generaloverview of MIR, which will examine the history of MIR, the functionality of MIR, application areas of MIR,and the components of MIR. Second, we will investigate music similarity measurement methods, where weprovide a comparative analysis of state of the art methods. The scope of this paper focuses on comparativeanalysis of the accuracy and efficiency of a few key MIR systems. These analyses help in understanding thecurrent and future challenges associated with the field of MIR systems and music similarity measures.

Abstract

The digitization of music has seen a considerable increase in audience size from a few localized listeners to awider range of global listeners. At the same time, the digitization brings the challenge of smoothly retrievingmusic from large databases. To deal with this challenge, many systems which support the smooth retrieval ofmusical data have been developed. At the computational level, a query music piece is compared with the restof the music pieces in the database. These systems, music information retrieval (MIR systems), work forvarious applications such as general music retrieval, plagiarism detection, music recommendation, andmusicology. This paper mainly addresses two parts of the MIR research area. First, it presents a generaloverview of MIR, which will examine the history of MIR, the functionality of MIR, application areas of MIR,and the components of MIR. Second, we will investigate music similarity measurement methods, where weprovide a comparative analysis of state of the art methods. The scope of this paper focuses on comparativeanalysis of the accuracy and efficiency of a few key MIR systems. These analyses help in understanding thecurrent and future challenges associated with the field of MIR systems and music similarity measures.

참고문헌 (113)

  1. J. S. Downie, "Music information retrieval", Annual Review of Information Science and Technology, 37(1), pp.295~340 (2003)
  2. M. A. Casey, "Content-based music information retrieval: current directions and future challenges", Proceedings of the IEEE, 96(4), pp.668~696 (2008)[DOI]
  3. M. Kassler, "Toward musical information retrieval", Perspectives of New Music, 4(2), pp.59~67 (1966)[DOI]
  4. M. Kassler, "The Computer and Music", pp.299~327 (1970), Cornell University Press
  5. H. B. Lincoln, "Elektronische Datenverarbeitung in der Musikwissenschaft", pp.57~62 (1967), Gustave Bosse Verlag
  6. D. Deutsch, "Octave generalization and tune recognition", Perception & Psychophysics, 11(6), pp.411~412 (1972)[DOI]
  7. D. A. Byrd, "Music notation by computer", pp.1984
  8. M. Mongeau, "Comparison of musical sequences", Computers and the Humanities, 24(3), pp.161~175 (1990)[DOI]
  9. J. Foote, "An overview of audio information retrieval", Multimedia Systems, 7(1), pp.2~10 (1999)[DOI]
  10. D. Byrd, "Problems of music information retrieval in the real world", Information Processing & Management, 38(2), pp.249~272 (2002)[DOI]
  11. J. S. Downie, "Evaluating a simple approach to music information retrieval: conceiving melodic n-grams as text", pp.1999
  12. A. Ghias, "Query by humming: musical information retrieval in an audio database", Proceedings of the 3rd ACM International Conference on Multimedia, pp.231~236 (1995)
  13. A. Freed, "Audio Engineering Society Convention 121", pp.1314~1325 (2006), Audio Engineering Society
  14. M. C. Jones, "Human similarity judgments: implications for the design of formal evaluations", Proceedings of 8th International Conference on Music Information Retrieval (ISMIR 2007), pp.539~542 (2007)
  15. M. Schedl, "The neglected user in music information retrieval research", Journal of Intelligent Information Systems, 41(3), pp.523~539 (2013)[DOI]
  16. J. Urbano, "Crowdsourcing preference judgments for evaluation of music similarity tasks", Proceedings of the 1st ACM SIGIR Workshop on Crowdsourcing for Search Evaluation, pp.9~16 (2010)
  17. U. M. Julian, "Evaluation in audio music similarity", pp.2013
  18. J. S. Downie, "The scientific evaluation of music information retrieval systems: foundations and future", Computer Music Journal, 28(2), pp.12~23 (2004)
  19. Music information retrieval: a survey of issues and approaches, "R. J. Demopoulos", Department of Computer Science, University of Western Ontario, ~, pp.Technical Report #677 (2007)
  20. M. Casey, "Automatic location and measurement of ornaments in audio recordings", Proceedings of 5th International Conference on Music Information Retrieval (ISMIR 2004), pp.311~317 (2004)
  21. T. Lambrou, "Classification of audio signals using statistical features on time and wavelet transform domains", Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, pp.3621~3624 (1998)
  22. T. Zhang, "Audio content analysis for online audiovisual data segmentation and classification", IEEE Transactions on Speech and Audio Processing, 9(4), pp.441~457 (2001)[DOI]
  23. G. Tzanetakis, "Musical genre classification of audio signals", IEEE Transactions on Speech and Audio Processing, 10(5), pp.293~302 (2002)[DOI]
  24. R. Typke, "A ground truth for half a million musical incipits", Proceedings of the 5th Dutch-Belgian Information Retrieval Workshop, pp.63~70 (2005)
  25. F. Alias, "A review of physical and perceptual feature extraction techniques for speech, music and environmental sounds", Applied Sciences, 6(5) (2016)
  26. D. Mitrovic, "Advances in Computers: Improving the Web", pp.71~150 (2010), Academic
  27. D. Gusfield, "Algorithms on Strings, Trees and Sequences: Computer Science and Computational Biology", pp.91~95 (1997), Cambridge University Press
  28. S. Needleman, "A general method applicable to the search for similarities in the amino acid sequence of two proteins", Journal of Molecular Biology, 48(3), pp.443~453 (1970)[DOI]
  29. D. Sankoff, "Time Warps, Strings Edits, and Macromolecules: The Theory and Practice of Sequence Comparison" (1983), Addison-Wesley
  30. M. Robine, "Music similarity: improvements of edit-based algorithms by considering music theory", Proceedings of the International Workshop on Multimedia Information Retrieval, pp.135~142 (2007)
  31. K. Lemstrom, "Using relative interval slope in music information retrieval", Proceedings of the International Conference on Computer Music, pp.317~320 (1999)
  32. R. J. McNab, "Towards the digital music library: tune retrieval from acoustic input", Proceedings of the first ACM International Conference on Digital Libraries, pp.11~18 (1996)
  33. V. I. Levenshtein, "Binary codes capable of correcting deletions, insertions, and reversals", Soviet Physics Doklady, 10(8), pp.707~710 (1966)
  34. R. A. Wagner, "The string-to-string correction problem", Journal of the ACM, 21(1), pp.168~173 (1974)[DOI]
  35. T. F. Smith, "Identification of common molecular subsequences", Journal of Molecular Biology, 147(1), pp.195~197 (1981)[DOI]
  36. Y. Zhu, "Warping indexes with envelope transforms for query by humming", Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, pp.181~192 (2003)
  37. M. J. Dovey, "An algorithm for locating polyphonic phrases within a polyphonic musical piece", Proceedings of the Artificial Intelligence and Simulation of Behavior (AISB)'99 Symposium on Musical Creativity, pp.48~53 (1999)
  38. E. Ukkonen, "Geometric algorithms for transposition invariant contentbased music retrieval", Proceedings of the 4th International Conference on Music Information Retrieval (ISMIR 2003), pp.193~199 (2003)
  39. R. Typke, "Searching notated polyphonic music using transportation distances", Proceedings of the 12th Annual ACM International Conference on Multimedia, pp.128~135 (2004)
  40. Y. Rubner, "The earth mover's distance as a metric for image retrieval", International Journal of Computer Vision, 40(2), pp.99~121 (2001)
  41. N. J. Bryan, "Source separation of polyphonic music with interactive userfeedback on a piano roll display", Proceedings of the 14th International Conference on Music Information Retrieval (ISMIR 2013), pp.119~124 (2013)
  42. S. Doraisamy, "Robust polyphonic music retrieval with n-grams", Journal of Intelligent Information systems, 21(1), pp.53~70 (2003)[DOI]
  43. S. Downie, "Evaluation of a simple and effective music information retrieval method", Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp.73~80 (2000)
  44. R. Typke, "Using transportation distances for measuring melodic similarity", Proceedings of the 4th International Conference on Music Information Retrieval (ISMIR 2003), pp.193~199 (2003)
  45. R. Typke, "A measure for evaluating retrieval techniques based on partially ordered ground truth lists", Proceedings of 2006 IEEE International Conference on Multimedia and Expo, pp.1793~1796 (2006)
  46. C. Dodge, "Computer Music: Synthesis, Composition, and Performance", pp.361~368 (1997), Schirmer Books
  47. G. R. Grimmett, "Probability and Random Processes", pp.245~288 (2001), Oxford University Press
  48. H. H. Hoos, "GUIDO", MIR-an experimental musical information retrieval system based on GUIDO music notation, 2001, 41~50
  49. R. C. Veltkamp, "Encyclopedia of Multimedia", pp.97~98 (2008), Springer
  50. D. Mullensiefen, "Melodic similarity: approaches and applications", Proceedings of the 8th International Conference on Music Perception and Cognition (2004)
  51. P. Foster, "Sequential complexity as a descriptor for musical similarity", IEEE, 2014, pp.22(12), 1965~1977
  52. M. W. Park, "Similarity measurement method between two songs by using the conditional euclidean distance", WSEAS Transactions on Information Science and Applications, 10(12), pp.381~388 (2013)
  53. D. Mullensiefen, "Cognitive adequacy in the measurement of melodic similarity: algorithmic vs. human judgments", Computing in Musicology, 13(2003), pp.147~176 (2004)
  54. P. Ferraro, "Optimizations of local edition for evaluating similarity between monophonic musical sequences", Proceeding RIAO 2007 Large Scale Semantic Access to Content (Text, Image, Video, and Sound), pp.64~69 (2007)
  55. Y. Tang, "Earth mover's distance based similarity search at scale", Proceedings of the VLDB Endowment, 7(4), pp.313~324 (2013)
  56. J. Lijffijt, "Benchmarking dynamic time warping for music retrieval", Proceedings of the 3rd International Conference on PErvasive Technologies Related to Assistive Environments, pp.1~7 (2010)
  57. S. Doraisamy, "Polyphonic music retrieval: the N-gram approach", pp.2004
  58. A. Uitdenbogered, "Melodic matching techniques for large music databases", Proceedings of the 7th ACM international conference on Multimedia, pp.56~66 (1999)
  59. G. Tzanetakis, "Manipulation, analysis and retrieval systems for audio signals", pp.2002
  60. "A large set of audio set for sound description (similarity and classification) in the CUIDADO project" (2004)[URL]
  61. P. Knees, "A music search engine built upon audio-based and webbased similarity measures", Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp.447~554 (2007)
  62. D. Turnbull, "Combining audio content and social context for semantic music discovery", Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp.387~394 (2009)
  63. E. J. Isaacson, "Music IR for music theory", Proceedings of the Workshop on the Creation of Standardized Test Collections, Tasks, and Metrics for MIR and MDL Evaluation, pp.23~26 (2002)
  64. C. Laurier, "Indexing music by mood: design and integration of an automatic content-based annotator", Multimedia Tools and Applications, 48(1), pp.161~184 (2010)[DOI]
  65. Y. E. Kim, "Music emotion recognition: a state of the art review", Proceedings of the 11th International Conference on Music Information Retrieval (ISMIR 2010), pp.255~266 (2010)
  66. A. Wang, "An industrial strength audio search algorithm", Proceedings of 4th International Conference on Music Information Retrieval (ISMIR 2013), pp.7~13 (2003)
  67. C. S. Dhir, "Extraction of independent discriminant features for data with asymmetric distribution", Knowledge and Information Systems, 30(2), pp.359~375 (2012)[DOI]
  68. R. B. Dannenberg, "A comparative evaluation of search techniques for query-by-humming using the MUSART testbed", Journal of the American Association for Information Science and Technology, 58(5), pp.687~701 (2007)[DOI]
  69. J. Salamon, "Tonal representations for music retrieval: from version identification to query-by-humming", International Journal of Multimedia Information Retrieval, 2(1), pp.45~58 (2013)[DOI]
  70. J. Serra, "Advances in Music Information Retrieval", pp.307~332 (2010), Springer
  71. H. Kirchhoff, "Evaluation of features for audio-to-audio alignment", Journal of New Music Research, 40(1), pp.27~41 (2011)[DOI]
  72. S. Dixon, "Match: a music alignment tool chest", Proceedings of 6th International Conference on Music Information Retrieval (ISMIR 2005), pp.492~497 (2005)
  73. M. Muller, "An efficient multiscale approach to audio synchronization", Proceedings of 7th International Conference on Music Information Retrieval (ISMIR 2006), pp.192~197 (2006)
  74. J. Lee, "Music plagiarism detection system", Proceedings of the 26th International Technical Conference on Circuits, 2011, 828~830
  75. C. Dittmar, "Audio forensics meets music information retrieval: a toolbox for inspection of music plagiarism", Proceedings of the 20th European Signal Processing Conference (EUSIPCO), pp.1249~1253 (2012)
  76. J. I. Park, "Music plagiarism detection using melody databases", Proceedings of the 9th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, pp.684~693 (2005)
  77. A. Saracoglu, "Content based copy detection with coarse audio-visual fingerprints", Proceedings of the 7th International Workshop on Content-Based Multimedia Indexing, pp.213~218 (2009)
  78. M. Schedl, "Music information retrieval: recent developments and applications", Foundations and Trends in Information Retrieval, 8(2-3), pp.127~261 (2014)[DOI]
  79. R. Burke, "Hybrid recommender systems: survey and experiments", User Modeling and User-Adapted Interaction, 12(4), pp.331~370 (2002)[DOI]
  80. Y. Song, "A survey of music recommendation systems and future perspectives", Proceedings of the 9th International Symposium on Computer Music Modelling and Retrieval (CMMR 2012), pp.395~410 (2012)
  81. L. Baltrunas, "InCarMusic: context-aware music recommendations in a car", Proceedings of the International Conference on Electronic Commerce and Web Technologies, pp.89~100 (2011)
  82. Y. C. Zhang, "Auralist: introducing serendipity into music recommendation", Proceedings of the 5th ACM International Conference on Web Search and Data Mining, pp.13~22 (2012)
  83. M. Schedl, "A model for serendipitous music retrieval", Proceedings of the 2nd Workshop on Context-Awareness in Retrieval and Recommendation, pp.10~13 (2012)
  84. M. Schedl, "Hybrid retrieval approaches to geospatial music recommendation", Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp.793~796 (2013)
  85. D. Perrot, "Scanning the dial: an exploration of factors in the identification of musical style", Proceedings of the Society for Music Perception and Cognition (1999)
  86. F. Pachet, "A taxonomy of musical genres", Proceedings of RIAO 2000: Content-Based Multimedia Information Access, pp.1238~1245 (2000)
  87. G. Tzanetakis, "Marsyas: a framework for audio analysis", Organised Sound, 4(3), pp.169~175 (2000)[DOI]
  88. C. N. Silla, "A machine learning approach to automatic music genre classification", Journal of the Brazilian Computer Society, 14(3), pp.7~18 (2008)[DOI]
  89. T. Pohle, "Reinventing the wheel: a novel approach to music player interfaces", IEEE Transactions on Multimedia, 9(3), pp.567~575 (2007)[DOI]
  90. D. Schnitzer, "One-touch access to music on mobile devices", Proceedings of the 6th International Conference on Mobile and Ubiquitous Multimedia, pp.103~109 (2007)
  91. N. Koenigstein, "Song ranking based on piracy in peer-to-peer networks", Proceedings of 10th International Conference on Music Information Retrieval (ISMIR 2009), pp.633~638 (2009)
  92. M. Schedl, "What's hot? Estimating country-specific artist popularity", Proceedings of 11th International Conference on Music Information Retrieval (ISMIR 2010), pp.117~122 (2010)
  93. R. Dhanaraj, "Automatic prediction of hit songs", Proceedings of 6th International Conference on Music Information Retrieval (ISMIR 2005), pp.488~491 (2005)
  94. I. Karydis, "Musical track popularity mining dataset", Proceedings of the 12th International Conference on Artificial Intelligence Applications and Innovations, pp.562~572 (2016)
  95. X. Serra, "Roadmap for Music Information ReSearch" (2013), MIRES Consortium
  96. Y. H. Yang, "Music Emotion Recognition" (2011), CRC Press
  97. P. Cano, "Computational Intelligence for Modelling and Prediction", pp.233~245 (2005), Springer Science and Business Media
  98. T. Kageyama, "Melody retrieval with humming", Proceedings of the International Computer Music Conference, pp.349~351 (1993)
  99. N. Kosugi, "A practical query-by-humming system for a large music database", Proceedings of the 8th ACM international conference on Multimedi, pp.333~342 (2000)
  100. T. B. Mahieux, "Large-scale cover song recognition using the 2D Fourier transform magnitude", Proceedings of 13th International Conference on Music Information Retrieval (ISMIR 2012) (2012)
  101. M. P. Ryynanen, "Automatic transcription of melody, bass line, and chords in polyphonic music", Computer Music Journal, 32(3), pp.72~86 (2008)[DOI]
  102. K. Kashino, "Application of Bayesian probability network to music scene analysis", Computational Auditory Scene Analysis, 1(998), pp.1~15 (1995)
  103. F. Pachet, "Hit song science is not yet a science", Proceedings of 9th International Conference on Music Information Retrieval (ISMIR 2008), pp.355~360 (2008)
  104. J. S. Downie, "The 2005 Music Information Retrieval Evaluation eXchange (MIREX 2005): Preliminary Overview", Proceedings of 6th International Conference on Music Information Retrieval, pp.320~323 (2005)
  105. M. D. Ferreira, "On accuracy and time processing evaluation of cover song identification systems", Journal of New Music Research, 45(4), pp.333~342 (2016)[DOI]
  106. R. Scholz, "Cross task study on MIREX recent results: an index for evolution measurement and some stagnation hypothesis", Proceedings of 17th International Conference on Music Information Retrieval (ISMIR 2016), pp.372~378 (2016)
  107. K. Lemstrom, "Searching monophonic patterns within polyphonic sources", Proceedings of RIAO 2000: Content-Based Multimedia Information Access, pp.1261~1279 (2000)
  108. M. Grachten, "Melodic similarity: looking for a good abstraction level", Proceedings of 5th International Conference on Music Information Retrieval (ISMIR 2004), pp.210~215 (2004)
  109. N. Orio, "Music retrieval: a tutorial and review", Foundations and Trends in Information Retrieval, 1(1), pp.1~90 (2006)[DOI]
  110. P. Herrera-Boyer, "Towards instrument segmentation for music content description: a critical review of instrument classification techniques", Proceedings of 1st International Conference on Music Information Retrieval (ISMIR 2000), pp.115~119 (2000)
  111. P. Lamere, "Social tagging and music information retrieval", Journal of New Music Research, 37(2), pp.101~114 (2008)[DOI]
  112. "Music machine to predict tomorrow's hits" (2006)[URL]
  113. M. Goto, "Multimodal Music Processing", pp.217~225 (2012), Dagstuhl Publishing

관련 논문AI추천

내용기반 음악검색 시스템의 비교 분석노정순한국정보관리학회 · 정보관리학회지2013 · 제30권 제3호Conjoined Audio Fingerprint based on Interhash and Intra hash Algorithms김대진, 최홍섭한국콘텐츠학회 · International Journal of Contents2015 · 제11권 제4호Analysis of Pre-Processing Methods for Music Information Retrieval in Noisy Environments using Mobile Devices김대진, Ddeo-Ol-Ra Koo한국콘텐츠학회 · International Journal of Contents2012 · 제8권 제2호The Problems and Opportunities of Content-based Analysis and Description of Ethnic MusicAxel Hallez, Dirk Moelants, Guy De Tré, Jos Gansemans, Marc Leman, Olmo Cornelis, Rita De Caluwe, Tom Matthé국립민속박물관 · International Journal of Intangible Heritage2007 · 제2호The Classification of Music Styles on the Basis of Spectral Contrast Features왕얀빙한국컴퓨터정보학회 · 한국컴퓨터정보학회논문지2017 · 제22권 제1호Thai Classical Music Matching using t-Distribution on Instantaneous Robust Algorithm for Pitch Tracking FrameworkPheerasut Boonmatham, Sunee Pongpinigpinyo, Tasanawan Soonklang한국정보처리학회 · JIPS(Journal of Information Processing Systems)2017 · 제13권 제5호

이 간행물의 다른 논문 (17건)

Practical Approaches Based on Deep Learning and Social Computing박종혁pp. 1-5A Survey on Passive Image Copy-Move Forgery DetectionZhi Zhang, Xiao Zhou, Chengyou Wangpp. 6-31Black Hole along with Other Attacks in MANETs: A SurveyHua-Pei Chiang, Han-Chieh Chao, Fan-Hsun Tsengpp. 56-78A Survey on Automatic Twitter Event SummarizationDwijen Rudrapal, Amitava Das, Baby Bhattacharyapp. 79-100A Survey about Consensus Algorithms Used in BlockchainGiang-Truong Nguyen, 김경백pp. 101-128
원문 보기