Optical Music Score Recognition System for Smart Mobile Devices
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
In this paper, we propose a smart system that can optically recognize a music score within a document and can play the music after recognition. Many historic handwritten documents have now been digitalized. Converting images of a music score within documents into digital files is particularly difficult and requires considerable resources because a music score consists of a 2D structure with both staff lines and symbols. The proposed system takes an input image using a mobile device equipped with a camera module, and the image is optimized via preprocessing. Binarization, music sheet correction, staff line recognition, vertical line detection, note recognition, and symbol recognition processing are then applied, and a music file is generated in an XML format. The Music XML file is recorded as digital information, and based on that file, we can modify the result, logically correct errors, and finally generate a MIDI file. Our system reduces misrecognition, and a wider range of music score can be recognized because we have implemented distortion correction and vertical line detection. We show that the proposed method is practical, and that is has potential for wide application through an experiment with a variety of music scores.
Abstract
In this paper, we propose a smart system that can optically recognize a music score within a document and can play the music after recognition. Many historic handwritten documents have now been digitalized. Converting images of a music score within documents into digital files is particularly difficult and requires considerable resources because a music score consists of a 2D structure with both staff lines and symbols. The proposed system takes an input image using a mobile device equipped with a camera module, and the image is optimized via preprocessing. Binarization, music sheet correction, staff line recognition, vertical line detection, note recognition, and symbol recognition processing are then applied, and a music file is generated in an XML format. The Music XML file is recorded as digital information, and based on that file, we can modify the result, logically correct errors, and finally generate a MIDI file. Our system reduces misrecognition, and a wider range of music score can be recognized because we have implemented distortion correction and vertical line detection. We show that the proposed method is practical, and that is has potential for wide application through an experiment with a variety of music scores.
참고문헌 (12)
- J. M. Yoo, "Advanced Binarization Method for Music Score Recognition sing Local Thresholds", CIT Workshops, pp.417~420 (2008)
- V. Q. Nhat, "Adaptive Line Fitting for Staff Detection in Handwritten Music Score Images", Proc. 8th ICUIMC, (99) (2014)
- A. Rebelo, "Optical music recognition: state-of-the-art and open issues", International Journal of Multimedia Information Retrieval, 1(3), pp.173~190 (2012)
- D. Bainbridge, "The Challenge of Optical Music Recognition", Computers and the Humanities, 35(2), pp.95~121 (2001)
- 박건희, "휴대폰 카메라로 촬영한 악보 영상 인식을 위한의사트리 알고리즘", 한국콘텐츠학회 논문지, 8(6), pp.16~25 (2008), 한국콘텐츠학회
- Y. Y. Tang, "Image transformation approach to nonlinear shape restoration", IEEE Trans. Systems. Man and Cybernetics, 23(1), pp.155~172 (1993)
- T. Beran, "Recognition of Printed Music Score", LNAI, (1715), pp.174~179 (1999)
- A. Capela, "Integrated Recognition System for Music Scores", Proc. ICMC'2008 (2008)
- A. Robelo, "Optical recognition of music symbols: A comparative study", IJDAR, 13(1), pp.19~31 (2010)
- Q. Q. Arshad, "Overview of Algorithms and Techniques for Optical Music Recognition", CIIT Workshops on 4th CWRC (2006)
- 김광백, "퍼지 ART 알고리즘을 이용한 인쇄 악보의 자동인식과 연주", 한국전자통신학회 논문지, 6(1), pp.84~89 (2011), 한국전자통신학회
- G. S. Choudhury, "Strike Up the Score", D-Lib Magazing, 7(2) (2001)