음표 임베딩과 마디 임베딩을 이용한곡의 생성 및 정량적 평가 방법
Creating Songs Using Note Embedding and Bar Embedding and Quantitatively Evaluating Methods
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
인공신경망을 이용해서 기존 곡을 학습시키고 새로운 곡을 생성하기 위해서는 전처리 과정으로 곡을 신경망이 인식할 수 있는 숫자로 변환해야하며, 지금까지는 원-핫 인코딩이 사용되어 왔다. 본 논문에서는 음표 임베딩과 마디 임베딩을 제안하고 기존의 원-핫 인코딩과 성능을 비교하였다. 성능비교는 어떤 방식이 작곡가가 작곡한 곡과 유사한 곡을 생성하는지를 정량적 평가에 근거해서 수행하였으며, 평가방법으로는 자연어 처리분야에서 사용되는 정량적 평가 방법들을 이용하였다. 평가결과 마디 임베딩으로 생성한 곡이 가장 좋았으며 그 다음으로 음표 임베딩이 좋았다. 이는 본 논문에서 제안한 음표 임베딩과 마디 임베딩이 원-핫 인코딩보다 작곡가가 작곡한 곡과 유사한 곡을 생성한 것으로서 의의가 있다.
Abstract
In order to learn an existing song and create a new song using an artificial neural network, it is necessary to convert the song intonumerical data that the neural network can recognize as a preprocessing process, and one-hot encoding has been used until now. Inthis paper, we proposed a note embedding method using notes as a basic unit and a bar embedding method that uses the bar as thebasic unit, and compared the performance with the existing one-hot encoding. The performance comparison was conducted based onquantitative evaluation to determine which method produced a song more similar to the song composed by the composer, and quantitativeevaluation methods used in the field of natural language processing were used as the evaluation method. As a result of the evaluation,the song created with bar embedding was the best, followed by note embedding. This is significant in that the note embedding and barembedding proposed in this paper create a song that is more similar to the song composed by the composer than the existing one-hotencoding.
참고문헌 (24)
- H. Chu, "Song from PI : A musically plausible network for pop music generation", arXiv preprint arXiv:1611.03477, ~ (2016)
- F. Shah, "LSTM Based Music Generation", 2019 International Conference on Machine Learning and Data Engineering (2019)
- P. Chen, "CS 224 N project report: From Note 2 Vec to Chord 2 Vec", ~ (2019)
- 황서림, "RNN-GAN을 이용한 코드 기반의 단계적 트로트 음악 생성 기법", 한국음향학회지, 39(6), pp.622~628 (2020), 한국음향학회
- "Similarity Method Between Words"[URL]
- L. C. Yang, "On the evaluation of generative models in music", Neural Computing and Applications, 32(9), pp.4773~4784 (2020)
- B. Logan, "Toward evaluation techniques for music similarity", The MIR, 2003, pp.3, 81~85
- K. Papineni, "BLEU : a Method for Automatic Evaluation of Machine Translation", Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp.311~318 (2002)
- C. Y. Lin, "ROUGE : A package for automatic evaluation of summaries", Proceedings of the Workshop on Text Summarization Branches Out, pp.74~81 (2004)
- S. Banerjee, "METEOR : An automatic metric for MT evaluation with improved correlation with human judgments", Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and, 2005, 65~72
- R. Vedantam, "CIDEr : Consensus-based image description evaluation", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.4566~4575 (2015)
- S. Sharma, "Relevance of unsupervised metrics in task-oriented dialogue for evaluating natural language generation", arXiv preprint arXiv:1706.09799, ~ (2017)
- T. Mikolov, "Efficient Estimation of Word Representations in Vector Space", Proceedings of Workshop at ICLR (2013)
- J. Pennington, "GloVe: Global vectors for word representation", Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pp.1532~1543 (2014)
- A. Joulin, "Bag of tricks for efficient text classification", Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, pp.427~431 (2017)
- S. Hochreiter, "Long short-term memory", Neural Computation, 9(8), pp.1735~1780 (1997)
- H. Sak, "Long short-term memory recurrent neural network architectures for large scale acoustic modeling", Proceedings of the Annual Conference of the International Speech Communication Association, pp.338~342 (2014)
- T. Mikolov, "Recurrent neural network based language model", Proceedings of the 11th Annual Conference of the International Speech Communication Association, pp.1045~1048 (2010)
- I. Sutskever, "Sequence to sequence learning with neural networks", arXiv preprint arXiv:1409.3215, ~ (2014)
- R. Jozefowicz, "An empirical exploration of recurrent network architectures", Proceedings of the 32nd International Conference on Machine Learning, pp.2342~2350 (2015)
- D. Bahdanau, "Neural machine translation by jointly learning to align and translate", arXiv preprint arXiv : 1409. 0473, ~ (2016)
- K. Xu, "How, attend and tell : Neural image caption generation with visual attention", Proceedings of the 32nd International Conference on Machine Learning, pp.2048~2057 (2015)
- Z. Yang, "Hierarchical attention networks for document classification", Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp.1480~1489 (2016)
- Z. Lin, "A structured self-attentive sentence embedding", arXiv preprint arXiv : 1703. 03130, ~ (2017)