Implementation of Melody Playback Method through Image Classification and Stroke Analysis
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
In this study, we devised a application that generates and reproduces music by analyzing images received from a user. It was aimed not only to capture the technical meaning of auditioning images, but also to express emotions and intentions in user's images. In the proposed application, a user draws a picture of a desired object. The application uses artificial intelligence to determine which object an image is. After that, the emotions that can be connected with each objects. The application determines the key that matches the mood through the emotion associated with the object. After setting a key suitable for the emotion, the user's stroke order is analyzed, and the melody is composed based on the extracted user’s stroke data. In the future, research on arts such as painting and music will be continued as well as implementing auditory expression of images. Based on this, we will present the direction to embody the artistic and intention in the image into music. It will also be a meaningful attempt as a direction of combination between engineering fields such as artificial intelligence for recognizing pictures and art fields such as picture analysis, and music production.
Abstract
In this study, we devised a application that generates and reproduces music by analyzing images received from a user. It was aimed not only to capture the technical meaning of auditioning images, but also to express emotions and intentions in user's images. In the proposed application, a user draws a picture of a desired object. The application uses artificial intelligence to determine which object an image is. After that, the emotions that can be connected with each objects. The application determines the key that matches the mood through the emotion associated with the object. After setting a key suitable for the emotion, the user's stroke order is analyzed, and the melody is composed based on the extracted user’s stroke data. In the future, research on arts such as painting and music will be continued as well as implementing auditory expression of images. Based on this, we will present the direction to embody the artistic and intention in the image into music. It will also be a meaningful attempt as a direction of combination between engineering fields such as artificial intelligence for recognizing pictures and art fields such as picture analysis, and music production.
참고문헌 (13)
- S. Cho, "Developing Digital Contents Using Multimedia Technology", Digital Contents Society, 1(1), pp.103~110 (2000)
- 이혜인, "멜로디 비교 시각화를 통한 음정 교정 시스템 구현", 전기학회논문지, 63(1), pp.156~161 (2014), 대한전기학회[DOI]
- 김지연, "대중음악의 시각화를 통한 텍스타일 프린트 패턴디자인 발상", 한국의류산업학회지, 17(4), pp.524~540 (2015), 한국의류산업학회
- 조재영, "신경망 기반 장르별 멜로디 패턴 형성", 한국정보기술학회논문지, 7(5), pp.125~130 (2009), 한국정보기술학회
- 조재영, "신경망을 이용한 코드별 멜로디 패턴 분석", 한국정보기술학회논문지, 7(1), pp.252~257 (2009), 한국정보기술학회
- Doyoung Noh, "The Study on translate a sound source of image coordinate using overlay techniques of Layer", Korean Geospatial Information Society Conference, pp.61~68 (2010)
- 배명진, "의도적인 공감각 기반 인간의 움직임 시·청각화 시스템의구현", 한국지능시스템학회 논문지, 28(1), pp.83~90 (2018), 한국지능시스템학회
- Sharif Razavian, Ali, "CNN features off-the-shelf : an astounding baseline for recognition", Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp.806~813 (2014)
- Dong-rim Kim, "Research on the visualization of music sensibility for directing a music emotion of LED lighting system", Doctoral, pp.2016
- Mi-Jin Kim, "Emotion Prediction from Images Based on Color and Object Word", Korean Computer Graphics Society Conference, pp.115~116 (2015)
- 변성우, "IoT를 위한 음성신호 기반의 톤, 템포 특징벡터를 이용한 감정인식", 전기학회논문지, 65(1), pp.116~121 (2016), 대한전기학회[DOI]