음향 기반 물 사용 활동 감지용 엣지 컴퓨팅 시스템
The Edge Computing System for the Detection of Water Usage Activities with Sound Classification
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Efforts to employ smart home sensors to monitor the indoor activities of elderly single residents have been made to assess the feasibility of a safe and healthy lifestyle. However, the bathroom remains an area of blind spot. In this study, we have developed and evaluated a new edge computer device that can automatically detect water usage activities in the bathroom and record the activity log on a cloud server. Three kinds of sound as flushing, show- ering, and washing using wash basin generated during water usage were recorded and cut into 1-second scenes. These sound clips were then converted into a 2-dimensional image using MEL-spectrogram. Sound data augmen- tation techniques were adopted to obtain better learning effect from smaller number of data sets. These techniques, some of which are applied in time domain and others in frequency domain, increased the number of training data set by 30 times. A deep learning model, called CRNN, combining Convolutional Neural Network and Recurrent Neu- ral Network was employed. The edge device was implemented using Raspberry Pi 4 and was equipped with a con- denser microphone and amplifier to run the pre-trained model in real-time. The detected activities were recorded as text-based activity logs on a Firebase server. Performance was evaluated in two bathrooms for the three water usage activities, resulting in an accuracy of 96.1% and 88.2%, and F1 Score of 96.1% and 87.8%, respectively. Most of the classification errors were observed in the water sound from washing. In conclusion, this system demonstrates the potential for use in recording the activities as a lifelog of elderly single residents to a cloud server over the long- term.
Abstract
Efforts to employ smart home sensors to monitor the indoor activities of elderly single residents have been made to assess the feasibility of a safe and healthy lifestyle. However, the bathroom remains an area of blind spot. In this study, we have developed and evaluated a new edge computer device that can automatically detect water usage activities in the bathroom and record the activity log on a cloud server. Three kinds of sound as flushing, show- ering, and washing using wash basin generated during water usage were recorded and cut into 1-second scenes. These sound clips were then converted into a 2-dimensional image using MEL-spectrogram. Sound data augmen- tation techniques were adopted to obtain better learning effect from smaller number of data sets. These techniques, some of which are applied in time domain and others in frequency domain, increased the number of training data set by 30 times. A deep learning model, called CRNN, combining Convolutional Neural Network and Recurrent Neu- ral Network was employed. The edge device was implemented using Raspberry Pi 4 and was equipped with a con- denser microphone and amplifier to run the pre-trained model in real-time. The detected activities were recorded as text-based activity logs on a Firebase server. Performance was evaluated in two bathrooms for the three water usage activities, resulting in an accuracy of 96.1% and 88.2%, and F1 Score of 96.1% and 87.8%, respectively. Most of the classification errors were observed in the water sound from washing. In conclusion, this system demonstrates the potential for use in recording the activities as a lifelog of elderly single residents to a cloud server over the long- term.
참고문헌 (15)
- "K-indicator, National Index System"[URL]
- 문희정, "재가노인 단독세대의 주택내 안전사고 실태 및 실내환경 평가에 관한 연구", 한국주거학회논문집, 15(1), pp.75~84 (2004), 한국주거학회
- Storeng SH, "Factors associated with basic and instrumental activities of daily living in elderly participants of a population-based survey : the Nord-Trøndelag Health Study", BMJ Open, 8(3), pp.e018942~ (2018)
- 신영석, "고령자 생활활동패턴에 따른 신체, 인지 및 정서의 건강상태에 관한 비교 연구", 노인복지연구, 72(4), pp.7~29 (2017), 한국노인복지학회[DOI]
- Baig M, "A Systematic Review of Wearable Sensors and IoT-Based Monitoring Applications for Older Adults – a Focus on Ageing Population and Independent Living", Journal of Medical Systems, 43, pp.233~ (2019)
- Bankole A, "BESI : Behavioral and Environmental Sensing and Intervention for Dementia Caregiver Empowerment", American Journal of Alzheimer’s Disease & Other Dementias, 35, pp.1~15 (2020)
- Miguel K, "Home Camera-Based Fall Detection System for the Elderly", Sensors, 17(12), pp.2864~ (2017)
- Serizel R, "Sound Event Detection in Synthetic Domestic Environments", IEEE International Conference on Acoustics, Speech and Signal Processing, pp.86~90 (2020)
- 소순원, "한국어 음성을 이용한 연령 분류 딥러닝 알고리즘 기술 개발", 의공학회지, 39(2), pp.63~68 (2018), 대한의용생체공학회
- "IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events"[URL]
- Abayomi OO, "Data Augmentation and Deep Learning Methods in Sound Classification: A Systematic Review", Electronics, 11(22), pp.3795~ (2022)
- Wei W, "A-CRNN: A Domain Adaptation Model for Sound Event Detection", IEEE International Conference on Acoustics, Speech and Signal Processing ICASSP, pp.276~280 (2020)
- Kong Q, "Sound Event Detection of Weakly Labelled Data With CNN-Transformer and Automatic Threshold Optimization", IEEE, 2020, 2450~2460
- "Mobile Web Application Development Platform"[URL]
- "MyHealthApple"[URL]