비점오염물질측정망의 탁도 예측을 위한 수질 인자를 이용한 최적 머신러닝 알고리즘 선정
Selection of the best fitted Machine Learning Algorithms for TurbidityPrediction using Water Quality Parameters in Non-point Source Pollution Monitoring Network
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This study was aimed to determine the best fitted machine learning model to predict the turbidity relative to water temperature, pH, EC, and DO data collected from non-point source pollution monitoring networks in case of missing data. Thus, K-NN, SVM, and Decision Tree were used to be trained. To assess the sensitivity on each algorithm to the scale of the monitoring data, both raw and normalized data sets were run. Additionally, hyperparameters were tuned to derive optimal values for each algorithm’s performance. K-fold cross-validation was employed to prevent overfitting. After tuning, the top 10 models with the highest NSE were evaluated using separate test data that was not involved in the tuning process. This allowed for further validation of the model performance using metrics such as NSE, MSE, RMSE, and MAE. The results indicated that Decision Tree algorithm achieved highest prediction accuracy followed by SVM and K-NN. Decision Tree was particularly well-suited for accurate turbidity prediction relative to other water quality monitoring data. Thus, machine learning techniques could be effectively used for predicting one of the water quality parameters when it will be partially missed or false recorded.
Abstract
This study was aimed to determine the best fitted machine learning model to predict the turbidity relative to water temperature, pH, EC, and DO data collected from non-point source pollution monitoring networks in case of missing data. Thus, K-NN, SVM, and Decision Tree were used to be trained. To assess the sensitivity on each algorithm to the scale of the monitoring data, both raw and normalized data sets were run. Additionally, hyperparameters were tuned to derive optimal values for each algorithm’s performance. K-fold cross-validation was employed to prevent overfitting. After tuning, the top 10 models with the highest NSE were evaluated using separate test data that was not involved in the tuning process. This allowed for further validation of the model performance using metrics such as NSE, MSE, RMSE, and MAE. The results indicated that Decision Tree algorithm achieved highest prediction accuracy followed by SVM and K-NN. Decision Tree was particularly well-suited for accurate turbidity prediction relative to other water quality monitoring data. Thus, machine learning techniques could be effectively used for predicting one of the water quality parameters when it will be partially missed or false recorded.
참고문헌 (12)
- 김진호, "농촌유역의 강우사상별 농업 비 점원오염물질 유출특성", 한국물환경학회지, 24(1), pp.69~77 (2008)
- 통합 물관리를 고려한 지속가능한 물순환 관리체계 구축 및 정책기반 마련 연구, "한혜진", 한국환경정책·평가 연구원, 15~18 (2020)
- 제3차(2021~2025) 강우유출 비점오염원 관리 종합대책, "관계부처합동", 11~16 (2020)
- 비점오염원 관리지역 모니터링 및 평가 -소양호 유역을 중심으로-, "국립환경과학원 한강물환경연구소", 1~7 (2009)
- 물환경측정망 설치·운영계획, "환경부", 3~50 (2023)
- 정원구, "강우시 흙탕물 발생 하천의 수질개선 효과 분석", 한국환경분석학회지, 20(1), pp.49~57 (2017)
- 비점오염물질측정망 자료 활용방안 연구, "국립환경과학원", 27~52 (2022)
- 권대욱, "머신 러닝 기법을 활용한 ADAS", 자율주행 차량의 운행 적합도 설계, 한양대학교, 2021
- 환경 빅데이터 분석 및 서비스 개발, "강성원", 한국환경정책·평가연구원, 46~61 (2017)
- 이한승, "교차검증과 SVM을 이용한 도시침수 위험기준 추정 알고리즘 적용성 검토", 한국수자원학회 논문집, 52(12), pp.963~973 (2019)
- 김용훈, "AutoML의 성능개선을 위한 Hyperparameter 최적화 연구", 박사, pp.2020
- M. M. Ahsan, "Effect of data scaling methods on machine learning algorithms and model performance", Technologies, 9(3), pp.52~68 (2021)
