본문 바로가기
KERD
논문KCI 등재

시스템 결함 분석을 위한 이벤트 로그 연관성에 관한 연구

Correlation Analysis of Event Logs for System Fault Detection

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

주제분류산업공학

초록

To identify the cause of the error and maintain the health of system, an administrator usually analyzes event log data since it contains useful information to infer the cause of the error. However, because today’s systems are huge and complex, it is almost impossible for administrators to manually analyze event log files to identify the cause of an error. In particular, as OpenStack, which is being widely used as cloud management system, operates with various service modules being linked to multiple servers, it is hard to access each node and analyze event log messages for each service module in the case of an error. For this, in this paper, we propose a novel message-based log analysis method that enables the administrator to find the cause of an error quickly. Specifically, the proposed method 1) consolidates event log data generated from system level and application service level, 2) clusters the consolidated data based on messages, and 3) analyzes interrelations among message groups in order to promptly identify the cause of a system error. This study has great significance in the following three aspects. First, the root cause of the error can be identified by collecting event logs of both system level and application service level and analyzing interrelations among the logs. Second, administrators do not need to classify messages for training since unsupervised learning of event log messages is applied. Third, using Dynamic Time Warping, an algorithm for measuring similarity of dynamic patterns over time increases accuracy of analysis on patterns generated from distributed system in which time synchronization is not exactly consistent.

Abstract

To identify the cause of the error and maintain the health of system, an administrator usually analyzes event log data since it contains useful information to infer the cause of the error. However, because today’s systems are huge and complex, it is almost impossible for administrators to manually analyze event log files to identify the cause of an error. In particular, as OpenStack, which is being widely used as cloud management system, operates with various service modules being linked to multiple servers, it is hard to access each node and analyze event log messages for each service module in the case of an error. For this, in this paper, we propose a novel message-based log analysis method that enables the administrator to find the cause of an error quickly. Specifically, the proposed method 1) consolidates event log data generated from system level and application service level, 2) clusters the consolidated data based on messages, and 3) analyzes interrelations among message groups in order to promptly identify the cause of a system error. This study has great significance in the following three aspects. First, the root cause of the error can be identified by collecting event logs of both system level and application service level and analyzing interrelations among the logs. Second, administrators do not need to classify messages for training since unsupervised learning of event log messages is applied. Third, using Dynamic Time Warping, an algorithm for measuring similarity of dynamic patterns over time increases accuracy of analysis on patterns generated from distributed system in which time synchronization is not exactly consistent.

참고문헌 (15)

  1. Package tm, "Feinerer, I.", CRAN, ~ (2013)
  2. Gerhards, R., "The syslog protocol", RFC 5424, ~ (2009)
  3. 주우민, "군집화 기반 프로세스 마이닝을 이용한 커리큘럼 마이닝 분석", 산업경영시스템학회지, 38(4), pp.45~55 (2015), 한국산업경영시스템학회
  4. Kaufman, K., "Finding groups in data : An introduction to cluster analysis" (2009), John Wiley and Sons
  5. Oliner, A., "What supercomputers say :A study of five system logs", Proc. of 37th Annual IEEE, 2007, 575~584
  6. [URL]
  7. Park, Y. -S., "An empirical study on faults prediction for large scale telecommunication software", Journal of the Korean Society for Quality Management, 27(2), pp.263~276 (1999)
  8. Pitakrat, T., "A framework for system event classification and prediction by means of machine learning", Proc. of the 8th International Conference on Performance Evaluation Methodologies and Tools, pp.173~180 (2014), ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering)
  9. [URL]
  10. "RSYSLOG : The rocket-fast system for log processing"[URL]
  11. Sahoo, R.K., "Critical event prediction for proactive management in large-scale computer clusters", Proc. of the 9th ACM SIGKDD international conference on Knowledge discovery and data mining, pp.426~435 (2003)
  12. Sakoe, H., "Dynamic programming algorithm optimization for spoken word recognition", IEEE Transactions on Acoustics, Speech and Signal Processing, 26(1), pp.43~49 (1978)
  13. 유재욱, "군집 분석을 활용한 제품 플랫폼 설계를 위한 모듈 공용화", 산업경영시스템학회지, 37(3), pp.89~98 (2014), 한국산업경영시스템학회
  14. Zheng, Z., "A practical failure prediction with location and lead time for Blue Gene", P, 2010, 15~22
  15. Zheng, Z., "System log pre-processing to improve failure prediction", Proc. of IEEE, 2009, 572~577

관련 논문AI추천

이 간행물의 다른 논문 (16건)