이상자료가 연안 환경자료의 통계 척도에 미치는 영향
Impact of Outliers on the Statistical Measures of the Environmental Monitoring Data in Busan Coastal Sea
0
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
The statistical measures of the coastal environmental data are used in a variety of statistical inferences, hypothesis tests, and data-driven modeling. If the measures are biased, then the statistical estimations and models may also be biased and this potential for bias is great when data contain some outliers defined as extraordinary large or small data values. This study aims to suggest more robust statistical measures as alternatives to more commonly used measures and to assess the performance these robust measures through a quantitative evaluation of more typical measures, such as in terms of locations, spreads, and shapes, with regard to environmental monitoring data in the Busan coastal sea. The detection of outliers within the data was carried out on the basis of Rosner’s test. About 5−10% of the nutrient data were found to contain outliers based on Rosner’s test. After removal (zero-weighting) of the outliers in the data sets, the relative change ratios of the mean and standard deviation between before and after outlierremoval conditions revealed the figures 13 and 33%, respectively. The variation magnitudes of skewness and kurtosis are 1.36 and 8.11 in a decreasing trend, respectively. On the other hand, the change ratios for more robust measures regarding the mean and standard deviation are 3.7−10.5%, and the variation magnitudes of robust skewness and kurtosis are about only 2−4% of the magnitude of the non-robust measures. The robust measures can be regarded as outlier-resistant statistical measures based on the relatively small changes in the scenarios before and after outlier removal conditions.
Abstract
The statistical measures of the coastal environmental data are used in a variety of statistical inferences, hypothesis tests, and data-driven modeling. If the measures are biased, then the statistical estimations and models may also be biased and this potential for bias is great when data contain some outliers defined as extraordinary large or small data values. This study aims to suggest more robust statistical measures as alternatives to more commonly used measures and to assess the performance these robust measures through a quantitative evaluation of more typical measures, such as in terms of locations, spreads, and shapes, with regard to environmental monitoring data in the Busan coastal sea. The detection of outliers within the data was carried out on the basis of Rosner’s test. About 5−10% of the nutrient data were found to contain outliers based on Rosner’s test. After removal (zero-weighting) of the outliers in the data sets, the relative change ratios of the mean and standard deviation between before and after outlierremoval conditions revealed the figures 13 and 33%, respectively. The variation magnitudes of skewness and kurtosis are 1.36 and 8.11 in a decreasing trend, respectively. On the other hand, the change ratios for more robust measures regarding the mean and standard deviation are 3.7−10.5%, and the variation magnitudes of robust skewness and kurtosis are about only 2−4% of the magnitude of the non-robust measures. The robust measures can be regarded as outlier-resistant statistical measures based on the relatively small changes in the scenarios before and after outlier removal conditions.
참고문헌 (17)
- "해양환경측정망 원본자료" (2016)[URL]
- "국가해양환경측정망 자료-부산연안" (2015)[URL]
- Barnett V, "Outliers in statistical data", pp.584~ (1994), JohnWiley Sons
- Bonato M., "Robust estimation of skewness and kurtosis in distributions with infinite higher moments", Financ Res Lett, 8, pp.77~87 (2011)
- Brys G, "A robust measure of skewness", J Comput Graph Stat, 13(4), pp.996~1017 (2004)
- Dixon WJ., "Ratios involving extreme values", Ann Math Stat, 22(1), pp.68~78 (1951)
- Erceg-Hurn DM, "Modern robust statistical methods : an easy way to maximize the accuracy and power of your research", Am Psychol, 63(7), pp.591~601 (2008)
- Grubbs FE., "Sample criteria for testing outlying observations", Ann Math Stat, 21(1), pp.27~58 (1950)
- Huber PJ, "Robust statistics", pp.380~ (2009), John Wiley & Sons
- Kim T-H, "On more robust estimation of skewness and kurtosis Financ", Res Lett, 1, pp.56~73 (2004)
- Martinez WL, "Exploratory data analysis with MATLAB", pp.2005, Chapman & Hall
- Millard SP., "EnvStats: an R package for environmental statistics", pp.291~ (2013), Springer
- Moors JJA., "A quantile alternative for kurtosis", J Roy Stat Soc D-Sta, 37(1), pp.25~32 (1988)
- "R: a language and environment for statistical computing" (2015)[URL]
- Rosner B., "Percentage points for a generalized ESD many-outlier procedure", Technometrics, 25(2), pp.165~172 (1983)
- Rousseeuw PJ, "Alternatives to the median absolute deviation", J Am Stat Assoc, 88(424), pp.1273~1283 (1993)
- Rousseeuw PJ, "Robust regression and outlier detection", pp.329~ (2003), John Wiley & Sons