치의학 연구에서 귀무가설 유의성 검정의 문제점과 대안에 관한 고찰
Review on Problems with Null Hypothesis Significance Testing in Dental Research and Its Alternatives
1
조회
0
다운로드
5
인용
0
참고문헌
키워드
초록
치의학 연구에서 사용되는 귀무가설 유의성 검정에서 p값을 기준으로 연구의 결과를 평가하는 것은 많은 문제점을 내포하고 있다. 귀무가설이 기각되지 않은 경우에 귀무가설이 옳다는 결론을 내리는 것은 논리적 오류이다. p값에 대한 중대한 오해가 많이 있으며 연구자는 논문을 작성할 때 p값의 해석에 신중해야 한다. 귀무가설검정을 보완하거나 대체할 수 있는 대안으로서, 효과 크기, 신뢰구간, 베이지안 통계 등이 있다.
Abstract
There are many problems in evaluating study results by p value in null hypothesis testing for dental research. It is a logical fallacy to conclude that the null hypothesis is true when the it is not rejected. There are much serious misunderstanding about p value, and researchers should be cautious about interpreting p value in writing papers. As alternatives to complement or replace the null hypothesis significance testing, effect size, confidence interval, and Bayesian statistics are introduced.
참고문헌 (48)
- "Not significant, but Important? Know the pitfalls of p-values and formal hypothesis tests"[URL]
- "Siracusano"[URL]
- Meehl PE, "Theory-testing in psychology and physics: a methodological paradox", Philosophy Sci, 34, pp.103~115 (1967)
- Meehl PE, "Theoretical risks and tabular asterisks: sir Karl, sir Ronald, and the slow progress of soft psychology", J Consult Clin Psychol, 46, pp.806~834 (1978)
- Cohen J, "The earth is round", Am Psychol, 49, pp.997~1003 (1994)
- Schmidt FL, "Eight common but false objections to the discontinuation of significance testing in the analysis of research data, In What if there were no significance tests?", pp.37~64 (1997), Lawrence Erlbaum Associates
- "NHST problems/URL:"[URL]
- "Fallacy of affirming the consequent"[URL]
- Pollard P, "On the probability of making type I errors", Psychol Bull, 102, pp.159~163 (1987)
- Reese HW, "Problems of statistical inference", Mex J Behav Anal, 25, pp.39~68 (1999)
- Goodman S, "A dirty dozen: twelve p-value misconceptions", Semin Hematol, 45, pp.135~140 (2008)
- Hubbard R, "Why p values are not a useful measure of evidence in statistical significance sesting", Theory Psychol, 18, pp.69~88 (2008)
- Sterne JAC, "Sifting the evidence - what’s wrong with significance tests?", BMJ(Clin res), 322, pp.226~231 (2001)
- Johnson, DH, "The insignificance of statistical significance testing", J Wildlife Manag, 63, pp.763~772 (1999)
- Nurminen M, "Statistical significance - a misconstrued notion in medical research", Scand J Work Environ Health, 23, pp.232~235 (1997)
- Schervish MJ, "P values: what they are and what they are not", Am Stat, 50, pp.203~206 (1996)
- Carver RP, "The case against statistical significance testing", Harvard Educat Review, 48, pp.378~399 (1978)
- Nickerson RS, "Null hypothesis statistical testing: a review of an old and continuing controversy", Psychol Methods, 5, pp.241~301 (2000)
- Berger JO, "Testing a point null hypothesis: the irreconcilability of p values and evidence (with comments)", J Am Stat Assoc, 82, pp.112~139 (1987)
- Berger JO, "Testing precise hypotheses (with comments)", Stat Science, 2, pp.317~352 (1987)
- Nester MR, "An applied statistician’s creed", Statistician, 45, pp.401~410 (1996)
- Berger JO, "Statistical analysis and the illusion of objectivity", Am Scientist, 76, pp.159~165 (1988)
- Hubbard, R, "Alphabet soup: blurring the distinctions between p’s and α’s in psychological research", Theory Psychol, 14, pp.295~327 (2004)
- Sellke T, "Calibration of p values for testing precise null hypotheses", Am Statistician, 55, pp.62~71 (2001)
- Gelman A, "The difference between ‘significant’and ‘not significant’is not itself statistically significant", Am Statistician, 60, pp.328~331 (2006)
- "Uniform requirements for manuscripts submitted to biomedical journals"[URL]
- Royall RM, "The effect of sample size on the meaning of significance tests", Am Statistician, 40, pp.313~315 (1986)
- Hand DJ, "Data mining: statistics and more?", Am Statistician, 52, pp.112~118 (1998)
- Fisher RA, "The design of experiments" (1966), Oliver & Boyd
- Fisher BJ, "R.A. Fisher: The life of a scientist" (1978), Wiley
- "Alternatives to null hypothesis significance testing. Theory & Science"[URL]
- Rosenthal R, "Effect size estimation, significance testing, and the file-drawer problem", J Parapsychol, 56, pp.57~58 (1992)
- Vaughan GM, "Beyond tests of significance: Estimating strength of effects in selected ANOVA designs", Psychol Bulletin, 72, pp.204~213 (1969)
- Silva-Aycaguer LC, "Null hypothesis significance test in health sciences research (1995-2006): statistical analysis and interpretation", BMC Med Res Methodol, 10, pp.44~ (2010)
- Schmidt FL, "Statistical significance testing and cumulative knowledge in psychology: implications for training of researchers", Psychol Methods, 1, pp.115~129 (1996)
- Cumming G, "Inference by eye: confidence intervals and how to read pictures of data", Am Psychol, 60, pp.170~180 (2005)
- Schenker N, "On judging the significance of differences by examining the overlap between confidence intervals", Am Statistician, 55, pp.182~186 (2001)
- Wang S, "Mr. Bayes goes to Washington", Science, 339, pp.758~759 (2013)
- Efron B, "Bayes’Theorem in the twenty-first century", Science, 340, pp.1177~1178 (2013)
- "Guidance for the use of Bayesian statistics in medical device clinical trials"[URL]
- Lilford RJ, "The statistical basis of public policy: a paradigm shift is overdue", Br Med J, 313, pp.603~607 (1996)
- Efron B, "Why isn’t everyone a Bayesian (with discussion)?", Am Statist, 40, pp.1~11 (1986)
- Nurminen M, "Exact Bayesian analysis of two proportions", Scand J Stat, 14, pp.67~77 (1987)
- Diaconis P, "On the consistency of Bayes estimate (with discussion)", Ann Math Stat, 14, pp.1~67 (1986)
- Zhang Y, "Bayesian latent variable models for spatially correlated toothlevel binary data in caries research", Stat Modelling, 11, pp.25~47 (2011)
- Tu YK, "A Bayesian network meta-analysis on comparisons of enamel matrix derivatives, guided tissue regeneration and their combination therapies", J Clin Periodontol, 39, pp.303~314 (2012)
- Frosio I, "Bayesian denoising in digital radiography: a comparison in the dental field", Comput Med Imaging Graph, 37, pp.28~39 (2013)
- Freedman L, "Bayesian statistical methods. A natural way to assess clinical evidence (editorial)", Br Med J, 313, pp.569~570 (1996)
