Test-Retest Reliability of a Questionnaire for the Korea Youth Risk Behavior Web-Based Survey
2
조회
0
다운로드
16
인용
0
참고문헌
키워드
초록
Objectives: A web-based survey has been administered annually since 2005 throughout Korea to assess the prevalence of adolescent health risk behaviors among middle and high school students. The aim of this study was to evaluate the test-retest reliability of the Korea Youth Risk Behavior Web-based Survey (KYRBWS) questionnaire. Methods: A convenience sample of 2298 middle and high school students participated in self-administered questionnaire surveys twice, approximately two weeks apart, in 2008. The percent agreement, kappa statistics, and prevalence rates at the first and second surveys were computed for the core subset of 39 self-reported health risk behavior indices of the KYRBWS. Results: Among 39 indices, seven indices had kappas ≥ 0.81 and all of the indices had kappas ≥ 0.41. Based on nonoverlapping 95% confidence intervals, three indices had significantly different prevalence rates between the first and second surveys. In the subgroup analyses by school grade and gender, two indices had significantly different reliability estimates between middle and high school students. There were no significantly different reliability estimates between male and female students, except for one index. Conclusions: This study demonstrated that the reliability estimates for the KYRBWS questionnaire are varied, but generally reliable over time. The indices with low reliability estimates need to be evaluated further in order to determine whether the indices should be modified or deleted from future versions of the KYRBWS.
Abstract
Objectives: A web-based survey has been administered annually since 2005 throughout Korea to assess the prevalence of adolescent health risk behaviors among middle and high school students. The aim of this study was to evaluate the test-retest reliability of the Korea Youth Risk Behavior Web-based Survey (KYRBWS) questionnaire. Methods: A convenience sample of 2298 middle and high school students participated in self-administered questionnaire surveys twice, approximately two weeks apart, in 2008. The percent agreement, kappa statistics, and prevalence rates at the first and second surveys were computed for the core subset of 39 self-reported health risk behavior indices of the KYRBWS. Results: Among 39 indices, seven indices had kappas ≥ 0.81 and all of the indices had kappas ≥ 0.41. Based on nonoverlapping 95% confidence intervals, three indices had significantly different prevalence rates between the first and second surveys. In the subgroup analyses by school grade and gender, two indices had significantly different reliability estimates between middle and high school students. There were no significantly different reliability estimates between male and female students, except for one index. Conclusions: This study demonstrated that the reliability estimates for the KYRBWS questionnaire are varied, but generally reliable over time. The indices with low reliability estimates need to be evaluated further in order to determine whether the indices should be modified or deleted from future versions of the KYRBWS.
참고문헌 (22)
- Korea National Statistical Office, "Annual Report on the Cause of Death Statistics, 2007" (2008), Korea National Statistical Office
- Mokdad AH, "Actual causes of death in the United States, 2000", JAMA, 291(10), pp.1238~1245 (2004)
- McGue M, "The association of early adolescent problem behavior and adult psychopathology: a multivariate behavioral genetic perspective", Behav Genet, 36(4), pp.591~602 (2006)
- Korea Centers for Disease Control and Prevention, "Reports on the Korea Youth Risk Behavior Web-based Survey, 2005" (2007), Korea Centers for Disease Control and Prevention
- Korea Centers for Disease Control and Prevention, "Reports on the Korea Youth Risk Behavior Web-based Survey, 2006" (2007), Korea Centers for Disease Control and Prevention
- Korea Centers for Disease Control and Prevention, "Reports on the Korea Youth Risk Behavior Web-based Survey, 2007" (2008), Korea Centers for Disease Control and Prevention
- "Health behaviour in school-aged children: a World Health Organization collaborative cross-national study"[URL]
- Eaton DK, "Youth risk behavior surveillance--United States, 2007", MMWR Surveill Summ, 57(4), pp.1~131 (2008)
- Brener ND, "Reliability of the Youth Risk Behavior Survey Questionnaire", Am J Epidemiol, 141(6), pp.575~580 (1995)
- Brener ND, "Reliability of the 1999 youth risk behavior survey questionnaire", J Adolesc Health, 31(4), pp.336~342 (2002)
- Zullig KJ, "Reliability of the 2005 middle school Youth Risk Behavior Survey", J Adolesc Health, 39(6), pp.856~860 (2006)
- Vereecken CA, "A Belgian study on the reliability and relative validity of the Health Behaviour in School- Aged Children food-frequency questionnaire", Public Health Nutr, 6(6), pp.581~588 (2003)
- Booth ML, "The reliability and validity of the physical activity questions in the WHO health behaviour in schoolchildren (HBSC) survey: a population study", Br J Sports Med, 35(4), pp.263~267 (2001)
- Landis JR, "The measurement of observer agreement for categorical data", Biometrics, 33(1), pp.159~174 (1977)
- Korean Educational Development Institute, "Statistical Yearbook of Education, 2008" (2008), Korean Educational Development Institute
- Feinstein AR, "High agreement but low kappa: I. The problems of two paradoxes", J Clin Epidemiol, 43(6), pp.543~549 (1990)
- Cicchetti DV, "High agreement but low kappa: II. Resolving the paradoxes", J Clin Epidemiol, 43(6), pp.551~558 (1990)
- Byrt T, "Bias, prevalence and kappa", J Clin Epidemiol, 46(5), pp.423~429 (1993)
- Brener ND, "Assessment of factors affecting the validity of self-reported health-risk behavior among adolescents: evidence from the scientific literature", J Adolesc Health, 33(6), pp.436~457 (2003)
- Turner CF, "Effect of mode of administration and wording and reporting of drug use. In: Survey Measurement of Drug Use: Methodological Studies", pp.177~220 (1992), Government Printing Office
- Turner CF, "Adolescent sexual behavior, drug use, and violence: Increased reporting with computer survey technology", Science, 280(5365), pp.867~873 (1989)
- Kann L, "An assessment of the effect of data collection setting on the prevalence of health-risk behaviors among adolescents", J Adolesc Health, 31(4), pp.327~335 (2002)