Concordance Rate Between the Ratings of Clinician and SelfRatings of Worker on a Functional Capacity Evaluation
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Background: Functional capacity evaluations (FCEs) are designed to systematically assess the capacity to perform work-related tasks and to determine worker’s ability to return to the previous job following work-related injuries. These evaluations may be rated either by clinician or worker. There has been a lack of consensus between the two scoring methods. Objects: This study aimed: 1) to confirm if the data are fit to the Rasch rating scale model and 2) to investigate the item-level concordance rate between the ratings of clinician and injured worker of the FCE. Methods: A cross-sectional study was conducted with a sample (n=124) of a rehabilitation program with the Occupational Rehabilitation Data Base for workers with low back pain. The functional capacity evaluation at admission and discharge was administered to clinicians and workers. The data were analyzed using both classical test theory-based Pearson’s r and intra-class coefficient followed by item-level analysis with Rasch rating scale model. Results: All items of the FCE, except sitting items rated by clinician at admission and handling items rated by both clinician and worker throughout admission and discharge, were acceptable fit statistics with minor out of ranges for a misfit criterion. This may indicate that the items of the FCE overall fit to the Rasch rating scale model. Few problematic items responding differently to clinician and worker both at admission and discharge were detected with the differential item functioning analysis despite the excellent concordance rate using the two conventional statistics-sitting and handling items at admission and handling item at discharge. Conclusion: The item-level speculations using Rasch analysis of the FCE demonstrate that the ratings of clinician and self ratings of worker were psychometrically acceptable though there was an apparent discrepancy between the raters both at admission and discharge.
Abstract
Background: Functional capacity evaluations (FCEs) are designed to systematically assess the capacity to perform work-related tasks and to determine worker’s ability to return to the previous job following work-related injuries. These evaluations may be rated either by clinician or worker. There has been a lack of consensus between the two scoring methods. Objects: This study aimed: 1) to confirm if the data are fit to the Rasch rating scale model and 2) to investigate the item-level concordance rate between the ratings of clinician and injured worker of the FCE. Methods: A cross-sectional study was conducted with a sample (n=124) of a rehabilitation program with the Occupational Rehabilitation Data Base for workers with low back pain. The functional capacity evaluation at admission and discharge was administered to clinicians and workers. The data were analyzed using both classical test theory-based Pearson’s r and intra-class coefficient followed by item-level analysis with Rasch rating scale model. Results: All items of the FCE, except sitting items rated by clinician at admission and handling items rated by both clinician and worker throughout admission and discharge, were acceptable fit statistics with minor out of ranges for a misfit criterion. This may indicate that the items of the FCE overall fit to the Rasch rating scale model. Few problematic items responding differently to clinician and worker both at admission and discharge were detected with the differential item functioning analysis despite the excellent concordance rate using the two conventional statistics-sitting and handling items at admission and handling item at discharge. Conclusion: The item-level speculations using Rasch analysis of the FCE demonstrate that the ratings of clinician and self ratings of worker were psychometrically acceptable though there was an apparent discrepancy between the raters both at admission and discharge.
참고문헌 (38)
- M. Beninato, "Using the International Classification of Functioning, Disability and Health as a Framework to Examine the Association Between Falls and Clinical Assessment Tools in People With Stroke", Physical Therapy, 89(8), pp.816~825 (2009), Oxford University Press (OUP)[DOI]
- Bond TG, "Applying the Rasch Model:Fundamental measurement in the human sciences", pp.23~28 (2001), Lawrence Erlbaum Associates Publishers
- TJH Bovend’Eerdt, "Agreement between Two Different Scoring Procedures for Goal Attainment Scaling is Low", Journal of Rehabilitation Medicine, 43(1), pp.46~49 (2011), Acta Dermato-Venereologica[DOI]
- P. Bray, "Health-related Quality of Life in Boys With Duchenne Muscular Dystrophy: Agreement Between Parents and Their Sons", Journal of Child Neurology, 25(10), pp.1188~1194 (2010), SAGE Publications[DOI]
- Chen JJ, "Functional capacity evaluation & disability", Iowa Orthop J, 27, pp.121~127 (2007)
- 최봉삼, "Responsiveness Comparisons of Self-Report Versus Therapist-Scored Functional Capacity for Workers With Low Back Pain", 한국전문물리치료학회지, 19(3), pp.91~97 (2012), 한국전문물리치료학회
- Cutler RB, "Relationships between functional capacity measures and baseline psychological measures in chronic pain patients", J Occup Rehabil, 13(4), pp.249~258 (2003)
- Davis E, "Parent-proxy and child self-reported health-related quality of life: Using qualitative methods to explain the discordance", Qual Life Res, 16(5), pp.863~871 (2007)
- De Civita M, "Evaluating health-related quality-of-life studies in paediatric populations: Some conceptual, methodological and developmental considerations and recent applications", Pharmacoeconomics, 23(7), pp.659~685 (2005)
- Eiser C, "Can parents rate their child’s health-related quality of life? Results of a systematic review", Qual Life Res, 10(4), pp.347~357 (2001)
- Fishbain DA, "Measuring residual functional capacity in chronic low back pain patients based on the Dictionary of Occupational Titles", Spine, 19(8), pp.872~880 (1994)
- Fishbain DA, "Validity of the dictionary of occupational titles residual functional capacity battery", Clin J Pain, 15(2), pp.102~110 (1999)
- Gross DP, "Measurement properties of performance-based assessment of functional capacity", J Occup Rehabil, 14(3), pp.165~174 (2004)
- Gross DP, "The prognostic value of functional capacity evaluation in patients with chronic low back pain: Part 2: Sustained recovery", Spine, 29(8), pp.920~924 (2004)
- Haley SM, "Activity outcome measurement for postacute care", Med Care, 42(1 Suppl), pp.I49~I61 (2004)
- Huang HY, "Effects of the common scale setting in the assessment of differential item functioning", Psychol Rep, 114(1), pp.104~125 (2014)
- C. L. James, "Functional Capacity Evaluation Research: Report from the Second International Functional Capacity Evaluation Research Meeting", Journal of Occupational Rehabilitation, 26(1), pp.80~83 (2016), Springer Nature[DOI]
- P. P. F. M. Kuijer, "Are performance-based measures predictive of work participation in patients with musculoskeletal disorders? A systematic review", International Archives of Occupational and Environmental Health, 85(2), pp.109~123 (2012), Springer Nature[DOI]
- Yoonjeong Lim, "The level of agreement between child self-reports and parent proxy-reports of health-related quality of life in boys with Duchenne muscular dystrophy", Quality of Life Research, 23(7), pp.1945~1952 (2014), Springer Nature[DOI]
- Linacre JM, "Optimizing rating scale category effectiveness", J Appl Meas, 3(1), pp.85~106 (2002)
- Linacre JM, "Rasch model estimation: Further topics", J Appl Meas, 5(1), pp.95~110 (2004)
- Magaziner J, "Comparison with self-reports and observations of performance", Am J Epidemiol, 146(5), pp.418~428 (1997)
- McHugh ML, "Interrater reliability: The kappa statistic", Biochem Med, 22(3), pp.276~282 (2012)
- Navah Z. Ratzon, "Functional capacity evaluation: Does it change the determination of the degree of work disability?", Disability and Health Journal, 8(1), pp.80~85 (2015), Elsevier BV[DOI]
- Alexandra Rouquette, "Rasch modelling to deal with changes in the questionnaires used during long-term follow-up of cohort studies: a simulation study", BMC Medical Research Methodology, 16(1), pp.105~ (2016), Springer Nature[DOI]
- Remko Soer, "Pain Response of Healthy Workers Following a Functional Capacity Evaluation and Implications for Clinical Interpretation", Journal of Occupational Rehabilitation, 18(3), pp.290~298 (2008), Springer Nature[DOI]
- Taherbhai HM, "Pre-equating: A simulation study based on a large scale assessment model", J Appl Meas, 5(3), pp.301~318 (2004)
- Teresi JA, "Statistical methods for examination of differential item functioning(DIF)with applications to cross-cultural measurement of functional, physical and mental health", J Ment Health Aging, 7(1), pp.31~40 (2001)
- M. A. Trippolini, "Construct Validity of Functional Capacity Evaluation in Patients with Whiplash-Associated Disorders", Journal of Occupational Rehabilitation, 25(3), pp.481~492 (2015), Springer Nature[DOI]
- United States Department of Labor, "Dictionary of Occupational Titles", pp.189~192 (1986), United States Government Printing
- van der Linden FA, "Proxy measurements in multiple sclerosis: Agreement between patients and their partners on the impact of multiple sclerosis in daily life", J Neurol Neurosurg Psychiatry, 77(10), pp.1157~1162 (2006)
- Velozo CA, "Measurement qualities of a self-report and therapist-scored functional capacity instrument based on the Dictionary of Occupational Titles", J Occup Rehabil, 16(1), pp.109~122 (2006)
- Velozo CA, "The use of Rasch analysis to produce scale-free measurement of functional ability", Am J Occup Ther, 53(1), pp.83~90 (1999)
- Velozo CA, "Training Manual:Occupational rehabilitation data base manual", University of Illinois at Chicago, 12~25 (1994)
- Viera AJ, "Understanding interobserver agreement: The kappa statistic", Fam Med, 37(5), pp.360~363 (2005)
- White-Koning M, "Determinants of child-parent agreement in quality-of-life reports: A European study of children with cerebral palsy", Pediatrics, 120(4), pp.e804~e814 (2007)
- Wright BD, "Observations are always ordinal;measurements, however, must be interval", Arch Phys Med Rehabil, 70(12), pp.857~860 (1989)
- Wright BD, "Best Test Design. Rasch Measurement", pp.93~95 (1979), MESA Press