The Intra- and Inter-rater Reliability and the Learning Curve for a Simple Neurological Score for Rats
5
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Objective: To measure the intra- and inter-rater reliability of a simple sensorimotor performance test for rats, and to evaluate the learning efficiency of a novice rater for the test. Method: Middle cerebral arteries were occluded by intraluminal sutures in 25 male Sprague-Dawley rats (10∼12 weeks old). The sensorimotor performance test was performed by a novice and an experienced rater, with each rater performing the test twice each week for 3 consecutive weeks. A ten-minute standardized video about the rating method was shown to the novice rater after the second test each week. Results: The intra- and inter-rater agreement was determined using Cohen's weighted kappa coefficient. The intra-rater reliability was initially poor for the novice (κ [95% confidence interval], 0.31[−0.02, 0.64]), but it improved significantly after 3-week self education using the standardized video (0.81 [0.69, 0.93], showing almost perfect agreement. The reliability of the experienced researcher was good at all times (κ=0.64, 0.76, 0.71, for week 1, 2, 3, respectively), indicating substantial agreement. The inter-rater reliability showed clear improvement after self-education (κ= 0.44, 0.69, 0.69, for week 1, 2, 3, respectively). Although the total sum score was highly reliable, some of the individual items showed lower intra-and inter-rater agreement. However, each rater showed greater within-rater variability for different subtests. Conclusion: The simple sensorimotor performance test showed high degree of intra- and inter-rater agreement when performed by experienced or properly educated raters. The inaccuracy of the novice was rectified by 3-week self-education using a video.
Abstract
Objective: To measure the intra- and inter-rater reliability of a simple sensorimotor performance test for rats, and to evaluate the learning efficiency of a novice rater for the test. Method: Middle cerebral arteries were occluded by intraluminal sutures in 25 male Sprague-Dawley rats (10∼12 weeks old). The sensorimotor performance test was performed by a novice and an experienced rater, with each rater performing the test twice each week for 3 consecutive weeks. A ten-minute standardized video about the rating method was shown to the novice rater after the second test each week. Results: The intra- and inter-rater agreement was determined using Cohen's weighted kappa coefficient. The intra-rater reliability was initially poor for the novice (κ [95% confidence interval], 0.31[−0.02, 0.64]), but it improved significantly after 3-week self education using the standardized video (0.81 [0.69, 0.93], showing almost perfect agreement. The reliability of the experienced researcher was good at all times (κ=0.64, 0.76, 0.71, for week 1, 2, 3, respectively), indicating substantial agreement. The inter-rater reliability showed clear improvement after self-education (κ= 0.44, 0.69, 0.69, for week 1, 2, 3, respectively). Although the total sum score was highly reliable, some of the individual items showed lower intra-and inter-rater agreement. However, each rater showed greater within-rater variability for different subtests. Conclusion: The simple sensorimotor performance test showed high degree of intra- and inter-rater agreement when performed by experienced or properly educated raters. The inaccuracy of the novice was rectified by 3-week self-education using a video.
참고문헌 (17)
- Garcia JH, "Neurological deficit and extent of neuronal necrosis attributable to middle cerebral artery occlusion in rats. Statistical validation", Stroke, 26, pp.627~635 (1995)
- Tomasello F, "Assessment of inter-observer differences in the Italian multicenter study on reversible cerebral ischemia", Stroke, 13, pp.32~35 (1982)
- Pantoni L, "Interrater agreement on a simple neurological score in rats", Stroke, 29, pp.871~872 (1998)
- Landis JR, "The measurement of observer agreement for categorical data", Biometrics, 33, pp.159~174 (1977)
- Longa EZ, "Reversible middle cerebral artery occlusion without craniectomy in rats", Stroke, 20, pp.84~91 (1989)
- Cohen J., "Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit", Psychol Bull, 70, pp.213~220 (1968)
- Fleiss JL, "Statistical methods for rates and proportions", pp.760~ (2003), J. Wiley
- Schallert T, "Use-dependent structural events in recovery of function", Adv Neurol, 73, pp.229~238 (1997)
- Schallert T, "CNS plasticity and assessment of forelimb sensorimotor outcome in unilateral rat models of stroke, cortical ablation, parkinsonism and spinal cord injury", Neuropharmacology, 39, pp.777~787 (2000)
- Olesen J, "Reproducibility and Utility of a Simple Neurological Scoring System for Stroke Patients (Copenhagen Stroke Scale)", Neurorehabilitation and Neural Repair, 2, pp.59~63 (1988)
- Buchanan GN, "MRI of fistula in ano: inter- and intraobserver agreement and effects of directed education", AJR Am J Roentgenol, 183, pp.135~140 (2004)
- Depienne C, "Hereditary spastic paraplegias:an update", Curr Opin Neurol, 20, pp.674~680 (2007)
- Gagliano ME, "A literature review on the efficacy of video in patient education", J Med Educ, 63, pp.785~792 (1988)
- Lyden P, "Improved reliability of the NIH Stroke Scale using video training. NINDS TPA Stroke Study Group", Stroke, 25, pp.2220~2226 (1994)
- Todd KH, "Randomized, controlled trial of video self-instruction versus traditional CPR training", Ann Emerg Med, 31, pp.364~369 (1998)
- Katz RJ, "Acute and chronic stress effects on open field activity in the rat: implications for a model of depression", Neurosci Biobehav Rev, 5, pp.247~251 (1981)
- Tanaka M, "Establishment and assessment of a rat model of fatigue", Neurosci Lett, 352, pp.159~162 (2003)