Rating criteria to evaluate student performance in digital wax-up training using multi-purpose software
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
PURPOSE. The aim of this study was to introduce rating criteria to evaluate student performance in a newly developed, digital wax-up preclinical program for computer-aided design (CAD) of full-coverage crowns and preliminarily investigate the reliability and internal consistency of the rating system. MATERIALS AND METHODS. This study, conducted in 2017, enrolled 47 fifth-year dental students of Okayama University Dental School. Digital wax-up training included a fundamental practice using computer graphics (CG), multipurpose CAD software programs, and an advanced practice to execute a digital waxup of the right mandibular second molar (#47). Each student’s digital wax-up work (stereolithography data) was evaluated by two instructors using seven qualitative criteria. The total qualitative score (0-90) of the criteria was calculated. The total volumetric discrepancy between each student’s digital wax-up work and a reference prepared by an instructor was automatically measured by the CAD software. The inter-rater reliability of each criterion was analyzed using a weighted kappa index. The relationship between the total volume discrepancy and the total qualitative score was analyzed using Spearman’s correlation. RESULTS. The weighted kappa values for the seven qualitative criteria ranged from 0.62 - 0.93. The total qualitative score and the total volumetric discrepancy were negatively correlated (ρ = -0.27, P = .09, respectively); however, this was not statistically significant. CONCLUSION. The established qualitative criteria to evaluate students’ work showed sufficiently high inter-rater reliability; however, the digitally measured volumetric discrepancy could not sufficiently predict the total qualitative score.
Abstract
PURPOSE. The aim of this study was to introduce rating criteria to evaluate student performance in a newly developed, digital wax-up preclinical program for computer-aided design (CAD) of full-coverage crowns and preliminarily investigate the reliability and internal consistency of the rating system. MATERIALS AND METHODS. This study, conducted in 2017, enrolled 47 fifth-year dental students of Okayama University Dental School. Digital wax-up training included a fundamental practice using computer graphics (CG), multipurpose CAD software programs, and an advanced practice to execute a digital waxup of the right mandibular second molar (#47). Each student’s digital wax-up work (stereolithography data) was evaluated by two instructors using seven qualitative criteria. The total qualitative score (0-90) of the criteria was calculated. The total volumetric discrepancy between each student’s digital wax-up work and a reference prepared by an instructor was automatically measured by the CAD software. The inter-rater reliability of each criterion was analyzed using a weighted kappa index. The relationship between the total volume discrepancy and the total qualitative score was analyzed using Spearman’s correlation. RESULTS. The weighted kappa values for the seven qualitative criteria ranged from 0.62 - 0.93. The total qualitative score and the total volumetric discrepancy were negatively correlated (ρ = -0.27, P = .09, respectively); however, this was not statistically significant. CONCLUSION. The established qualitative criteria to evaluate students’ work showed sufficiently high inter-rater reliability; however, the digitally measured volumetric discrepancy could not sufficiently predict the total qualitative score.
참고문헌 (23)
- Iacopino AM, "The influence of “new science” on dental education: current concepts, trends, and models for the future", J Dent Educ, 71, pp.450~462 (2007)
- Miyazaki T, "A review of dental CAD", CAM : current status and future perspectives from 20 years of experience, 2009, pp.28, 44~56
- Fasbinder DJ, "Computerized technology for restorative dentistry", Am J Dent, 26, pp.115~120 (2013)
- Callan RS, "Reliability of CAD CAM technology in assessing crown preparations in a preclinical dental school environment", J Dent Educ, 78, pp.40~50 (2014)
- Douglas RD, "Dental students’preferences and performance in crown design : conventional wax-added versus CAD", J Dent Educ, 78, pp.1663~1672 (2014)
- Reifeis PE, "Introducing CAD", CAM into a predoctoral dental curriculum : a case study, 2014, pp.78, 1432~1441
- Afshari FS, "Integration of digital dentistry into a predoctoral implant program: program description, rationale, and utilization trends", J Dent Educ, 81, pp.986~994 (2017)
- Schwindling FS, "Establishing CAD", CAM in preclinical dental education : evaluation of a handson module, 2015, pp.79, 1215~1221
- de Azevedo Rde A, "Comparative effectiveness of dental anatomy carving pedagogy : a systematic review", J Dent Educ, 79, pp.914~921 (2015)
- Cardoso JA, "Reducing subjectivity in the evaluation of pre-clinical dental preparations for fixed prosthodontics using the Kavo PrepAssistant", Eur J Dent Educ, 10, pp.149~156 (2006)
- Haj-Ali R, "Rater reliability : short-and long-term effects of calibration training", J Dent Educ, 70, pp.428~433 (2006)
- Sharaf AA, "Intra-and inter-examiner variability in evaluating preclinical pediatric dentistry operative procedures", J Dent Educ, 71, pp.540~544 (2007)
- Licari FW, "Designing evaluation forms to facilitate student learning", J Dent Educ, 72, pp.48~58 (2008)
- Satterthwaite JD, "Peer-group assessment of pre-clinical operative skills in restorative dentistry and comparison with experienced assessors", Eur J Dent Educ, 12, pp.99~102 (2008)
- Kwon SR, "Dental anatomy grading : comparison between conventional visual and a novel digital assessment technique", J Dent Educ, 78, pp.1655~1662 (2014)
- Kunkel TC, "A comparison of crown preparation grading via PrepCheck versus grading by dental school instructors", Int J Comput Dent, 21, pp.305~311 (2018)
- Renne WG, "E4D compare software : an alternative to faculty grading in dental education", J Dent Educ, 77, pp.168~175 (2013)
- Hamil LM, "Dental students’ opinions of preparation assessment with E4D compare software versus traditional methods", J Dent Educ, 78, pp.1424~1431 (2014)
- Garrett PH, "Comparison of dental students’ self-directed, faculty, and software-based assessments of dental anatomy waxups:a retrospective study", J Dent Educ, 79, pp.1437~1444 (2015)
- Gratton DG, "Impact of digital tooth preparation evaluation technology on preclinical dental students’ technical and self-evaluation skills", J Dent Educ, 80, pp.91~99 (2016)
- Kurosaki Y, "Digital transfer of the subgingival contour and emergence profile of the provisional restoration to the final bone-anchored fixed restoration", J Prosthodont Res, 63, pp.125~129 (2019)
- Landis JR, "The measurement of observer agreement for categorical data", Biometrics, 33, pp.159~174 (1977)
- Gratton DG, "Performance of two different digital evaluation systems used for assessing pre-clinical dental students’ prosthodontic technical skills", Eur J Dent Educ, 21, pp.252~260 (2017)