본문 바로가기
KERD
논문KCI 등재

보편적 행동지원 실행충실도 평가도구 고찰

Review of the fidelity measures in universal behavioral supports

김제린
한국행동분석학회 (Korean Association for Behavior Analysis)|2022.12|행동분석ㆍ지원연구 (Journal of Behavior Analysis and Support)|제9권 제3호|pp. 43-81|DOI 10.22874/kaba.2022.9.3.43

0

조회

0

다운로드

2

인용

0

참고문헌

키워드

보편적 지원학교 차원의 긍정적 행동지원실행충실도School-wide positive behavioral interventions and supports(SWPBIS)Universal supportsfidelity of implementation

초록

본 연구의 목적은 학교 차원의 긍정적 행동지원(school-wide Positive Behavioral Interventions and Supports; 이하 SWPBIS)의 보편적 지원에 관한 실행충실도 평가도구를 도구적 특징 및 내용적 측면에서 살펴보는 것이다. 국내외에서 개발된 총 8개의 보편적 지원 실행충실도 평가도구를 선정하여, 각 평가도구의 특징을 사용 목적, 평가 방법, 실행 적절성 기준, 평가도구 구성, 접근성을 중심으로 살펴보았다. 또한, 문항 분석(총 258개)을 통해 보편적 지원의 핵심 요소와 하위 요소를 유목화하고, 핵심 요소별 관련 문항을 중재 요소의 양적 측면, 중재 제공자의 질적 측면, 중재 대상자의 반응성 측면에서 분석하였다. 연구 결과를 살펴보면, 보편적 지원 실행충실도 평가도구는 크게 연구와 학교 활용을 위해 개발되지만, 평가 방법에 따라 다양한 기능(예: 팀 기반 정기 점검, 교직원 인식 조사)을 제공한다. 각 평가도구는 평정척도 이외 다양한 정보(예: 평가, 채점, 활용 방법)와 자료(예: 자료 수집 양식, 실행계획서 양식)를 제공하며, 대부분 특정 사이트나 학술논문을 통해 무료로 배포되고 있다. 문항 분석을 통해 10개 핵심 요소(예: 기대행동 정의 및 교육)와 60개 하위 요소(예: 기대행동을 긍정문으로 명확하게 정의하기)가 확인되었고, 전반적으로 실행충실도의 다차원적 측면이 균형있게 평가되고 있다. 본 연구는 연구 결과의 시사점을 바탕으로 추후 SWPBIS 실행충실도 평가도구 개발과 적용에 관해 제언하였다.

Abstract

The purpose of this study is to review the fidelity measures in school-wide positive behavioral interventions and supports; SWPBIS) with an emphasis on their instrumental characteristics and contents. A total of eight instruments, both domestically and internationally developed, were chosen and reviewed in terms of the purpose, the methods of assessment, the criterion scores on adequacy, the composition, and the accessibility. Also, through the in-depth investigation of the item contents (from 258 items), core and sub-elements were identified, and all relevant items within a specific core element were reviewed according to three dimensions including exposure of the intervention, quality of the intervention providers, and responsiveness of the intervention recipients. As a result, the fidelity measures in the universal behavioral supports are used in a school or research and provide multiple functions (e.g. school teams’ use for the regular implementation monitoring, survey of school faculty and staff’s perception) with varied assessment methods. To enhance the user’s understanding, most measures serve different types of information (e.g., measurement, scoring, utilization methods) and materials (e.g., data collection form, action plan form) in addition to the rating scales and are open to the public at no cost through relevant websites or research publications. Also, the review of the item contents found 10 core elements(e.g., defining and teaching the expected behaviors) and 60 sub-elements (e.g., defining the expectations and rules in a clear and positive manner), and those elements were measured evenly in all three dimensions. In the end, the study provided several implications regarding the further development and utilization of fidelity measures in universal behavioral supports.

참고문헌 (51)

  1. 김보경, "학년 단위의 긍정적 행동지원을 통해 실시된 보편적 지원이 통합학급 초등학생의 사회적 능력, 수업참여행동 및 학교 분위기에 대한 인식에 미치는 영향", 정서·행동장애연구, 33(1), pp.85~105 (2017), 한국정서행동장애학회[DOI]
  2. 김수희, "긍정적행동지원, 학급긍정훈육법, 회복적생활교육에 대한 초등교사의 인식 비교", 통합교육연구, 17(1), pp.81~109 (2022), 한국통합교육학회[DOI]
  3. 김영아, "유아 문제행동 지도를 위한 긍정적 행동지원 평가도구 개발", 미래유아교육학회지, 25(1), pp.159~182 (2018), 미래유아교육학회[DOI]
  4. 김제린, "한국판 SWPBIS Tiered Fidelity Inventory Tier 1 (TFI T1)의 내용 타당도 연구", 특수교육, 21(2), pp.5~32 (2022), 특수교육연구소[DOI]
  5. 남동미, "한국형 학교차원 긍정적 행동지원 1차 실행충실도 척도(KIFC-T1)의 개발과 타당화", 한국심리학회지:학교, 17(3), pp.401~419 (2020), 한국심리학회산하학교심리학회[DOI]
  6. 박계신, "학교차원 긍정적 행동지원 적용을 통한 위기학생 예방 및 지원 방안 모색", 행동분석ㆍ지원연구, 7(1), pp.23~50 (2020), 한국행동분석학회[DOI]
  7. 박계신, "한국의 특수교육대상자 행동지원 정책 분석", 행동분석ㆍ지원연구, 9(1), pp.1~25 (2022), 한국행동분석학회[DOI]
  8. 배현민, "교사의 심리적 소진 연구 국내 연구동향: 2013년∼2020년을 중심으로", 교육연구논총, 42(3), pp.181~207 (2021), 교육연구소[DOI]
  9. 정광범, "보편적 차원의 긍정적 행동지원에 관한 문헌연구: 질적 지표(Benchmarks of Quality) 중심으로", 정서·행동장애연구, 35(2), pp.285~310 (2019), 한국정서행동장애학회[DOI]
  11. Bastable, E., "A survey of team members’ perceptions of coaching activities related to Tier 1 SWPBIS implementation", Journal of Positive Behavior Interventions, 22(1), pp.51~61 (2020)
  12. Bellg, A. J., "Enhancing treatment fidelity in health behavior change studies : Best practices and recommendations from the NIH Behavior Change Consortium", Health Psychology, 23(5), pp.443~ (2004)
  13. Boden, L. J., "Staffand youth buy-in ideas for initial and sustainable facility-wide positive behavior intervention and supports implementation within residential and juvenile facilities", Remedial and Special Education, 41(2), pp.88~98 (2020)
  14. Bradshaw, C. P., "Preliminary validation of the implementation phases inventory for assessing fidelity of schoolwide positive behavior supports", Journal of Positive Behavior Interventions, 11(3), pp.145~160 (2009)
  15. Michele B. Carney, "Construct maps and item frameworks: an example in proportional reasoning", Mathematics Education Research Journal (2022), Springer Science and Business Media LLC[DOI]
  16. (2020)[URL]
  17. The revised school-wide PBS Benchmarks of Quality (BoQ), "Childs, K. E.", OSEP Technical Assistance Center on Positive Behavioral Interventions and Supports, ~ (2011)
  18. Cohen, R., "Measuring school-wide positive behavior support implementation : Development and validation of the benchmarks of quality", Journal of Positive Behavior Interventions, 9(4), pp.203~213 (2007)
  19. Cross, W., "Observational Measures of Implementer Fidelity for a School-based Preventive Intervention : Development, Reliability and Validity", Prevention Science  : The Official Journal of the Society for Prevention Research, 16(1), pp.122~132 (2015)
  20. Dane, A. V., "Program integrity in primary and early secondary prevention : Are implementation effects out of control", Clinical Psychology Review, 18(1), pp.23~45 (1998)
  21. Dusenbury, L., "A review of research on fidelity of implementation : Implications for drug abuse prevention in school settings", Health Education Research, 18(2), pp.237~256 (2003)
  22. Filter, K. J., "An Expert Consensus Process to Distill Tier 1 PBIS into Core Practice Elements Essential to Frontline Implementation", Education and Treatment of Children, 45(1), pp.51~67 (2022)
  23. "Fidelity of Implementation in Educational Research and Practice" (2020)[URL]
  24. Horner, R. H., "School-wide PBIS : An Example of Applied Behavior Analysis Implemented at a Scale of Social Importance", Behavior Analysis in Practice, 8(1), pp.80~85 (2015)
  25. Horner, R. H., "Implementing Effective Educational Practices at Scales of Social Importance", Clinical Child and Family Psychology Review, 20(1), pp.25~35 (2017)
  26. Horner, R. H., "The school-wide evaluation tool(SET)a research instrument for assessing school-wide positive behavior support", Journal of Positive Behavior Interventions, 6(1), pp.3~12 (2004)
  27. "Tier 1 Benchmarks of Quality (BoQ)" (2010)[URL]
  28. Kittelman, A., "Optimal timing for launching installation of tiers 2 and 3 systems of school-wide positive behavioral interventions and supports", Journal of Positive Behavior Interventions, 24(3), pp.171~182 (2022)
  29. Mathews, S., "Critical features predicting sustained implementation of school-wide positive behavioral interventions and supports", Journal of Positive Behavior Interventions, 16(3), pp.168~178 (2014)
  30. McIntosh, K., "Technical adequacy of the SWPBIS tiered fidelity inventory", Journal of Positive Behavior Interventions, 19(1), pp.3~13 (2017)
  31. McIntosh, K., "Predictors of sustained implementation of school-wide positive behavioral interventions and supports", Journal of Positive Behavior Interventions, 18(4), pp.209~218 (2016)
  32. Mercer, S. H., "Comparability of fidelity measures for assessing tier 1 school-wide positive behavioral interventions and supports", Journal of Positive Behavior Interventions, 19(4), pp.195~204 (2017)
  33. Nelson, M. C., "A procedure for assessing intervention fidelity in experiments testing educational and behavioral interventions", The Journal of Behavioral Health Services & Research, 39(4), pp.374~396 (2012)
  34. "PBISAssessment User’s Manual" (2022)[URL]
  35. Reinke, W. M., "Classroom-level positive behavior supports in schools implementing SW-PBIS : Identifying areas for enhancement", Journal of Positive Behavior Interventions, 15(1), pp.39~50 (2013)
  36. Rice, K. G., "Multilevel confirmatory factor analysis of the Effective Behavior Support Self-Assessment Survey", School Psychology, 34(3), pp.318~ (2019)
  37. Rosas, S. R., "The use of concept mapping in measurement development and evaluation : application and future directions", Evaluation and program planning, 60, pp.265~276 (2017)
  38. Sanetti, L. M. H., "Treatment integrity assessment in the schools : An evaluation of the Treatment Integrity Planning Protocol", School Psychology Quarterly, 24(1), pp.24~ (2009)
  39. Solomon, B. G., "Examining the reliability and validity of the effective behavior support self-assessment survey", Education and Treatment of Children, 38(2), pp.175~191 (2015)
  40. Sugai, G., "Sustaining and Scaling Positive Behavioral Interventions and Supports : Implementation Drivers, Outcomes, and Considerations", Exceptional Children, 86(2), pp.120~136 (2020)
  41. "PBIS Self-Assessment Survey (SAS, Version 3.0)" (2009)[URL]
  42. "PBIS team implementation checklist (TIC 3.1), Educational and Community Supports" (2014)[URL]
  43. Sugai, G., "School-wide evaluation tool" (2001), University of Oregon
  44. Tobin, T., "Fidelity measures to improve implementation of positive behavioural support", International Journal of Positive Behavioural Support, 2(2), pp.12~19 (2012)
  45. Van Camp, A. M., "Building from the bottom up : The importance of Tier 1 supports in the context of Tier 2 interventions", Journal of Positive Behavior Interventions, 23(1), pp.53~64 (2021)
  46. van Dijk, W., "The Relation Between Implementation Fidelity and Students’ Reading Outcomes: A Systematic Review of the Literature", ~ (2020)
  47. Vincent, C., "A reexamination of the psychometric properties of the school-wide evaluation tool (SET)", Journal of Positive Behavior Interventions, 12(3), pp.161~179 (2010)
  48. Walker, B. A., "The SAPR-PBIS manual: A team-based approach to implementing effective schoolwide positive behavior interventions and supports" (2012), Paul H. Brookes Publishing Company
  49. Walker, B., "The validity and reliability of the self-assessment and program review : Assessing school progress in schoolwide positive behavior support", Journal of Positive Behavior Interventions, 11(2), pp.94~109 (2009)
  50. Waltz, J., "Testing the integrity of a psychotherapy protocol : Assessment of adherence and competence", Journal of Consulting and Clinical Psychology, 61(4), pp.620~ (1993)
  51. Wilson, M., "Measuring progressions : Assessment structures underlying a learning progression", Journal of Research in Science Teaching : The Official Journal of the National Association for Research in Science Teaching, 46(6), pp.716~730 (2009)

관련 논문AI추천

학교 차원의 긍정적 행동지원 실행 연구 최신 동향: 2012-2017년 국내외 학술지를 중심으로김은혜, 이효정한국정서행동장애학회 · 정서·행동장애연구2018 · 제34권 제1호한국형 학교차원 긍정적 행동지원 1차 실행충실도 척도(KIFC-T1)의 개발과 타당화남동미, 송원영, 원성두, 장은진, 조광순한국심리학회산하학교심리학회 · 한국심리학회지:학교2020 · 제17권 제3호보편적 차원의 긍정적 행동지원에 관한 문헌연구: 질적 지표(Benchmarks of Quality) 중심으로이병인, 정광범한국정서행동장애학회 · 정서·행동장애연구2019 · 제35권 제2호일반 초·중·고등학교에서 보편적 차원의 긍정적 행동지원을 적용한 국내 실험 연구 분석최하영한국행동분석학회 · 행동분석ㆍ지원연구2017 · 제4권 제2호한국형 긍정적 행동지원 3차 실행충실도 척도(KT3-FC)의 개발과 타당화남동미, 송원영, 원성두, 장은진, 조광순한국심리학회산하학교심리학회 · 한국심리학회지:학교2020 · 제17권 제2호보편적 차원의 긍정적 행동지원에 관한 문헌연구김영란한국특수교육문제연구소 · 특수교육저널:이론과 실천2009 · 제10권 제4호

이 간행물의 다른 논문 (5건)

행동유관도식을 활용한 사회적 도해 중재가 ADHD 위험군 유아의 사회적 의사소통 행동에 미치는 영향문현미, 이미란pp. 1-18동기조작(MO)이 자폐스펙트럼장애 학생의 자발적인 정보 맨드에 미치는 영향양송이, 박혜숙pp. 19-41일치 훈련에 대한 문헌 연구정선화pp. 83-100태블릿 PC를 이용한 자기관리전략이 지적장애 초등학생의 수업 참여 행동에 미치는 영향전현숙, 박혜숙pp. 101-125Using the Individualized Behavior Rating Scale Tool (IBRST) as a Self-Monitoring Tool to Improve Classroom Behavior조광순, Marissa Novotny, Dominique Martinezpp. 127-150
원문 보기