본문 바로가기
KERD
논문KCI 등재

예비 교사를 대상으로 한 시스템 사고 검사 도구 개정 및 타당화

Revision and Validation of the Systems Thinking Measuring Instrument for Pre-service Teachers

이현동
과학교육연구소 (Science Education Research Institute)|2024.06|교사교육연구 (Teacher Education Research)|제63권 제2호|pp. 217-236|DOI 10.15812/ter.63.2.202406.217

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

탐색적 요인 분석확인적 요인 분석예비 교사Exploratory factor analysisConfirmatory factor analysisPre-service teachers개정 시스템 사고 검사 도구(Re_STMI_pst)시스템 사고 척도Revised Systems Thinking Measuring InstrumentSTS(Systems Thinking Scale)

초록

이 연구는 예비 교사들을 대상으로 시스템 사고 검사 도구(STMI)를 개정하고, 개정된 Re_STMI(pst.)의 타당도를 검증하고자 하였다. 이를 위하여 예비 검사에는 예비 교사 187명, 본 검사에는 예비 교사 340명이 검사 도구에 응답한 데이터를 활용하여 분석하였다. 개정을 위한 시스템 사고 검사 도구는 Lee et al.(2013)에서 개발한 STMI 검사 도구를 선정하였으며, 공인 타당도 검증을 위한 비교 척도로는 Dolansky et al.(2020)의 STS 척도를 활용하였다. 사전 검사 결과, STMI의 8문항에서 타당도에 문제점이 분석되었으며, 문항을 수정･보완하기 위하여 전문가 협의회를 실시하였다. 전문가 협의회에서 도출된 내용을 반영하여 8문항과 함께 STMI 문항 전반적인 수정･보완을 거쳐 Re_STMI(pst.)로 개정하였다. 개정된 검사 도구로 본 검사를 실시한 결과, 탐색적 요인분석에서는 20개 문항 모두 의도한 요인에 적재되었으며, 문항 타당도도 양호한 것으로 분석되었다. 확인적 요인분석에서는 /df: 2.103, CFI: .925, TLI: .911, SRMR: .054, RMSEA: .057로 나타났으며 집중 타당도의 AVE 및 Concept validity가 양호한 값으로 분석되었다. 그리고 다중집단분석을 실시한 교차 타당도에서도 설정한 모형이 적합하다고 분석되었다. Re_STMI(pst.)와 STS 간 공인 타당도를 검증에서는 전체 문항 간 상관이 .761로, 하위 요인에서 STS 간 상관은 .428 ~ .709로 높은 상관을 보여주었다. 따라서 예비 교사들을 대상으로 수정･보완을 거친 개정 시스템 사고 검사 도구의 경우 예비 교사 교육과정 등에서 진행하는 시스템 사고 역량 측정 연구에서 타당도가 검증된 검사지로써 활용할 수 있을 것이다. 또한 학생들의 시스템 사고 수준을 측정하는 후속 검사 도구 개발 과정에서 공인 타당도를 비교할 수 있는 검사지로써 활용될 수 있을 것이다.

Abstract

The purpose of this study was to revise the systems thinking measuring instrument for pre-service teachers and validate the revised Re_STMI(pst.). Data from 187 pre-service teachers for the pilot test and 340 for the main test were analyzed. The systems thinking measuring instrument for revision that was selected STMI by Lee et al. (2013), and STS (Dolansky et al., 2020) scale was utilized for criterion validity verification. The pilot-test revealed issues with validity in 8 items of STMI, leading to expert committee for modification and supplementation. Based on the reflection from a committee of experts, modifications and supplements to STMI items were implemented to revise the Re_STMI(pst.) Results of the main test with the revised tool showed 20 items loaded onto intended factors in exploratory factor analysis, and item validity was also analyzed to be acceptable. Confirmatory factor analysis indicated strong model fit indices (/df: 2.103, CFI: .925, TLI: .911, SRMR: .054, RMSEA: .057) and acceptable AVE and concept validity for construct validity. Additionally, cross-validity through multi-group analysis showed the model to be appropriate. In the criterion validity comparison between Re_STMI(pst.) and STS, a high correlation (.761) among all items and among sub-factors (.428~.709) was observed. Therefore, the revised system thinking assessment tool, which has been modified and supplemented for pre-service teachers, can be used as a validated assessment tool in studies measuring system thinking competencies conducted in pre-service teacher education programs. It could also serve as a tool for comparing validity in the development process of sub-sequent measurement tools for assessing students' systems thinking levels.

참고문헌 (69)

  1. Bae, B., "Amos 24 Advanced Structural Equation Modeling" (2018), Cheongram
  2. Bak, B., "Scale Revalidation of Epistemological Beliefs and Exploration of their Domainality", The Korean Journal of Eductional Psychology, 26(3), pp.739~767 (2012)
  3. Bal-Taştan, S., "The impacts of teacher’s efficacy and motivation on student’s academic achievement in science education among secondary and high school students", EURASIA Journal of Mathematics, Science and Technology Education, 14(6), pp.2353~2366 (2018)
  4. Bentler, M., "Comparative fit indexes in structural models", Psychological bulletin, 107(2), pp.238~ (1990)
  5. Ben-Zvi Assaraf, O., "Four Case Studies, Six Years Later : Developing System Thinking Skills in Junior High School and Sustaining Them over Time", Journal of Research in Science Teaching, 47(10), pp.1253~1280 (2010)
  6. Ben-zvi-Assaraf, O., "Development of System Thinking Skills in the Context of Earth System Education", Journal of Research in Science Teaching, 42(5), pp.518~560 (2005)
  7. Ben-zvi-Assaraf, O., "A Study of Junior High Students’Perceptions of the water cycle", Journal of Geoscience Education, 53(4), pp.366~373 (2005)
  8. Ben-Zvi-Assaraf, O., "A Design Based Research of an Earth Systems Based Environmental Curriculum", Eurasia Journal of Mathematics, Science & Technology Education, 5(1), pp.47~62 (2009)
  9. Breslyn, W., "Developing a learning progression for sea level rise : A major impact of climate change", Journal of Research In Science Teaching, 53(10), pp.1471~1499 (2016)
  10. Cheung, G. W., "Evaluating goodness-of-fit indexes for testing measurement invariance", Structural Equation Modeling, 9, pp.233~255 (2002)
  11. Cho, C., "The Study of Relationship between Transformational Leadership and Organizational Effects in Public Relief Medical Welfare Organization", Health Service Management Review, 8(1), pp.23~32 (2014)
  12. Cho, O., "The Effects of Simulation-based Education on Nursing Students’ Presence in Education, Systems Thinking and Proactivity in Problem Solving", Journal of Korean Academic Society of Home Health Care Nursing, 23(2), pp.147~154 (2016)
  13. Davis, A. C., "The relationship between systems thinking and the new ecological paradigm", Systems Research and Behavioral Science, 33(4), pp.575~586 (2016)
  14. Dawes, M. E., "Experimental evaluation of self-efficacy treatmenton technical", scientific career outcomes, 2000, pp.28(10), 87~99
  15. Dolansky, M. A., "Development and validation of the systems thinking scale", Journal of General Internal Medicine, 35, pp.2314~2320 (2020)
  16. Glynn, S., "Science motivation questionnaire II : Validation with science majors and nonscience majors", Journal of Research in Science Teaching, 48(10), pp.1159~1176 (2011)
  17. Groves, K. S., "Linear and Nonlinear Thinking : A Multidimensional Model and Measure", The Journal of Creative Behavior, 49(2), pp.111~136 (2015)[DOI]
  18. Ha, M., "Examining the Validity of History-of-Science-Based Evolution Concept Assessment and Exploring Conceptual Progressions by Contexts", Journal of the Korean Association for Science Education, 36(3), pp.509~517 (2016)
  19. Hong, S., "Testing configural, metric, scalar, and latent mean in variance across gender in sociotropy and autonomy using non-western sample", Educational and Psychology Measurement, 63, pp.636~654 (2003)
  20. Hu, T., "Cut off Criteria for Fit Indexes in Covariance Structure Analysis : Conventional Criteria versus New Alternatives", Structural Equation Modeling, 6, pp.1~55 (1999)
  21. Jeon, J., "Development and Application of Instrument for Level Scale of the Systems Thinking Ability about Carbon Cycle", Journal of the Korean Association for Science Education, 42(4), pp.397~415 (2022)
  22. Jo, G., "Effect of systems thinking based steam education program on climate change topics", International Journal of Contents, 17(7), pp.113~123 (2017)
  23. Jung, J., "Development and validation of the Kkondae tendency scale", Korean Journal of Coaching Psychology, 7, pp.153~196 (2023)
  24. Kang, C., "Analysis of conceptions related to Earth system and systems-thinking of high school student about water cycle", Journal of Science Education, 32(1), pp.61~72 (2008)
  25. Keşan, C., "Mathematics and Science Self-Efficacy Resources as the Predictor of Academic Success", International Online Journal of Educational Sciences, 10(2), pp.45~58 (2018)
  26. The Exploration of Direction for Curriculum Innovation in Preparation for the Intelligence Information Society, "KICE(Korea Institute for Curriculum and Evaluation)", Korea Institute for Curriculum and Evaluation, ~, pp.RRC 2023-3 (2023)
  27. A new educational approach to citizenship in school emphasizing neutrality in public education, "KICE(Korea Institute for Curriculum and Evaluation)", Korea Institute for Curriculum and Evaluation, ~, pp.CRC 2024-1 (2024)
  28. Kim, B., "Characteristics of Elementary Students’ System Thinking in Learning of Water Cycle", Journal of Korean Elementary Science Education, 39(3), pp.412~432 (2020)
  29. Kim, H., "A Phenomenological Study of Elementary School Teachers’ System Thinking-based Science Teaching Experiences", The Journal of The Korean Earth Science Society, 40(1), pp.65~85 (2019)
  30. Kim, H., "The Effect of a System Thinking-based STEAM-type ESD Program on Environmental Literacy and System Thinking Ability of Elementary Students", Journal of Korean Journal of Environmental Education, 30(1), pp.85~102 (2017)
  31. Kim, J., "Applications of Structural Equation Modeling inManagement Studies : A Critical Review", Korean management review, 36(4), pp.897~923 (2007)
  32. Kim, S., "Writing a dissertation with a structural equation model" (2012), Communication Books
  33. Kwon, Y., "Analysis of Biology Teachers’ Systems Thinking about Ecosystem", BIOLOGY EDUCATION, 39(4), pp.529~543 (2011)
  34. Lee, H., "Revalidation of measuring instrument systems thinking and comparison of systems thinking between science and general high school students", Journal of the Korean Association for Science Education, 33(4), pp.1237~1247 (2013)
  35. Lee, H., "Validity Verification of Systems Thinking Measuring Instrument of Elementary School Students’ and Middle School Students’ : Using Item Response Analysis", Secondary Education Research, 67(2), pp.249~277 (2019)
  36. Lee, H., "An Analysis of Systems Thinking Levels of the Water Cycle in Earth System of Primary School Pre-Service Teachers", Teacher Education Research, 59(1), pp.21~38 (2020)
  37. Lee, H., "Effects of Systems Thinking on High School Students’ Science Self-Efficacy", The Journal of The Korean Earth Science Society, 37(3), pp.133~145 (2016)
  38. Lee, H., "Analysis and effects of high school students’ systems thinking using iceberg(IB)model", Journal of the Korean Association for Science Education, 37(4), pp.611~624 (2017)
  39. Lee, H., "Development of Framework and Rubric for Measuring Students’Level of Systems Thinking", Journal of the Korean Association for Science Education, 38(3), pp.355~367 (2018)
  40. Lee, H., "Verification the Systems Thinking Factor Structure and Comparison of Systems Thinking Based on Preferred Subjects about Elementary School Students’", Journal of the Korean Association for Science Education, 39(2), pp.161~171 (2019)
  41. Lee, H., "An instrument development and validation for measuring high school students' systems thinking", Journal of the Korean Association for Science Education, 33(3), pp.995~1006 (2013)
  42. Lee, H., "Development and application of the educational program to increase high school students'systems thinking skills : Focus on global warming", Journal of the Korean Earth Science Society, 32, pp.784~797 (2011)
  43. Lee, H., "The Validation of the Systems Thinking Assessment Tool for Measuring the Higher-order Thinking Ability of Vietnamese High School Students", The Journal of The Korean Earth Science Society, 44(4), pp.318~330 (2023)
  44. Lee, H., "Validation of the Revised Systems Thinking Measurning Instrument(Re_STMI) for High School Students", Brain, Digital, & Learning, 14(1) (2024)
  45. Lent, R. W., "Latent structures of the sources of mathematics self-efficacy", Journal of Vocational Behavior, 49, pp.292~308 (1996)
  46. Lim, A., "Development and validation of the acceptance for differences in couple relationships scale based on IBCT", Korean Journal of Psychology : General, 39, pp.599~632 (2020)
  47. Maani, K. E., "Links between systems thinking and complex decision making", System Dynamics Review, 20(1), pp.21~48 (2004)
  48. Ministry of Education(MOE), "2022 revised curriculum: Science", Ministry of Education, ~ (2022)
  49. Mohan, L., "Developing a multi-year learning progression for carbon cycling in socio-ecological systems", Journal of Research in Science Teaching, 46(6), pp.675~698 (2009)
  50. Mohan, L., "Developing a carbon cycling learning progression for K-12", Paper presented at the annual meeting of the National Association for Research on Science Teaching (2006)
  51. Moon, B., "A Study on the Abilities and Characteristics of the Systems Thinking for Pre-service Elementary Teachers", Korean System Dynamics Review, 8(2), pp.235~252 (2017)
  52. Mun, B., "Development and validation of a scale to measure of early childhood teachers climate literacy", Journal of Eco Early Childhood Education & Care, 23, pp.71~94 (2024)
  53. National Academies Press, , 2012
  54. (2017)[URL]
  55. Noh, K., "The proper method of statistical analysis for dissertation" (2019), Hanbit
  56. O'Connor, J., "The art of systems thinking: Essential skills for creativity and problem solving" (1997), Thorsons Publishers
  57. Park, K., "Analysis of Systems Thinking Level of Pre-service Teachers about Carbon Cycle in Earth Systems using Rubrics of Evaluating Systems Thinking", Journal of the Korean Association for Science Education, 39(5), pp.599~611 (2019)
  58. Park, M., "The Effect of Simulation Integrated with Problem Based Learning on System Thinking, Learning Flow, Proactivity in Problem Solving and Performance Ability for Medication in Nursing Students", Journal of Digital Convergence, 16(8), pp.221~231 (2018)
  59. Randle, J. M., "The development and initial validation of the paradigm of systems thinking", Systems Research and Behavioral Science, 35(6), pp.645~657 (2018)
  60. Rust, J., "Modern psychometrics: The science of psychological assessment" (2014), Routledge
  61. Senge, P. M., "The fifth discipline: Fieldbook" (1996), Broadway Business
  62. Senge, P. M., "Schools that learn(Updated and Revised): A fifth discipline fieldbook for educators, parents, and everyone who cares about education" (2012), Doubleday
  63. Seong, T., "consideration of evidence based on consequence of testing and evaluation actibity in perspective of the meta evaluation", Korean Journal of Educational Research, 41(1), pp.91~110 (2003)
  64. Shin, H., "Validation of the Korean Teacher WellBeing Scale (K-TWBS): For secondary school teachers", Brain, Digital, &Learning, 13(4), pp.483~501 (2023)
  65. AMOS, "Statistical Analysis Methods Required for Writing SPSS", pp.2010, Song, J.
  66. Sterman, J. D., "Business dynamics: systems thinking and modeling for a complex world (No. HD30. 2 S7835 2000)", ~ (2000)
  67. Sweeney, B., "The systems thinking playbook: Exercises to stretch and build learning and systems thinking capabilities" (2010), Chelsea Green Publishing
  68. Tucker, R., "A reliability coefficient for maximum likelihood factor analysis", Psychometrika, 38(1), pp.1~10 (1973)
  69. Yu, M., "Development and Validation of a Career Guidance Competency Scale using AI for Pre-service Teachers", Journal of Future Society, 15(1), pp.242~263 (2024)

관련 논문AI추천

고등학생들을 대상으로 한 개정 시스템 사고 검사도구(Re_STMI)의 타당도 검증박병열, 이현동, 이효녕, 전재돈뇌·AI기반교육연구소 · Brain, Digital, & Learning2024 · 제14권 제1호초등학생의 시스템 사고 요인 구조 검증과 선호 과목에 따른 시스템 사고 비교이현동, 이효녕, 전재돈한국과학교육학회 · 한국과학교육학회지2019 · 제39권 제2호고등학생들의 시스템 사고 측정을 위한 측정 도구 개발과 타당화권혁수, 박경숙, 이현동, 이효녕한국과학교육학회 · 한국과학교육학회지2013 · 제33권 제5호과학 고등학교와 일반 고등학교 학생들을 대상으로 시스템 사고측정 도구의 타당도 검증 및 시스템 사고 비교이현동, 이효녕한국과학교육학회 · 한국과학교육학회지2013 · 제33권 제6호문항 반응 분석을 활용한 초등학생과 중학생의 시스템 사고 검사 도구 타당도 검증이현동사범대학부속중등교육연구소 · 중등교육연구2019 · 제67권 제2호학생들의 시스템 사고 수준 측정을 위한 Framework와 Rubric의 개발이현동, 이효녕, 전재돈한국과학교육학회 · 한국과학교육학회지2018 · 제38권 제3호

이 간행물의 다른 논문 (8건)

잠재전이분석을 활용한 초등학생의 학교 밖 쓰기 활동 변화 유형과 영향요인 탐색신은진, 손원숙, 이빛나pp. 119-132Desmos를 활용한 수학수업에서 익명성이 학생들의 학습 참여도에 미치는 영향손홍찬, 박도현pp. 133-152중학생의 학교스포츠클럽활동 참여를 통한 성취목표성향이 스포츠자신감 및 학업적 그릿에 미치는 영향이다영, 조건상pp. 153-166외국인 유학생 대상 비교과 교육 CIPP 평가 지표 연구: I-CVI를 활용한 4단계 평가 지표 개발을 중심으로김성재pp. 167-182중학교 교사의 피드백 인식과 의도 및 디지털 리터러시가 형성적 피드백 실행에 미치는 영향: 원격 및 대면수업 비교김경남, 손원숙pp. 183-200
원문 보기