2015 개정 과학과 교육과정에 기초한 과학과 핵심역량 조사 문항의 개발 및 적용
Developing and Applying the Questionnaire to Measure Science Core Competencies Based on the 2015 Revised National Science Curriculum
1
조회
0
다운로드
57
인용
0
참고문헌
키워드
초록
이 연구는 2015 과학과 교육과정에 제시된 과학과 핵심역량에 관한 서술문을 기초로 학생들의 과학과 핵심역량을 측정할 수 있는 문항을 개발하고, 그 타당도와 신뢰도를 확인하기 위하여 진행되었다. 2015 과학과 교육과정에 제시된 과학적 사고력, 과학적 탐구 능력, 과학적 문제해결력, 과학적 의사소통 능력, 과학적 참여와 평생 학습 능력에 대한 설명을 근거로 각 역량별로 5개 문항씩, 총 25개 문항이 개발되었다. 개발된 문항은 전국 17개 시도에 고루 분포한 학생 참여형 과학수업 선도학교의 초등학교, 중학교, 고등학교 학생 11,348명을 대상으로 과학과 핵심역량을 조사하여 문항의 타당도와 신뢰도를 분석하였다. 타당도는 Messick(1995)이 제안한 6가지 타당도 중 내용 타당도, 실제 타당도, 내적 구조 타당도, 일반화 타당도 등 4가지를 확인하였다. 라쉬 모델의 문항 적합도(MNSQ)를 분석한 결과, 25개 문항 중 부적합 문항은 없었으며, 구조방정식을 활용한 확인적 요인 분석 결과 5개 요인 모델은 적합한 모델로 확인되었다. 성별과 학교급 별에 따른 차별적 문항 반응을 분석한 결과, 부적합 값은 175개 중 2개에서 나타났다. 성별과 학교급별 다변량 이원분산분석을 실시한 결과, 학교급 간 및 성별 간에서 통계적으로 유의미한 차이가 나타났 으며, 교호작용 효과 역시 유의미하였다. 결론적으로 2015 과학과 교육과정에 제시된 과학과 핵심역량의 설명에 기초하여 개발한 과학과 핵심역량 평가문항은 정신측정학적 관점에서 타당하며, 따라서 교육 현장에서 그 활용 가치가 있을 것으로 판단된다.
Abstract
This study was conducted to develop items to measure scientific core competency based on statements of scientific core competencies presented in the 2015 revised national science curriculum and to identify the validity and reliability of the newly developed items. Based on the explanations of scientific reasoning, scientific inquiry ability, scientific problem-solving ability, scientific communication ability, participation/ lifelong learning in science presented in the 2015 revised national science curriculum, 25 items were developed by five science education experts. To explore the validity and reliability of the developed items, data were collected from 11,348 students in elementary, middle, and high schools nationwide. The content validity, substantive validity, the internal structure validity, and generalization validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there were no nonconformity in the 25 items. The confirmatory factor analysis using the structural equation modeling revealed that the five-factor model was a suitable model. The differential item functioning analyses by gender and school level revealed that the nonconformity DIF value was found in only two out of 175 cases. The results of the multivariate analysis of variance by gender and school level showed significant differences of test scores between schools and genders, and the interaction effect was also significant. The assessment items of science core competency based on the 2015 revised national science curriculum are valid from a psychometric point of view and can be used in the science education field.
참고문헌 (51)
- Angner, E., "Economists as experts : Overconfidence in theory and practice", Journal of Economic Methodology, 13(1), pp.1~24 (2006)
- Baars, M., "Effects of training self-assessment and using assessment standards on retrospective and prospective monitoring of problem solving", Learning and Instruction, 33, pp.92~107 (2014)
- 백평구, "대학생 핵심역량 수준과 대학생 개인 변인의 관계 및 특성", 교양교육연구, 7(3), pp.349~387 (2013), 한국교양교육학회
- Benbow, C. P., "Sex differences in mathematical reasoning ability : More facts", Science, 222(4627), pp.1029~1031 (1983)
- Boone, W. J., "Rasch Analysis in the Human Sciences" (2014), Springer
- Cavallo, A. M., "Gender differences in learning constructs, shifts in learning constructs, and their relationship to course achievement in a structured inquiry, yearlong college physics course for life science majors", School Science and Mathematics, 104(6), pp.288~300 (2004)
- Measuring Youth Competency Index and International Comparative Study Ⅱ(IEA ICCS 2016) : General Report, "Chang, G.", National Youth Policy Institute, ~ (2015)
- Chi, M. T., "The Cambridge Handbook of Expertise and Expert Performance", pp.21~30 (2006), Cambridge University Press
- 최경희, "과학교육에서의 성별 차이 현황과 해결 방안", 여성학논집, 25(2), pp.117~158 (2008), 한국여성연구원[DOI]
- Gadermann, A. M., "Investigating the substantive aspect of construct validity for the satisfaction with life scale adapted for children : A focus on cognitive processes", Social Indicators Research, 100(1), pp.37~60 (2011)
- George, D., "Using SPSS for Windows Step by Step : a Simple Guide and Reference" (2003), Allyn & Bacon
- 진미석, "대학생 핵심역량 진단체제 구축 방안 연구", 교육행정학연구, 29(4), pp.461~486 (2011), 한국교육행정학회
- 2014 KEDI Student Competency Index Survey, "Kang, Y.", KEDI, ~, pp.KEDI Report RR 2014-26 (2014)
- A Study for Developing Student Competency Index, "Kim, C.", KEDI, ~, pp.KEDI Report RR 2013-23 (2013)
- 김동일, "대학 교수가 바라본 고등교육에서의 대학생 핵심역량: 서울대학교 사례를 중심으로", 아시아교육연구, 10(2), pp.195~214 (2009), 교육연구소[DOI]
- Kim, E, "Readiness of university students in Korea for the core competencies in the 21st century", Master, pp.2014
- 김혜영, "역량교육모델의 진단과 방향:역량교육과정과 교육효과를 중심으로", 교양교육연구, 6(4), pp.11~40 (2012), 한국교양교육학회
- 김혜영, "역량진단검사 활용방안에 관한 연구 ― 진단도구와 교과·비교과 프로그램의 연계를 중심으로", 교양교육연구, 7(4), pp.139~172 (2013), 한국교양교육학회
- A Study on Development and Progress Plan of Lifetime Core Competency for AdolescentⅠ : General Report, "Kim, K.", National Youth Policy Institute, ~ (2008)
- A Study on Development and Progress Plan of Lifetime Core Competency for AdolescentⅡ : General Report, "Kim, K.", National Youth Policy Institute, ~ (2009)
- Kostons, D., "Training self-assessment and task-selection skills : A cognitive approach to improving self-regulated learning", Learning and Instruction, 22(2), pp.121~132 (2012)
- 곽영순, "과학과 교육과정 개정에 대비한 핵심역량 재구조화 방안", 한국지구과학회지, 34(4), pp.368~377 (2013), 한국지구과학회
- Lai, J. S., "Procedures for the analysis of differential item functioning(DIF)for small sample sizes", Evaluation & the health professions, 28(3), pp.283~294 (2005)
- A Study on the Vision of Elementary and Secondary School Curriculum for the Improvement of Core Competencies of Future Koreans : General Report RRC 2009-10, "Lee, G.", Korea Institute for Curriculum and Evaluation, ~ (2009)
- Exploring Curriculum for the Development of Core Competencies in the Future : Focusing on the Linkage of Curriculum, Teaching⋅Learning and Educational Evaluation. Research Report RRC 2013002, "Lee, G.", Korea Institute for Curriculum and Evaluation, ~ (2013)
- 이경희, "공과대학 신입생의 핵심역량 인식수준을 통한 공학교육방향 연구", 공학교육연구, 13(6), pp.57~71 (2010), 한국공학교육학회[DOI]
- A Study on the Vision of Elementary and Secondary School Curriculum for the Improvement of Core Competencies of Future Koreans(Ⅱ) : Focusing on Sub-Element Setting by Core Competency Area, "Lee, G.", Korea Institute for Curriculum and Evaluation, ~ (2008)
- 이준기, "잠재집단분석방법을 통한 공과대학 학생들의 성별, 학년별, 공학인증제 프로그램 선택에 따른 공학 창의성 유형 탐색", 과학교육연구지, 41(1), pp.16~35 (2017), 과학교육연구소[DOI]
- 이숙정, "대학 교양교육의 방향과 과제: 역량기반 교양교육 사례연구를 중심으로", 교양교육연구, 6(2), pp.11~42 (2012), 한국교양교육학회[DOI]
- Lee, V. E., "Gender differences in middle grade science achievement : Subject domain, ability level, and course emphasis", Science Education, 80(6), pp.613~650 (1996)
- Menkhoff, L., "Overconfidence, experience, and professionalism : An experimental study", Journal of Economic Behavior & Organization, 86, pp.92~101 (2013)
- Messick, S., "Standards of validity and the validity of standards in performance assessment", Educational Measurement : Issues and Practice, 14(4), pp.5~8 (1995)
- MOE(Ministry of Education), "2015 revised Science National Curriculum", Ministry of Education, ~ (2015)
- Neumann, I., "Evaluating instrument quality in science education : Rasch‐based analyses of a nature of science test", International Journal of Science Education, 33(10), pp.1373~1405 (2011)
- 노윤신, "국내 4년제 대학교 대학생의 역량모델 구축 사례: D여대를 중심으로", 기업교육과인재연구, 15(1), pp.79~101 (2013), 한국기업교육학회
- 노윤신, "대학생 역량진단 도구의 개발과 타당화 연구 : D 여자대학교를 중심으로", HRD연구, 15(3), pp.273~305 (2013), 한국인력개발학회[DOI]
- OECD, "Defining and selection of competencies: Theoretical and conceptual foundation", OECD Press, ~ (2003)
- OECD, "Schooling for tomorrow: Thinking scenarios, rethinking education", OECD Press, ~ (2006)
- Pajares, F., "Self-efficacy, motivation constructs, and mathematics performance of entering middle school students", Contemporary Educational Psychology, 24(2), pp.124~139 (1999)
- Pallier, G., "Gender differences in the self-assessment of accuracy on cognitive tasks", Sex Roles, 48(5), pp.265~276 (2003)
- Panadero, E., "Rubrics and self-assessment scripts effects on self-regulation, learning and self-efficacy in secondary education", Learning and Individual Differences, 22(6), pp.806~813 (2012)
- 박병태, "과학 성취도 최상위 학생의 과학 문제 해결 과정에서 성공자와 실패자의 성별 특성 비교", 학습자중심교과교육연구, 10(2), pp.173~189 (2010), 학습자중심교과교육학회
- Quirk, P. J., "The trouble with experts", Critical Review, 22(4), pp.449~465 (2010)
- Scott, N. W., "A simulation study provided sample size guidance for differential item functioning(DIF)studies using short scales", Journal of Clinical Ppidemiology, 62(3), pp.288~295 (2009)
- Measuring Youth Competency Index and International Comparative Study Ⅰ(IEA ICCS 2016) : General Report, "Seong, E.", National Youth Policy Institute, ~ (2014)
- Shin, S., "Influence of career motivation on science learning in Korean high-school students", EURASIA Journal of Mathematics Science and Technology Education, 13(5), pp.1517~1538 (2017)
- 소경희, "뉴질랜드 교육과정 개혁 동향: 핵심역량 중심 교육과정의 실천 사례", 비교교육연구, 20(2), pp.27~50 (2010), 한국비교교육학회
- A Study on the Support for Core Competency of Korean Students in Collegiate Level, "Son, Y.", Korea Research Institute for Vocational Education and Training, ~ (2016)
- Stankov, L., "Confidence and cognitive test performance", Journal of Educational Psychology, 100(4), pp.961~ (2008)
- Wright, B. D., "Reasonable mean-square-fit values", Rasch Measurement Transactions, 8(3), pp.370~ (1994)
- A Study on the Vision of Elementary and Secondary School Curriculum for the Improvement of Core Competencies of Future Koreans (Ⅰ): Focusing on Core Competency Criteria and Area Setting, "Yoon, H.", Korea Institute for Curriculum and Evaluation, ~, pp.Research Report RRC 2007-1 (2007)
