본문 바로가기
KERD
논문KCI 등재

교육대학원과 사범대학 예비수학교사의 교직 적성·인성 검사에 대한측정의 동등성 분석

An Analysis of Measurement Equivalence in a Teaching Aptitude and Personality Test for Pre-service Mathematics Teachers between a Graduate School of Education and a College of Education

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

초록

The purpose of this study was to investigate the measurement equivalence and to suggest application ways in teaching aptitude and personality test results for pre-service mathematics teachers between a graduate school of education and a college of education. This study analyzed the scores of the teaching aptitude and personality test of 36 pre-service mathematics teachers enrolled in a graduate school of education and 111 pre-service mathematics teachers in a college of education by performing a multivariate generalizability analysis. The main results were as follows. First, graduate’s pre-service mathematics teachers had a higher level of teaching aptitude and personality than that of college’s pre-service mathematics teachers based on the total scores. In addition, graduate’s pre-service mathematics teachers had higher levels of teaching aptitude and personality than those of college’s pre-service mathematics teachers except for a creativity·application domain based on the sub-domain scores. Second, cognitive domains were measured more precisely but affective domains were measured less precisely for graduate’s pre-service mathematics teachers than for college’s pre-service mathematics teachers. Third, regardless of school levels, Cronbach’s  values, which might be overestimated by applying the classical test theory, were higher than dependability coefficients. Fourth, this study showed a somewhat negative result in ensuring the measurement equivalence for a problem solving·exploration domain. However, regardless of school levels, this study indicated that the overall measurement was generally reliable on composite scores. Based on these results, it was confirmed that multivariate generalizability methodologies’ approach can be useful for exploring the measurement equivalence issues. Finally, this study suggests how to utilize the results of the test, how to apply a multivariate generalizability analysis for detecting the measurement equivalence, and how to develop future research based on limitations.

Abstract

The purpose of this study was to investigate the measurement equivalence and to suggest application ways in teaching aptitude and personality test results for pre-service mathematics teachers between a graduate school of education and a college of education. This study analyzed the scores of the teaching aptitude and personality test of 36 pre-service mathematics teachers enrolled in a graduate school of education and 111 pre-service mathematics teachers in a college of education by performing a multivariate generalizability analysis. The main results were as follows. First, graduate’s pre-service mathematics teachers had a higher level of teaching aptitude and personality than that of college’s pre-service mathematics teachers based on the total scores. In addition, graduate’s pre-service mathematics teachers had higher levels of teaching aptitude and personality than those of college’s pre-service mathematics teachers except for a creativity·application domain based on the sub-domain scores. Second, cognitive domains were measured more precisely but affective domains were measured less precisely for graduate’s pre-service mathematics teachers than for college’s pre-service mathematics teachers. Third, regardless of school levels, Cronbach’s  values, which might be overestimated by applying the classical test theory, were higher than dependability coefficients. Fourth, this study showed a somewhat negative result in ensuring the measurement equivalence for a problem solving·exploration domain. However, regardless of school levels, this study indicated that the overall measurement was generally reliable on composite scores. Based on these results, it was confirmed that multivariate generalizability methodologies’ approach can be useful for exploring the measurement equivalence issues. Finally, this study suggests how to utilize the results of the test, how to apply a multivariate generalizability analysis for detecting the measurement equivalence, and how to develop future research based on limitations.

참고문헌 (66)

  1. 교육부, "2015 문·이과 통합형 교육과정 총론 주요 사항", 교육부, ~ (2015)
  2. 김래영, "교원양성교육과정과 교원임용후보자 선정경쟁시험에 나타난 중등수학교사에게 요구되는 지식 분석: 교수를 위한 내용 지식을 중심으로", 교과교육학연구, 21(5), pp.610~623 (2017), 교과교육연구소[DOI]
  3. 김명화, "채점 자동화 시스템 구축을 위한 수학 구성형 문항의 채점의 일반화 가능도", 교육문제연구, (22), pp.205~222 (2005), 교육문제연구소
  4. 김성숙, "일반화가능도 이론" (2001), 교육과학사
  5. 김성숙, "정의적 성취특성 측정의 오차요인 및 성취수준별 척도의 동등성 분석", 교육과정평가연구, 21(1), pp.153~172 (2018), 한국교육과정평가원[DOI]
  6. 김성연, "수학적 창의성 검사의 채점 영역별 가중치 분석", 수학교육, 55(2), pp.147~169 (2016), 한국수학교육학회
  7. 김성연, "교직 인성 검사에서의 문항 프로파일 분석", 중등교육연구, 65(4), pp.705~729 (2017), 사범대학부속중등교육연구소[DOI]
  8. 김성연, "수학적 창의성 태도 검사에서 수학영재와 일반학생의 다집단일반화가능도 분석", 수학교육 논문집, 31(1), pp.49~70 (2017), 한국수학교육학회[DOI]
  9. 김성연, "예비수학교사의 교직 적성·인성 검사에서 분할점수 변화에 따른 다양한신뢰도 탐색", 수학교육, 57(1), pp.55~74 (2018), 한국수학교육학회[DOI]
  10. 김성연, "교육대학원과 사범대학에서 교직 적성・인성 검사의 일반화가능도 분석", 교원교육, 34(2), pp.23~47 (2018), 교육연구원[DOI]
  11. 김정환, "초등학교 기간제 교사의 교육능력 관련 요소의 인과관계 분석", 교육평가연구, 17(1), pp.121~140 (2004), 한국교육평가학회
  12. 교직 적성·인성검사 도구 개발 연구, "김정환", 교육과학기술부, ~ (2012)
  13. 김진영, "예비유아교사의 셀프리더십과 교직인・적성과의 관계", 한국교육, 40(3), pp.5~25 (2013), 한국교육개발원[DOI]
  14. 김현진, "교사·학교장 신념과 중학생의 자율성 및 자기효능감, 학업성취도의 관계 분석", 교육학연구, 51(2), pp.117~143 (2013), 한국교육학회
  15. 박정, "우리나라 중학생의 수학에 대한 정의적 특성 변화와 수학 성취에 미치는 영향력 분석", 수학교육, 46(1), pp.19~31 (2007), 한국수학교육학회
  16. 백인순, "교육대학원에 대한 교사의 인식 조사 연구", 석사, 초등교육, pp.2000
  17. 신준국, "수학수업에서 인성 함양을 위한 중학교 교수·학습 자료 개발 연구", 수학교육 논문집, 29(2), pp.255~279 (2015), 한국수학교육학회
  18. 안도희, "교직이수 학생들의 교직핵심역량, 교수능력 및 교직전문성 열망 간의 관계", 교원교육, 31(1), pp.203~226 (2015), 교육연구원[DOI]
  19. 안재희, "교직이수 학생들의 진로결정에 대한 인식 분석", 열린교육연구, 20(2), pp.27~49 (2012), 한국열린교육학회[DOI]
  20. 오유진, "영어과 임용준비생들의 서답형 영어쓰기답안에 대한 인식과 이에 대비한 각 교육기관 교육과정의 효율성에 관한 인식", 석사, pp.2016
  21. 원혜경, "예비유아교사를 위한 간편형 교직 적ㆍ인성 척도 타당화 연구", 유아교육학논집, 21(1), pp.133~165 (2017), 한국영유아교원교육학회
  22. 이규민, "초등학교 과학과 수행평가의 총체적 채점과 분석적 채점 방식에 대한 일반화가능도 분석", 아동교육, 16(4), pp.169~184 (2007), 한국아동교육학회
  23. 이문수, "A Comparison of Generalizability Theory and Many Facet Rasch Measurement in an Analysis of Mathematics Creative Problem Solving Test", 교육과정평가연구, 19(2), pp.251~279 (2016), 한국교육과정평가원
  24. 이선정, "서울소재 교육대학원 가정교육전공 교육과정에 대한 운영실태와 교육대학원생의 인식", 한국가정과교육학회지, 20(4), pp.173~186 (2008), 한국가정과교육학회
  25. 이현숙, "PISA 2012 수학 성취도를 설명하는 학생의 정의적 특성 및 교사 특성 분석을 위한 다층 구조방정식모형의 적용", 교과교육학연구, 19(1), pp.137~158 (2015), 교과교육연구소[DOI]
  26. 전경희, "예비교사의 입학전형 유형별 교직 적·인성 특성의 구조적 관계 분석", 학습자중심교과교육연구, 17(17), pp.315~334 (2017), 학습자중심교과교육학회[DOI]
  27. 조운주, "예비유아교사를 위한 교직적성ㆍ인성 검사도구의 타당성 및 개선방안", 육아지원연구, 9(2), pp.101~123 (2014), 한국육아지원학회[DOI]
  28. 한혜숙, "중등 수학 교사들의 정의적 특성에 대한 인식과 수업 실태 분석", 한국학교수학회논문집, 14(4), pp.491~518 (2011), 한국학교수학회
  29. 황혜정, "수학 수업의 교사 지식에 관한 평가 요소 탐색 - 교수‧학습 방법 및 평가를 중심으로 -", 한국학교수학회논문집, 14(3), pp.241~263 (2011), 한국학교수학회
  30. Abedi, J., "The language factor in mathematics tests", Applied Measurement in Education, 14(3), pp.219~234 (2001)
  31. Baxter, G. P, "Mathematics performance assessment : Technical quality and diverse student impact", Journal for Research in Mathematics Education, 24, pp.190~216 (1993)
  32. Brennan, R. L., "Generalizability Theory" (2001), Springer-Verlag
  33. Brennan, R. L., "Manual for mGENOVA" (2001), Iowa Testing Programs, University of Iowa
  34. Christ, T. J., "An examination of alternate assessment durations when assessing multiple‐skill computational fluency : The generalizability and dependability of curriculum‐based outcomes within the context of educational decisions", Psychology in the Schools, 42(6), pp.615~622 (2005)
  35. Cohen, J., "Statistical power analysis for the behavioral sciences" (1988), Lawrence Earlbaum Associates
  36. Cronbach, L. J., "Generalizability analysis for performance assessments of student achievement or school effectiveness", Educational and Psychological Measurement, 57(3), pp.373~399 (1997)
  37. Darling-Hammond, L., "Teacher quality and student achievement : A review of state policy evidence", Education Policy Analysis Archives, 8(1), pp.1~44 (2000)
  38. Dunbar, S. B., "Quality control in the development and use of performance assessments", Applied measurement in education, 4(4), pp.289~303 (1991)
  39. Fyans, L. J., "Generalizability theory:Inferences and practical applications" (1983), Jossey-Bass Inc Pub
  40. Hill, H. C., "When rater reliability is not enough : Teacher observation systems and a case for the generalizability study", Educational Researcher, 41(2), pp.56~64 (2012)
  41. Hill, H. C., "Effects of teachers’ mathematical knowledge for teaching on student achievement", American educational research journal, 42(2), pp.371~406 (2005)
  42. The reliability of classroom observations by school personnel, "Ho, A. D.", MET Project, Bill & Melinda Gates Foundation, ~ (2013)
  43. Houchard, M. A., "Principal leadership, teacher morale, and student achievement in seven schools in Mitchell county", pp.2005
  44. Klein, S. P., "The reliability of mathematics portfolio scores : lessons from the Vermont experience", Applied Measurement in Education, 8(3), pp.243~260 (1995)
  45. Klieme, E., "The power of video studies in investigating teaching and learning in the classroom", pp.137~160 (2009)
  46. Kukla-Acevedo, S., "Do teacher characteristics matter? New results on the effects of teacher preparation on student achievement", Economics of Education Review, 28(1), pp.49~57 (2009)
  47. Kunter, M., "Students' and mathematics teachers' perceptions of teacher enthusiasm and instruction", Learning and Instruction, 18(5), pp.468~482 (2008)
  48. Lakin, J. M., "Multigroup generalizability analysis of verbal, quantitative, and nonverbal ability tests for culturally and linguistically diverse students", Educational and Psychological Measurement, 72(1), pp.139~158 (2012)
  49. Lane, S., "Generalizability and validity of a mathematics performance assessment", Journal of Educational Measurement, 33(1), pp.71~92 (1996)
  50. Lee, G., "Estimating reliability under a generalizability theory model for test scores composed of testlets", Applied Measurement in Education, 12(3), pp.237~255 (1999)
  51. Li, D., "A multi-group generalizability analysis of a large-scale reading comprehension test", annual meeting of the National Council on Measurement in Education (2007)
  52. Marty, M. C., "Accuracy and reliability of peer assessment of athletic training psychomotor laboratory skills", Journal of athletic training, 45(6), pp.609~614 (2010)
  53. Mastergeorge, A. M., "Rating performance assessments of students with disabilities : A study of reliability and bias", Journal of Psychoeducational Assessment, 28(6), pp.536~550 (2010)
  54. Measuring reading comprehension and mathematics instruction in urban middle schools:A pilot study of the Instructional Quality Assessment, "Matsumura, L. C.", National Center for Research on Evaluation, Standards, and Student Testing (CRESST), ~, pp.CSE Technical Report 681 (2006)
  55. McBee, M. M., "The generalizability of a performance assessment measuring achievement in eight-grade mathematics", Applied Measurement in Education, 11(2), pp.179~194 (1998)
  56. Mõttus, R., "The effect of response style on self-reported conscientiousness across 20 countries", Personality and Social Psychology Bulletin, 38(11), pp.1423~1436 (2012)
  57. Narvaez, D., "Handbook of moral and character education" (2008), Routledge
  58. Multivariate generalizability analyses of mixed-format advanced placement exams, "Powers, S.", CASMA, ~ (2009)
  59. Schnitzler, C., "A new qualitative typology to classify treading water movement patterns", Journal of sports science & medicine, 14(3), pp.530~ (2015)
  60. Shavelson, R. J., "Sampling variability of performance assessments", Journal of Educational Measurement, 30(3), pp.215~232 (1993)
  61. Shavelson, R. J., "Generalizability theory: A primer" (1991), Sage Publications
  62. Sluijsmans, D., "Peer assessment in problem based learning", Studies in educational evaluation, 27(2), pp.153~173 (2001)
  63. Thompson, A. G., "Teacher’ belief and conceptions: A synthesis of the research" (1992), Macmillan Publishing Company
  64. Wayne, A. J., "Teacher characteristics and student achievement gains : A review", Review of Educational Research, 73(1), pp.89~122 (2003)
  65. Wilhelm, A. G., "Generalizing from observations of mathematics teachers' instructional practice using the instructional quality assessment", Journal for Research in Mathematics Education, 46(3), pp.270~279 (2015)
  66. Yin, P., "A multivariate generalizability analysis of the multistate bar examination", Educational and psychological measurement, 65(4), pp.668~686 (2005)

관련 논문AI추천

이 간행물의 다른 논문 (5건)