라쉬 모형을 이용한 연어 능숙도 평가 타당성 검증 연구
A Validation Study on the Collocation Size Test Using the Rasch Model
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
지금까지 다양한 연어 평가 검사지가 개발되었지만 이들 연구들 모두는 연어 평가 문항의 유형이나 특정 연어의 학습 정도 즉 연어 성취도 평가적 성격을 지니고 있을 뿐 절대적인 연어 지식을 측정하지는 못하는 한계점을 가지고 있다. 본 연구에서는 초등학생들의 절대적 연어 지식을 측정 도구 개발의 일환으로 Kwark, Shin과 Lee(2019)의 연구에서 제작된 등급별 연어 능숙도 검사지(Collocation Size Test, CST)의 수준별 위계를 중심으로 타당성을 검증하였다. 본 연구에서 타당화하는 CST는 모두 4개의 수준으로 구성되어 있으며 각 수준은 500개의 연어를 대표하는 10개 문항으로 제작되었다. CST 타당화는 라쉬 모형을 이용하여 실시하였다. 타당화를 위해 우선 Wright Map을 통해 CST가 피험자 집단의 전체 능력을 모두 측정하는지를 살펴보고, 문항적합도를 통해 문항의 양호도를 검증하였다. 다음으로 연어 능숙도의 4단계 수준별로 개발된 CST문항들이 위계적으로 기능하고 있는지를 검증하기 위해 수준별 10개 문항들의 평균 난도와 95% 신뢰구간을 분석하였으며, 마지막으로 의미인식과 형태인식 문항들 간에 4단계의 위계적 구조가 차별화 되는지 확인하였다.
Abstract
Although a variety of collocation tests have been developed so far, all of these tests have some limitations in that they do not measure absolute collocation knowledge. The present study was designed to validate the hierarchy of the Collocation Size Test (CST) developed in Kwark, Shin, & Lee (2019) study to measure the size of the absolute collocation knowledge of 160 Korean elementary students. The CST consists of four levels and each level contains 10 items, representing the knowledge of 500 collocations. The validation procedure of the CST was performed, using the Rash model. In order to validate the CST items, the Wright Map was used to check whether their CST could measure the general collocation proficiency of the subject group and the quality of the items was verified through the item fit. In addition, in order to verify whether the items graded for the four levels of the CST could function hierarchically, the mean score and the 95% confidence interval of the 10 items of each level were analyzed. The findings showed that the hierarchical structure of the four levels is appropriately differentiated.
참고문헌 (39)
- Adams, R. J., "Quest" (1996), Australian Council for Educational Research
- Beglar, D., "A Rasch-based validation of the vocabulary size test", Language Testing, 27(1), pp.101~118 (2010)
- Bonk, W., "A focus on language test development: Expanding the language proficiency construct across a variety of tests", pp.133~142 (2000), Second Language Teaching and Curriculum Center of University of Hawaii
- Cruse, D. A., "Lexical semantics" (1986), Cambridge University Press
- Crystal, D., "A dictionary of linguistics and phonetics" (1985), Blackwell
- Eyckmans, J., "Researching second language collocation knowledge", pp.139~152 (2009), Palgrave Macmillan
- Eyckmans, J., "The deleted-essentials test: An effective and affective compromise", Humanising Language Teaching, 6(4) (2004)
- Firth, J. R., "Studies in linguistic analysis", pp.1~32 (1957), Philological Society
- Gu, Y., "Vocabulary learning in second language: Person, task, context and strategies", TESL-EJ, 7(2), pp.1~26 (2003)
- Gyllstad, H., "Teaching english collocations: Developing receptive tests for use with advanced Swedish learners", doctoral, pp.2007
- Gyllstad, H., "Researching second language collocation knowledge", pp.153~170 (2009), Palgrave Macmillan
- Halliday, M. A. K., "The linguistic sciences and language teaching" (1964), Longman
- 한수미, "Developing a Collocation Test for Korean EFL Learners: Test Validation and Item Format Effect", 영어학, 16(2), pp.221~243 (2016), 한국영어학회[DOI]
- Huckin, T., "Second language reading and vocabulary learning" (1995), Ablex Publishing Corporation
- 곽은영, "한국 초등학생의 영어 어휘 및 연어 지식 탐색", 학습자중심교과교육연구, 19(19), pp.927~948 (2019), 학습자중심교과교육학회[DOI]
- Lewis, M., "The lexical approach" (1993), Language Teaching Publications
- Martinez, R., "A phrasal expressions list", Applied Linguistics, 33(3), pp.299~320 (2012)
- McLean, S., "The creation and validation of a listening vocabulary levels test", Language Teaching Research, 19(6), pp.741~760 (2015)
- Nation, I. S. P., "Testing and teaching vocabulary", Guidelines, 5, pp.12~25 (1983)
- Nation, I. S. P., "Teaching and learning vocabulary" (1990), Heinle & Heinle Publishers
- Nation, I. S. P., "Learning vocabulary in another language" (2001), Cambridge University Press
- Nation, I. S. P., "A vocabulary size test", The Language Teacher, 31(7), pp.9~13 (2007)
- Nunan, D., "Language teaching methodology: A text book for teacher" (1991), Prentice Hall International
- Read, J., "The development of a new measure of L2vocabulary knowledge", Language Testing, 10, pp.355~371 (1993)
- Read, J., "Validation in language assessment", pp.41~61 (1998), Lawrence Erlbaum Associates
- Read, J., "Research in teaching vocabulary", Annual Review of Applied Linguistics, 24, pp.146~161 (2004)
- Revier, R. L., "Researching second language collocation knowledge", pp.125~138 (2009), Palgrave Macmillan
- Schmitt, N., "The word associates format : Validation evidence", Language Testing, 28(1), pp.105~126 (2011)
- Schmitt, N., "Developing and exploring the bahviour of two versions of the vocabulary levels test", Language Testing, 18(1), pp.55~88 (2001)
- Shillaw, J., "Researching second language collocation knowledge", pp.153~170 (2009), Palgrave Macmillan
- 신동광, "영어 연어 능숙도 검사지 개발", 멀티미디어 언어교육, 20(2), pp.59~83 (2017), 한국멀티미디어언어교육학회[DOI]
- 신동광, "A Multiword Unit Analysis: COCA Multiword Unit List 20 and ColloGram", Journal of Asia TEFL, 16(2), pp.608~623 (2019), 아시아테플
- Smith Jr., E. V., "Effect of item redundancy on Rasch item and person estimates", Journal of Applied Measurement, 6, pp.147~163 (2005)
- Stewart, J., "Do multiple-choice options inflate estimates of vocabulary size on the VST?", Language Assessment Quarterly, 11(3), pp.271~282 (2014)
- Stewart, J., "Estimating guessing effects on the vocabulary levels test for differing degrees of word knowledge", TESOL Quarterly, 45(2), pp.370~380 (2011)
- Walfe, E. W., "Instrument development tools and activities for measure validation using Rasch models: Part I-Instrument development tools", Journal of Applied Measurement, 8, pp.97~123 (2007)
- Webb, S., "The updated vocabulary levels test : Developing and validating two new forms of the VLT", ITL-International Journal of Applied Linguistics, 168(1), pp.34~70 (2017)
- Wilkins, D. A., "Linguistics in language teaching" (1972), Edward Arnold
- Wilson, M., "Constructing measures: An item response modeling approach" (2004), Lawrence Erlbaum Associates