Effects of Text Length and Question Type on Test-takers’ Performance on Fill-in-the-blank Items in Korean CSAT
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
This study examines the effects of text length and question type on Korean EFL readers’ reading comprehension of the fill-in-the-blank items in Korean CSAT. A total of 100 Korean EFL college students participated in the study. After divided into three different proficiency groups, the participants took a reading comprehension test which consisted of 4 reading passages (2 short and 2 long) from the Korean CSAT, followed by multiple-choice fill-in-the-blank questions and open-ended inference questions. The longer version of the passages was made from its originally restored version in which one or two paragraphs were added. The results showed that the college students performed better on the long passages than the short ones. In addition, the college students’ reading comprehension test performance was affected differently depending on the type of questions. The findings of the study provided implications on how to select and construct reading passages for high-stake nationwide examinations, such as the Korean CSAT.
Abstract
This study examines the effects of text length and question type on Korean EFL readers’ reading comprehension of the fill-in-the-blank items in Korean CSAT. A total of 100 Korean EFL college students participated in the study. After divided into three different proficiency groups, the participants took a reading comprehension test which consisted of 4 reading passages (2 short and 2 long) from the Korean CSAT, followed by multiple-choice fill-in-the-blank questions and open-ended inference questions. The longer version of the passages was made from its originally restored version in which one or two paragraphs were added. The results showed that the college students performed better on the long passages than the short ones. In addition, the college students’ reading comprehension test performance was affected differently depending on the type of questions. The findings of the study provided implications on how to select and construct reading passages for high-stake nationwide examinations, such as the Korean CSAT.
참고문헌 (73)
- Alderson, J. C., "Assessing reading" (2000), Cambridge University Press
- Alderson, J. C., "Reading in a foreign language", pp.1~27 (1984), Longman
- Anderson, N. J., "An exploratory study into the construct validity of a reading comprehension test : Triangulation of data sources", Language Testing, 8(1), pp.41~66 (1991)
- Bachman, L., "Language assessment in practice" (2010), Oxford University Press
- Bachman, L. F., "Fundamental considerations in language testing" (1990), Oxford University Press
- Beach, K. L., "The effect of media, text length, and reading rates on college student reading comprehension levels", doctoral, pp.2008
- Brantmeier, C., "Effects of reader's knowledge, text type, and test type on L1 and L2reading comprehension in Spanish", The Modern Language Journal, 89(1), pp.37~53 (2005)
- Bridgeman, B., "Relationships among multiple-choice and openended analytical questions", Journal of Educational Measurement, 30, pp.313~329 (1993)
- Campbell, J. R., "Cognitive processes elicited by multiple-choice and constructedresponse questions on an assessment of reading comprehension", doctoral, pp.1999
- Carrell, P. L., "Second language reading: Reading ability or language proficiency?", Applied Linguistics, 12(2), pp.159~179 (1991)
- Cha, K. A., "The effect of text length in the diagnosis of reading comprehension", Journal of the Applied Linguistics Association of Korea, 8(1), pp.249~275 (1995)
- 채은영, "A Study of a Timed Cloze Test for Evaluating L2 Proficiency", 영어교육, 70(3), pp.117~135 (2015), 한국영어교육학회[DOI]
- Chapelle, C. A., "Building a validity argument for the test of English as a foreign language", pp.145~186 (2008), Routledge
- Chastain, K., "Developing second language skills: Theory and practice" (1988), Harcourt Brace Jovanovich
- Choi, M. S., "Analysis of the factors affecting passage dependency of multiplechoice English reading comprehension tests", master’s, pp.2011
- Clarke, M. A., "The short circuit hypothesis of ESL reading or when language competence interferes with reading performance", Modern Language Journal, 64, pp.203~209 (1980)
- Cohen, A. D., "On taking language tests", Language Testing, 1(1), pp.70~81 (1984)
- Commander, N. E., "Illusion of knowing in adult readers : Effects of reading skill and passage length", Contemporary Educational Psychology, 22(1), pp.39~52 (1997)
- Connor, U., "Passage dependency in ESL reading comprehension tests", Language Learning, 28(1), pp.149~157 (1978)
- Damankesh, M., "The washback effect of Iranian high school final examinations on students’ test-taking and test-preparation strategies", Studies in Educational Evaluation, 45, pp.62~69 (2015)
- Daneman, M., "Using working memory theory to investigate the construct validity of multiple-choice reading comprehension tests such as the SAT", Journal of Experimental Psychology, 130(2), pp.208~223 (2001)
- Derrick, C., "Three aspects of reading comprehension as measured by tests of different lengths", Research Bulletin, 53(8) (1953), Educational Testing Service
- Doe, C., "Exploring the testing process : Three test takers’ observed and reported strategy use over time and testing contexts", Canadian Modern Language Review, 67(1), pp.29~54 (2011)
- Farr, R., "A description of what happens when an examinee takes a multiple-choice reading comprehension test", Journal of Educational Measurement, 27(3), pp.209~226 (1990)
- Ferrer, A., "Impact of text availability and question format on reading comprehension processes", Contemporary Educational Psychology, 51, pp.404~415 (2017)
- Garcia, G. E., "Factors influencing the English reading test performance of Spanishspeaking Hispanic children", Reading Research Quarterly, 26(4), pp.371~392 (1991)
- Gordon, C. M., "The interaction between task and meaning construction in EFL reading comprehension tests", TESOL Quarterly, 29(2), pp.299~324 (1995)
- Grabe, W., "Reading in a second language: Moving from theory to practice" (2009), Cambridge University Press
- Grabe, W., "The companion to language assessment", pp.185~200 (2014), John Wiley & Sons
- Flippo, R. F., "Handbook of college reading and study strategy research", pp.403~472 (2000), Lawrence Erlbaum Associates
- Hashemi, S. Z., "External factors influences on EFL learners’reading comprehension test performance", International Journal of Language Learning and Applied Linguistics World, 7(1), pp.150~166 (2014)
- Hsu, W. T., "EFL students’ English language knowledge, strategy use and multiplechoice reading test performance: A structural equation modeling approach", Doctoral, pp.2008
- Jalilehvand, M., "The effects of text length and picture on reading comprehension of Iranian EFL students", Asian Social Science, 8(3), pp.329~ (2012)
- Johnston, P., "The centrality of reading comprehension test questions and their validity", Paper presented at the annual meeting of the New York State Reading Association (1982)
- Just, M. A., "The psychology of reading and language comprehension" (1987), Allyn & Bacon
- 강대민, "A Study on Short-answer-question Format in Testing", 어학연구, 41(4), pp.963~983 (2005), 언어교육원
- Keenan, J. M., "Reading comprehension tests vary in the skills they assess : Differential dependence on decoding and oral comprehension", Scientific Studies of Reading, 12(3), pp.281~300 (2008)
- Kern, R. G., "Literacy and language teaching" (2000), Oxford University Press
- 김성혜, "Test-taking Strategies of L2 Adolescent Learners: Three Multiple-choice Items and L2 Proficiency", 영어교육, 69(1), pp.61~90 (2014), 한국영어교육학회[DOI]
- Kim, S. J., "Analyzing the cohesion of the reading passages on standardized English tests: CSAT, TEPS, EIKEN and TOEFL", master’s, pp.2016
- Kintsch, W., "The role of knowledge in discourse comprehension : A constructionintegration model", Psychological Review, 95(2), pp.163~182 (1988)
- Kintsch, W., "Comprehension: A paradigm for cognition" (1998), Cambridge University Press
- Kintsch, W., "The science of reading: A handbook", pp.209~226 (2005), Blackwell Publishing
- Kulesz, P. A., "The influence of properties of the test and their interactions with reader characteristics on reading comprehension : An explanatory item response study", Journal of Educational Psychology, 108(8), pp.1078~1097 (2016)
- 이준규, "연구도구로서의 제2 언어 능숙도 자가평가", 영어학연구, 20(2), pp.125~137 (2014), 한국영어학학회[DOI]
- Lee, K. S., "The effects of the number of questions per passage, the length of passage, and the topic familiarity on multiple-choice English listening and reading comprehension tests", English Teaching, 54(4), pp.327~351 (1999)
- Liu, F., "The effect of three test methods on reading comprehension : An experiment", Asian Social Science, 5(6), pp.147~153 (2009)
- Liu, O. L., "Does content knowledge affect TOEFL iBT™ reading performance? A confirmatory approach to differential item functioning" (2009), English Testing System
- Magliano, J. P., "Reading comprehension strategies: Theories, interventions, and technologies", pp.107~136 (2007), Lawrence Erlbaum Associates
- 남유경, "Korean EFL Students’ Strategy Use in Gap-Filling Inference Items", 영어교육, 70(4), pp.81~107 (2015), 한국영어교육학회[DOI]
- Nevo, N., "Test-taking strategies on a multiple-choice test of reading comprehension", Language Testing, 6(2), pp.199~215 (1989)
- OECD., "The PISA 2003 assessment framework: Mathematics, reading, science and problem solving knowledge and skills" (2003), OECD Publishing
- Ozuru, Y., "Influence of question format and text availability on the assessment of expository text comprehension", Cognition and Instruction, 25(4), pp.399~438 (2007)
- Ozuru, Y., "Comparing comprehension measured by multiple-choice and open-ended questions", Canadian Journal of Experimental Psychology, 67(3), pp.215~227 (2013)
- Ozuru, Y., "Where’s the difficulty in standardized reading tests: The passage or the question?", Behavior Research Methods, 40(4), pp.1001~1015 (2008)
- Perfetti, C. A., "Reading ability" (1985), Oxford University Press
- Pressley, M., "Delusions about performance on multiple-choice comprehension tests", Reading Research Quarterly, 23, pp.454~464 (1988)
- Rodriguez, M. C., "Construct equivalence of multiple-choice and constructedresponse items : A random effects synthesis of correlations", Journal of Educational Measurement, 40(2), pp.163~184 (2003)
- Rothkopf, E. Z., "Passage length and recall with test size held constant : Effects of modality, pacing, and learning set", Journal of Verbal Learning and Verbal Behavior, 22(6), pp.667~681 (1983)
- Rupp, A. A., "How assessing reading comprehension with multiple-choice questions shapes the construct : A cognitive processing perspective", Language Testing, 23(4), pp.441~474 (2006)
- Sainsbury, M., "Assessing reading: From theories to classrooms" (2006), National Foundation for Educational Research
- Salehi, M., "Test taking strategies: Implications for test validation", Journal of Language Teaching and Research, 2(4), pp.850~858 (2011)
- Shohamy, E., "Does the testing method make a difference? The case of reading comprehension", Language Testing, 1(2), pp.147~170 (1984)
- Sternberg, R. J., "Are we reading too much into reading comprehension tests?", Journal of Reading, 34(7), pp.540~545 (1991)
- Todd, W. B., "Influence of response mode, sex, reading ability, and level of difficulty on four measures of recall of meaningful written material", Journal of Educational Psychology, 62(3), pp.229~234 (1971)
- Valencia, S., "Authentic reading assessment:Practices and possibilities", pp.6~21 (1994), International Reading Association
- Valencia, S. W., "Principles for classroom comprehension assessment", Remedial and Special Education, 9(1), pp.26~35 (1988)
- van Dijk, T. A., "Strategies of discourse comprehension" (1983), Academic Press
- Wolf, D. F., "A comparison of assessment tasks used to measure FL reading comprehension", The Modern Language Journal, 77, pp.473~489 (1993)
- Wolf, D. F., "Issues in reading comprehension assessment : Implications for the development of research instruments and classroom tests", Foreign Language Annals, 26(3), pp.322~331 (1993)
- Yamashita, J., "Processes of taking a gap-filling test : Comparison of skilled and less skilled EFL readers", Language Testing, 20(3), pp.267~293 (2003)
- 이연숙, "On the Optimal Text Length of Reading Comprehension Tests", 영어영문학연구, 55(4), pp.505~530 (2013), 한국중앙영어영문학회[DOI]
- Zhang, L., "Chinese college test takers’ individual differences and reading test performance : A structural equation modeling approach", Perceptual and Motor Skills, 122(3), pp.725~741 (2016)
