Improving the Validity of L2 Performance Assessments: Use of Many-Facet Rasch Measurement
0
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
Performance assessment has been widely used over the years in the second language testing field, along with a continuous emphasis on the communicative approach in second language teaching and learning. With attempts to replace traditional paper-and-pencil tests with performance assessment for more meaningful, appropriate inferences about test-takers’ language ability, the validity of second language performance assessments has been an important issue in language testing. This article first describes where validation can be situated in the assessment framework after briefly defining each component of the assessment process and the validation of language tests. It then introduces second language performance assessment, including its unique characteristics and variables inevitably involved in the assessment process to address the need to validate the assessment. Finally, the article reviews empirical studies and discusses how second language performance assessments can be validated statistically based on many-facet Rasch measurement.
Abstract
Performance assessment has been widely used over the years in the second language testing field, along with a continuous emphasis on the communicative approach in second language teaching and learning. With attempts to replace traditional paper-and-pencil tests with performance assessment for more meaningful, appropriate inferences about test-takers’ language ability, the validity of second language performance assessments has been an important issue in language testing. This article first describes where validation can be situated in the assessment framework after briefly defining each component of the assessment process and the validation of language tests. It then introduces second language performance assessment, including its unique characteristics and variables inevitably involved in the assessment process to address the need to validate the assessment. Finally, the article reviews empirical studies and discusses how second language performance assessments can be validated statistically based on many-facet Rasch measurement.
참고문헌 (25)
- American Educational Research Association, "Standards for educational and psychological testing" (1999), American Educational Research Association
- Andrich, D., "A rating scale formulation for ordered response categories", Psychometrika, 43, pp.561~573 (1978)
- Aryadoust, V., "Gender and academic major bias in peer assessment of oral presentations", Language Assessment Quarterly, 13, pp.1~24 (2016)
- Bachman, L. F., "Fundamental considerations in language testing" (1990), Oxford University Press
- Bachman, L. F., "Some reflections on task-based language performance assessment", Language Testing, 19, pp.453~476 (2002)
- Bachman, L. F., "Statistical analyses for language assessment" (2004), Cambridge University Press
- Bachman, L. F., "Building and supporting a case for test use", Language Assessment Quarterly, 2, pp.1~34 (2005)
- Bachman, L. F., "Language testing in practice" (1996), Oxford University Press
- Bond, T. G., "Applying the Rasch model: Fundamental measurement in the human sciences" (2015), Routledge
- Bonk, W. J., "A many-facet Rasch analysis of the second language group oral discussion task", Language Testing, 20, pp.89~110 (2003)
- Brown, A., "The effect of rater variables in the development of an occupation-specific language performance test", Language Testing, 12, pp.1~15 (1995)
- Davis, L., "The influence of interlocutor proficiency in a paired oral assessment", Language Testing, 26, pp.367~396 (2009)
- Di Gennaro, K., "Investigating differences in the writing performance of international and generation 1. 5 students", Language Testing, 26, pp.533~559 (2009)
- Eckes, T., "Examining rater effects in TestDaF writing and speaking performance assessments : A many-facet Rasch analysis", Language Assessment Quarterly, 2, pp.197~221 (2005)
- Eckes, T., "Operational rater types in writing assessment : Linking rater cognition to rater behavior", Language Assessment Quarterly, 9, pp.270~292 (2012)
- Fulcher, G., "Testing second language speaking" (2003), Pearson
- Harsch, C., "Designing and scaling level-specific writing tasks in alignment with the CEFR : A test-centered approach", Language Assessment Quarterly, 8, pp.1~33 (2011)
- Kane, M., "An argument-based approach to validity", Psychological Bulletin, 112, pp.527~535 (1992)
- Kane, M., "Educational measurement", pp.17~64 (2006), Greenwood Publishing
- Kane, M., "Validating score interpretations and uses", Language Testing, 29, pp.3~17 (2012)
- Kane, M., "Validating measures of performance", Educational Measurement : Issues and Practice, 18, pp.5~17 (1999)
- Khabbazbashi, N., "Topic and background knowledge effects on performance in speaking assessment", Language Testing, 34, pp.23~48 (2017)
- Kiddle, T., "The effect of mode of response on a semidirect test of oral proficiency", Language Assessment Quarterly, 8, pp.342~360 (2011)
- Kim, Y., "An investigation into native and non-native teachers’ judgment of oral English performance : A mixed methods approach", Language Testing, 26, pp.187~217 (2009)
- Lim, G. S., "The development and maintenance of rating quality in performance writing assessment : A longitudinal study of new and experienced raters", Language Testing, 28, pp.543~560 (2011)