한국어 수용성판단에서의 학술지간 신뢰도 분석
The reliability of Korean acceptability judgments in the journals
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
The reliability of linguists’ judgments on sentence acceptability in the journals has often been called into question. In this study, we first conducted the direct comparison of the linguists’ judgments given in the journals with naive (non-linguists) population. We further compared the large-scale replication studies conducted for acceptability judgments among the diverse journals. We collected 7.116 pairs of sentences from 32 Korean journals for experiments. We tested this sample with 26,253 naive participants using 7-point Likert scale. Overall results reveal that formal judgments by naive participants are shown to diverge from informal judgments by linguists in the journals (Convergence rates 81.47%), which patterns alike the results reported in the previous studies such as Song et al.(2017), Ahn et al.(2019), Cho et al.(2019), and Ahn & Cho (2021). The results of our study further show that there are robust contrasts in convergence rates among the journals; 54.69%~94.44%, which indicates outstanding differences concerning the quality of the data points published in journals.
Abstract
The reliability of linguists’ judgments on sentence acceptability in the journals has often been called into question. In this study, we first conducted the direct comparison of the linguists’ judgments given in the journals with naive (non-linguists) population. We further compared the large-scale replication studies conducted for acceptability judgments among the diverse journals. We collected 7.116 pairs of sentences from 32 Korean journals for experiments. We tested this sample with 26,253 naive participants using 7-point Likert scale. Overall results reveal that formal judgments by naive participants are shown to diverge from informal judgments by linguists in the journals (Convergence rates 81.47%), which patterns alike the results reported in the previous studies such as Song et al.(2017), Ahn et al.(2019), Cho et al.(2019), and Ahn & Cho (2021). The results of our study further show that there are robust contrasts in convergence rates among the journals; 54.69%~94.44%, which indicates outstanding differences concerning the quality of the data points published in journals.
참고문헌 (23)
- 안희돈, "한국어 수용성 판단에서의 형식적 방법과 비형식적 방법의 비교 - 이산형 측정 자료의 경우", 한말연구, (51), pp.57~86 (2019), 한말연구학회[DOI]
- 문장 문법성 판단을 위한 기초 자료 구축, "안희돈", 국립국어원, ~ (2020)
- 안희돈, "한국어 수용성판단 자료의 학술지간 비교: ‘생성문법연구’와 ‘국어학’을 중심으로", 생성문법연구, 31(2), pp.343~356 (2021), 한국생성문법학회[DOI]
- 조용준, "한국어 실험통사론의 모색 – 대격중출구문에 대한 수용성판단을 중심으로 –", 박사, pp.2015
- 조용준, "한국어 수용성 판단에서의 형식적 방법과 비형식적 방법의 비교(2)", 언어학 연구, (51), pp.129~160 (2019), 한국중원언어학회[DOI]
- Häussler, Jana, "Hot topics surrounding acceptability judgment tasks", Proceedings of Linguistic Evidence 2016 (2017), University of Tübingen
- Hill, Archibald A, "Grammaticality", Word, 17, pp.1~10 (1961)
- Juzek, Tom, "Acceptability judgement tasks and grammatical theory", Doctoral, pp.2016
- Juzek, Tom, "Data convergence in syntanctic theory and the role of sentence pairs", Zeitshrift für Sprichwissenschaft, 39(2), pp.109~147 (2020)
- Steven Langsford, "Quantifying sentence acceptability measures: Reliability, bias, and variability", Glossa: a journal of general linguistics, 3(1) (2018), Open Library of the Humanities[DOI]
- Tal Linzen, "The reliability of acceptability judgments across languages", Glossa: a journal of general linguistics, 3(1) (2018), Open Library of the Humanities[DOI]
- Mahowald, Kyle, "SNAP jud gments: A small N acceptability paradigm (SNAP) for linguistic acceptability judgments", Language, 92(3), pp.619~635 (2016)
- Marty, Paul, "The effect of three basic task features on the sensitivity of acceptability judgment tasks", Glossa: a journal of general linguistics, 5(1), pp.72~ (2020)[DOI]
- Schütze, Carson T, "Linguistic Intuitions: Evidence and Method" (2020), Oxford University Press
- 송상헌, "Measuring the Degree of Convergence between Informal and Formal Acceptability Judgments for Korean", 언어, 42(4), pp.761~804 (2017), 한국언어학회[DOI]
- Spencer, N. J., "Differences between linguists and nonlinguists in intuitions of grammaticality-acceptability", Journal of Psycholinguistic Research, 2, pp.83~98 (1973)
- Sprouse, Jon, "Linguistic Intuitions" (2020), Oxford University Press
- Sprouse, Jon, "The Oxford Handbook of Experimental Syntax", Oxford University Press
- Sprouse, Jon, "Assessing the reliability of textbook data in syntax: Adger’s Core Syntax", Journal of Linguistics, 48, pp.609~652 (2012)
- Sprouse, Jon, "The Cambridge Handbook of Biolinguistics", pp.181~202 (2013), Cambridge University Press
- Sprouse, Jon, "Design sensitivity and statistical power in acceptability judgment experiments", Glossa: a journal of general linguistics, 2(1) (2017)[DOI]
- Sprouse, Jon, "Oxford Handbook of English Grammar", pp.40~58 (2020), Oxford University Press
- Sprouse, Jon, "A comparison of informal and formal acceptability judgments using a random sample from Linguistic Inquiry 2001-2010", Lingua, 134, pp.219~248 (2013)