본문 바로가기
KERD
논문

웹기반 실험을 통한 음운 및 철자 점화 효과의 재검증

Reinvestigating the Phonological and Orthographic Priming Effects with the Web-based Experiment

0

조회

0

다운로드

5

인용

0

참고문헌

키워드

주제분류언어학

초록

In a traditional psycholinguistic study, participants visit a laboratory and perform experiments in a controlled environment. Recently, a web-based study in which participants conduct experiments using online platforms is getting popular. A few studies have demonstrated that web-based experiments have successfully replicated the findings shown in lab-based experiments. The purpose of this study was to replicate a masked priming effect found in lab-based experiments using a web-based experiment platform implemented with PsychoPy and Pavlovia. In Experiment 1, participants performed a visual masked priming lexical decision task in which a prime and a target were visually presented. In Experiment 2, participants performed a cross-modal masked priming lexical decision task in which a visual prime stimulus was preceded by an auditory target stimulus. The results of both experiments were consistent with those found in previous lab-based studies. The results indicate that web-based experimental procedure should be an applicable alternative to the lab-based controlled procedure in psycholinguistic research.

Abstract

In a traditional psycholinguistic study, participants visit a laboratory and perform experiments in a controlled environment. Recently, a web-based study in which participants conduct experiments using online platforms is getting popular. A few studies have demonstrated that web-based experiments have successfully replicated the findings shown in lab-based experiments. The purpose of this study was to replicate a masked priming effect found in lab-based experiments using a web-based experiment platform implemented with PsychoPy and Pavlovia. In Experiment 1, participants performed a visual masked priming lexical decision task in which a prime and a target were visually presented. In Experiment 2, participants performed a cross-modal masked priming lexical decision task in which a visual prime stimulus was preceded by an auditory target stimulus. The results of both experiments were consistent with those found in previous lab-based studies. The results indicate that web-based experimental procedure should be an applicable alternative to the lab-based controlled procedure in psycholinguistic research.

참고문헌 (72)

  1. Abdi, Hervé, "Encyclopedia of measurement and statistics", pp.1~9 (2007), Sage
  2. Aguasvivas, Jose A., "SPALEX: A Spanish lexical decision database from a massive online data collection", Frontiers in psychology, 9, pp.2156~ (2018)
  3. Anwyl-Irvine, Alexander L., "Gorilla in our midst: An online behavioral experiment builder", Behavior research methods, 52(1), pp.388~407 (2020)
  4. Anwyl-Irvine, Alexander L, "Realistic precision and accuracy of online experiment platforms, web browsers, and devices", Behavior Research Methods, 53(4), pp.1407~1425 (2021)
  5. 배성봉, "한국어 단어 재인에서 표기 음절과 음운 음절의 처리", 한국심리학회지: 인지 및 생물, 22(3), pp.369~385 (2010), 한국인지및생물심리학회[DOI]
  6. Baker, Daniel H., "Power contours: Optimising sample size and precision in experimental psychology and human neuroscience", Psychological Methods, 26(3), pp.295~ (2021)
  7. Barnhoorn, Jonathan S., "QRTEngine: An easy solution for running online reaction time experiments using Qualtrics", Behavior research methods, 47(4), pp.918~929 (2015)
  8. Berinsky, Adam J., "Evaluating online labor markets for experimental research: Amazon.com’s mechanical Turk", Political Analysis, 20(3), pp.351~368 (2012)
  9. Betts, Hannah N., "Retuning of lexical-semantic representations:Repetition and spacing effects in word-meaning priming", Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(7), pp.1130~1150 (2018)
  10. Bohannon, John, "Mechanical Turk upends social sciences", Science, 352, pp.1263~1264 (2016)
  11. Booth-Kewley, Stephanie, "Impression management, social desirability, and computer administration of attitude questionnaires: Does the computer make a difference?", Journal of Applied Psychology, 77(4), pp.562~566 (1992)
  12. Brand, Andrew, "Assessing the effects of technical variance on the statistical outcomes of web experiments measuring response times", Social Science Computer Review, 30(3), pp.350~357 (2012)
  13. Brysbaert, Marc, "Power Analysis and Effect Size in Mixed Effects Models: A Tutorial", Journal of cognition, 1(1), pp.9~ (2018)
  14. Buhrmester, Michael, "Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data?", Perspectives on Psychological Science, 6(1), pp.3~5 (2011)
  15. Cai, Zhenguang G, "Accent modulates access to word meaning: Evidence for a speaker-model account of spoken word recognition", Cognitive Psychology, 98, pp.73~101 (2017)
  16. Carpenter, Thomas P, "Survey-software implicit association tests: A methodological and empirical analysis", Behavior research methods, 51(5), pp.2194~2208 (2019)
  17. Chandler, Jesse, "Nonnaïveté among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers", Behavior research methods, 46(1), pp.112~130 (2014)
  18. Chen, Tsung-Ying, "Worldlikeness: a web-based tool for typological psycholinguistic research", University of Pennsylvania Working Papers in Linguistics, 23(1), pp.4~ (2017)
  19. Chetverikov, Audrey, "Online versus offline: The Web as a medium for response time data collection", Behavior research methods, 48(3), pp.1086~1099 (2016)
  20. Cohen, Jacob, "Statistical power analysis for the behavioral sciences" (1988), Erlbaum
  21. Crump, Matthew J., "Evaluating Amazon's Mechanical Turk as a tool for experimental behavioral research", PloS one, 8(3), pp.e57410~ (2013)
  22. De Groot, Annette M., "Research methods in psycholinguistics and the neurobiology of language: A practical guide" (2017), John Wiley & Sons
  23. Elze, Tobias, "Temporal properties of liquid crystal displays:Implications for vision science experiments", PloS one, 7(9), pp.e44048~ (2012)
  24. Enochson, Kelly, "Collecting psycholinguistic response time data using Amazon Mechanical Turk", PloS one, 10(3), pp.e0116946~ (2015)
  25. Forster, Kenneth I., "The pros and cons of masked priming", Journal of psycholinguistic research, 27(2), pp.203~233 (1998)
  26. Forster, Kenneth I., "DMDX: A Windows display program with millisecond accuracy", Behavior research methods, instruments, &computers, 35(1), pp.116~124 (2003)
  27. Geary, Jonathan, "Morphological priming without semantic relationship in Hebrew spoken word recognition", Proceedings of the Linguistic Society of America, 4(9), pp.1~10 (2019)
  28. Germine, Laura, "Is the Web as good as the lab? Comparable performance from Web and lab in cognitive", perceptual experiments, 2012, pp.19(5), 847~857
  29. Green, David M., "Signal detection theory and psychophysics" (1966), Wiley
  30. Henrich, Joseph, "Most people are not WEIRD", Nature, 466(7302), pp.29~29 (2010)
  31. Hilbig, Benjamin E., "Reaction time effects in lab-versus Web-based research:Experimental evidence", Behavior Research Methods, 48(4), pp.1718~1724 (2016)
  32. Horton, John J., "The online laboratory:Conducting experiments in a real labor market", Experimental Economics, 14(3), pp.399~425 (2011)
  33. Karvay, Yvette, "They’re watching you: the impact of social evaluation and anxiety on threat-related perceptual decision-making", Psychological Research, pp.1~10 (2021)
  34. Keller, Frank, "Timing accuracy of web experiments: A case study using the WebExp software package", Behavior research methods, 41(1), pp.1~12 (2009)
  35. 김빛나, "심리학 연구에서 재현성 위기의 현황과 원인 및 대안 모색에 대한 개관", 한국심리학회지:일반, 36(3), pp.359~396 (2017), 한국심리학회[DOI]
  36. 김병진, "웹 기반 온라인 자기조절읽기과제를 이용한 단어 예측성 효과의 반복 검증", 한국심리학회지: 인지 및 생물, 33(2), pp.87~93 (2021), 한국인지및생물심리학회[DOI]
  37. Kim, Dahyeon, "Effects of Print Exposure on an Online Lexical Decision Task: A Direct Replication Using a Web-Based Experimental Procedure", Frontiers in Psychology, pp.3448~ (2021)
  38. Kochari Arnold R., "Conducting Web-Based Experiments for Numerical Cognition Research", Journal of cognition, 2(1), pp.39~ (2019)
  39. 권은진, "한국어 시각단어 재인시 형태소와 표기 정보의 영향", 언어과학, 25(2), pp.1~16 (2018), 한국언어과학회[DOI]
  40. 이선경, "한국어 말소리 재인 시 표기의 영향", 인문논총, 41, pp.27~41 (2016), 인문과학연구소
  41. 이선경, "웹기반 온라인 주의 연구: 온라인 실험은 실험실 실험만큼 효과적일까?", Journal of The Korean Data Analysis Society, 23(3), pp.1355~1368 (2021), 한국자료분석학회[DOI]
  42. 이영준, "한국어 학습자의 타동성 인식 조사", 우리말글, 70, pp.215~238 (2016), 우리말글학회[DOI]
  43. Mason, Winter, "Conducting behavioral research on Amazon’s Mechanical Turk", Behavior research methods, 44(1), pp.1~23 (2012)
  44. Maylor, Elizabeth A, "A large-scale comparison of prospective and retrospective memory development from childhood to middle age", Quarterly Journal of Experimental Psychology, 63(3), pp.442~451 (2010)
  45. Merz, Zachary C., "Examining broad intellectual abilities obtained within an mTurk internet sample", Current Psychology, pp.1~9 (2020)
  46. Neath, Ian, "Response time accuracy in Apple Macintosh computers", Behavior research methods, 43(2), pp.353~362 (2011)
  47. Necka, Elizabeth A., "Measuring the prevalence of problematic respondent behaviors among MTurk, campus, and community participants", PloS one, 11(6), pp.e0157732~ (2016)
  48. Neely, James H, "Basic processes in reading: Visual word recognition", pp.264~336 (1991), Lawrence Erlbaum
  49. Open Science Collaboration, "Estimating the reproducibility of psychological science", Science, 349(6251), pp.943~951 (2015)
  50. Orne, Martin T., "On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications", American Psychologist, 17(11), pp.776~783 (1962)
  51. Peirce, Jonathan, "PsychoPy2:Experiments in behavior made easy", Behavior research methods, 51(1), pp.195~203 (2019)
  52. Poort, Eva D, "The cognate facilitation effect in bilingual lexical decision is influenced by stimulus list composition", Acta psychologica, 180, pp.52~63 (2017)
  53. Reimers, Stian, "The BBC internet study: General methodology", Archives of Sexual Behavior, 36(2), pp.147~161 (2007)
  54. Reimers, Stian, "Presentation and response timing accuracy in Adobe Flash and HTML5", JavaScript Web experiments, 2015, pp.47(2), 309~327
  55. Reips, Ulf-Dietrich, "The Web experimental psychology lab: Five years of data collection on the Internet", Behavior Research Methods, Instruments, &Computers, 33(2), pp.201~211 (2001)
  56. Reips, Ulf-Dietrich, "Handbook of multimethod measurement in psychology", pp.73~85 (2006), American Psychological Association
  57. Reips, Ulf-Dietrich, "The Web Experiment List: A Web service for the recruitment of participants and archiving of Internet-based experiments", Behavior Research Methods, 37(2), pp.287~292 (2005)
  58. Semmelmann, Kilian, "Online psychophysics: Reaction time effects in cognitive experiments", Behavior Research Methods, 49(4), pp.1241~1260 (2017)
  59. Siegwarth, Nicole, "Experimenter effects on cardiovascular reactivity and task performance during mental stress testing", The Psychological Record, 62(1), pp.69~82 (2012)
  60. Simcox, Travis, "Collecting response times using amazon mechanical turk and adobe flash", Behavior research methods, 46(1), pp.95~111 (2014)
  61. Slote, Joseph, "Conducting spoken word recognition research online: Validation and a new timing method", Behavior Research Methods, 48(2), pp.553~566 (2016)
  62. Stanislaw, Harold, "Calculation of signal detection theory measures. Behavior Research Methods", Instruments, and Computers, 31(1), pp.137~149 (1999)
  63. Stoet, Gijsbert, "PsyToolkit: A novel web-based method for running online questionnaires and reaction-time experiments", Teaching of Psychology, 44(1), pp.24~31 (2017)
  64. 태진이, "한국어 시각 단어재인과정에서 음운정보와 표기정보의 역할", 인지과학, 26(1), pp.1~26 (2015), 한국인지과학회[DOI]
  65. 태진이, "한국어 시각단어재인에서 음절과 음절체의 역할", 언어과학연구, (73), pp.205~224 (2015), 언어과학회
  66. Thorson, Katherine R., "Controlling the uncontrolled: Are there incidental experimenter effects on physiologic responding?", Psychophysiology, 57(3), pp.e13500~ (2020)
  67. Van den Bussche, Eva, "Mechanisms of masked priming: a meta-analysis", Psychological bulletin, 135(3), pp.452~477 (2009)
  68. Wason, Peter C., "Reasoning about a rule", Quarterly Journal of Experimental Psychology, 20, pp.273~281 (1968)
  69. 이광오, "한국어 고유어의 인지에서 형태소 처리", 한국심리학회지: 인지 및 생물, 21(3), pp.233~247 (2009), 한국인지및생물심리학회[DOI]
  70. 이광오, "한자어의 표기정보와 음운정보 처리", 제 17회 한글 및 한국어 정보처리 학술대회, pp.63~72 (2005)
  71. 이광오, "한글단어의 인지과정에서 형태소 정보처리", 한국심리학회지:인지 및 생물, 11(1), pp.77~91 (1999)
  72. Yun, Jiwon, "Meaning and prosody of wh-indeterminates in Korean", Linguistic Inquiry, 50(3), pp.630~647 (2019)

관련 논문AI추천

이 간행물의 다른 논문 (12건)