Emotion Recognition in Comics: The Effect of Visual Morphemes in Visual Narrative Contexts
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
In comics, the term “visual morphemes” refers to one type of graphic structure that can be combined with other graphic elements to generate diverse meaning. For instance, the visual morphemes of whirlwind-shaped lines indicate confusion if they are placed above a person’s head. Prior empirical research has shown that such emotive visual morphemes do in fact help comic readers recognize the emotions of comic characters. However, there has been little evidence of the effect of emotive visual morphemes when emotion recognition is required in narrative contexts where multiple images are arranged to form a story, as opposed to when in solitary images of character-morpheme dyads. This study thus examined how emotive visual morphemes affect the identification of character’s emotions in narrative contexts consisting of three image panels. Results showed that emotion recognition was slower when the visual morphemes were not corresponding to the emotions of characters than when they were corresponding or when they were not provided at all. The findings thus add to our understanding of visual morpheme processing by providing empirical support for the emotive visual morpheme effects in the visual narrative structure.
Abstract
In comics, the term “visual morphemes” refers to one type of graphic structure that can be combined with other graphic elements to generate diverse meaning. For instance, the visual morphemes of whirlwind-shaped lines indicate confusion if they are placed above a person’s head. Prior empirical research has shown that such emotive visual morphemes do in fact help comic readers recognize the emotions of comic characters. However, there has been little evidence of the effect of emotive visual morphemes when emotion recognition is required in narrative contexts where multiple images are arranged to form a story, as opposed to when in solitary images of character-morpheme dyads. This study thus examined how emotive visual morphemes affect the identification of character’s emotions in narrative contexts consisting of three image panels. Results showed that emotion recognition was slower when the visual morphemes were not corresponding to the emotions of characters than when they were corresponding or when they were not provided at all. The findings thus add to our understanding of visual morpheme processing by providing empirical support for the emotive visual morpheme effects in the visual narrative structure.
참고문헌 (18)
- Michael Abbott, "Visual representation of emotion in manga: Loss of control is Loss of hands in Azumanga Daioh Volume 4", Language and Literature: International Journal of Stylistics, 20(2), pp.91~112 (2011), SAGE Publications[DOI]
- Cohn, N., "Comics, linguistics, and visual language: The past and future of a field", pp.92~118 (2012), Palgrave MacMillan
- Neil Cohn, "Visual Narrative Structure", Cognitive Science, 37(3), pp.413~452 (2012), Wiley[DOI]
- Neil Cohn, "You're a Good Structure, Charlie Brown: The Distribution of Narrative Categories in Comic Strips", Cognitive Science, 38(7), pp.1317~1359 (2014), Wiley[DOI]
- Neil Cohn, "Combinatorial Morphology in Visual Languages", The Construction of Words, pp.175~199 (2018), Springer International Publishing[DOI]
- Cohn, N., "Empirical Comics Research", pp.305~328 (2018), Routledge
- Neil Cohn, "The vocabulary of manga: Visual morphology in dialects of Japanese Visual Language", Journal of Pragmatics, 92, pp.17~29 (2016), Elsevier BV[DOI]
- Neil Cohn, "Meaning above (and in) the head: Combinatorial visual morphology from comics and emoji", Memory & Cognition, 50(7), pp.1381~1398 (2022), Springer Science and Business Media LLC[DOI]
- Neil Cohn, "The notion of the motion: The neurocognition of motion lines in visual narratives", Brain Research, 1601, pp.73~84 (2015), Elsevier BV[DOI]
- Neil Cohn, "Meaning above the head: combinatorial constraints on the visual vocabulary of comics", Journal of Cognitive Psychology, 28(5), pp.559~574 (2016), Informa UK Limited[DOI]
- Forceville, C., "Visual representations of the idealized cognitive model of anger in the Asterix album La Zizanie", Journal of Pragmatics, 37(1), pp.69~88 (2005)
- Charles Forceville, "Pictorial runes in Tintin and the Picaros", Journal of Pragmatics, 43(3), pp.875~890 (2011), Elsevier BV[DOI]
- Forceville, C., "Balloonics: The visuals of balloons in comics", pp.56~73 (2010), McFarland
- Kendall, L. N., "Show me how you feel: Iconicity and systematicity in visual morphology", pp.214~229 (2020), John Benjamins
- John M Kennedy, "Metaphor in Pictures", Perception, 11(5), pp.589~605 (1982), SAGE Publications[DOI]
- Amitash Ojha, "An experimental study on the effect of emotion lines in comics", Semiotica, 2021(243), pp.305~324 (2021), Walter de Gruyter GmbH[DOI]
- Peirce, J. W., "Building Experiments in PsychoPy" (2018), Sage
- "Standalone PsychoPy 2021.1.4 for 64bit Windows (using Python3.6)"[URL]