Holistic Processing Affects Surface Texture Perception: Approach from Japanese Sound Symbolic Words
0
조회
0
다운로드
0
인용
0
참고문헌
초록
The human visual system is able to perceive not only the macrostructure (form and shape) of a surface, but also its microstructure (texture). Some evidence suggests that microstructural characteristics are processed independently of macrostructural features. However, the human visual system can interpret a variety of information about the physical world, enabling the recognition and semantic categorization of complex visual scenes at a glance. This remarkable perceptual ability relies heavily on holistic processing, which is achieved by estimating the global statistical summary of an image. On the other hand, texture is an important source of information for distinguishing between artificial and naturally occurring surfaces in images. In addition, it is reported that Japanese sound symbolic words are useful to express fine differences in texture and synesthetic characteristics. However, there is no evidence comparing the characteristics of surface texture perception between whole- and part-based images using sound symbolic words. The objective of the present study was to examine whether sound symbolic words for describing the surface texture perception differs between whole-based images related to the holistic processing and part-based images. In Experiment 1, we examined the effect of whole- based images in surface texture perception using sound symbolic words.In Experiment 2, we examined the effect of part-based images in surface texture perception using sound symbolic words. The results revealed that the sensory and symbolic descriptors differed in texture perceptions between whole-based and part-based image processing. These findings suggest that sound symbolic words can describe differences in surface texture between whole-based and part-based images at a fine resolution.
Abstract
The human visual system is able to perceive not only the macrostructure (form and shape) of a surface, but also its microstructure (texture). Some evidence suggests that microstructural characteristics are processed independently of macrostructural features. However, the human visual system can interpret a variety of information about the physical world, enabling the recognition and semantic categorization of complex visual scenes at a glance. This remarkable perceptual ability relies heavily on holistic processing, which is achieved by estimating the global statistical summary of an image. On the other hand, texture is an important source of information for distinguishing between artificial and naturally occurring surfaces in images. In addition, it is reported that Japanese sound symbolic words are useful to express fine differences in texture and synesthetic characteristics. However, there is no evidence comparing the characteristics of surface texture perception between whole- and part-based images using sound symbolic words. The objective of the present study was to examine whether sound symbolic words for describing the surface texture perception differs between whole-based images related to the holistic processing and part-based images. In Experiment 1, we examined the effect of whole- based images in surface texture perception using sound symbolic words.In Experiment 2, we examined the effect of part-based images in surface texture perception using sound symbolic words. The results revealed that the sensory and symbolic descriptors differed in texture perceptions between whole-based and part-based image processing. These findings suggest that sound symbolic words can describe differences in surface texture between whole-based and part-based images at a fine resolution.
참고문헌 (66)
- Adelson, E. H., "Computational models of visual processing", pp.1~20 (1991), MIT Press
- Jones, L. A., "Human hand function" (2006), Oxford University Press
- Lederman, S. J., "Haptic perception: A tutorial", Attention, Perception & Psychophysics, 71, pp.1439~1459 (2009)
- Bensmaia, S. J, "Texture from touch", Scholarpedia, 4, pp.7956~ (2009)
- Tiest, W. M. B, "Tactual perception of material properties", Vision Research, 50, pp.2775~2782 (2010)
- Whitaker, T. A., "Vision and touch : independent or integrated systems for the perception of texture?", Brain Res, 1242, pp.59~72 (2008)
- Tamura, H., "Textural features corresponding to visual perception", Syst. Man Cybern. IEEE Trans, 75, pp.460~473 (1978)
- Lederman, S. J., "Perception of texture by vision and touch : Multidimensionality and intersensory integration", Journal of Experimental Psychology: Human Perception & Performance, 12, pp.169~180 (1986)
- Liu, J., "Aesthetic perception of visual textures:a holistic exploration using texture analysis. psychological experiment, and perception modeling", Front Comput Neurosci, 9, pp.134~ (2015)
- Guo, X., "Analysis of texture characteristics associated with visual complexity perception", Optical review, 19(5), pp.306~314 (2012)
- Schyns, P. G., "From blobs to boundary edges: evidence for timeand spatial-scale-dependent scene recognition", Psychol. Sci, 5, pp.195~200 (1994)
- Thorpe, S., "Speed of processing in the human visual system", Nature, 381, pp.520~522 (1996)
- Oliva, A, "Neurobiology of Attention", pp.251~256 (2005), Elsevier
- Oliva, A, "Modeling the shape of the scene: a holistic representation of the spatial envelope", Int. J. Comp. Vis, 42, pp.145~175 (2001)
- Parkes, L., "Compulsory averaging of crowded orientation signals in human vision", Nat. Neurosci, 4, pp.739~744 (2001)
- Ariely, D, "Seeing sets: representation by statistical properties", Psychol. Sci, 12, pp.157~162 (2001)
- Chong, S. C, "Representation of statistical properties", Vision Res, 43, pp.393~404 (2003)
- Oliva, A., "Scene-centered description from spatial envelope properties", Lecture note in computer science series. Proceedings of the 2nd Workshop on Biologically Motivated Computer Vision (2002)
- Rao, A. R., "Identifying high-level features of texture perception", GMIP, 55, pp.218~233 (1993)
- Heaps, C., "Similarity and features of natural textures", J. Exp. Psychol. Hum. Percept. Perform, 25, pp.299~320 (1999)
- Sucevic, J., "When the sound-symbolism effect disappears: The differential role of order and timing in presenting visual and auditory stimuli", Psychology, 4(7A), pp.11~18 (2013)
- Parise, C. V., "Audiovisual crossmodal correspondences and sound symbolism: A study using the implicit association test", Experimental Brain Research, 220, pp.319~333 (2012)
- Spence, C, "Crossmodal correspondences: a tutorial review", Atten Percept Psychophys, 73(4), pp.1~25 (2011)
- Ramachandran, V. S., "Synaesthesia—A window into perception, thought and language", Journal of Consciousness Studies, 8, pp.3~34 (2001)
- Ramachandran, V. S., "Hearing colors, tasting shapes", Scientific American, 288, pp.43~49 (2003)
- Suþeviü, J., "Balloons and bavoons versus spikes and shikes: ERPs reveal shared neural processes for shape-sound-meaning congruence in words, and shape-sound congruence in pseudowords", Brain and language, 145, pp.11~22 (2015)
- Revill, K. P., "Crosslinguistic sound symbolism and crossmodal correspondence: Evidence from fMRI and DTI", Brain and Language, 128, pp.18~24 (2014)
- Spence, C., "Tasting shapes and words", Food Quality and Preference, 22, pp.290~295 (2011)
- Spence, C., "Tasting shapes: A review of four hypotheses", Theoria et Historia Scientiarum, 10, pp.207~238 (2013)
- Bremner, A. J., "“Bouba” and “Kiki” in Namibia? A remote culture make similar shape-sound matches, but different shape-taste matches to Westerners", Cognition, 126, pp.165~172 (2013)
- The use of onomatopoeia in the conversational style of adolescents’, "Nordberg, B", Uppsala University. FUMS, ~, pp.FUMS rapport nr 132 (1986)
- Jakobson, R., "The sound shape of language" (1979), Harvester Press
- Boyle, M. W., "Implications for phonetic symbolism:The relationship between pure tones and geometric figures", Journal of Psycholinguistic Research, 9, pp.535~544 (1980)
- Holland, M, "Some physiognomic aspects of naming, or, maluma and takete revisited", Percept. Motor Skill, 19, pp.111~117 (1964)
- Lindauer, M. S, "The meanings of the physiognomic stimuli taketa and maluma", Bulletin of the Psychonomic Society, 28, pp.47~50 (1990)
- Taylor, I. K, "Phonetic symbolism re-examined", Psychological Bulletin, 60, pp.200~209 (1963)
- Bankieris, K., "What is the link between synaesthesia and sound symbolism?", Cognition, 136, pp.186~195 (2015)
- Sapir, E, "A study in phonetic symbolism", Journal of Experimental Psychology, 12, pp.225~239 (1929)
- Köhler, W, "Gestalt Psychology" (1929), Liveright
- Kanero, J., "How sound symbolism is processed in the brain: a study on Japanese mimetic words", PLoS ONE, 9, pp.1~8 (2014)
- Sakamoto, M., "Effectiveness of onomatopoeia representing quality of tactile texture’ a comparative study with adjectives", the 13th National Conference of the Japanese Cognitive Linguistics Association, pp.473~485 (2013)
- Watanabe, J., "Visualizing tactile material relationships using sound symbolic words", Lecture Notes in Computer Science, 7283, pp.175~182 (2012)
- Hamano, S, "The sound-symbolic system of Japanese" (1998), CSLI & Kuroshio Publisher
- Sakamoto, M., "Metal-like Texture Design Evaluation Using Sound Symbolic Words", International Journal of Design Creativity and Innovation, 4(3-4), pp.181~194 (2015)
- Sakamoto, M., "Cross-Modal Associations between Sounds and Drink Tastes", Textures: A Study with Spontaneous Production of Sound-Symbolic Words, 2015, pp.4(3), 197~203
- Evans, K. K., "Natural cross-modal mappings between visual and auditory features", Journal of Vision, 10(1), pp.6.1~12 (2010)
- Nahm, F. K. D., "Cross-modal associations and the human amygdale", Neuropsychologia, 31, pp.727~744 (1993)
- Westbury, C, "Implicit sound symbolism in lexical access: Evidence from an interference task", Brain and Language, 93, pp.10~19 (2005)
- Sharan, L., "Material Perception: What Can You See in a Brief Glance?", Journal of Vision, 14(9), pp.12~ (2014)
- Baek, S., "Kansei factor space classified by information for kansei modeling of image", Applied Mathematics and Computation, 205(2), pp.874~882 (2008)
- Choi, K., "A systematic approach to the kansei factors of tactile sense regarding the surface roughness", Appl Ergon, 38, pp.53~63 (2007)
- Chen, Y. W., "Mapping function of color image features and human KANSEI", IEEE International Conference on Intelligent Information Hiding and Multimedia Signal Processing, pp.725~ (2008)
- Kakehi, H., "Dictionary of iconic expressions in Japanese" (1996), Mouton de Gruyter
- Lederman, S. J., "Texture perception: Studies of intersensory Lntegration using a discrepancy paradigm", Journal of Experimental Psychology: Human Perception & Performance, 7, pp.902~991 (1981)
- Schifferstein, H. N. J., "Capturing product experiences: a split-modality approach", Acta Psychol. (Amst.), 118, pp.293~318 (2005)
- Schifferstein, H. N. J, "The perceived importance of sensory modalities in product usage: a study of self reports", Acta Psychol. (Amst.), 121, pp.41~64 (2006)
- Lennie, P, "Single units and cortical organization", Perception, 27, pp.889~935 (1998)
- Kastner, S., "Texture segregation in the human visual cortex: a function MRI study", Journal of Neurophysiology, 83, pp.2453~2457 (2000)
- Klatzky, R. L., "There’s More to Touch than Meets the Eye: The Salience of Object Attributes for Haptics with and without Vision", Journal of Experimental Psychology, 116(4), pp.356~369 (1987)
- Wastiels, L., "Touching Materials Visually: About the Dominance of Vision in Building Material Assessment", International Journal of Design, 7(2), pp.31~41 (2013)
- Flanagan, J. R., "Experience can change distinct size-weight priors engaged in lifting objects and judging their weights", Curr. Biol, 18, pp.1742~1747 (2008)
- Seitz, A. R., "Simultaneous and independent acquisition of multisensory and unisensory associations", Perception, 36, pp.1445~1453 (2007)
- Ernst, M. O, "Learning to integrate arbitrary signals from vision and touch", J. Vis, 7(7), pp.1~14 (2007)
- Goda, N., "Crossmodal association of visual and haptic material properties of objects in the monkey ventral visual cortex", Current Biology, 26(7), pp.928~934 (2016)
- Goda, N., "Representation of the material properties of objects in the visual cortex of nonhuman primates", J Neurosci, 34(7), pp.2660~2673 (2014)
- R. Doizaki, "Automatic Estimation of Multidimensional Ratings from a Single Sound-symbolic Word and Wordbased Visualization of Tactile Perceptual Space", IEEE Transactions on Haptics, 10(2), pp.173~182 (2017)
