Crossmodal Perceptual Learning and Sensory Substitution
i-Perception October 1, 2011 DOI: 10.1068/ic745 (opens in new tab)
Study at a glance
AI-extracted from the abstract| Characteristics | Theoretical or philosophical paper Peer reviewed |
|---|---|
| Key points | Argues that although some aspects of sound-to-vision conversion, such as mapping vertical location to pitch, rely on natural crossmodal mappings, the extensive training required suggests that synthetic mappings are necessary to generalize perceptual learning to new objects and environments and ultimately to experience visual qualia. The author contends that sensorimotor experience may be required to develop expertise and a form of synthetic synaesthesia. |
Abstract
A sensory substitution device for blind persons aims to provide the missing visual input by converting images into a form that another modality can perceive, such as sound. Here I will discuss the perceptual learning and attentional mechanisms necessary for interpreting sounds produced by a device (The vOICe) in a visuospatial manner. Although some aspects of the conversion, such as relating vertical location to pitch, rely on natural crossmodal mappings, the extensive training required suggests that synthetic mappings are required to generalize perceptual learning to new objects and environments, and ultimately to experience visual qualia. Here I will discuss the effects of the conversion and training on perception and attention that demonstrate the synthetic nature of learning the crossmodal mapping. Sensorimotor experience may be required to facilitate learning, develop expertise, and to develop a form of synthetic synaesthesia.