Synesthesia

Synaesthesia is a strange sensory blending: synaesthetes report experiences of colours or tastes associated with particular sounds or words. This volume presents new essays by scientists and philosophers exploring what such cases can tell us about the nature of perception and its boundaries with illusion and imagination.

Developmental synesthesia typically involves either the stimulation of one sensory modality which gives rise to an experience in a different modality (when a sound, for example, evokes a colour) or the stimulation of a single sensory modality giving rise to different qualitative aspects of experience (when the sight of a number, for example, evokes a colour). These occurrences seem to support Grice’s (1989) argument that sense modalities cannot be individuated without reference to the introspective-character of experience. This, however, threatens intentionalism (...) which maintains that the qualitative character of experience is exhausted, or fully determined by, its intentional content. Ross (2001) attempts to defuse Grice’s argument by proposing an account that does not appeal to the qualitative character of experience to individuate sense modalities. I argue that his account is unsuccessful. (shrink)

The Warner Books back cover proclaims: In the tradition of Oliver Sachʼs [sic] bestselling *The Man Who Mistook His Wife for a Hat...* The manner and misspellingsignify that Cytowic himself had nothing to do with such publishing hucksterism. However, one thing is clear upon reading this book: Richard Cytowic, M.D., is no Oliver Sacks. Though, as will be seen, there is much in here to recommend itself, his stilted reproduction of conversations which or may not have taken place and his (...) CreativeFiction 100 characterizations (i.e., Dr. Wood's continual inhalation of smoke or food) strike the experienced reader as painfully contrived, as though Cytowic were doing hislevel best to imitate Sacks and reach that always-elusive wider audience. (shrink)

Synaesthesia is a condition in which one type of stimulation evokes the sensation of another, as when the hearing of a sound produces photisms, i.e. mental percepts of colours. R is a 20 year old colour blind subject who, in addition to the relatively common grapheme-colour synaesthesia, presents a rarely reported cross modal perception in which a variety of visual stimuli elicit aura-like percepts of colour. In R, photisms seem to be closely related to the affective valence of stimuli and (...) typically bring out a consistent pattern of emotional responses. The present case study suggests that colours might be an intrinsic category of the human brain. We developed an empirical methodology that allowed us to study the subject's otherwise inaccessible phenomenological experience. First, we found that R shows a Stroop effect elicited by photisms despite the fact that he does not show a regular Stroop with real colours. Secondly, by manipulating the colour context we confirmed that colours can alter R's emotional evaluation of the stimuli. Furthermore, we demonstrated that R's auras may actually lead to a partially inverted emotional spectrum where certain stimuli bring out emotional reactions opposite to the normal ones. These findings can only be accounted for by considering R's subjective colour experience or qualia. Therefore the present paper defends the view that qualia are a useful scientific concept that can be approached and studied by experimental methods. (shrink)

In this report, the phenomenology of two blind users of a sensory substitution device – “The vOICe” – that converts visual images to auditory signals is described. The users both report detailed visual phenomenology that developed within months of immersive use and has continued to evolve over a period of years. This visual phenomenology, although triggered through use of The vOICe, is likely to depend not only on online visualization of the auditory signal but also on the users’ previous (albeit (...) distant) experience of veridical vision (e.g. knowledge of shapes and visual perspective). Once established, the sensory substitution mapping between the auditory and visual domains is not confined to when the device is worn and, thus, may constitute an example of acquired synaesthesia. (shrink)

This chapter provides a review of the hypothesis that synesthetic-like perception is present in infants and toddlers. Infants and very young children exhibit evidence of functional hyperconnectivity between the senses, much of which is reminiscent of the cross-sensory associations observed in synaesthetic adults. As most of these cross-sensory correspondances cannot be easily explained by learning, it is likely that these represent natural associations between the senses. In average adults, these 'natural associations' are felt only intuitively rather than explicitly. These observations (...) have led to the proposal of the 'neonatal synaesthesia hypothesis', which purports that all individuals are born synaesthetic, with explicit conscious perception of these natural cross-modal associations dissipating over development in typical individuals. This dissipation is likely the result of experience-dependent synaptic pruning and/or inhibition of cross-sensory neural connections. At the same time, cross-modal associations matching those common in the environment might be assumed to be learned. This hypothesis is re-evaluated in light of recent research findings, and is examined in the context of current evolutionary models of neuronal recycling and emerging evidence of longitudinal changes in children with synaesthesia. (shrink)

Colour synaesthesia is the mental experience involving a strong association between specific colours and specific auditory stimuli, such as words, or achromatic visual stimuli, such as numerals or letters. In the contemporary literature on colour synaesthesia, the majority view treats the phenomenon as one arising from some of the same neural events mediating colour perception triggered by genuinely coloured objects; this view that synaesthesia is perceptually based, however, is not universally endorsed. What strategies have been utilized to evaluate the perceptual (...) reality of colour synaesthesia, and what is the evidence produced by those strategies? This chapter tackles those questions within the context of colour graphemic synaesthesia, the most widely studied form of synaesthesia. We divide the research strategies into those employing behavioral measures to assess whether synaesthetia influences performance on tasks known to be sensitive stimulus colour and those employing indirect measures that use physiological responses as proxies for colour perception. Our chapter concludes that there is sufficient justification for the belief in the perceptual reality of colour grapheme synaesthesia. At the same time, we applaud those who remain disbelievers, for their skepticism has underscored the logical issues surrounding research on this question. (shrink)

Grapheme-colour synaesthetes experience unusual colour percepts when they encounter letters and/or digits. Studies of English-speaking grapheme-colour synaesthetes have shown that synaesthetic colours are sometimes triggered by rule-based linguistic mechanisms . In contrast, little is known about synaesthesia in logographic languages such as Chinese. The current study shows the mechanisms by which synaesthetic speakers of Chinese colour their language. One hypothesis is that Chinese characters might be coloured by their constituent morphological units, known as radicals, and we tested this by eliciting (...) synaesthetic colours for characters while manipulating features of the radicals within them. We found that both the function and position of radicals influence the nature of the synaesthetic colour generated. Our data show that in Chinese, as in English, synaesthetic colours are influenced by systematic rules, rather than by random associations, and that these rules are based on existing psycholinguistic mechanisms of language processing. (shrink)

In grapheme-color synesthesia, a number or letter can evoke two different and possibly conflicting color sensations at the same time. In this study, we investigate the relationship between synesthesia and executive control functions. First, no general skill differences were obtained between synesthetes and non-synesthetes in classic executive control paradigms. Furthermore, classic executive control effects did not interact with synesthetic behavioral effects. Third, we found support for our hypothesis that inhibition of a synesthetic color takes effort and time. Finally, individual differences (...) analyses showed no relationship between the two skills; performance on a ‘normal’ Stroop task does not predict performance on a synesthetic Stroop task. Across four studies, the current results consistently show no clear relationship between executive control functions and synesthetic behavioral effects. This raises the question of which mechanisms are at play in synesthetic ‘management’ during the presence of two conflicting sensations. (shrink)

Synaesthesia is a heterogeneous phenomenon, even when considering one particular sub-type. The purpose of this study was to design a reliable and valid questionnaire for grapheme-colour synaesthesia that captures this heterogeneity. By the means of a large sample of 628 synaesthetes and a factor analysis, we created the Coloured Letters and Numbers questionnaire with 16 items loading on 4 different factors . These factors were externally validated with tests which are widely used in the field of synaesthesia research. The questionnaire (...) showed good test–retest reliability and construct validity . Our findings are discussed in the light of current theories and new ideas in synaesthesia research. More generally, the questionnaire is a useful tool which can be widely used in synaesthesia research to reveal the influence of individual differences on various performance measures and will be useful in generating new hypotheses. (shrink)

People with grapheme-color synesthesia perceive specific colors when viewing different letters or numbers. Previous studies have suggested that synesthetic color experience can be bistable when induced by an ambiguous character. However, the exact relationship between processes underlying the identity of an alphanumeric character and the experience of the induced synesthetic color has not been examined. In the present study, we explored this by focusing on the temporal relation of inducer identification and color emergence using inducers whose identity could be rendered (...) ambiguous upon rotation of the characters. Specifically, achromatic alphabetic letters and digits were presented at varying angles to 9 grapheme-color synesthetes. Results showed that grapheme identification and synesthetically perceived grapheme color covary with the orientation of the test stimulus and that synesthetes were slower naming the experienced color than identifying the character, particularly at intermediate angles where ambiguity was greatest. (shrink)

Grapheme-color synesthetes experience color, not physically present, when viewing symbols. Synesthetes cannot remember learning these associations. Must synesthetic percepts be formed during a sensitive period? Can they form later and be consistent? What determines their nature? We tested grapheme-color synesthete, MC2, before, during and after she studied Hindi abroad. We investigated whether novel graphemes elicited synesthetic percepts, changed with familiarity, and/or benefited from phonemic information. MC2 reported color percepts to novel Devanagari and Hebrew graphemes. MC2 monitored these percepts over 6 (...) months in a Hindi-speaking environment. MC2 and synesthete DN, reported synesthetic percepts for Armenian graphemes, or Cyrillic graphemes + phonemes over time. Synesthetes, not controls, reported color percepts for novel graphemes that gained consistency over time. Phonemic information did not enhance consistency. Thus, synesthetes can form and consolidate percepts to novel graphemes as adults. These percepts may depend on pre-existing grapheme-color relationships but they can flexibly shift with familiarity. (shrink)

Researchers have long suspected that grapheme-color synaesthesia is useful, but research on its utility has so far focused primarily on episodic memory and perceptual discrimination. Here we ask whether it can be harnessed during rule-based Category learning. Participants learned through trial and error to classify grapheme pairs that were organized into categories on the basis of their associated synaesthetic colors. The performance of synaesthetes was similar to non-synaesthetes viewing graphemes that were physically colored in the same way. Specifically, synaesthetes learned (...) to categorize stimuli effectively, they were able to transfer this learning to novel stimuli, and they falsely recognized grapheme-pair foils, all like non-synaesthetes viewing colored graphemes. These findings demonstrate that synaesthesia can be exploited when learning the kind of material taught in many classroom settings. (shrink)

Despite some principal similarities, there is no systematic comparison between the different types of synesthesia . This comprehensive review compares the three principal types of synesthesia and focuses on their phenomenological features and their relation to different etiological models. Implications of this comparison for the validity of the different etiological models are discussed.Comparison of the three forms of synesthesia show many more differences than similarities. This is in contrast to their representation in the literature, where they are discussed in many (...) respects as being virtually similar. Noteworthy is the much broader spectrum and intensity with the typical drug-induced synesthesias compared to genuine and acquired synesthesias. A major implication of the phenomenological comparison in regard to the etiological models is that genuine and acquired synesthesias point to morphological substrates, while drug-induced synesthesia appears to be based on functional changes of brain activity. (shrink)

In spatial sequence synaesthesia ordinal stimuli are perceived as arranged in peripersonal space. Using fMRI, we examined the neural bases of SSS and colour synaesthesia for spoken words in a late-blind synaesthete, JF. He reported days of the week and months of the year as both coloured and spatially ordered in peripersonal space; parts of the days and festivities of the year were spatially ordered but uncoloured. Words that denote time-units and triggered no concurrents were used in a control condition. (...) Both conditions inducing SSS activated the occipito-parietal, infero-frontal and insular cortex. The colour area hOC4v was engaged when the synaesthetic experience included colour. These results confirm the continued recruitment of visual colour cortex in this late-blind synaesthetes. Synaesthesia also involved activation in inferior frontal cortex, which may be related to spatial memory and detection, and in the insula, which might contribute to audiovisual integration related to the processing of inducers and concurrents. (shrink)

Determining the nature of binding in grapheme-color synaesthesia has consequences for understanding the neural basis of synaesthesia and visual awareness in general. We evaluated type- and token-based letter-color binding using a synaesthetic version of the object-reviewing paradigm. Although mean response times failed to reveal any significant differences between synaesthetes and control participants, RT analyses with ex-Gaussian distributions revealed that the response facilitation in the synaesthesia group reflected type representations exclusively, while response facilitation in the control group, who learned letter-color associations, (...) was dominated by token representations. Thus, letter-color associations in associator synaesthetes are type-based, and do not involve binding to object tokens, consistent with their subjective reports. Contrary to recent studies that failed to find differences between synaesthetes and non-synaesthetes with behavioral measures, response time distribution analyses indicate that color sensations in synaesthetes are not simply the extreme form of normal letter-color associations, and cannot be attributed to demand characteristics. (shrink)

In developmental lexical–gustatory synesthesia, specific words can trigger taste perceptions and these synesthetic associations are generally stable. We describe a case of multilingual lexical–gustatory synesthesia for whom some synesthesias were bidirectional as some tastes also triggered auditory word associations. Evoked concurrents could be gustatory but also tactile sensations. In addition to words and pseudowords, many voices were effective inducers, suggesting increased connections between cortical taste areas and both voice-selective and language-selective areas. Lasting changes in some evoked tastes occurred during childhood (...) suggesting that some plasticity can be present after the initial learning of associations. Inducers were often linked to taste concurrents phonologically or semantically, but also through identifiable childhood episodes . Several inducers were phonologically linked to episodic inducers suggesting a process of secondary acquisition for many inducers. Implications of these observations are discussed. (shrink)

Recent research on grapheme-colour synesthesia has focused on whether visual attention is necessary to induce a synesthetic percept. The current study investigated the influence of synesthesia on overt visual attention during an oculomotor target selection task. Chromatic and achromatic stimuli were presented with one target among distractors among multiple ‘5’s ). Participants executed an eye movement to the target. Synesthetes and controls showed a comparable target selection performance across conditions and a ‘pop-out effect’ was only seen in the chromatic condition. (...) As a pop-out effect was absent for the synesthetes in the achromatic condition, a synesthetic element appears not to elicit a synesthetic colour, even when it is the target. The synesthetic percepts are not pre-attentively available to distinguish the synesthetic target from synesthetic distractors when elements are presented in the periphery. Synesthesia appears to require full recognition to bind form and colour. (shrink)

Studies of linguistic synaesthesias in English have shown a range of fine-grained language mechanisms governing the associations between colours on the one hand, and graphemes, phonemes and words on the other. However, virtually nothing is known about how synaesthetic colouring might operate in non-alphabetic systems. The current study shows how synaesthetic speakers of Mandarin Chinese come to colour the logographic units of their language. Both native and non-native Chinese speakers experienced synaesthetic colours for characters, and for words spelled in the (...) Chinese spelling systems of Pinyin and Bopomo. We assessed the influences of lexical tone and Pinyin/Bopomo spelling and showed that synaesthetic colours are assigned to Chinese words in a non-random fashion. Our data show that Chinese-speaking synaesthetes with very different native languages can exhibit both differences and similarities in the ways in which they come to colour their Chinese words. (shrink)

Recent studies on cortical processing of sensory information highlight the importance of multisensory integration, and define precise rules governing reciprocal influences between inputs of different sensory modalities. We propose that psychophysical interactions between different types of sensory stimuli and linguistic synaesthesia share common origins and mechanisms. To test this hypothesis, we compare neurophysiological findings with corpus-based analyses relating to linguistic synaesthesia. Namely, we present Williams' hypothesis and its recent developments about the hierarchy of synaesthetic pairings, and examine critical aspects of (...) this theory concerning universality, directionality, sensory categories, and usage of corpora. These theoretical issues are verified against linguistic data derived from corpus-based analyses of Italian synaesthetic pairings related to auditory and tactile modalities. Our findings reveal a strong parallel between linguistic synaesthesia and neurophysiological interactions between different sensory stimuli, suggesting that linguistic synaesthesia is affected by tendencies similar to the rules underlying the perceptual association of distinct sensory modalities. (shrink)

Mechanisms of selective attention exert a powerful influence on visual perception. We examined whether attentional selection is necessary for generation of the vivid colours experienced by individuals with grapheme-colour synaesthesia. Twelve synaesthetes and matched controls viewed rapid serial displays of nonsense characters within which were embedded an oriented grating (T1) and a letter-prime (T2), forming a modified attentional blink (AB) task. At the end of the stream a coloured probe appeared that was either congruent or incongruent with the synaesthetic colour (...) elicited by the letter-prime. When the prime was attended, synaesthetes showed a reliable effect of prime-probe congruency. In contrast, when the prime appeared at 350 ms following T1 (during the AB), the congruency effect was eliminated. Our findings suggest that focused attention is crucial for inducing letters to elicit colours in synaesthesia. © 2009 Elsevier B.V. All rights reserved. (shrink)