Ursa Sapiens
  • The Blog
  • Team
  • About Us
  • Categories
  • Blog Archives
    • December 2014
    • November 2014
    • April 2014
    • March 2014
    • February 2014
    • January 2014
    • December 2013
  • Brown TTH

That Beautiful Blue Oboe: Synesthesia and the Nature of Perception

11/19/2014

0 Comments

 
by Jennifer Maccani, PhD
Picture
The painter Wassily Kandinsky was a well-known synesthete who saw music. [image via]
If you’re a fan of classical music, you’ve likely spent a rhapsodic hour daydreaming to the lilting melodies of Beethoven’s sixth symphony, the “Pastoral,” so-named because the music is said to evoke images in the mind’s eye of rolling fields, fluttering streams, and tinkling birdsong. Yet, for roughly 0.05-1% of the population (1), Beethoven’s masterpieces can evoke far different—and far more vivid—imagery. For these people, music and/or other sensory stimuli trigger immediate perceptions that feel as real as the music itself, often in the form of color and shape (2, 3). These people were born with what some might consider a real-life superpower, a condition called synesthesia.
The most common type is grapheme-color synesthesia, in which letters or numbers elicit colors in the mind’s eye. For synesthetes, these colors are an essential part of the letters or numbers themselves, almost a part of their essence or identity (4). However, over 60 types of synesthesia have been identified in the population; in fact, there may be 150 or more distinct types (5). Music can evoke spatial sensations, shapes or colors (6-8); words can taste sour or sweet (9); voices can look like grey smoke or dry, cracked soil (9, 10); or the sound of a car horn can smell like strawberries (11). Even the personalities of one’s family and friends can have their own distinct colors (12). Individuals may have only one type, or several, and some of them—such as voice-color and personality-color synesthesia—are rarer than others.
Picture
To learn more about this xkcd comic, head over to explainxkcd. [image via]
Synesthesia is more than color association. For synesthetes (people with synesthesia), responses are both automatic and consistent (6), and the same responses occur nearly every time a particular stimulus is encountered—often for most of a person’s life (13). Whether synesthesia is a one-way street, with numbers evoking colors but not the other way around, is still up for debate; in some individuals, evidence suggests that colors may unconsciously serve as keys for the stimuli that produce them, serving as a kind of color code (13). In one study, synesthetes who see color in response to numbers were able to complete math problems just as quickly with patches of color as they could with the numbers themselves (14).

This is only one benefit of synesthesia, and it illustrates one potential reason that synesthesia may have evolved in the first place. Some research has suggested that synesthesia may aid in the learning of language or categories (15, 16). In addition, improved color sensitivity, color working memory, mental rotation ability, and mental imagery have all been described in synesthetes, although motion perception may be impaired in some individuals (2, 17-23). Synesthesia requires attention to produce an effect, though, and the majority of individuals see color or shape in their mind’s eye only (24).

Interestingly, although synesthetic perceptions vary widely from one individual to the next, some similarities have been described for certain types of synesthesia. For example, many people with grapheme-color synesthesia perceive the letter “A” to be red, and the day Sunday to be white (25). These pairings—or “perceptual representation systems,” as scientists call them (25)—are typically formed very early in childhood, although time of development can vary (26). For almost half of synesthetes, these systems are fixed by the age of 7 or 8; for more than 70%, by age 10 or 11 (26). 
Picture
Some synesthetes see letters and numbers as having their own colors. [image via]
Though scientists have tried since 1934 to train non-synesthetes to produce synesthetic responses, they have been unable to do so, making it likely that synesthesia is caused by inherent genetic or structural differences in affected individuals, rather than environmental factors .

Aside from certain currently unanswerable questions about synesthesia—for example, how do synesthetes tell their perceptions from physical reality? (41)—one common question non-synesthetes often ask is: what is it like to be synesthetic?

With emerging technology, you may be able to find out.

Several apps have recently been developed that approximate synesthetic experiences. One such app is “Roy G Biv” by Julian Glander, which allows users to translate colors into music via their phone. Color data is converted into 8-note synth modulations, so you can find out what chartreuse sounds like, or if chocolate cake sounds as delicious as it tastes. Another similar app is Stromatolite’s “Synaesthesia”, which allows users to scan colors and convert them into music. Tilting one’s phone changes the pitch; shaking creates beats.
Of course, if “Roy G Biv” and “Synaesthesia” are too whimsical for your taste, you can try the “ChoiceMap” app by Jonathan Jackson, which approximates its creator’s synesthesia to help users think through decisions (42).

Jackson’s synesthesia helps him to visualize his decision-making processes by transforming what he intuitively feels about his choices into a geometric map or model of his priorities. Like other synesthetes, his sensory perceptions are instinctive and immediate, so he never put pen to paper to describe it until he set about making “ChoiceMap.” He discovered that he could create a mathematical algorithm to approximate the models he saw in his mind into an interface users could better understand, allowing others to take advantage of a decision-making process that, to Jackson, is second nature.

ChoiceMap intro video from ChoiceMap on Vimeo.

While these apps are a great start at approximating and allowing others to benefit from synesthesia, they’re a far cry from allowing non-synesthetes to see the world as synesthetes do: full of colors, textures, and shapes overlaid atop the physical world on a plane that can’t be accessed by or described fully to others. When will non-synesthetes be able to experience synesthetic colors that don’t exist in the physical world, or see the undulating hues evoked by Beethoven’s “Pastoral” symphony? Only time will tell. As research progresses, perhaps we’ll gain a better understanding of the boundaries of our senses, of what it means to perceive, of what “real” really means.

References
  1. Asher JE, Lamb JA, Brocklebank D, Cazier JB, Maestrini E, Addis L, et al. A whole-genome scan and fine-mapping linkage study of auditory-visual synesthesia reveals evidence of linkage to chromosomes 2q24, 5q33, 6p12, and 12p12. American journal of human genetics. 2009;84(2):279-85.
  2. Banissy MJ, Tester V, Muggleton NG, Janik AB, Davenport A, Franklin A, et al. Synesthesia for color is linked to improved color perception but reduced motion perception. Psychological science. 2013;24(12):2390-7.
  3. Cytowic RE, Wood FB. Synesthesia. I. A review of major theories and their brain basis. Brain and cognition. 1982;1(1):23-35.
  4. Witthoft N, Winawer J. Learning, memory, and synesthesia. Psychological science. 2013;24(3):258-65.
  5. Cytowic RE, Eagleman, D. M. Wednesday is Indigo Blue: Discovering the Brain of Synesthesia. Cambridge: MIT Press; 2009.
  6. Akiva-Kabiri L, Linkovski O, Gertner L, Henik A. Musical space synesthesia: Automatic, explicit and conceptual connections between musical stimuli and space. Consciousness and cognition. 2014;28C:17-29.
  7. Adeli M, Rouat J, Molotchnikoff S. Audiovisual correspondence between musical timbre and visual shapes. Frontiers in human neuroscience. 2014;8:352.
  8. Zamm A, Schlaug G, Eagleman DM, Loui P. Pathways to seeing music: enhanced structural connectivity in colored-music synesthesia. NeuroImage. 2013;74:359-66.
  9. Bankieris K, Simner J. Sound symbolism in synesthesia: Evidence from a lexical-gustatory synesthete. Neurocase. 2014;20(6):640-51.
  10. Moos A, Simmons D, Simner J, Smith R. Color and texture associations in voice-induced synesthesia. Frontiers in psychology. 2013;4:568.
  11. Jackson TE, Sandramouli S. Auditory-olfactory synesthesia coexisting with auditory-visual synesthesia. Journal of neuro-ophthalmology : the official journal of the North American Neuro-Ophthalmology Society. 2012;32(3):221-3.
  12. Ramachandran VS, Miller L, Livingstone MS, Brang D. Colored halos around faces and emotion-evoked colors: a new form of synesthesia. Neurocase. 2012;18(4):352-8.
  13. Colizoli O, Murre JM, Rouw R. Defining (trained) grapheme-color synesthesia. Frontiers in human neuroscience. 2014;8:368.
  14. McCarthy JD, Barnes LN, Alvarez BD, Caplovitz GP. Two plus blue equals green: grapheme-color synesthesia allows cognitive access to numerical information via color. Consciousness and cognition. 2013;22(4):1384-92.
  15. Watson MR, Akins KA, Spiker C, Crawford L, Enns JT. Synesthesia and learning: a critical review and novel theory. Frontiers in human neuroscience. 2014;8:98.
  16. Watson MR, Blair MR, Kozik P, Akins KA, Enns JT. Grapheme-color synaesthesia benefits rule-based Category learning. Consciousness and cognition. 2012;21(3):1533-40.
  17. McCarthy JD, Caplovitz GP. Color synesthesia improves color but impairs motion perception. Trends in cognitive sciences. 2014;18(5):224-6.
  18. Terhune DB, Wudarczyk OA, Kochuparampil P, Cohen Kadosh R. Enhanced dimension-specific visual working memory in grapheme-color synesthesia. Cognition. 2013;129(1):123-37.
  19. Pritchard J, Rothen N, Coolbear D, Ward J. Enhanced associative memory for colour (but not shape or location) in synaesthesia. Cognition. 2013;127(2):230-4.
  20. Barnett KJ, Newell FN. Synaesthesia is associated with enhanced, self-rated visual imagery. Consciousness and cognition. 2008;17(3):1032-9.
  21. Price MC. Spatial forms and mental imagery. Cortex; a journal devoted to the study of the nervous system and behavior. 2009;45(10):1229-45.
  22. Price MC. What kind of mental images are spatial forms? Cognitive processing. 2009;10 Suppl 2:S276-8.
  23. Brang D, Miller LE, McQuire M, Ramachandran VS, Coulson S. Enhanced mental rotation ability in time-space synesthesia. Cognitive processing. 2013;14(4):429-34.
  24. Rich AN, Karstoft KI. Exploring the benefit of synaesthetic colours: testing for "pop-out" in individuals with grapheme-colour synaesthesia. Cognitive neuropsychology. 2013;30(2):110-25.
  25. Rouw R, Case L, Gosavi R, Ramachandran V. Color associations for days and letters across different languages. Frontiers in psychology. 2014;5:369.
  26. Simner J, Bain AE. A longitudinal study of grapheme-color synesthesia in childhood: 6/7 years to 10/11 years. Frontiers in human neuroscience. 2013;7:603.
  27. Kelly FL. An experimental attempt to produce artificial chromaesthesia by the technique of the conditioned response. J Exp Psychol 1934;17:315-41.
  28. Deroy O, Spence C. Training, hypnosis, and drugs: artificial synaesthesia, or artificial paradises? Frontiers in psychology. 2013;4:660.
  29. Rothen N, Meier B. Acquiring synaesthesia: insights from training studies. Frontiers in human neuroscience. 2014;8:109.
  30. Brogaard B. Serotonergic hyperactivity as a potential factor in developmental, acquired and drug-induced synesthesia. Frontiers in human neuroscience. 2013;7:657.
  31. Grossenbacher PG, Lovelace CT. Mechanisms of synesthesia: cognitive and physiological constraints. Trends in cognitive sciences. 2001;5(1):36-41.
  32. Rouw R. 'Special cases': neural mechanisms and individual differences in synaesthesia. Journal of neuropsychology. 2011;5(2):145-51.
  33. Ramachandran VS, Hubbard EM. Psychophysical investigations into the neural basis of synaesthesia. Proceedings Biological sciences / The Royal Society. 2001;268(1470):979-83.
  34. Carmichael DA, Simner J. The immune hypothesis of synesthesia. Frontiers in human neuroscience. 2013;7:563.
  35. Melero H, Pena-Melian A, Rios-Lago M, Pajares G, Hernandez-Tamames JA, Alvarez-Linera J. Grapheme-color synesthetes show peculiarities in their emotional brain: cortical and subcortical evidence from VBM analysis of 3D-T1 and DTI data. Experimental brain research. 2013;227(3):343-53.
  36. Fourgeaud L, Boulanger LM. Role of immune molecules in the establishment and plasticity of glutamatergic synapses. The European journal of neuroscience. 2010;32(2):207-17.
  37. Bor D, Billington J, Baron-Cohen S. Savant memory for digits in a case of synaesthesia and Asperger syndrome is related to hyperactivity in the lateral prefrontal cortex. Neurocase. 2007;13(5):311-9.
  38. Enstrom AM, Van de Water JA, Ashwood P. Autoimmunity in autism. Current opinion in investigational drugs. 2009;10(5):463-73.
  39. Neufeld J, Roy M, Zapf A, Sinke C, Emrich HM, Prox-Vagedes V, et al. Is synesthesia more common in patients with Asperger syndrome? Frontiers in human neuroscience. 2013;7:847.
  40. Tomson SN, Avidan N, Lee K, Sarma AK, Tushe R, Milewicz DM, et al. The genetics of colored sequence synesthesia: suggestive evidence of linkage to 16q and genetic heterogeneity for the condition. Behavioural brain research. 2011;223(1):48-52.
  41. Rouw R, Ridderinkhof KR. The most intriguing question in synesthesia research. Cognitive neuroscience. 2014;5(2):128-30.
  42. Kessler S. Fast Company [Internet]: Mansueto Ventures, LLC. 2014. [cited 2014]. Available from: http://www.fastcompany.com/3024927/this-app-aids-your-decision-making-by-mimicking-its-creators-synesthesia.

0 Comments



Leave a Reply.

Powered by Create your own unique website with customizable templates.
  • The Blog
  • Team
  • About Us
  • Categories
  • Blog Archives
    • December 2014
    • November 2014
    • April 2014
    • March 2014
    • February 2014
    • January 2014
    • December 2013
  • Brown TTH