LOGIN TO YOUR ACCOUNT

Username
Password
Remember Me
Or use your Academic/Social account:

CREATE AN ACCOUNT

Or use your Academic/Social account:

Congratulations!

You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.

Important!

Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message

CREATE AN ACCOUNT

Name:
Username:
Password:
Verify Password:
E-mail:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Ward, Jamie; Moore, Samantha; Thompson-Lake, Daisy; Salih, Shireen; Beck, Brianna (2008)
Languages: English
Types: Article
Subjects:
Identifiers:doi:10.1068/p5815
The term 'visual music' refers to works of art in which both hearing and vision are directly or indirectly stimulated. Our ability to create, perceive, and appreciate visual music is hypothesised to rely on the same multisensory processes that support auditory-visual (AV) integration in other contexts. Whilst these mechanisms have been extensively studied, there has been little research on how these processes affect aesthetic judgments (of liking or preference). Studies of synaesthesia in which sound evokes vision and studies of cross-modal biases in non-synaesthetes have revealed non-arbitrary mappings between visual and auditory properties (eg high-pitch sounds being smaller and brighter). In three experiments, we presented members of the general population with animated AV clips derived from synaesthetic experiences and contrasted them with a number of control conditions. The control conditions consisted of the same clips rotated or with the colour changed, random AV pairings, or animated clips generated by non-synaesthetes. Synaesthetic AV animations were generally preferred over the control conditions. The results suggest that non-arbitrary AV mappings, present in the experiences of synaesthetes, can be readily appreciated by others and may underpin our tendency to engage with certain forms of art.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • Ben-Artzi E, Marks L E, 1995 ``Visual ^ auditory interaction in speeded classification: Role of stimulus difference'' Perception & Psychophysics 57 1151 ^ 1162
    • Brougher K, Strick J, Wiseman A, Zilczer J, 2005 Visual Music: Synaesthesia in Art and Music since 1900 (London: Thames & Hudson)
    • Calvert G, Spence C, Stein B E, 2004 The Handbook of Multisensory Processes (Cambridge, MA: MIT Press)
    • Calvert G A, Campbell R, Brammer M J, 2000 ``Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex'' Current Biology 10 649 ^ 657
    • Daily A, Martindale C, Borkum J, 1997 ``Creativity, synaesthesia and physiognomic perception'' Creativity Research Journal 10 1 ^ 8
    • Dehaene S, Bossini S, Giraux P, 1993 ``The mental representation of parity and numerical magnitude'' Journal of Experimental Psychology: General 122 371 ^ 396
    • Fias W, Fischer M H, 2005 ``Spatial representation of number'', in Handbook of Mathematical Cognition Ed. J I D Campbell (New York: Psychology Press)
    • Gallace A, Spence C, 2006 ``Multisensory synesthetic interactions in the speeded classification of visual size'' Perception & Psychophysics 68 1191 ^ 1203
    • Gevers W, Reynvoet B, Fias W, 2003 ``The mental representation of ordinal sequences is spatially organized'' Cognition 87 B87 ^ B95
    • Lewkowicz D, Turkewitz G, 1980 ``Cross-modal equivalence in infancy: Auditory ^ visual intensity matching'' Developmental Psychology 16 597 ^ 607
    • Macaluso E, George N, Dolan R, Spence C, Driver J, 2004 ``Spatial and temporal factors during processing of audiovisual speech: a PET study'' NeuroImage 21 725 ^ 732
    • Marks L, 1987 ``On cross-modal similarity: Auditory ^ visual interactions in speeded discrimination'' Journal of Experimental Psychology: Human Perception and Performance 13 384 ^ 394
    • Marks L E, 1974 ``On associations of light and sound: The mediation of brightness, pitch, and loudness'' American Journal of Psychology 87 173 ^ 188
    • Marks L E, 1975 ``On coloured-hearing synaesthesia: Cross-modal translations of sensory dimensions'' Psychological Bulletin 82 303 ^ 331
    • Marks L E, 1982 ``Bright sneezes and dark coughs, loud sunlight and soft moonlight'' Journal of Experimental Psychology: Human Perception and Performance 8 177 ^ 193
    • Marks L E, 2004 ``Cross-modal interactions in speeded classification'', in The Handbook of Multisensory Processes Eds G Calvert, C Spence, B E Stein (Cambridge, MA: MIT Press)
    • Martino G, Marks L E, 1999 ``Perceptual and linguistic interactions in speeded classification: tests of the semantic coding hypothesis'' Perception 28 903 ^ 923
    • Nelson T M, MacDonald G A, 1971 ``Lateral organization, perceived depth and title preference in pictures'' Perceptual and Motor Skills 33 983 ^ 986
    • Nicholls M E R, Bradshaw J L, Mattingley J B, 1999 ``Free-viewing perceptual asymmetries for the judgment of brightness, numerosity and size'' Neuropsychologia 37 307 ^ 314
    • Olson L R, Gatenby J C, Gore J C, 2002 ``A comparison of bound and unbound audio ^ visual information processing in the human cerebral cortex'' Cognitive Brain Research 14 129 ^ 138
    • Peacock K, 1988 ``Instruments to perform color-music: Two centuries of technological experimentation'' Leonardo 21 397 ^ 406
    • Rusconi E, Kwan B, Giordano B, Umilta¬© C, Butterworth B, 2006 ``Spatial representation of pitch height: the SMARC effect'' Cognition 99 113 ^ 129
    • Shams L, Kamitani Y, Shimojo S, 2000 ``Illusions. What you see is what you hear'' Nature 408 788
    • Simner J, Mulvenna C, Sagiv N, Tsakanikos E, Witherby S A, Fraser C, Scott K, Ward J, 2006 ``Synaesthesia: The prevalence of atypical cross-modal experiences'' Perception 35 1024 ^ 1033
    • Sun J, Perona P, 1998 ``Where is the sun?'' Nature Neuroscience 1 183 ^ 184
    • Ward J, Huckstep B, Tsakanikos E, 2006 ``Sound ^ colour synaesthesia: to what extent does it use cross-modal mechanisms common to us all?'' Cortex 42 264 ^ 280
    • Ward J, Thompson-Lake D, Ely R, Kaminski F, 2008 ``Synaesthesia, creativity and art: What is the link?'' British Journal of Psychology 99 127 ^ 141
    • Willmann R R, 1944 An Experimental Investigation of the Creative Process in Music Psychological Monographs 57, 1
    • Zeki S, 1999 Inner Vision: An Exploration of Art and the Brain (Oxford: Oxford University Press)
  • No related research data.
  • No similar publications.

Share - Bookmark

Download from

Funded by projects

  • WT

Cite this article