Hostname: page-component-586b7cd67f-t7fkt Total loading time: 0 Render date: 2024-11-29T07:38:41.601Z Has data issue: false hasContentIssue false
  • English
  • Français

Organised Sound, Mental Imageries and the Future of Music Technology: a neuroscience outlook*

Published online by Cambridge University Press:  11 March 2010

Eduardo Reck Miranda
Eduardo Reck Miranda*
Affiliation:
Interdisciplinary Centre for Computer Music Research (ICCMR), Faculty of Arts, University of Plymouth, Plymouth PL4 8AA, UK
*
E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

The prospect of being able to gain a better understanding of how the brain processes music is very exciting for musicians and developers of music technology. Composers would certainly welcome the possibility of being able to predict more objectively the effect of particular musical configurations on their audiences. Furthermore, new music technologies are bound to emerge from such understanding. Despite an impressive amount of ongoing research into the neuroscience of music, progress in this field still remains largely uncharted for musicians and unexplored by developers of technology: the literature is complex and difficult to disentangle. This paper is an attempt to chart the field for the readership of this journal. It articulates a working hypothesis for the neural basis of mental imageries elicited by music, based on the notion that such imageries are by-products of the inherent abstracting and predicting properties of the brain. It is argued that such mental imageries are scaffolds for music perception. The paper also speculates on the impact that a better understanding of the musical brain may have on the development of future technology for electroacoustic music, which may include the development of new analysis tools such as the olivogram and the thalamogram.

Type
Articles
Information
Organised Sound , Volume 15 , Issue 1: Sonic imagery , April 2010 , pp. 13 - 25
Copyright
Copyright © Cambridge University Press 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

The author is thankful to Dr Simon Durrant for the fMRI images used in figure 1 and for his insights into the auditory pathways, which contributed to the difficult task of summarising their functioning in this paper. The author acknowledges the funding support of EPSRC for the project ‘Learning the Structure of Music’, grant EP/D0629341. The author thanks Elsevier for granting permission to reproduce the image of the brain in figure 2.

References

Altenmüller, E. O. 2003. How Many Music Centres Are in the Brain?. In I. Peretz and R. Zatorre (eds.) The Cognitive Neuroscience of Music. Oxford: Oxford University Press, 346–353.CrossRefGoogle Scholar
Arnott, S. R., Grady, C. L., Hevenor, S. J., Graham, S., Alain, C. 2005. The Functional Organization of Auditory Working Memory as Revealed by fMRI. Journal of Cognitive Neuroscience 17(5): 819–883.CrossRefGoogle ScholarPubMed
Avanzini, G., Lopez, L., Koelsch, S., Majno, M. (eds.) 2005. The Neurosciences of Music II: From Perception to Performance. Annals of the New York Academy of Sciences, Vol. 1060. New York: The New York Academy of Sciences.Google Scholar
Barnes, R., Jones, M. R.. 2000. Expectancy, Attention, and Time. Cognitive Psychology 41: 254–311.Google Scholar
Bear, M. K., Connors, B. W., Paradiso, M. A. 2001. Neuroscience: Exploring the Brain (2nd ed.) Baltimore, MD: Lippincott Williams Wilkins.Google Scholar
Besson, M., Schön, D. 2003. Comparison Between Language and Music. In I. Peretz and R. Zatorre (eds.) The Cognitive Neuroscience of Music. Oxford: Oxford University Press, 269–293.CrossRefGoogle Scholar
Binder, J. R., Desai, R. H., Graves, W. W., Conant, L. L. 2009. Where Is the Semantic System? A Critical Review and Meta-Analysis of 120 Functional Neuroimaging Studies. Cerebral Cortex 19(12): 2767–2796.CrossRefGoogle ScholarPubMed
Bressler, S. L. 2000. The Dynamic Manifestation of Cognitive Structures in the Cerebral Cortex. In A. Riegler, M. Peschl and A. von Stein (eds.) Understanding Representation in the Cognitive Sciences: Does Representation Need Reality?, Part 4, New York: Springer US, 121–216.Google Scholar
Brust, J. C. M. 2003. Music and the Neurologist: A Historical Perspective. In I. Peretz and R. Zatorre (eds.) The Cognitive Neuroscience of Music. Oxford: Oxford University Press, 181–191.Google Scholar
Carter, C. S., Mintun, M., Nichols, T., Cohen, J. D. 1997. Anterior Cingulate Gyrus Dysfunction and Selective Attention Deficits in Schizophrenia: [15O]H2O PET Study During Single-Trial Stroop Task Performance. The American Journal of Psychiatry 154: 1670–1675.CrossRefGoogle ScholarPubMed
Cooper, N. P., Jr.Guinan, J. J. 2003. Separate Mechanical Processes Underlie Fast and Slow Effects of Medial Olivocochlear Efferent Activity. The Journal of Physiology 548: 307–312.CrossRefGoogle ScholarPubMed
Damasio, A. 2001. Some Notes on Brain, Imagination and Creativity. In K. H. Pfenninger and V. R. Sjubik (eds.) The Origins of Creativity. New York: Oxford University Press, 59–68.Google Scholar
Drake, C., Jones, M. R., Baruch, C. 2000. The Development of Rhythmic Attending in Auditory Sequences: Attunement, Referent Period, Focal Attending. Cognition 77: 251–288.CrossRefGoogle ScholarPubMed
Durrant, S., Hardoon, D., Miranda, E. R., Shawe-Taylor, J., Brechmann, A., Scheich, H. 2007. Neural Correlated of Tonality in Music. Proceedings of NIPS Workshop on Music, Brain and Cognition. Whistler, Canada, http://web.mac.com/davidrh/MBCworkshop07/Workshop.html (accessed on 27 July 2009).Google Scholar
Durrant, S., Hardoon, D., Brechmann, A., Shawe-Taylor, J., Miranda, E. R., Scheich, H. 2009. GLM and SVM Analyses of Neural Response to Tonal and Atonal Stimuli: New Techniques and a Comparison. Connection Science 21(2–3): 161–175.CrossRefGoogle Scholar
Elfgren, C., van Westen, D., Passant, U., Larsson, E.-M., Mannfolk, P., Fransson, P. 2006. fMRI Activity in the Medial Temporal Lobe during Famous Face Processing. NeuroImage 30(2): 6090–6616.Google Scholar
Emmerson, S. 2007. Living Electronic Music. Aldershot: Ashgate.Google Scholar
Fabbro, F., Moretti, R., Bava, A. 2000. Language Impairments in Patients with Cerebellar Lesions. Journal of Neurolinguistics 13(203): 173–188.Google Scholar
Fodor, J. A. 1988. The Modularity of Mind: An Essay on Faculty Psychology. Cambridge, MA: The MIT Press.Google Scholar
Gimenes, M., Miranda, E. R. forthcoming. An Ontomemetic Approach to Musical Intelligence. In E. R. Miranda (ed.) A-Life for Music: Music and Computer Models of Living Systems. Middleton: A-R Editions.Google Scholar
Godoy, R. I., Jorgensen, H (eds.) 2001. Musical Imagery. Milton Park: Routledge.Google Scholar
Griffiths, T. D. 2003. The Neural Processing of Complex Sounds. In I. Peretz and R. Zatorre (eds.) The Cognitive Neuroscience of Music. Oxford: Oxford University Press, 168–177.CrossRefGoogle Scholar
Griffiths, T., Büchel, C., Frackowiack, R. S. J., Patterson, R. D. 1998. Analysis of Temporal Structure in Sound in the Brain. Nature Neuroscience 1: 422–427.CrossRefGoogle Scholar
Halpern, A. 2003. Cerebral Substrates of Musical Imagery. In I. Peretz and R. Zatorre (eds.) The Cognitive Neuroscience of Music. Oxford: Oxford University Press, 217–230.CrossRefGoogle Scholar
Hampe, B., Grady, J. E (eds.) 2005. From Perception to Meaning: Image Schemas in Cognitive Linguistics. Berlin: Walter de Gruyter & Co.CrossRefGoogle Scholar
Hannon, E. E., Snyder, J. S., Eerola, T., Krumhansl, C. L. 2004. The Role of Melodic and Temporal Cues in Perceiving Musical Meter. Journal of Experimental Psychology: Human Perception and Performance 30(5): 956–974.Google Scholar
Hodges, D. A., Hairston, W. D., Burdette, J. H. 2005. Aspects of Multisensory Perception. Annals of the New York Academy of Sciences 1060: 175–185.Google Scholar
Huron, D. 2006. Sweet Anticipation: Music and the Psychology of Expectation. Cambridge, MA: The MIT Press.Google Scholar
Jones, M. R., Yee, W. 1997. Sensitivity to Time Change: The Role of Context and Skill. Journal of Experimental Psychology: Human Perception and Performance 23: 693–709.Google Scholar
Jones, M. R., Moynihan, H., MacKenzie, N., Puente, J. 2002. Temporal Aspects of Stimulus-Driven Attending in Dynamic Arrays. Psychological Science 13: 313–1319.Google Scholar
Jung-Beeman, M., Bowden, E. M., Haberman, J., Frymiare, J. L., Arambel-Liu, S., Greenblatt, R., Reber, P. J., Kounios, J. 2004. Neural Activity When People Solve Verbal Problems with Insight. PLoS Biol 2(4): e97. doi:10.1371/journal.pbio.0020097.CrossRefGoogle ScholarPubMed
Jusczyk, P. W., Krumhansl, C. L. 1993. Pitch and Rhythmic Patterns Affecting Infants’ Sensitivity to Musical Phrase Structure. Journal of Experimental Psychology: Human Perception and Performance 19(3): 627–640.Google Scholar
Klein, J. M., Jones, M. R. 1996. Effects of Attentional Set and Rhythmic Complexity on Attending. Perception & Psychophysics 58: 34–46.Google Scholar
Koelsch, S., Siebel, W. A. 2005. Towards a Neural Basis of Music Perception. Trends in Cognitive Science 9(12): 578–584.Google Scholar
Landy, L. 2007. The Art of Sound Organisation. Cambridge, MA: The MIT Press.Google Scholar
Limb, C. J., Kemeny, S., Ortigoza, E. B., Rouhani, S., Braun, A. R. 2006. Left Hemispheric Lateralization of Brain Activity during Passive Rhythm Perception in Musicians. The Anatomical Record. Part A, Discoveries in Molecular, Cellular, and Evolutionary Biology 288(4): 382–389.Google Scholar
Miranda, E. R. 2006. Brain–Computer Music Interface for Composition and Performance. International Journal on Disability and Human Development 5(2): 119–125.Google Scholar
Miranda, E. R., Matthias, J. 2009. Music Neurotechnology for Sound Synthesis: Sound Synthesis with Spiking Neuronal Networks. Leonardo 42(5): 439–442.Google Scholar
Miranda, E. R., Overy, K. 2009. Preface: The Neuroscience of Music. Contemporary Music Review 28(3): 1–4.CrossRefGoogle Scholar
Miranda, E. R., Bull, L., Gueguen, F., Uroukov, I. S. 2009. Computer Music Meets Unconventional Computing: Towards Sound Synthesis with In Vitro Neuronal Networks. Computer Music Journal 33(1): 9–18.Google Scholar
Nolte, J., Jr.Angevine, J. B. 2007. The Human Brain in Photographs and Diagrams. Philadelpha, PA: Elsevier.Google Scholar
Palmer, C., Krumhansl, C. L. 1987. Independent Temporal and Pitch Structures in Determination of Musical Phrases. Journal of Experimental Psychology: Human Perception and Performance 13: 116–126.Google ScholarPubMed
Parsons, L. M. 2003. Exploring the Functional Neuroanatomy of Music Performance, Perception and Comprehension. In I. Peretz and R. Zatorre (eds.) The Cognitive Neuroscience of Music. Oxford: Oxford University Press, 247–268.CrossRefGoogle Scholar
Parsons, L. M. 2005. Exploring the Functional Neuroanatomy of Music Performance, Perception and Comprehension. Annals of the New York Academy of Sciences 930: 211–231.Google Scholar
Patterson, R. D., Upperkamp, S., Johnsrude, I. S., Griffiths, T. 2002. The Processing of Temporal Pitch and Melody Information in Auditory Cortex. Neuron 36: 767–776.CrossRefGoogle ScholarPubMed
Paulus, M. P., Rogalsky, C., Simmons, A., Feinstein, J. S., Stein, M. B. 2003. Increased Activation in the Right Insula during Risk-taking Decision Making is Related to Harm Avoidance and Neuroticism. NeuroImage 19(4): 1439–1448.CrossRefGoogle ScholarPubMed
Peretz, I. 1990. Processing of Local and Global Musical Information by Unilateral Brain-damaged Patients. Brain 113: 1185–1205.CrossRefGoogle ScholarPubMed
Peretz, I. 2003. Brain Specialisation for Music: New Evidence from Congenital Amusia. In I. Peretz and R. Zatorre (eds.) The Cognitive Neuroscience of Music. Oxford: Oxford University Press, 192–203.Google Scholar
Peretz, I., Coltheart, M. 2003. Modularity of music processing. Nature Neuroscience 6(7): 688–691.CrossRefGoogle ScholarPubMed
Peretz, I., Morais, J. 1989. Music and Modularity. Contemporary Music Review 4: 277–291.CrossRefGoogle Scholar
Peretz, I., Zatorre, R. 2003. The Cognitive Neuroscience of Music. Oxford: Oxford University Press.Google Scholar
Pineda, J. A. 2008. Sensorimotor Cortex as a Critical Component of an ‘Extended’ Mirror Neuron System: Does it Solve the Development, Correspondence, and Control Problems in Mirroring? Behavioral and Brain Functions 4(47), doi:10.1186/1744-9081-4-47.CrossRefGoogle ScholarPubMed
Ratey, J. 2001. A User’s Guide to the Brain. London: Little, Brown and Company.Google Scholar
Ross, E. D., Mesulam, M. M. 1979. Dominant Language Functions of the Right Hemisphere? Prosody and Emotional Gesturing. Archives of Neurology 36: 144–148.Google Scholar
Schofield, B. R., Cant, N. B. 1999. Descending Auditory Pathways: Projections from the Inferior Colliculus Contact Superior Olivary Cells that Project Bilaterally to the Cochlear Nuclei. Journal of Computational Neurology 409(2): 210–223.3.0.CO;2-A>CrossRefGoogle Scholar
Shah, S. G., Klumpp, H., Angstadt, M., Nathan, P. J., Phan, K. L. 2009. Amygdala and Insula Response to Emotional Images in Patients with Generalized Social Anxiety Disorder. Journal of Psychiatry and Neuroscience 34(4): 296–302.Google Scholar
Shore, S. E., Godfrey, D. A., Helfert, R. H., Altschuler, R. A., Jr.Bledsoe, S. C. 1992. Connection between the Cochlea Nuclei in the Guinea Pig. Hearing Research 62: 16–26.Google Scholar
Sloboda, J. 2005. Exploring the Musical Mind. Oxford: Oxford University Press.Google Scholar
Smalley, D. 1997. Spectromorphology: Explaining Sound-Shapes. Organised Sound 2(2): 107–126.CrossRefGoogle Scholar
Stewart, L., Overath, T., Warren, J. D., Foxton, J. M., Griffiths, T. D. 2008. fMRI Evidence for a Cortical Hierarchy of Pitch Pattern Processing. PLoS ONE 3(1): e1470. doi:10.1371/journal.pone.0001470.Google Scholar
Stroh, C. 1983. A Brief Primer on Vision and Human Perception. Arts Education 36(4): 44–45.CrossRefGoogle Scholar
Stroop, J. R. 1935. Studies of Interference in Serial Verbal Reactions. Journal of Experimental Psychology 18: 643–662.CrossRefGoogle Scholar
Temperley, D. 2001. The Cognition of Basic Musical Structures. Cambridge, MA: The MIT Press.Google Scholar
Willems, R. M., Ozyürek, A., Hagoort, P. 2009. Differential Roles for Left Inferior Frontal and Superior Temporal Cortex in Multimodal Integration of Action and Language. NeuroImage 47(4): 1992–2004.CrossRefGoogle ScholarPubMed
Worden, F. G. 1971. Hearing and the Neural Detection of Acoustic Patterns. Behavioural Neuroscience 16: 20–30.Google ScholarPubMed
Yee, W., Holleran, S., Jones, M. 1994. Sensitivity to Event Timing in Regular and Irregular Sequences: Influences of Musical Skill. Perception & Psychophysics 56: 461–471.Google Scholar
Zatorre, R., Peretz, I. (eds.) 2001. The Biological Foundations of Music. Annals of the New York Academy of Sciences, Vol. 930. New York: The New York Academy of Sciences.Google Scholar