We are immersed in a wonderful cacophony of sound. Sustained and intermittent pings, cracks, burrs, plops and tingles jostle for position in our heads. High-pitched delicate cascades contrast starkly with deep thunder like rumbles that seem to permeate our entire bodies. We are exploring a fragmenting fault zone from the inside, a dynamic geological process brought to our ears through sonification and science–art collaboration: the interactive sound art installation Aftershock. Aftershock (2011) is the result of the collaboration between composer Natasha Barrett, associate professor of geosciences Karen Mair and the Norwegian Centre for the Physics of Geological Processes (PGP) at the University of Oslo. In this paper we discuss how a scientist and an artist collaborated through sonification, the artistic results of this approach and how new compositional methods and aesthetical frameworks emerged.

Alvin Lucier's Music for Solo Performer (1965), often referred to as the ‘brain wave piece’, has become a key work of experimental music. Its setup, in which the brain waves of a solo performer are made to excite percussion instruments, has given the work a central place in the discourse on artistic sonification. However, only a small number of the authors making reference to the work seem to have studied the score, and even fewer have given thought to the score's implications for performance practice and aesthetic reflection. This paper pays detailed attention to these yet overlooked aspects, drawing on accounts of early performances as well as the authors’ participation in a 2012 performance led by the composer. We also trace the history of live-electronic equipment used for Music for Solo Performer and discuss the work's reception in sonification research.

Sonification is described as an under-utilised dimension of the ‘wow!’ factor in science engagement multi-media. It is suggested that sonification's potential value, like much of the scientific visualisation content, probably lies less in hard facts and more in how it may serve as a stimulant for curiosity. Sound is described as a multi-dimensional phenomenon, and a number of approaches to creating sonifications are reviewed. Design strategies are described for five types of phenomena that were sonified for works created by cosmologist George Smoot III and percussionist/ethnomusicologist Mickey Hart, most particularly for their film Rhythms of the Universe (Hart and Smoot 2013).

The desire to make data accessible through the sense of listening has led to ongoing research in the fields of sonification and auditory display since the early 1990s. Coming from the disciplines of computer sciences and human computer interface (HCI), the conceptualisation of sonification has been mostly driven by application areas and methods. On the other hand, the sonic arts, which have always participated in the auditory display community, have a genuine focus on sound. Despite these close interdisciplinary relationships between communities of sound practitioners, a rich and sound- or listening-centred concept of sonification is still missing for design guidelines. Complementary to the useful organisation by fields of application, a proper conceptual framework for sound needs to be abstracted from applications and also to some degree from tasks, as both are not directly related to sound. As an initial approach to recasting the thinking about sonification, we propose a conceptualisation of sonifications along two poles in which sound serves either a normative or a descriptive purpose. According to these two poles, design guidelines can be developed proper to display purposes and listening modes.

Parameter mapping sonification is the most widely used technique for representing multi-dimensional data in sound. However, it is known to be unreliable when used for detecting information in some types of data. This is generally thought to be the result of the co-dependency of the psychoacoustic dimensions used in the mapping.

Positing its perceptual basis in a theory of embodied cognition, the most common approach to overcoming this limitation involves techniques that afford the interactive exploration of the data using gross body gestures. In some circumstances, such exploration is not possible and, even when it is, it may be neither necessary nor sufficient.

This article explores some other possible reasons for the unreliability of parameter mapping sonification and, drawing from the experience of expressive musical performance, suggests that the problem lies not in the parametric approach per se, nor in the lack of interactivity, but in the extent to which the parameters employed contribute to coherent gestalts. A method for how this might be achieved that relies on the use of micro-gestural information is proposed. While this is speculative, the use of such gestural inflections is well known in music performance, is supported by findings in neuroscience and lends itself to empirical testing.

Emotion is a word not often heard in sonification, though advances in affective computing make the data type imminent. At times the relationship between emotion and sonification has been contentious due to an implied overlap with music. This paper clarifies the relationship, demonstrating how it can be mutually beneficial. After identifying contexts favourable to auditory display of emotion, and the utility of its development to research in musical emotion, the current state of the field is addressed, reiterating the necessary conditions for sound to qualify as a sonification of emotion. With this framework, strategies for display are presented that use acoustic and structural cues designed to target select auditory-cognitive mechanisms of musical emotion. Two sonifications are then described using these strategies to convey arousal and valence though differing in design methodology: one designed ecologically, the other computationally. Each model is sampled at 15-second intervals at 49 evenly distributed points on the AV space, and evaluated using a publically available tool for computational music emotion recognition. The computational design performed 65 times better in this test, but the ecological design is argued to be more useful for emotional communication. Conscious of these limitations, computational design and evaluation is supported for future development.

Aesthetics are gaining increasing recognition as an important topic in auditory display. This article looks to embodied cognition to provide an aesthetic framework for auditory display design. It calls for a serious rethinking of the relationship between aesthetics and meaning-making in order to tackle the mapping problem which has resulted from historically positivistic and disembodied approaches within the field. Arguments for an embodied aesthetic framework are presented. An early example is considered and suggestions for further research on the road to an embodied aesthetics are proposed. Finally a closing discussion considers the merits of this approach to solving the mapping problem and designing more intuitively meaningful auditory displays.

The author's Construction in Self (2009) belongs to the interdisciplinary context of auditory display/music. Its use of data at audio rate could be described as both audification and non-standard synthesis. The possibilities of audio-rate data use and the relation between the above descriptions are explored, and then used to develop a conceptual and theoretical basis of the work.

Vickers and Hogg's term ‘indexicality’ is used to contrast audio with control rate. The conceptual implications of its use within the digital medium and the possibility for the formation of higher-order structures are discussed. Grond and Hermann's notion of ‘familiarity’ is used to illustrate the difference between audification and non-standard synthesis, and the contexts of auditory display and music respectively. Familiarity is given as being determined by Dombois and Eckel's categories of data. Kubisch's Electrical Walks, Xenakis's GENDYN and the audification of seismograms are used as examples. Bogost's concept of the alien is introduced, and its relevance to the New Aesthetic and Algorave are discussed. Sound examples from Construction in Self are used to demonstrate the varying levels of familiarity or noise possible and suggested as providing a way of bridging the divide between institutional and underground electronic music.

This essay elaborates a field of general aesthetic considerations relevant to the sonification of data. A set of dialectical tropes are introduced to define the possibility space for organised sonified data: data-in-itself and the listener-for-itself; cognitive support and sabotage; and the Peircean triad of rheme–dicisign–argument. Taken together, these three dialectical parameters elaborate a conceptual space in which strategies can be sought for mapping acoustic parameters to data features, data structure and sonic transformations, all with respect to listener reception. A work-in-progress is discussed in connection with this general aesthetic field, and considerations of the aesthetic space are applied to several works. Finally, the notion of data verité is explored in connection to ‘big data’ and issues related to the transformation of data into information generally.