Animated screen-based notation and visual representation of sound provide an important solution to visualising a range of musical phenomena and techniques including continuous parametrical changes, synchronisation with prerecorded audio or live processing, and nonlinear formal organisation. The limitations of human visual capabilities, however, place some constraints upon the efficacy of screen-based representation, particularly in regard to notation reading. Findings from sightreading studies exploring the manner in which notation is encoded, processed and executed are examined with the aim of identifying the perceptual and practical boundaries of presenting animated notation on screen. The development of efficient visual representation is proposed as an important requirement for alleviating the issues created by the time constraints of reading on screen. Studies in semantics and cross-modal activation are discussed as a foundation for the expansion of approaches to the visualisation of sound.

Do Desenho e do Som is a software application that creates graphical screen scores in real time. Fascinated by the theoretical discussions concerning improvisation, composition and real-time composition, the author endeavours to conceive an interactive environment to induce controlled improvisation contexts, using real-time scores. Do Desenho e do Som makes use of real-time screen scores to facilitate the communication of formalised musical ideas, which due to their ambiguous graphical nature create an interesting interaction between a composer, an assistant and performers. It also grants a real-time control over form as the notation, and consequently the music, unfolds at runtime. With a focus on the underlying importance of listening, the author based this article on his own experience designing the Do Desenho e do Som software and using it for composition.

This short article presents the author’s ideas about different score formats for instrumental performers of mixed electroacoustic music. Following a trajectory from initial understanding through effective rehearsal and ending in performance, different score formats are discussed. Each is based on and addresses performers’ needs and improves documentation and transmission of the composer’s intentions and the performer’s contribution. The author bases these suggestions on her experience as a performer/commissioner and composer of new mixed electroacoustic works, many of which are collaborative creations.

The ‘comprovisation’ (Dudas 2010) of electroacoustic music in an affective manner through Internet2, using a directed dramaturgy approach, poses unique scoring problems. Building on prior work (Whalley 2009, 2012c), GNMISS (Graphic Networked Music Interactive Scoring System) was developed to address this. The system has four visual layers that illustrate the structure of works, represented on a circle with parts for each player. One layer maps emotions to colours based on associated words as a primary basis for gesture and timbre representation. A second layer gives musical motives and frequency information for participants to follow. A third allows for more detailed indications of gesture and sound archetypes through representative symbols. Finally, an inside layer represents macro key centres. For timing, the circle score turns in clock time with the current playing position always at noon, and a central metronome shows speed independent of clock time. Technically, client programs sit on distributed machines across the Internet, with data being coordinated by an OSC Server. Distributed scores can be built by a composer or by a team, and all content can be altered simultaneously across client machines. Two works are discussed as initial examples of its implementation: Sensai na Chikai and SymbolAct.

This article explores listening and communications strategies that arise with a collaborative scoring system we are developing for use within improvisational contexts. Performers generate notation on a scrolling score a short time before it is played or rendered into sound. Working a short time in the future allows performers to respond to sound as they would in any improvisatory situation, and yet coordinate their activity through notation in a way typically associated with pre-composed music. The ‘Anticipatory Score’ platform supports the exploration of different kinds of relationships between performers, composers and audience members, and different listening and engagement strategies that affect the musical experience for all participants.

Computer code is a form of notational language. It prescribes actions to be carried out by the computer, often by systems called interpreters. When code is used to write music, we are therefore operating with programming language as a relatively new form of musical notation. Music is a time-based art form and the traditional musical score is a linear chronograph with instructions for an interpreter. Here code and traditional notation are somewhat at odds, since code is written as text, without any representational timeline. This can pose problems, for example for a composer who is working on a section in the middle of a long piece, but has to repeatedly run the code from the beginning or make temporary arrangements to solve this difficulty in the compositional process. In short: code does not come with a timeline but is rather the material used for building timelines. This article explores the context of creating linear ‘code scores’ in the area of musical notation. It presents the Threnoscope as an example of a system that implements both representational notation and a prescriptive code score.

Notation is the traditional method for composers to specify detailed relationships between musical events. However, the conventions under which the tradition evolved – controlled relationships between two or more human performers – were intended for situations apart from those found in electroacoustic music. Many composers of electroacoustic music have adopted the tradition for mixed media works that use live performers, and new customs have appeared that address issues in coordinating performers with electroacoustic elements. The author presents generative music as one method of avoiding the fixedness of tape music: coupled with real-time notation for live performers, generative music is described as a continuation of research into expressive performance within electroacoustic music by incorporating instrumentalists rather than synthetic output. Real-time score generation is described as a final goal of a generative system, and two recent works are presented as examples of the difficulties of real-time notation.

The author examines visual design considerations in the development of real-time screen scores. Such scores are shown to lend themselves particularly well to the representation of non-linear musical processes and the articulation of non-linear musical forms. The author argues that the foregrounding of such scores, through their projection for an audience and meticulous design, draws especial attention to the manner in which such non-linear processes are represented and in turn decoded by performers. While the transparency of the decoding process is shown to vary across a wide spectrum, the central role of the notational schema in works such as these is shown to align them in many ways with a broader interface aesthetics, promoting rich fields of creative and artistic enquiry.

This paper looks at microsound – an emergent term, corresponding concept and associated genre of experimental electronica appearing in the late 1990s – which animates the idea of sound as material entity, and, as I will demonstrate, ultimately complicates and expands questions concerning disciplinary boundaries. The conceptualisation of sounds as having mass or as matter, particularly on an imagined ‘atomic’ level as is implicit in microsound, has had many historical antecedents, especially in the twentieth century. However, the comparison, representation and analogy of sound as an object of material composition is a peculiar metaphor as sound has no inherent material substance. At the meeting point of microsound, a wide spectrum of musicians and listeners across genres and subgenres has converged, along with a diverse range of technologies and approaches to those technologies. In what follows, an exploration of the inception and implications of microsound will offer one instructive path that helps elucidate the intertwined relationship between sound art and experimental electronica. Thus, this paper adds to the critical dialogue regarding these complex yet drastically under-theorised fields of creative activity by using microsound to articulate specific points of connection, commonality and divergence.

Sonification has become a commonly used tool for data analysis, auditory feedback and compositional inspiration. It is often described in scientific terms as a means of uncovering previously unknown patterns in information or data through the use of the auditory sense. This goal seems to be objective, but the results and methodologies can be highly subjective. Moreover, the techniques and sources of information are strikingly similar to those used in mysticism, especially mysticisms of negation, even though the frames of reference and underlying perceptions of the world are markedly different. Both practitioners of sonification and apophatic mystics believe that certain types of information are incomprehensible through traditional analytic means and can only be understood through experience. In this way, sonification can be thought of as a source of mystical information.

In this paper, I will discuss the similarities between sonification and apophatic mysticism, or the mysticism of negation. I will argue that the practice of sonification, as a source of mystical information, is ideally suited for creative contemplation, particularly in electronic music. I will start by providing some historical background on the mysticism of negation. I will then present several ways in which sonified knowledge (sound) is often imagined, discussed and perceived akin to a mystical object. Finally, I will discuss specific ways in which sonification exemplifies apophatic mysticism and reveals mystical information. This information – whatever its nature – can be used for creative contemplation and is a potentially invaluable source of compositional and spiritual inspiration.