J. M. Coetzee’s late work exhibits a productive dialogue between fiction and other arts as part of his interest in the possibilities of thinking in mediums other than ordinary language. Focusing particularly on the Jesus novels, this article examines the critical role of music and how Coetzee uses musical forms as literary strategies that open up alternative possibilities of communication and thinking. Revisiting the famous “What is a Classic?” essay and the biographical moment that leads Coetzee to the music of J. S. Bach, I look at how Coetzee writes musically by considering questions of content, form, and technique, and then turn to the representation of music in relation to mathematics. I propose that the interest in music in the Jesus novels is part of his conscious engagement with ordinary language and his inherent desire to transcend it that characterizes the late work.