Tag: music

  • The Museum of Imaginary Musical Instruments Gets a Hallway

    Since 2013, Thomas Patteson and I have curated the Museum of Imaginary Musical Instruments online. This year it became a book, published by Reaktion. And now, thanks to the Center for the Arts at Northeastern University, it exists through December as something you can walk through: a showcase on the third floor of Ryder Hall in Boston, home to the Department of Music.

    A hallway in the Museum of Imaginary Musical Instruments, featuring white walls with informational text on one side, several closed doors, and artwork displayed. Soft lighting illuminates the space.

    Instruments that don’t exist hang in a hallway lined with practice rooms and faculty offices. During the installation, the sound of people rehearsing drifted through the doors, real instruments being played a few feet from imaginary ones.

    I love how this juxtaposition resonates with the spirit of the project. As we say on the welcome panel: imaginary instruments are, no less than the ones we play, interfaces between mind and world; they limn the edges of what we can think and do.

    Sign introducing the Museum of Imaginary Musical Instruments, describing the concept and purpose of imaginary instruments.

    The book gathers far more instruments than any hallway could display (well, at least any practical one). The showcase offers a small sample of how imagination works with the stuff of sound and technology. Here’s a tour through it.

    What may have been

    Many imaginary instruments come from asking what may yet come to be. The oldest object in the showcase comes from the opposite question. A tenth-century manuscript from the abbey of Saint Emmeram in Regensburg illustrates the “instruments of St. Jerome,” biblical instruments described in a letter attributed to Jerome but almost certainly written centuries later. Its vague descriptions invited wildly divergent drawings. Some illustrators deliberately avoided any resemblance to known instruments, on the theory that sacred ancient instruments must have had a more spiritual reality.

    St. Jerome manuscript

    Nearby is the “sound houses” passage from Francis Bacon’s New Atlantis (1626), which describes places for producing and studying every kind of sound, alongside Lowell Hess’s 1964 illustration of Bacon’s utopian island. Three centuries after Bacon, electronic musicians adopted his text as prophecy. Daphne Oram, co-founder of the BBC Radiophonic Workshop, posted it on the studio door and then rewrote it for her own vision. Her story, including an instrument design of her own, is one of my favorites in the book.

    An artistic representation of 'New Atlantis', featuring various scenes of a mythical city with intricate buildings, landscapes, and people engaged in different activities, displayed on a wall alongside two informational plaques.

    Johann Gottlob Krüger’s ocular harpsichord (1743) would have played chords of light. Each key plucked a string and opened a colored-glass window, following Newton’s analogy between pitches and colors. Other color instruments were built, but as far as we know, this one never was.

    A collection of historical illustrations displayed on a wall, featuring a detailed scientific diagram, a map titled 'New Atlantic,' and other texts with descriptions.

    Necessary monsters

    No imaginary instrument is more vexing than the cat piano, shown here in Louis Poyet’s 1883 engraving. It turns up again and again from the late 1500s onward, sometimes as a joke about cacophony and sometimes, disturbingly, as a cure for melancholy. Borges’s phrase for the dragon fits it: a “necessary monster.” Why it keeps coming back is one of the questions the book explores.

    Luigi Russolo’s intonarumori went the other way. He actually built at least sixteen noise instruments, with names like the howler, the hisser, and the crackler, but all were lost, along with most of the details of how they worked. An instrument that once existed has become imaginary again, known more as an idea than an object.

    Black and white photograph of individuals using a machine for an unknown purpose, displayed alongside a handwritten blueprint.

    Science fictions, comic and earnest

    In 2011, Moog Music announced the PolyTheremin, with five antennas played finger by finger. It was an April Fools’ joke, believable and impossible in exactly the right proportions, and demonstrated by the very real thereminist Dorit Chrysler.

    PolyTheremin

    The Wiggly Tendrils’ song siphon translates brain activity into songs. It comes from the liner notes of their album The Life, Death and Persistence of Captain Charles Fort. The band are known associates of the museum’s curators, and which came first, the siphon or the museum, remains unclear. (The Wiggly Tendrils played songs from the album at our Rozzie Bound Books event in September.)

    Song siphon sketch

    A darker relative is the “temporal interceptor” from Black Mirror‘s “Rachel, Jack and Ashley Too” (2019). It extracts songs from a comatose pop star’s dreams and transforms her distorted rage into uplifting pop. The machine is imaginary, but the questions it raises about synthesizing an artist’s voice are not. The song siphon and the interceptor belong to a whole family of mind instruments in the book, which stretches from medieval automata to Alice Coltrane’s celestial psaltery.

    A digital display featuring futuristic technology, showcasing waveform graphs and visualizations of brain activity, representing concepts from the series 'Black Mirror.'

    At the edge of the possible

    The last wall stands outside the Music Rehearsal Room. In 1843, Ada Lovelace imagined that Babbage’s engine might compose music, if the relations between sounds could be expressed in numbers. Today text, sound, and image have all become data. Two contemporary works respond to that condition: Jonathan Ulman’s Snare Drums Reimagined (2024) and Hexorcismos’s synthesizer concept Al Filo del Caos (At the Edge of Chaos) (2025). Both test the limits of the possible and ask, what if? The book’s chapter on computational instruments follows that question from combinatorics to the present.

    A collage of four images featuring different snare drums, showcasing their unique designs and textures, displayed on a wall.

    Behind the scenes

    A museum of imaginary instruments still needs a tape measure, a pencil, and a hammer. Many thanks to Evelyn O’Donoghue of the Center for the Arts for her careful work getting everything printed, level and in place.

    A person kneeling and measuring the wall with a ruler to hang artwork in a hallway, wearing a pink striped sweater and a purple headband.

    Things being otherwise

    Imaginary instruments can look like pure whimsy. But they are also serious: to conceive of a technology that doesn’t exist is to shed light on the ones that do, and to insist that things could be otherwise.

    If this hallway sparked your curiosity, there’s more to explore in The Museum of Imaginary Musical Instruments, available to order wherever books are sold, and at our upcoming events in New York City (October 14), Chicago (November 13) and beyond (see our website for the full schedule).

    The showcase is on view on the third floor of Ryder Hall, Northeastern University in Boston, through December.

  • Spawn Songs: How AIs Find Their Voices

    If you, like me, follow news about AI in music, you’ve probably seen an image like this:

    AI_Electronic_Beats
    Source

    Or this:

    ai-music-01
    Source

    No humans here. Just AI, in robotic form, ready to take full control of the creative tasks of producer and composer. In fact, images intimating such a future have been circulating since the early 20th century. Compare the following image from 1930, from a campaign by a musicians’ union against the substitution of recorded music for live musicians in theaters:

    deathofmusic robot_at_the_helm

    It’s easy retrospectively to laugh at worries that mechanical reproduction would bring the destruction of art. But we should not be so blasé as to think that it all turned out ok. Yes, the substitution of recorded music for live musicians in theaters threatened the livelihood of countless instrumentalists across the nation. But the representation of recorded music as a robot wresting control of musical culture ignored the many people and new kinds of creative labor involved in producing recorded music. We are left to wonder “what if”: what if the energy poured into a simplified, sensationalist image of mechanical substitution had instead been directed to fueling a more robust public discourse about recording’s new configurations of people and tools, and their implications for musical authorship, ownership, and compensation? Perhaps what some now regard as among the greatest injustices in the history of recorded music – the shadow status of session musicians whose creative contributions were integral to the iconic sound of hit songs, for instance, or the infamous Bridgeport Music, Inc. v. Dimension Films 2005 blanket ruling against unlicensed sampling, which failed to fathom the creative labor of hip hop musicians – might have played out differently.

    Similarly, today’s robot representations do not capture the realities of AI. As Mary Gray and Siddharth Suri demonstrate in their new book Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass, the AI systems in our lives depend on many largely hidden human workers. Think of search engine results, social media feeds, recommender systems – these “rely on a shared pool of on-demand workers amassed by on-demand platforms” (xvii), and these on-demand platforms “allow humans to power many of the websites, apps, online services, and algorithms most consumers think are automated” (170). By selling their services as powered by the magic of AI, companies (and the media hype surrounding them) conceal an underlying dynamic: that as we ask AI to do more, we are generating “new needs and different types of human labor to fill those needs” (xviii).

    Recognizing the human labor involved in AI systems, the “humans in the loop” as Gray and Suri put it, calls for fundamentally reimagining what AI is – conjuring not autonomous robots that eliminate humans from the picture, but rather networked systems in which people play a constant, dynamic, essential part. It calls, in other words, for changing the image of AI in popular consciousness.

    Re-enter music. Although music has long been shadowed by fears of robot take-over, musicians are also adept at taking in the world around them and reflecting it back in ways that can wake us up to new (and old) realities, helping us apprehend our world differently not just at intellectual but also at emotional, visceral levels.

    This past summer, Holly Herndon released PROTO, an album made in collaboration with other human musicians and Spawn, her name for a collection of vocal models created using machine learning techniques. Herndon also calls Spawn her “AI baby,” and the use of AI in creating the album has driven its media coverage. But Herndon’s work resists reduction to “now AI can compose music too!”-style headlines. When asked by Jezebel’s Hazel Cills how to think about the people behind AI, Herndon responded:

    That’s one of the biggest problems of AI; it’s this kind of opaque, black box technology, and when we have this glossy press release where it’s like “the machine just wrote this song” you’re totally discounting all the human labor that went into the training set that the thing learns on. That was a really important part of how we set up the project and the way that we did. We wanted the people training Spawn to be visible, to be audible, to be named, to be compensated, because I think that’s a huge part of what we’re facing with this thing today.

    The track “Evening Shades (Live Training)” illustrates this desire for public recognition of the people and labor required to make Spawn work. Through the alternation of a full-voiced human choir with Spawn’s oddly filtered and stuttering efforts to repeat back the same phrase, the track makes audible some of the process – some of the human labor – involved in training Spawn to “sing”:

    Rather than picture AI as a robot, then, listening to PROTO can help us imagine AI as a gathering of people and machines – a collective endeavor in which many humans work together with algorithmic systems. What if we were to start our discussions of AI from such an understanding – might we better grapple with the implications for authorship, ownership, compensation, with how to recognize and value the many “humans in the loop?” What if…?

     

    Further reading:

    David Turner, “AI isn’t going to replace your favorite band,” Penny Fractions newsletter, November 6 2019.

    Cherie Hu, “Slave to the ‘rithm? Not so fast: Everything you need to know about the deal between Endel and Warner Music,” Water & Music newsletter, March 25 2019.

    Melissa Avdeeff, “Artificial Intelligence & Popular Music: SKYGGE, Flow Machines, and the Audio Uncanny Valley,” Arts 8/4 (2019).