The idea of Sounding Letters is to use the initial letters of Ars Electronica Futurelab and Ars Electronica Center as a musical theme and to compose a piece of music based on this theme by using an AI system. Both the Ars Electronica Futurelab and the Ars Electronica Center celebrated their 25th anniversaries in 2021.
The representation is based on the following idea: Notes in music can be represented as letters. Eight letters A to G are used for this purpose. A C-major scale, for example, is represented as C, D, E, F, G, A, B. Each letter corresponds to a note that can occur in different octaves. In the case of the Ars Electronica Futurelab the musical theme consists of A-E-F and in the case of the Ars Electronica Center the theme is: A-E-C.
Sounding Letters photo: Robert Bauernhansl
Sounding Letters
Sounding Letters photo: Denise Hirtenfelder
Ricercar Image: Ali Nikrang
From a musical point of view, an interesting aspect of these themes is that all the notes belong to the same or similar chords (e.g A-min, F-maj, F-maj7 or A-min6) and thus all the letters harmonize in any combination. In the history of music, several examples can be found in which composers use this notation to represent words, names, initial letters or even messages in their music and to “encrypt” a message in their music. Apparently, the representation is limited to only eight letters (or nine in the German system) and cannot be used in many cases.
We fed these musical themes into Ricercar, an AI-based music composition system being developed at the Ars Electronica Futurelab, and used it to compose several pieces of music. We selected one of the pieces as a musical baseline that was performed at the Ars Electronica Festival 2021 together with human musicians.
Demo: Sounding Letters — Visualized AI/Human composed piano performance
Not only this composition is thus created in close collaboration between human and machine. Also the result is performed by the artist in a joint performance together with a Steinway & Sons Spirio self-playing piano.
Credits
Ali Nikrang
Sounding Letters ist ein Gewinnerprojekt der Ars Electronica Futurelab Ideas Expedition 2021