For this project, I created an audio reactive visualisation in TouchDesigner based on Ambisonics, a format for spatial audio that represents sound around the listener in a full 3D sphere. The goal was to transform the spatial audio data into a visual experience.
I created a 3D environment containing 426 spheres positioned around the viewer. Each sphere reacts to the incoming audio data by scaling with the volume at its corresponding position in the spatial sound field. This creates a constantly moving visual representation of where the sound is coming from and how intense it is. In the center of the visualisation, I added a dancing 3D alien that also reacts to the music by scaling with the incoming audio data. Combined with the surrounding spheres, this creates an energetic and visually engaging experience that could work well as a visual for indoor music events.
For testing, I used Reaper together with the IEM EnergyVisualizerGrid plugin to generate and send spatial audio data to TouchDesigner. The plugin calculates RMS values for 426 points distributed across the 3D sound sphere and sends this data to TouchDesigner through OSC. I built the technical pipeline to receive and process this data in real time before using it to control the visual elements.
This project allowed me to combine spatial audio, real-time data processing, TouchDesigner and creative visual development. It gave me experience with OSC communication and working with live audio data to create an interactive visual experience that directly responds to the spatial characteristics of music.
I created a 3D environment containing 426 spheres positioned around the viewer. Each sphere reacts to the incoming audio data by scaling with the volume at its corresponding position in the spatial sound field. This creates a constantly moving visual representation of where the sound is coming from and how intense it is. In the center of the visualisation, I added a dancing 3D alien that also reacts to the music by scaling with the incoming audio data. Combined with the surrounding spheres, this creates an energetic and visually engaging experience that could work well as a visual for indoor music events.
For testing, I used Reaper together with the IEM EnergyVisualizerGrid plugin to generate and send spatial audio data to TouchDesigner. The plugin calculates RMS values for 426 points distributed across the 3D sound sphere and sends this data to TouchDesigner through OSC. I built the technical pipeline to receive and process this data in real time before using it to control the visual elements.
This project allowed me to combine spatial audio, real-time data processing, TouchDesigner and creative visual development. It gave me experience with OSC communication and working with live audio data to create an interactive visual experience that directly responds to the spatial characteristics of music.