Audio Developer Conference

Our poster discusses the use of gestural body movement for interaction with music software. While interaction with music software and virtual instruments has traditionally involved using Graphical User Interfaces (GUIs) and/or hardware MIDI controllers, we discuss the unique interactions and interfaces found in recent body movement controllers. Some of these controllers have been designed with the intention of being used in a performance context to provide visualization for an audience of the performer’s actions on the music. Another goal of these controllers is to ensure a high degree of expression during their use. Some of these controllers are used to make music creation more accessible for all people. The idea of body motion based interaction with electronic instruments is far from new, with inventions such as the Theremin existing since 1920. Today, interfaces that allow the use of mid-air body gestures to control music applications continue to become available such as the MI.MU Gloves, Wave MIDI Ring, Xbox Kinect, and the Leap Motion Controller. These interfaces are often accompanied by software tools enabling the user to design their custom gestural interactions with audio parameters.