This is the fourth experiment in a 1-year AHRC Digital Transformations project run jointly between Birmingham Conservatoire’s Integra Lab and Glasgow School of Art’s Digital Design Studios. The project explores new ways of positioning sound in space using touch-free interaction.

In this experiment we use the Microsoft Kinect as a motion capture device, enabling sounds can be dragged from a palette into a virtual 3D environment and moved around using direct physical manipulation.

Additionally, the system provides the capability to draw spatial trajectories with a simple finger movement and to automate the movement of sounds along the trajectories.

This initial experiment was developed in Unity 3D using the 3Dception plugin by TwoBigEars for binaural positioning.

Further details about the project can be found here.