Description

Our Transforming Transformation project seeks to explore new approaches to sound synthesis and transformation within immersive environments.

The first phase of this is ‘Transforming Transformation: 3D Models for Interactive Sound Design’, an AHRC-funded project in collaboration with Glasgow School of Art’s Digital Design Studios and Two Big Ears.

The project opens up a new field of music technology research by exploring human-centred approaches to creative sound design. The project will involve the development of a proof-of-concept system, which enables sound to be manipulated through hand movements as if it were an invisible 3D object. The interaction will be enhanced by real-time visualisation within a virtual 3D space. The research surfaces the notion of a ‘natural’ interface for sound design taking account of already learned behaviour and innate skills such as motor memory, gesture and spatial awareness. The aim is to enable musicians and sound designers to ‘think in sound’ when working with technology, catalysing a shift from technology-centric to human-centric models.

As a pilot project, we will concentrate on one specific audio processing technique: sound spatialisation, with a view to later amplifying our research findings in a larger project, addressing a wider range of sound design practices. In simple terms: our system will explore the idea that we can make users feel as if they are directly positioning sound in space by ‘picking it up and moving it’ with their hands, with the aim of serving as an exemplar for future, more detailed studies.

Sound design entails the manipulation of sound for dramatic, realistic, musical, or emotional effect. Typically, audio is processed using techniques such as filtering, time-stretching, pitch shifting, granulation, attenuation and panning. These techniques are exposed to the sound designer through discrete controls such as ‘sliders’ and ‘dials’ each of which controls a single parameter in the underlying signal processing system. By contrast, human concepts of sound are characterised by polymorphous, perceptual, metaphorical, symbolic and onomatopoeic associations. Many of these associations are cross-sensory, for example: ‘warm’, ‘bright’, ‘distant’, ‘metallic’. Furthermore, they suggest physicality and invite the possibility of direct quasi-tactile manipulation. This is especially true of spatialisation, where there exists a sense of sound localisation within an acoustic space, further evoking the idea of tangibility: ‘moving’ or ‘placing’ a sound, or even ‘pushing’ a sound to provide inertia in a given direction.

Our research therefore challenges existing sound design models and explores the notion of a ‘natural’ and direct corporeal link between imagined sound and acoustic results. In order to achieve this, we will draw upon the immense benefits offered by the PI’s research lab within a leading music Conservatoire. Being based within a Conservatoire environment, provides the project with immediate and unfettered access to high-quality musicians from a range of backgrounds. This serves to ground the research firmly in artistic practice, allowing artistic ideas to both test extant models and serve as the basis for new ones. Formal user experience reviews will be undertaken at milestone stages in the project allowing us to surface users’ tacit views and opinions on their experience when using the developed system.

The research method will also entail the commissioning of a new musical work utilising the system, to be premiered in a public workshop and concert in the final month of the project. This will serve as both an opportunity for testing in a ‘real world’ creative scenario and a means of disseminating the projects outputs in a public forum. There will also be a mid-project ‘experimental jam’ using the in-development system, which will be broadcast live on the internet.

Funding

Related Posts

MiXD website now online

May 3rd, 2016|

As part of the final phase of our AHRC Digital Transformations we're organising a national symposium on Music Interaction Design (MiXD). At the symposium we [...]

MiXD videos now available

April 25th, 2016|

https://www.youtube.com/watch?v=Xq-_CChlufc&list=PL7E6VwpzpQbn7-ueF8wFBN9Idnf-P8nF_ The videos from our MiXD symposium are now available via the following link. The symposium was huge success and featured a presentation of [...]

ICLI Paper accepted

April 18th, 2016|

Our paper titled 'Approaches to Visualising the Spatial Position of Sound-objects' has been accepted for publication as a paper and demo at the International Conference [...]

esthesis: performance at MiXD

March 17th, 2016|

https://www.youtube.com/watch?v=dBRzhuQ3W5w As part of our AHRC Digital Transformations project "Transforming Transformation" we commissioned a new artistic work to explore the concept of transforming sound through [...]

EVA paper accepted

February 25th, 2016|

Our paper titled 'Approaches to Visualising the Spatial Position of Sound-objects' has been accepted for publication as a paper and demo at EVA London 2016. [...]

Transforming Transformation Experiment 4

January 25th, 2016|

https://vimeo.com/album/3830936/video/152990816 This is the fourth experiment in a 1-year AHRC Digital Transformations project run jointly between Birmingham Conservatoire’s Integra Lab and Glasgow School of [...]

Adding vibrotactile feedback

January 20th, 2016|

One of the findings from our first round of tests for the system we have developed for our AHRC Digital Transformations project "Transforming Transformation" is [...]

Artistic commission

January 11th, 2016|

We're pleased to announce that composer and sound artist James Dooley has accepted the artistic commission for our AHRC-funded Transforming Transformation project (working title "Integra [...]

Initial test results

December 3rd, 2015|

We have now completed the first round of testing on the system we've been developing for our AHRC Digital Transformations "Transforming Transformation" project. Full results [...]

Transforming Transformation experiment 3

September 16th, 2015|

https://vimeo.com/139458528 This is the third experiment in a 1-year AHRC Digital Transformations project run jointly between Birmingham Conservatoire’s Integra Lab and Glasgow School of [...]

Transforming Transformation experiment 2

September 3rd, 2015|

https://vimeo.com/138194406 This is the second experiment in a 1 year AHRC Digital Transformations project run jointly between Birmingham Conservatoire’s Integra Lab and Glasgow School [...]

Announcing the MiXD symposium

September 1st, 2015|

As part of our AHRC Digital Transformations project we were planning to present our final system (working title "Integra Forms") through a national public workshop [...]

Transforming Transformation experiment 1

June 23rd, 2015|

https://vimeo.com/131588660 This is the initial experiment in a 1 year AHRC Digital Transformations project run jointly between Birmingham Conservatoire’s Integra Lab and Glasgow School [...]

Gallery