Intended Outcome of Abby’s Dream Journey

Abby’s Dream Journey will shed light on the previously unrecognized power of 360-degree audio in the storytelling process.

When we think of virtual reality in 360-degree stories, we typically think of them as visual stories. Yet, for the nearly quarter billion people in the world who are blind, 360-degree experience is an auditory and tactile one.

The use of spatial sound recordings and binaural audio recordings allow us to listen to sounds in the way we hear them. We don’t hear in stereo or mono. We hear spatially, all around us.

To document and create Abby’s Dream Journey: immersive audio recording, interviews, conversational dialogue, participant observation, visual documentation, collaboration and web accessibility tools were used.

Binaural and ambisonic microphones were used while in Ethiopia to capture the sounds of Ethiopia for an immersive sound journey and to give a full experience of Abby’s story in new enhanced technical ways in order to provide a deeper understanding of how Abby now sees her world, through what she hears.

Binaural audio and spatial audio recordings made throughout our journey in Ethiopia will be used to create an immersive sound and tactile map for an in-person exhibit showcasing Abby’s Dream Journey.

Why is it important?

The use of this technology makes it possible to create 3D audio stories created by the combination of binaural and ambisonic recordings mixed with interviews. While 3D audio isn’t new, it is innovative in its use for journalistic stories, multidisciplinary ethnographies and immersive storytelling.

This is the first step in understanding the use of spatial audio to tell a 360-degree story as experienced and told through people who are blind.