Microsoft iPhone app creates a sound map for blind people

Microsoft app user with guide dog
Soundscape narrates points of interest for the blind Credit: Microsoft

Microsoft has launched an app which can help map the world for blind and visually impaired people, giving directions, describing the local area and guiding them from place to place.

The Soundscape app lets users set a beacon at their destination and then sets off 3D spatial audio cues to give the user awareness of what is around them. It connects to global map services to describe places of interest or street names. 

Using a smartphone connected to a headset like Apple AirPods, it helps blind people gain a better awareness of their location, while it can also be used in conjunction with other apps, like a GPS map, working in the background.

By telling users road and place names and giving directions out loud, the app provides blind people with points of reference to make it easier to navigate the world, while being distinct from route guidance apps. The app is made to be used to be in addition to navigation methods like guide dogs.

Microsoft revealed a prototype of the Soundscape technology, including a special headset, in 2014, but it has now released the app on iOS to the public in the UK and the US.

"The app enriches your perception of surroundings as you walk, helping you get where you want to go," Microsoft said in a blog post.

Tom Wright, chief executive of Guide Dogs said Soundscape made exploring towns and cities a more accessible experience for blind people. "Choosing where to go and what to do is an impossible dream. Soundscape will change this for many people," he said.

The project was started in 2014 by Microsoft developer Amos Miller, a product designer who lost his eye sight due to a genetic condition. “When someone can relate to their environment in a natural and intuitive way, it changes their relationship with their world,” said Mr Miller.

Microsoft Soundscape app on iPhone
Microsoft's Soundscape app on iPhone

The app has features such as "Look Ahead", that describes to users what is ahead, which can be controlled in the settings. 

The project had initially had behaved more like a map-like navigation system, Microsoft product lead Jarnail Chudge told the Telegraph, but the app was changed to offer more all-round awareness.

"What people really enjoyed was that ambient awareness, so we moved to a way-finding philosophy," Chudge said. "We focused on being descriptive and allowed the person in their own way to call on the information."

"We recognise this is quite different to what people have been originally taught, and it is not meant to replace a guide dog or cane, which is why our partnerships are so important. We want to connect with the right group of users. We want people to download it, play with it and give us feedback," he added.

Microsoft has previously worked on apps which help people with disabilities. Last year, the hardware giant announced an app called Seeing AI, which used a smartphone's camera to narrate the world to users.

License this content