Now that virtual reality is enjoying mainstream adoption with the likes of PlayStation VR, Gear VR, and Google Cardboard, the conversation is starting to turn to the huge potential that virtual reality presents in terms of allowing us to immerse ourselves in environments and experiences we could never experience in the real world.
One group for whom VR has enormous potential is people with disabilities. Anyone who experiences certain barriers to physical mobility in the real world could take control of a digital avatar’s body and visit new places, play games, or take part in rehabilitative experiences in ways that are more immersive and more meaningful than those that previous digital technologies could offer.
But designing tech that caters to the needs of disabled people doesn’t come without challenges. People who live with physical or mental disability are notoriously overlooked by large tech brands, and while the potential for VR to change that looms large, no one is yet making a considered effort to buck the trend.
It’s not all about climbing Everest
You don’t need to have a huge knowledge of cutting-edge VR applications to imagine how immersion within a virtual environment could be hugely beneficial to people living with disabilities, enabling participation across a range of activities within a space that feels relatively safe and free of limitations.
When we think of VR experiences, most of us will probably imagine things like or flying through space. But Shannon Garcia, a communication designer specialising in design for neurodiversity, explains that rather more prosaic experiences have the potential to change lives.
“If you have mobility issues, traveling to a friend’s hometown might have been too difficult, especially somewhere that’s logistically complicated,” she says. “Google Earth VR lets people travel and experience that spatial presence together in a way that makes it so much more accessible than a physical trip would ever be.”
She adds “for someone who has issues with social anxiety, or has difficulty navigating crowded areas, a VR-accessible concert or sports event could introduce a lot of opportunities that you and I take for granted, because we can physically participate in them”.
Not only that, but VR provides access to numerous applications that are being developed to potentially reduce the pain and stress experienced by individuals who live with physical or mental disabilities that require treatment.
Steve Spohn, Chief Operations Officer at the , charity explains: “Virtual reality has huge potential for people with disabilities in ways outside of ordinary gaming. Testing is being done on a variety of applications, including using 3-D sound to soothe people with autism, lowering anxiety and loneliness for people with PTSD, soothing pain for people in burn units, and improving the quality of life for people who are bed-bound or completely immobilized.
“When done correctly, virtual reality will literally change the lives of people with disabilities.”
What these VR solutions will look like, and how they’ll work, will depend on the types of disabilities an individual has. But as VR technology continues to evolve, so too do the practical solutions that make controlling how games and software behave easier to engage with for anyone who has until now been restricted by physical barriers of one sort or another. The challenge now is how to seamlessly integrate the two.
“The challenge is figuring out the ways to control the virtual reality experience for people with disabilities who have limited ability to operate standard controllers and devices,” Spohn adds.
“For example, if you take a virtual reality experience of climbing Mount Kilimanjaro and give it to someone who has lost the ability to walk, it might improve their spirits, bringing them to a happier place. But if you gave that same experience to someone who also doesn’t have the ability to move any muscles, the virtual experience would be just as frustrating as the real thing.”
A wealth of control options
Barrie Ellis, Accessibility Technical Specialist at gamer’s charity , offers an overview of the kinds of tech currently available that allow people with disabilities to control games and software.
“Today there’s a huge number of options, including control through eye-gaze, blinking, facial gestures, breath, muscle movement, sound and/or speech control, head-trackers, and chin, lip and mouth-controlled joysticks.
“There are bite and tongue switches [originally used for skydiving photography as I understand], sip-puff tubes and tongue trackers. There’s even the possibility for changes in skin-colour, heart-rate and brain waves to control games.”
The challenge comes with adding this hardware to VR experiences in a way that feels seamless, and Steve Spohn believes there’s particularly big potential for eye tracking tech in this space.
“The Steel Series Sentry is an eye gaze controller that allows you to move the mouse with your eyes,” he explains. “In combination with fancy software, you can play games like Diablo, Hearthstone, and any other mouse-based game with only your eyes.”
Developing new tools
We spoke with , a tech company that specialises in eye-tracking tech, and which has recently made a multi-million dollar investment in VR with a commitment to exploring and developing ways that it can solve problems and open up new opportunities.
A spokesperson told use: “Eye-tracking implementation in VR will provide users the opportunity for true immersion based off what you are looking at, instead of the way your head is moving.”
Tobii uses what’s known as foveated rendering, which means an image’s resolution and detail will change according to fixation points: points which Tobii defines as being where a user’s vision is focused, moment to moment.
“Foveated rendering is a major technology leap for VR, as it lowers GPU/power consumption, provides 4K graphics to the user at all times and brings the device closer to an untethered experience [you don’t need a gaming notebook to power the current GPU requirements]” the spokesperson added.
“These advancements make the experience more immersive, which is the ultimate goal of VR.”
But eye tracking is just one way to better control VR experiences, and many more are either already on the market or are currently being developed.
At CES earlier this year, the was showcased, a foot-powered virtual reality and gaming controller that allows the user to move intuitively through any 3D space. It readily emulates keyboard keys, a full mouse, or a joystick at your feet, allowing people with disabilities to do new and more things with their computers and hardware.