Beyond Sight: Navigating the World Through Sound and Innovation

The Pivot from VR to Accessible Platforms

• Initially envisioned VR as the “ultimate equalizer” but discovered significant accessibility barriers
• Mainstream VR platforms remain largely inaccessible to BLV users despite AI advancements
• Solution: Pivoted to Zoom – a familiar, screen-reader friendly platform that works on any device with any internet connection

Live Audio-Described Tours

• Real-time, on-location virtual experiences emphasizing vivid descriptions, interactivity, and multi-sensory engagement
• Tours incorporate stories, history, sounds, and optional tactile elements (purchasable artifacts like desert roses or miniature statues)
• Tour guides undergo specialized certification training focusing on:
  • Vivid language and strategic pacing
  • Contextual layering
  • Emotional tone appropriate to the environment
  • Technical proficiency

Impact on BLV Community

Shanell Matos shared powerful personal experiences:

• Tours transform perceptions – the Vietnam Memorial went from “just a wall” to a meaningful space through detailed descriptions of symbols, artist intent, and purpose
• Audio descriptions provide access to places BLV individuals could never physically touch (like Big Ben)
• Eliminates uncertainty about accessibility and safety when traveling
• Creates equal opportunity for “the joy of discovery”

Technology Integration

Adora AI Travel Companion (developed 2 years ago):

• Personalizes experiences for individual tour participants
• Greets attendees, asks about interests, converses throughout tours
• Supports multiple languages
• Allows private interaction for those uncomfortable speaking up in large groups
• Important note: AI will not replace human guides

Future VR/MR Plans:

• Ready to adopt XR technology when it becomes truly accessible
• Exploring spatial audio and haptic feedback integration
• Envisions combining live VR tours with AI-powered audio descriptions and potential smell/taste simulation

Design Recommendations for VR/AR Developers

• Use all senses, not just visual descriptions (sounds, smells, textures)
  • Example: Different sounds for walking on gravel vs. dry dirt
• Get feedback from diverse BLV users (those born with and without vision)
• Follow “Nothing for us, without us” principle – involve the community in development
• Ensure independent usability with screen readers
• Consider meaningful haptic feedback (avoiding fatigue from constant buzzing)
• Balance information value vs. information overload
• Address both technical accessibility AND cost accessibility
• Optimize for minimal internet coverage and data consumption

Summary generated via Claude