Augmented Reality Navigation for the Visually Impaired


Md. Sabbir Ahmed (SBB)

Lecturer

sabbir.ahmed@bracu.ac.bd

Synopsis

 

The development of an augmented reality (AR) navigation system tailored for the visually impaired addresses a critical need for enhancing mobility and independence among individuals with visual impairments. By leveraging advancements in computer vision, sensor technology, and haptic/audio feedback mechanisms, this system aims to provide real-time assistance in navigating complex environments, detecting obstacles, and recognizing objects. The system will:

  • Utilize computer vision and object recognition algorithms to identify objects and obstacles in the user's surroundings.
  • Translate this visual information into audio or haptic cues, guiding the user safely and efficiently.
  • Integrate user preferences and accessibility features for personalized experiences.

Relevance of the Topic

 

Visual impairment poses significant challenges to daily navigation, often requiring reliance on guide animals, canes, or assistance from others. Traditional aids offer limited assistance and can be cumbersome to use. An AR navigation system offers a promising solution by overlaying digital information onto the user's physical surroundings, thereby enhancing spatial awareness and facilitating independent mobility. This technology has the potential to revolutionize the lives of visually impaired individuals by empowering them to navigate confidently and efficiently in various environments, including indoor spaces, streets, and public transportation.

 


Future Research/Scope

  •  Incorporating real-time pathfinding and route planning based on user destination and surroundings.
  • Integrating with smart city infrastructure for enhanced accessibility information.
  • Exploring multimodal feedback using audio, haptic, and even olfactory cues.
  • Conducting user studies and gathering feedback to refine and personalize the system.
     

Skills Learned

 

This research will help undergraduate students develop valuable skills, including:
Developing an AR navigation system for the visually impaired involves a multidisciplinary approach, encompassing skills in computer vision, sensor fusion, human-computer interaction, signal processing, and accessibility design. Additionally, proficiency in software development, particularly in programming languages such as Python, C++, and Java, is essential for implementing the system's algorithms and user interfaces. Strong problem-solving abilities, attention to user experience, and empathy for the needs of visually impaired individuals are also crucial skills for designing effective and user-friendly solutions.

 


Relevant courses to the topic

 

  • CSE 221: Algorithms
  • CSE 422: Artificial Intelligence
  • CSE 425: Neural Networks
  • CSE 427: Machine Learning
  • CSE 428: Image Processing
  • Human-Computer Interaction (HCI)
     

 


Reading List

 

  • TBA

 



©2024 BracU CSE Department