Real-Time Audio Descriptions with LisNav

LisNav is an app at the intersection of Augmented Reality and Artificial Intelligence, dedicated to transforming the lives of the visually impaired. Experience a world where real-time audio descriptions come alive, empowering a new level of independence and inclusivity for everyone.

Believing in the universal right to experience the world around us, LisNav introduces a pioneering solution merging Augmented Reality (AR) with Artificial Intelligence (AI). Specifically designed to empower and enhance the lives of the visually impaired, this innovative technology acts as a guiding force, providing users with an unprecedented way to perceive and interact with their surroundings. With real-time audio descriptions, LisNav immerses users in an augmented environment, creating a rich tapestry of information and accessibility.

Exploring with LisNav

The fusion of Augmented Reality (AR) and Artificial Intelligence (AI) within LisNav significantly enhances spatial understanding and interaction, fostering a heightened sense of independence and confidence for users on their exploratory journeys. To complement this, LisNav leverages publicly accessible datasets to enrich audio-described content within urban environments. Moreover, it offers a unique feature to incorporate user-contributed information about local points of interest. This blend of data ensures comprehensive guidance, empowering users to navigate comfortably and securely in both known and unknown surroundings.

Accessible Bus Stops

By leveraging real-time audio descriptions and intelligent algorithms, the application provides users with clear and accurate information about bus stops, including names and connectivity details. This ensures that users, including those with visual impairments, can easily understand the bus stop network, facilitating seamless navigation and making public transportation more accessible and user-friendly. With LisNav, individuals can confidently move through the city, utilizing public transportation with enhanced awareness and independence.

Through stereo output, the system delivers audio-assisted environmental information, ensuring clear and precise descriptions when navigating outdoor and indoor environments. LisNav features compatibility with both the device's built-in audio output speaker and external audio peripherals, guaranteeing a seamless user experience.

Collective Safer Journeys

LisNav goes beyond conventional navigation by enabling users to contribute essential information related to warnings, hazards, emergencies, points of interest, and road closures. Users can actively input and access real-time updates, fostering a collective network that enhances safety and convenience during journeys. This dynamic exchange of information ensures that all users, particularly those with visual impairments, can make informed decisions, navigate potential hazards, and discover points of interest, while staying updated on emergency alerts and road closures. LisNav empowers the community to create a safer and more accessible world for everyone.

Sustainable Development Goals

Our work aligns with several UN SDGs.

Goal 3. Ensure healthy lives and promote well-being for all at all ages.

Goal 8. Promote sustained, inclusive and sustainable economic growth, full and productive employment and decent work for all.

Goal 10. Reduce inequality within and among countries.

Goal 11. Make cities and human settlements inclusive, safe, resilient and sustainable.

Urban Innovative Action

LisNav is part of VoxPop , an innovative project that aims to foster the digital transition of the mobility sector in Portugal, through a process of change based on the 3 main vectors of digital transformation: People, Processes and Technology.

This project is co-financed by the Câmara Municipal de Lisboa , Câmara Municipal de Aveiro and the European Regional Development Fund through the Urban Innovative Actions Initiative .

Urban Innovative Action

This project is supported by the European Institute of Innovation & Technology (EIT) as part of the Better Mobility Accelerator (BMA) .

Apple®, Apple logo® and App Store® are trademarks of Apple Inc., registered in the U.S. and other countries.