A highly innovative system, providing drivers with personalized, non-destructive, and explainable information, delivered by the AViSense extended vision suite, through an XR rendering system, improving drivers’ situational awareness, skills, capabilities, performance, and convenience

By providing drivers with relevant Augmented Reality (AR) information about their surroundings, we can enhance drivers’ capabilities and potentially improve their behavior, safety, and decision-making in critical situations within rapidly changing environments.

Connected Autonomous Vehicles (CAVs) offer the advantage of intercommunication, creating a network of connected vehicles known as cooperative situational awareness. This connectivity presents numerous opportunities, including the sharing of AR information related to the observed objects-of-interest between vehicles within the system (simultaneous or/and asynchronous). Such information transmission allows one vehicle to relay valuable observations to another, enhancing overall system awareness and efficiency.

To ensure the driver is efficiently informed about potentially dangerous situations while driving, we have developed an AR rendering notification system, alerting drivers for potentially hazardous objects-of-interest along the road, such as potholes and bumps (static objects) or moving vehicles and Vulnerable Road Users VRU (dynamic objects), facilitated through a centralized server. The transmitted information includes the Global Positioning System (GPS) location, geometrical characteristics, timestamp, and semantic label of the detected objects. The system then sends the relative AR information to nearby vehicles, providing early warning from a significant distance. This helps overcome the limitation of sensors in identifying potentially dangerous objects from long ranges. For drivers, the AR interface of the vehicle displays the location and nature of the potentially upcoming dangerous object in a non-distracting manner.

Through this communication system, drivers can receive early visual warnings about potential hazards that may not yet be within their field of view or are obstructed by other objects, thereby enhancing their performance and decision-making abilities.