XR-SENSE

The main objective of XR-SENSE is to develop next-generation visuo-haptic media technologies for inclusive immersive reality. The project focuses on enabling realistic, interactive and accessible XR experiences by combining advanced multimodal sensing, scene analysis, reconstruction, adaptive coding, low-latency streaming, interactive rendering, haptic feedback and human-centred XR interaction.

The initiative aims to overcome key limitations of current XR systems, including limited realism, high latency, poor synchronization between visual and haptic content, lack of scalable multimodal streaming, and insufficient consideration of human perception, trust, accessibility and inclusion. XR-SENSE will develop a modular technology framework integrating xSense, xStream and xHuman components, validated through demanding pilots in connected and autonomous vehicles, remote collaborative surgery, and immersive XR broadcasting.

In the XR-SENSE project, AviSense plays a key role in the connected mobility pilot, jointly leading Pilot 1 with IDNEO, which focuses on Connected and Autonomous Vehicles. AviSense contributes its expertise in AI-based scene understanding, multimodal sensing, cooperative perception, occlusion-aware perception, XR visualisation and safety-critical mobility applications.

AviSense is responsible for supporting the definition and validation of mobility-related XR scenarios, including collaborative awareness through XR overlays of occluded objects and XR-space remote co-pilots for social telepresence and infotainment. Through XR-SENSE, AviSense will help transform distributed vehicle and infrastructure sensing into real-time, explainable and visuo-haptic XR information for drivers, passengers and remote users, supporting safer, more inclusive and more immersive connected mobility experiences.