COoperative Real-Time EXperiences with EXtended reality

The mission of CORTEX² is to bridge the divide between widespread video-conferencing tools and state-of-the art XR-based solutions, democratising the uptake of next-generation eXtended Reality tele-cooperation among a large number of industrial segments and SMEs.

To this aim, our project will provide: (1) Full support for AR experience as extension of videoconferencing systems when using heterogeneous services end devices through a novel Mediation Gateway platform (2) Resource-efficient teleconferencing tools through innovative transmission methods and automatic summarization of shared long documents (3) User-friendly and powerful XR experiences with instant 3D reconstruction of environments and objects and simplified use of natural gestures in collaborative meetings (4) Fusion of vision and audio for multi-channel semantic interpretation and enhanced tools such as dialoguing virtual conversational agents and automatic meeting summarization (5) Full integration of IoT devices in XR experiences to optimize interaction with running systems and processes (6) Optimal extension possibilities and wide uptake opportunity through the delivery of the core system with open APIs and the the organisation of Open calls for extensions towards more technical modules and more use cases in various segments.

In order to ensure large adoption and fast scaling of our extended remote cooperation solution, we will use the widespread teleconferencing solution Rainbow from Alcatel Lucent Enterprise as a backbone for our innovative extended reality based tele-cooperation concept, which counts today more than 3 million users worldwide.

CORTEX will extend Rainbow to allow for fully interactive XR-based cooperation and will be demonstrated in three pilots: industrial production, business meetings and remote training.

Wide uptake will be guaranteed by financement of third-party projects to allow for more technical extensions, wider use-cases and deeper evaluation and assessment.