The project addresses multimodal user interfaces for XR, which employ lightfield-based head-mounted displays (HMD), touchless ultrasound haptics, other types of haptics, and eye tracking. The technologies have many applications e.g., in various industries such as health care. manufacturing, entertainment systems, cars, and beyond. Well-considered multimodal experiences and improved interaction may be the key sweet spot for for next-generation extended reality user interfaces. Extended reality scenes are usually viewed with HMDs, but usually they lack the sensation of touch, or use obtrusive tactile equipment. We will enhance the viewing and touchless interaction experience and make it more immersive. We develop the intersection of visual and touch modalities for XR. The project addresses realistic visual and tactile but touchless XR. The project will also collaborate with leading academics and companies in a new, relevant topic.

2025

2029