Multimodal User Experience in Extended Reality: Exploring Hand Tracking, Voice, and Passthrough Interactions

Published in international workshop on IMmersive Mixed and Virtual Environment Systems (MMVE 2025), Stellenbosch, South Africa, 2025

Kojic, T., Vergari, M., Warsinke, M., Ali, D., Möller, S. & Voigt-Antons, J.-N.

Download publication here.

This paper explores multimodal interaction in XR environments, focusing on hand tracking, voice input, and passthrough techniques. It discusses how these modalities shape user experience, usability, and workload, offering insights into future XR interface design.

Recommended citation: Kojic, T., Vergari, M., Warsinke, M., Ali, D., Möller, S. & Voigt-Antons, J.-N. (2025, March). Multimodal User Experience in Extended Reality: Exploring Hand Tracking, Voice, and Passthrough Interactions. Paper presented at the international workshop on IMmersive Mixed and Virtual Environment Systems (MMVE 2025), Stellenbosch, South Africa.