Skip to Main content Skip to Navigation

Multi-modal Interaction in Collaborative Virtual Environments: Study and analysis of performance in collaborative work

Abstract : The recent advancement in the field of high quality computer graphics and the capability of inexpensive computers to render realistic 3D scenes have made it possible to develop virtual environments where two or more users can co-exist and work collaboratively to achieve a common goal. Such environments are called Collaborative Virtual Environments (CVEs). The potential application domains of CVEs are many, such as military, medical, assembling, computer aided designing, teleoperation, education, games and social networks etc.. One of the problems related to CVEs is the user's low level of awareness about the status, actions and intentions of his/her collaborator, which not only reduces users' performance but also leads to non satisfactory results. In addition, collaborative tasks without using any proper computer generated assistance are very dicult to perform and are more prone to errors. The basic theme of this thesis is to provide assistance in collaborative 3D interaction in CVEs. In this context, we study and develop the concept of multimodal (audio, visual and haptic) assistance of a user or group of users. Our study focuses on how we can assist users to collaboratively interact with the entities of CVEs. We propose here to study and analyze the contribution of multimodal assistance in collaborative (synchronous and asynchronous) interaction with objects in the virtual environment. Indeed, we propose and implement various multimodal virtual guides. These guides are evaluated through a series of experiments where selection/manipulation task is carried out by users both in synchronous and asynchronous mode. The experiments were carried out in LISA (Laboratoire d'Ingénierie et Systèmes Automatisés) lab at University of Angers and IBISC (Informatique, Biologie Integrative et Systemes Complexes) lab at University of Evry. In these experiments users were asked to perform a task under various conditions ( with and without guides). Analysis was done on the basis of task completion time, errors and users' learning. For subjective evaluations questionnaires were used. The ndings of this research work can contribute to the development of collaborative systems for teleoperation, assembly tasks, e-learning, rehabilitation, computer aided design and entertainment.
Complete list of metadatas
Contributor : Frédéric Davesne <>
Submitted on : Wednesday, February 2, 2011 - 4:50:40 PM
Last modification on : Tuesday, June 30, 2020 - 11:56:07 AM
Long-term archiving on: : Tuesday, May 3, 2011 - 2:43:09 AM


  • HAL Id : tel-00562081, version 1



Sehat Ullah. Multi-modal Interaction in Collaborative Virtual Environments: Study and analysis of performance in collaborative work. Human-Computer Interaction [cs.HC]. Université d'Evry-Val d'Essonne, 2011. English. ⟨tel-00562081⟩



Record views


Files downloads