Skip to Main content Skip to Navigation
Book sections

3D camera tracking for mixed reality using multi sensors technology

Abstract : The concept of Mixed Reality (MR) aims at completing our perception of the real world, by adding fictitious elements that are not perceptible naturally such as: Computer generated images, virtual objects, texts, symbols, graphics, sounds, smells, et cetera. One of the major challenges for efficient Mixed Reality system is to ensure the spatiotemporal coherence of the augmented scene between the virtual and the real objects. The quality of the Real/Virtual registration depends mainly on the accuracy of the 3D camera pose estimation. The goal of this chapter is to provide an overview on the recent multi-sensor fusion approaches used in Mixed Reality systems for the 3D camera tracking. We describe the main sensors used in those approaches and we detail the issues surrounding their use (calibration process, fusion strategies, etc.). We include the description of some Mixed Reality techniques developed these last years and which use multi-sensor technology. Finally, we highlight new directions and open problems in this research field.
Complete list of metadata
Contributor : Frédéric Davesne <>
Submitted on : Friday, May 9, 2014 - 5:56:08 PM
Last modification on : Tuesday, June 30, 2020 - 11:56:08 AM




Fakhr-Eddine Ababsa, Imane Zendjebil, Jean-Yves Didier. 3D camera tracking for mixed reality using multi sensors technology. Depth Map and 3D Imaging Applications: Algorithms and Technologies, IGI Global, pp.528--539, 2011, ⟨10.4018/978-1-61350-326-3.ch027⟩. ⟨hal-00989159⟩



Record views