Skip to Main content Skip to Navigation
Journal articles

Consensus-Based Optimization for 3D Human Pose Estimation in Camera Coordinates

Abstract : 3D human pose estimation is frequently seen as the task of estimating 3D poses relative to the root body joint. Alternatively, we propose a 3D human pose estimation method in camera coordinates, which allows effective combination of 2D annotated data and 3D poses and a straightforward multi-view generalization. To that end, we cast the problem as a view frustum space pose estimation, where absolute depth prediction and joint relative depth estimations are disentangled. Final 3D predictions are obtained in camera coordinates by the inverse camera projection. Based on this, we also present a consensus-based optimization algorithm for multi-view predictions from uncalibrated images, which requires a single monocular training procedure. Although our method is indirectly tied to the training camera intrinsics, it still converges for cameras with different intrinsic parameters, resulting in coherent estimations up to a scale factor. Our method improves the state of the art on well known 3D human pose datasets, reducing the prediction error by 32% in the most common benchmark. We also reported our results in absolute pose position error, achieving 80 mm for monocular estimations and 51 mm for multi-view, on average. Source code is available at https://github.com/dluvizon/3d-pose-consensus.
Complete list of metadata

https://hal-univ-evry.archives-ouvertes.fr/hal-03570650
Contributor : Frédéric Davesne Connect in order to contact the contributor
Submitted on : Sunday, February 13, 2022 - 3:01:17 PM
Last modification on : Friday, August 5, 2022 - 2:46:00 PM

Links full text

Identifiers

Citation

Diogo Luvizon, David Picard, Hedi Tabia. Consensus-Based Optimization for 3D Human Pose Estimation in Camera Coordinates. International Journal of Computer Vision, Springer Verlag, 2022, 130, pp.869-882. ⟨10.1007/s11263-021-01570-9⟩. ⟨hal-03570650⟩

Share

Metrics

Record views

103