Correspondence-free online human motion retargeting - MORPHEO
Communication Dans Un Congrès Année : 2024

Correspondence-free online human motion retargeting

Rim Rekik
Mathieu Marsot
Anne-Hélène Olivier
Stefanie Wuhrer

Résumé

We present a data-driven framework for unsupervised human motion retargeting that animates a target subject with the motion of a source subject. Our method is correspondence-free, requiring neither spatial correspondences between the source and target shapes nor temporal correspondences between different frames of the source motion. This allows to animate a target shape with arbitrary sequences of humans in motion, possibly captured using 4D acquisition platforms or consumer devices. Our method unifies the advantages of two existing lines of work, namely skeletal motion retargeting, which leverages long-term temporal context, and surface-based retargeting, which preserves surface details, by combining a geometry-aware deformation model with a skeleton-aware motion transfer approach. This allows to take into account long-term temporal context while accounting for surface details. During inference, our method runs online,~\ie input can be processed in a serial way, and retargeting is performed in a single forward pass per frame. Experiments show that including long-term temporal context during training improves the method's accuracy for skeletal motion and detail preservation. Furthermore, our method generalizes to unobserved motions and body shapes. We demonstrate that our method achieves state-of-the-art results on two test datasets and that it can be used to animate human models with the output of a multi-view acquisition platform. Code is available at \url{https://gitlab.inria.fr/rrekikdi/human-motion-retargeting2023}.
Fichier principal
Vignette du fichier
motion_retargeting_3DV_preprint_.pdf (3.42 Mo) Télécharger le fichier
Correspondance-free online human retargeting.mp4 (17.91 Mo) Télécharger le fichier
motion_retargeting_3DV_preprint_-1.pdf (3.24 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
licence
licence
Origine Fichiers produits par l'(les) auteur(s)
licence

Dates et versions

hal-03970689 , version 1 (02-02-2023)
hal-03970689 , version 2 (04-03-2024)

Licence

Identifiants

Citer

Rim Rekik, Mathieu Marsot, Anne-Hélène Olivier, Jean-Sébastien Franco, Stefanie Wuhrer. Correspondence-free online human motion retargeting. International Conference on 3D Vision (3DV), Mar 2024, Davos, Switzerland. pp.707-716, ⟨10.1109/3DV62453.2024.00032⟩. ⟨hal-03970689v2⟩
294 Consultations
261 Téléchargements

Altmetric

Partager

More