Beyond Pose Matching: Feasibility, Embodiment Compatibility, and Trackability in Humanoid Motion Retargeting

Anonymous Authors

Abstract

Human motion retargeting provides a scalable means of generating reference motions for learning humanoid whole-body skills. However, a retargeted motion that closely matches the source human pose is not necessarily suitable for learning-based whole-body motion tracking. Embodiment differences, geometric incompatibility with the environment, and limited trackable motion range can lead to self-collisions, ground penetration, joint saturation, and excessively fast reference motions. This work studies humanoid motion retargeting from three perspectives: geometric feasibility, embodiment compatibility, and motion trackability. We examine these perspectives using collision-constrained differential inverse kinematics for nonpenetration, shoulder key-body correspondence for embodiment compatibility, and horizontal root-velocity scaling based on locomotion capability. Their effects are evaluated through controlled analyses of the corresponding failure modes. Across two humanoid platforms, the resulting retargeting design improves geometric feasibility and downstream motion-tracking performance over existing baselines. Physical-robot experiments further show that the resulting retargeting design improves execution repeatability for the evaluated motion.

Framework

Overview of the humanoid motion-retargeting and downstream tracking pipeline
Overview of the humanoid motion-retargeting and downstream tracking pipeline. Human motions from diverse sources are adapted to the target embodiment through human–robot key-body matching for embodiment compatibility and horizontal root-velocity scaling for motion trackability. The adapted motions are retargeted using two-stage differential IK with linearized signed-distance constraints for self-collision and ground-penetration prevention. The resulting robot references are used to train RL-based whole-body motion-tracking policies, which are transferred to the physical robot without real-world fine-tuning.

Motion Retargeting from Human Videos

Real-Robot Experiments