Hand modeling is critical for immersive VR/AR, action understanding or human healthcare. Existing parametric models account only for hand shape, pose or texture, without modeling the anatomical attributes like bone, which is essential for realistic hand biomechanics analysis. In this paper, we present PIANO, the first parametric bone model of human hands from MRI data. Our PIANO model is biologically correct, simple to animate and differentiable, achieving more anatomically precise modeling of the inner hand kinematic structure in a data-driven manner than traditional hand model based on outer surface only. Furthermore, our PIANO model can be applied in neural network layers to enable training with a fine-grained semantic loss, which opens up the new task of data-driven fine-grained hand bone anatomic and semantic understanding from MRI or even RGB images.

Overview

---

We present the first statistical internal hand bone model. Our model enables anatomically and physically precise modeling of the hand kinematic structure of different individuals, opening up the study of data-driven hand bone anatomic and semantic fine-grained understanding from MRI or even RGB images.

Bibtex