Skip to content

← ArchivePaper2022

Simulation of Hand Anatomy Using Medical Imaging

Mianlun Zheng, Bohan Wang, Jingtao Huang, Jernej Barbic

SIGGRAPH AsiaAcademic7 citesMuscles

Builds a volumetric musculoskeletal hand model from MRI data that matches scanned geometry across the full range of motion.

Abstract

Precision modeling of the hand internal musculoskeletal anatomy has been largely limited to individual poses, and has not been connected into continuous volumetric motion of the hand anatomy actuating across the hand's entire range of motion. This is for a good reason, as hand anatomy and its motion are extremely complex and cannot be predicted merely from the anatomy in a single pose. We give a method to simulate the volumetric shape of hand's musculoskeletal organs to any pose in the hand's range of motion, producing external hand shapes and internal organ shapes that match ground truth optical scans and medical images (MRI) in multiple scanned poses. We achieve this by combining MRI images in multiple hand poses with FEM multibody nonlinear elastoplastic simulation. Our system models bones, muscles, tendons, joint ligaments and fat as separate volumetric organs that mechanically interact through contact and attachments, and whose shape matches medical images (MRI) in the MRI-scanned hand poses. The match to MRI is achieved by incorporating pose-space deformation and plastic strains into the simulation. We show how to do this in a non-intrusive manner that still retains all the simulation benefits, namely the ability to prescribe realistic material properties, generalize to arbitrary poses, preserve volume and obey contacts and attachments.

How to read this

Category
Method: anatomical hand simulation from medical imaging
Contributions
  • A method to simulate the volumetric musculoskeletal hand across its full range of motion, not just isolated poses
  • Separate volumetric organs (bones, muscles, tendons, ligaments, fat) that interact via contact and attachments in FEM multibody nonlinear elastoplastic simulation
  • Matches optical scans and MRI in scanned poses by incorporating pose-space deformation and plastic strains
Context
Extends MRI-driven hand modeling (Wang et al., Hand Modeling and Simulation Using Stabilized MRI, 2019) from single-pose anatomy toward continuous volumetric motion across the range of motion.Builds on: Hand Modeling and Simulation Using Stabilized Magnetic Resonance Imaging
Correctness
Validation is against MRI and optical scans in a set of captured poses; the match to ground truth is demonstrated for those scanned poses, so accuracy for the in-between poses rests on the simulation and pose-space deformation generalizing, which a reader should keep in mind.
Clarity
Dense; a first pass gives the organ-based modeling idea, but the FEM, plasticity, and pose-space formulation need a careful second pass.
How to read it
First pass for the modeling decomposition and data pipeline; do a second pass on the FEM elastoplastic formulation and how plastic strains plus pose-space deformation force the MRI match if you intend to reimplement.

Builds on

Built upon by

Nothing yet.

Related work

Keywords

This page summarises the entry and links to its original source. The archive never hosts or redistributes the publication itself.Show it in the full archive list →