← ArchivePaper2019
Scalable Muscle-Actuated Human Simulation and Control
Two-level imitation learning drives a full-body model with 346 muscles to reproduce diverse locomotion skills at interactive rates.
Abstract
Many anatomical factors, such as bone geometry and muscle condition, interact to affect human movements. This work aims to build a comprehensive musculoskeletal model and its control system that reproduces realistic human movements driven by muscle contraction dynamics. The variations in the anatomic model generate a spectrum of human movements ranging from typical to highly stylistic movements. To do so, we discuss scalable and reliable simulation of anatomical features, robust control of under-actuated dynamical systems based on deep reinforcement learning, and modeling of pose-dependent joint limits. The key technical contribution is a scalable, two-level imitation learning algorithm that can deal with a comprehensive full-body musculoskeletal model with 346 muscles. We demonstrate the predictive simulation of dynamic motor skills under anatomical conditions including bone deformity, muscle weakness, contracture, and the use of a prosthesis. We also simulate various pathological gaits and predictively visualize how orthopedic surgeries improve post-operative gaits.
How to read this
- Category
- Method: muscle-actuated full-body musculoskeletal simulation and control
- Contributions
- Builds a comprehensive full-body musculoskeletal model driven by muscle contraction dynamics, with pose-dependent joint limits
- Introduces a scalable two-level imitation learning algorithm that controls a model with 346 muscles to reproduce diverse locomotion skills at interactive rates
- Predictively simulates motor skills under anatomical conditions (bone deformity, muscle weakness, contracture, prosthesis) and visualizes how orthopedic surgery affects gait
- Context
- Builds on example-guided deep reinforcement learning for physics-based character control, specifically DeepMimic (Peng et al. 2018), scaling that imitation-learning approach to a detailed muscle-actuated model.Builds on: DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills
- Correctness
- Demonstrated as predictive simulation across a spectrum of typical to pathological gaits; results are physics-and-anatomy-based predictions, not clinically validated outcomes, so the surgical/pathological visualizations should be read as illustrative rather than medically conclusive.
- Clarity
- Conceptually heavy (musculoskeletal modeling plus RL); a first pass conveys the scope and two-level scheme, deeper passes are needed for the control formulation.
- How to read it
- First pass for the model scope and the two-level imitation-learning idea; second pass on the control algorithm and muscle dynamics if you work on physics-based or biomechanical character control.
Builds on
Built upon by
- SoftCon: Simulation and Control of Soft-Bodied Animals with Biomimetic Actuators 2019
- Functionality-Driven Musculature Retargeting 2021
- Generative GaitNet 2022
- MuscleVAE: Model-Based Controllers of Muscle-Actuated Characters 2023
- A Neural Network Model for Efficient Musculoskeletal-Driven Skin Deformation 2024
- Physical Based Motion Reconstruction From Videos Using Musculoskeletal Model 2024
Related work
- Functionality-Driven Musculature Retargeting 2021 / CGF
- Physical Based Motion Reconstruction From Videos Using Musculoskeletal Model 2024 / CASA
- Generative GaitNet 2022 / SIGGRAPH
- Physics-Based Character Controllers Using Conditional VAEs 2022 / SIGGRAPH
Keywords
This page summarises the entry and links to its original source. The archive never hosts or redistributes the publication itself.Show it in the full archive list →