← ArchivePaper2022
Generative GaitNet
Jungnam Park, Sehee Min, Phil Sik Chang, Jaedong Lee, Moon Seok Park, Jehee Lee
A deep RL network controls 304 Hill-type musculotendons across a 618-dimensional anatomy-condition space, generating healthy and pathological gaits in real-time physics simulation.
Abstract
Understanding the relation between anatomy and gait is key to successful predictive gait simulation. In this paper, we present Generative GaitNet, which is a novel network architecture based on deep reinforcement learning for controlling a comprehensive, full-body, musculoskeletal model with 304 Hill-type musculotendons. The Generative GaitNet is a pre-trained, integrated system of artificial neural networks learned in a 618-dimensional continuous domain of anatomy conditions (e.g., mass distribution, body proportion, bone deformity, and muscle deficits) and gait conditions (e.g., stride and cadence). The pre-trained GaitNet takes anatomy and gait conditions as input and generates a series of gait cycles appropriate to the conditions through physics-based simulation. We will demonstrate the efficacy and expressive power of Generative GaitNet to generate a variety of healthy and pathological human gaits in real-time physics-based simulation.
How to read this
- Category
- Method: deep-RL control of a full-body musculoskeletal model for gait
- Contributions
- Generative GaitNet, a deep-RL architecture controlling a full-body musculoskeletal model with 304 Hill-type musculotendons
- A pre-trained, integrated network learned over a 618-dimensional continuous space of anatomy conditions (mass, proportions, bone deformity, muscle deficits) and gait conditions (stride, cadence)
- Generates a range of healthy and pathological gaits in real-time physics-based simulation from anatomy and gait inputs
- Context
- Builds on muscle-actuated character control, extending the scalable muscle simulation line of Lee et al.'s Scalable Muscle-Actuated Human Simulation and Control toward a generative, condition-parameterized network.Builds on: Scalable Muscle-Actuated Human Simulation and Control
- Correctness
- Relies on Hill-type muscle modeling and learning across a high-dimensional anatomy-gait space; efficacy and expressiveness are shown through simulated healthy and pathological gaits, so results are demonstrations within the simulated model rather than clinically validated predictions, and coverage at the edges of the 618-D condition space is the caveat.
- Clarity
- Fairly technical; a first pass conveys the conditioned-generative-control idea, a second pass for the RL setup and the anatomy/gait parameterization.
- How to read it
- First pass for the scope of the condition space and what generative control over gait means; second pass on the network architecture and RL training if you work on musculoskeletal control or predictive gait simulation.
Builds on
Built upon by
Nothing yet.
Related work
- SoftCon: Simulation and Control of Soft-Bodied Animals with Biomimetic Actuators 2019 / SIGGRAPH Asia
- MuscleVAE: Model-Based Controllers of Muscle-Actuated Characters 2023 / SIGGRAPH Asia
- Physical Based Motion Reconstruction From Videos Using Musculoskeletal Model 2024 / CASA
- Character Controllers Using Motion VAEs 2020 / SIGGRAPH
Keywords
This page summarises the entry and links to its original source. The archive never hosts or redistributes the publication itself.Show it in the full archive list →