← ArchivePaper2024
Taming Diffusion Probabilistic Models for Character Control
Rui Chen, Mingyi Shi, Shaoli Huang, Ping Tan, Taku Komura, Xuelin Chen
Conditional autoregressive motion diffusion model enabling real-time diverse character animation from high-level user control with a single unified model.
Abstract
We present a novel character control framework that effectively utilizes motion diffusion probabilistic models to generate high-quality and diverse character animations, responding in real-time to a variety of dynamic user-supplied control signals. At the heart of our method lies a transformer-based Conditional Autoregressive Motion Diffusion Model (CAMDM), which takes as input the character’s historical motion and can generate a range of diverse potential future motions conditioned on high-level, coarse user control. To meet the demands for diversity, controllability, and computational efficiency required by a real-time controller, we incorporate several key algorithmic designs. These include separate condition tokenization, classifier-free guidance on past motion, and heuristic future trajectory extension, all designed to address the challenges associated with taming motion diffusion probabilistic models for character control. As a result, our work represents the first model that enables real-time generation of high-quality, diverse character animations based on user interactive control, supporting animating the character in multiple styles with a single unified model. We evaluate our method on a diverse set of locomotion skills, demonstrating the merits of our method over existing character controllers.
How to read this
- Category
- Method: real-time diffusion-based interactive character control
- Contributions
- A transformer-based Conditional Autoregressive Motion Diffusion Model (CAMDM) generating diverse futures from historical motion and coarse user control
- Algorithmic designs for real-time use: separate condition tokenization, classifier-free guidance on past motion, and heuristic future trajectory extension
- A single unified model enabling real-time, diverse, multi-style animation from interactive control
- Context
- Adapts motion diffusion models, in the lineage of Tevet et al.'s Human Motion Diffusion Model, from offline text-to-motion generation into an autoregressive real-time interactive controller.Builds on: Human Motion Diffusion Model
- Correctness
- Hinges on the claim that the listed designs make diffusion fast and controllable enough for real-time interaction; presented as the first such real-time diverse controller, though the abstract is truncated, so consult the paper for evaluation datasets, latency, and diversity-versus-control tradeoffs.
- Clarity
- Accessible framing with named components; a first pass conveys the controller design, a second pass is needed for the autoregressive diffusion formulation and guidance scheme.
- How to read it
- Focus on the three real-time design choices (condition tokenization, CFG on past motion, trajectory extension) and how autoregression bridges diffusion and interactivity; a second pass on the model and timing is worth it for runtime work.
Builds on
Built upon by
Nothing yet.
Related work
- Human Motion Diffusion Model 2022 / arXiv
- Learned Motion Matching 2020 / SIGGRAPH
- Robust Motion In-Betweening 2020 / SIGGRAPH
- Real-Time Diverse Motion In-Betweening with Space-Time Control 2024 / MIG
Keywords
This page summarises the entry and links to its original source. The archive never hosts or redistributes the publication itself.Show it in the full archive list →