Skip to content

← ArchivePaper2024

Taming Diffusion Probabilistic Models for Character Control

Rui Chen, Mingyi Shi, Shaoli Huang, Ping Tan, Taku Komura, Xuelin Chen

SIGGRAPHAcademic79 citesMotion Synthesis

Conditional autoregressive motion diffusion model enabling real-time diverse character animation from high-level user control with a single unified model.

Abstract

We present a novel character control framework that effectively utilizes motion diffusion probabilistic models to generate high-quality and diverse character animations, responding in real-time to a variety of dynamic user-supplied control signals. At the heart of our method lies a transformer-based Conditional Autoregressive Motion Diffusion Model (CAMDM), which takes as input the character’s historical motion and can generate a range of diverse potential future motions conditioned on high-level, coarse user control. To meet the demands for diversity, controllability, and computational efficiency required by a real-time controller, we incorporate several key algorithmic designs. These include separate condition tokenization, classifier-free guidance on past motion, and heuristic future trajectory extension, all designed to address the challenges associated with taming motion diffusion probabilistic models for character control. As a result, our work represents the first model that enables real-time generation of high-quality, diverse character animations based on user interactive control, supporting animating the character in multiple styles with a single unified model. We evaluate our method on a diverse set of locomotion skills, demonstrating the merits of our method over existing character controllers.

How to read this

Category
Method: real-time diffusion-based interactive character control
Contributions
  • A transformer-based Conditional Autoregressive Motion Diffusion Model (CAMDM) generating diverse futures from historical motion and coarse user control
  • Algorithmic designs for real-time use: separate condition tokenization, classifier-free guidance on past motion, and heuristic future trajectory extension
  • A single unified model enabling real-time, diverse, multi-style animation from interactive control
Context
Adapts motion diffusion models, in the lineage of Tevet et al.'s Human Motion Diffusion Model, from offline text-to-motion generation into an autoregressive real-time interactive controller.Builds on: Human Motion Diffusion Model
Correctness
Hinges on the claim that the listed designs make diffusion fast and controllable enough for real-time interaction; presented as the first such real-time diverse controller, though the abstract is truncated, so consult the paper for evaluation datasets, latency, and diversity-versus-control tradeoffs.
Clarity
Accessible framing with named components; a first pass conveys the controller design, a second pass is needed for the autoregressive diffusion formulation and guidance scheme.
How to read it
Focus on the three real-time design choices (condition tokenization, CFG on past motion, trajectory extension) and how autoregression bridges diffusion and interactivity; a second pass on the model and timing is worth it for runtime work.

Builds on

Built upon by

Nothing yet.

Related work

Keywords

This page summarises the entry and links to its original source. The archive never hosts or redistributes the publication itself.Show it in the full archive list →