Research archive
Papers.
The research behind character technology: rigging, deformation, muscles and CFX, facial capture, retargeting, and motion synthesis. Papers from SIGGRAPH, DigiPro, SCA and the studio labs, alongside conference and engine talks from GDC, FMX, Annecy, Unreal, Houdini and Maya, all connected so you can trace how each idea grew out of the ones before it.
Most built upon
Interactive Skeleton Techniques for Enhancing Motion Dynamics in Key Frame Animation113 descendants in the lineage
Busiest year
2023
78 entries published
Entries per year
1972 to 2026
Topic trends
entries / year, 1972–2026landmark work, hover to trace
Pick a topic to trace its lineage
The venues behind 724 of the entries, from SIGGRAPH and the academic circuit to the engine and studio events. Journals and preprints have no fixed home; rotating conferences are pinned to a recent or frequent host.
drag to spin · click a marker to filter the list
Type
Topic
Venue
Org
Relations
Keywords
2026
65Disney Research Blender plugin built on a general motion model lets artists generate and edit full motion sequences by manipulating sparse handles, poses, window lengths and noise sampling.
Rigging / Motion Synthesis
Light Labs technical artist Rob Garcia details a modular, procedural Rig Factory built in Houdini for high volume character production.
Rigging
Automatically partitions an elastic solid into affine and elastic regions during simulation, cutting compute up to 17 times while keeping localized deformation detail.
CFX / ML Deformation
- ARTIST: Adaptive Humanoid Rigging by Transferring Individual Style with Optimal TransportEurographicsdetails ↗
Style adaptive auto rigging learns an artist's rigging conventions from a single example, formalizes the control rig as a pose representation, and recovers controllers via rig inversion.
Rigging / Retargeting
Presents a fully automated pipeline for wrapping and cleaning up dozens of FACS expression scans using WrapAI to build silver-level likeness rigs in minutes.
Facial / Skinning
Covers updates to Weta's muscle-driven APFS facial system and Bodyopt full-body skin-deformation network for performance-captured Avatar characters.
Facial / Muscles / Retargeting
For Toy Story 5's Blaze, Pixar built a grooming structure for interactive curl design and deployed Fizt Strands, built atop their Fizt cloth solver, improving collision and stability.
CFX
Cross-attention neural network for face rigging enabling variable local control over expression and pose for production face pipelines.
Facial / Rigging / ML Deformation
- ContactVision: Learning Foot Contact from Video for Physically Plausible Gait AnimationEurographicscode ↗details ↗
Detects heel and toe contact directly from video and feeds it into a reinforcement learning framework with a two segment foot model for realistic gait reconstruction.
Motion Synthesis / Retargeting
- Conversational Gesture Model (CGM): Extending Speaker-Centric Audio-Driven Motion Generation to Full Conversation GesturesEurographicsdetails ↗
A cross attention model fuses interlocutor audio, text, and gesture cues so one character can generate both speaking and listening gestures in dialogue.
Motion Synthesis
Pixar adapted Houdini's hair grooming system for the many bird species in Hoppers, adding controllable secondary motion that complements wing animation and shading for patterned feathers.
CFX
LoRA-MDM adapts a motion diffusion prior with only a few style samples, shifting the motion manifold so unseen actions inherit the style while staying editable.
Motion Synthesis
- DexterCap: Affordable and Automated Capture of Complex Hand-Object InteractionsEurographicsdetails ↗
Low cost capture rig using dense character coded marker patches to track fingers through severe self occlusion, released with the DexterHand manipulation dataset.
Retargeting / Motion Synthesis
Introduces a two way coupled dynamics model that superposes a base cloth surface and a spatially varying wrinkle amplitude and frequency field for interactive coarse mesh cloth.
CFX
Pixar talk using curvenets as a sparse geometric proxy to author parametrization contours whose weights are interpolated across the face mesh to drive articulation, shown on Hoppers.
Facial / Rigging
Feed forward method generates high quality 3D Gaussian head avatars from only a few input images while supporting real time facial animation.
Facial / ML Deformation
Embark Studios outlines their Houdini and USD-based procedural character pipeline shared across Arc Raiders and The Finals, balancing manual and automated rigging workflows.
Rigging / Skinning
Compresses temporally consistent Gaussians into free form skelebones via mean curvature skeleton extraction and partwise motion matching, beating linear blend skinning reanimation quality.
Rigging / ML Deformation
Best Paper Award winner, a generative diffusion framework with a dual objective loss that decouples skeletal integrity from drumstick precision to generalize to in the wild audio.
Motion Synthesis
SideFX's Max Rose builds a fully dynamic Jack in the Box character rig in Houdini 22, driving spring animation from two keyframes with Apex.
Rigging / Motion Synthesis
SideFX's Henry Dean rigs a character starting from no geometry or topology, demonstrating procedural KineFX rigging and animation in Houdini 22.
Rigging
Anchors strand generation on Large Reconstruction Model mesh priors and a Dual Orientation AutoEncoder to resolve global occlusion and local curl directionality when reconstructing strand-level hair.
CFX
- talkHigh-Fidelity on PC and Mobile: The 'Delta Force' Character Production Pipeline (Presented by Tencent Games)GDCdetails ↗
Details Team Jade's cross-platform character art pipeline for Delta Force, covering asset workflows that deliver AAA fidelity on both PC and mobile targets.
Skinning / Rigging
Examines how Pixar's Hoppers unified modeling, animation, simulation, and lighting to achieve felted cloth characters with physical realism and stylized appeal.
CFX / Skinning
- HyperBones: Realtime Bone-driven Neural Garment Simulation with Hypernetwork ConditioningarXivdetails ↗
A reduced space neural dynamics simulator with coarse and fine hypernetwork conditioned components predicts fast, physically plausible bone driven garment motion.
CFX
Uses volumetric morphing and Simon Says calibration expressions so tracker and target share one rig framework, fine tuning the rig for semantically meaningful retargeted controls.
Facial / Retargeting
Scheduled inpainting is an inference only technique that extends pretrained generative motion models to interactively edit, extend, stitch and composite animation clips without extra training.
Motion Synthesis
Sony Pictures Imageworks talk on the Chibi facial system for KPop Demon Hunters, a swappable toolkit of exaggerated facial features that frees expressions from the base model geometry.
Facial / Rigging
Animation director at Illogic Studios demonstrates feature-quality rigging and cross-department animation workflow for a commercial wolf character at production scale.
Rigging / Skinning
Describes a reinforcement-learning locomotion controller that trains robot enemies to self-discover terrain-adaptive walking and combat movement in physics simulation.
Motion Synthesis
Covers building a Vicon Valkyrie-based performance capture facility with custom file-management APIs to support complex multi-actor stunt and dialogue capture pipelines.
Retargeting / Facial
Given a monocular video and a rigged target character, directly optimizes target morphology and pose to reproduce observed motion without source 3D reconstruction.
Retargeting / Motion Synthesis
- MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart PrimitivesSIGGRAPHproject ↗details ↗
MotionBricks is a real-time generative motion framework: a modular latent backbone models over 350,000 clips in one network and a smart-primitive interface authors navigation and object interaction plug-and-play, reaching 15,000 FPS at 2ms latency and deployed zero-shot to a Unitree G1 humanoid.
Motion Synthesis / Retargeting
A compact, fully self supervised neural network generates strand level dynamic hair deformations from boundary condition history, running fast enough for lower end devices.
CFX
- OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character TopologiesarXivdetails ↗
Converts a static surface only character mesh into a FACS rig with up to 155 blendshapes and procedurally fitted teeth, gums, and tongue with no manual setup.
Facial / Rigging
Uses progressive neural networks with automatically assigned experts to track stable two character interactions like boxing and grappling under frequent physical contact.
Motion Synthesis
Finite element framework using prismatic solid shell elements and continuum skin ligaments models viscoelastic facial skin to produce contact induced wrinkles matching real footage.
Facial / CFX
- PhysSkin: Real-Time and Generalizable Physics-Based Animation via Self-Supervised Neural SkinningCVPRdetails ↗
Learns continuous, mesh free skinning weight fields from static geometry alone via physics informed self supervision, enabling real time physics based animation.
Skinning / ML Deformation
Framestore production talk on an end-to-end anatomy simulation platform that automates constraint construction through geometric labeling, converging rigging and creature FX into anatomically accurate muscle and tissue deformation.
Muscles / Rigging
Jointly models geometry and rig through coupled surface and skeleton latents, decoding mesh, joint hierarchy, and skinning weights together for image conditioned generation.
Rigging
Learns rig and motion jointly from raw mesh sequences with no rig annotations, encoding per vertex deformation into separate Gaussian bone and motion latent spaces.
Rigging / Motion Synthesis
- RigPAPR: Rig-Based Animation of Static Neural Point Clouds from a Fixed-Viewpoint VideoarXivdetails ↗
Auto rigs a static point rendered reconstruction and drives it under linear blend skinning from one fixed viewpoint video, recovering a reposable 3D asset.
Rigging / Skinning
- Skeletal-Driven Animation of Anatomical Humans via Neural Deformation GradientsEurographicsdetails ↗
Trains a network to predict per element deformation gradients for skeleton driven anatomical human animation, staying robust to element inversion and volume drift.
Muscles / ML Deformation
Formulates skin penetration removal as multi target inverse kinematics on skeleton subspace deformation, clustering penetrated vertices by deformation gradient similarity for stable interactive correction.
Skinning
Reframes skinning weight regression as discrete token sequence prediction, enabling TokenRig to autoregressively generate skeleton and skin weights together in one sequence.
Rigging / Skinning
Automatically generates production quality skinning weights from a mesh and skeleton in canonical pose, with direct sparsity control over bone influences per vertex.
Skinning
KAIST retargeting framework dynamically repositions proximity anchors onto reachable regions of a target character to preserve self-contact and near-body interaction semantics across differing body shapes.
Retargeting / Skinning
Infers spatio temporal muscle bulging and skin sliding from multiview RGB surface signals using cascaded U-Nets, the first method to recover muscle deformation from video.
Muscles / ML Deformation
SOMA introduces a canonical body topology and universal rig, reducing cross-model adapter complexity from O(M^2) to O(M) via inverse-LBS pose solving and FK optimization.
Retargeting / Skinning / Rigging
A self supervised framework generates temporally consistent skeletons and skinning weights directly from animated mesh sequences without manual rig supervision.
Rigging
Releases about six hours of idle motion capture from fifty non-actor subjects with an evaluation protocol and baseline transition concatenation model for idle animation synthesis.
Motion Synthesis
Reconstructs full body locomotion from insoles carrying an IMU and sixteen pressure sensors, free of line of sight limits and unconstrained by a mocap suit.
Motion Synthesis / Retargeting
Lead Creatures TD Jono Dysart details creature development pipelines for Vecna and the Mind Flayer across 1,185 VFX shots, including skin, muscle, and cloth systems.
Muscles / CFX / Skinning
- talkSwapped: Bringing the Four Elements to Life with Houdini | Skydance | Annecy HIVE 2026Houdinidetails ↗
Skydance Animation's FX team explains how fire, water and destruction effects were blended into a single character for the film Swapped.
CFX
- talkThe Hidden Ones: Real-Time AI Generation of Kung Fu Motions (Presented by Tencent Games AI)GDCdetails ↗
Introduces a markerless mocap capture pipeline paired with a dedicated generation model for real-time fluid Kung Fu transition synthesis in a fighting game.
Motion Synthesis / Retargeting
A Graph CVAE compresses heterogeneous kinematic chains into a shared latent motion manifold, letting motion captured from monocular video be retargeted to characters with arbitrary unseen skeletal topologies.
Retargeting / Motion Synthesis
Tumblehead unveils TumbleRig, a 30 plus node Apex based rigging package, demonstrated by building a cartoony frog character in Houdini 22.
Rigging
Two stage generative diffusion model trained purely on quadruped motion converts ordinary human motion into plausible controllable quadruped puppeteering with limb level control.
Retargeting / Motion Synthesis
Learns an instance specific neural deformation field mapping 3D points to offsets, animating complex garments on unseen poses in real time without topology handling.
CFX / Skinning
Presents VISVISE's full-stack pipeline covering 3D structural sketch generation, auto-retopology, auto-rigging, high-precision auto-skinning, and motion in-betweening.
Rigging / Skinning / Motion Synthesis
Reconstructs a strand based three dimensional hairstyle from ordinary video footage, producing simulation ready hair geometry for character work.
CFX
Distills motion priors from a pretrained video diffusion model to discover the plausible pose manifold of an auto rigged mesh, preventing anatomical hyperextension.
Rigging / Motion Synthesis
- VQ-Style: Disentangling Style and Content in Motion with Residual Quantized RepresentationsEurographicsdetails ↗
Residual vector quantized autoencoders learn a coarse to fine motion representation, then quantized code swapping transfers style at inference without fine tuning for unseen styles.
Motion Synthesis
Production session on Avatar Fire and Ash detailing the APFS proprietary facial performance system and the Bodyopt full-body deformation tool used across 146 characters and 2,539 shots.
Facial / Skinning
Unit Image's Felix Menguy and Tommy Toussaint present the studio's in house CFX pipeline, covering setup implementation and variation management for character work.
CFX
2025
44- talkAI in Maya: Autodesk CEO and Animation Product Manager Demo MotionMaker, FaceAnimator and MoreAUdetails ↗
Autodesk University 2025 live demo by CEO Andrew Anagnost and Product Manager Lance Thornton showing Maya's MotionMaker locomotion synthesis, FaceAnimator, and additional AI-driven character animation tools.
Motion Synthesis / Facial
2D generative prior guides joint placement and skinning weight prediction for diverse skeleton and mesh configurations.
Rigging / Skinning
- ATLAS: Decoupling Skeletal and Shape Parameters for Expressive Parametric Human ModelingICCVdetails ↗
Parametric body model trained on 600k scans that grounds the mesh in an explicit skeletal basis, decoupling bone length and shape from soft-tissue deformation for independent anatomical control.
Muscles / ML Deformation
Framestore Houdini Connect breakdown of crafting Appa's realistic fur groom and Momo's creature design for Netflix's live-action Avatar, plus storm and water FX.
CFX
Maya Learning Channel tutorial by rigging expert Matthew Tucker introducing the Bifrost Modular Rigging Framework, covering modules, pins, and transforms for building procedural node-based animation rigs.
Rigging
Covers the Bifrost rigging module interface in Maya, explaining input and output types, parent-child relationships, and how modules interact with Maya scenes for reusable rig components.
Rigging
Walks through building and publishing a custom spline rig module inside the Bifrost Modular Rigging Framework, demonstrating how to author reusable procedural rig components for character pipelines.
Rigging
- talkBig Flex: Controlling Muscle Shapes with Otis | Liesbeth Levick | Tokyo HIVE 2025Houdinidetails ↗
Liesbeth Levick shows the muscle target shape workflow in the Otis solver, allowing multiple target shapes per muscle for sculpted control.
Muscles
Three-stage pipeline combining multi-query mesh recovery, neural inverse kinematics, and 2D-informed refinement to produce biomechanically plausible human poses from monocular video.
Retargeting / Muscles
BlendSim shifts physics-based animation from discrete frame-by-frame solves to continuous interpolation trajectories built on blendshapes, representing each vertex path with continuous parametric Bezi
Facial / CFX
- talkCFX: Muscle and Soft Tissue with Otis | Houdini 21 | Kai Stavginski | SIGGRAPH HIVE 2025Houdinidetails ↗
Introduces the Otis GPU-accelerated dynamics solver in Houdini 21, delivering FEM-quality muscle, fascia, and fat simulation at interactive speeds for character FX pipelines.
Muscles / CFX / Skinning
- talkChaos Cloth Demystified: A Practical Guide for Artists | Unreal Fest Orlando 2025Unrealdetails ↗
Artist-focused guide to Chaos Cloth simulation in Unreal Engine, building a production-ready pipeline for both real-time and cinematic cloth sequences.
CFX / Skinning
Technical presentation on integrating Chaos Cloth into AAA game production pipelines, covering simulation fidelity, performance budgets, and artist-facing tooling.
CFX / Skinning
Multi-tiered strategy for choreographing Moana 2 hair and cloth motion using performance categorization, visual planning, and iterative refinement.
CFX
Foundry introduces the UsdSuperLayer node in Katana, providing a procedural on-demand approach that prevents full stage recomposition when editing large character and shading graphs.
Rigging
Blends 3D target shapes into 2D fabric panels via custom UVs to retarget cloth simulations toward artist-directed draping looks, used in Inside Out 2 and Elio.
CFX
- talkDreaming in Fur and Feathers: Crafting the Creatures of The Sandman | Rodeo FX | Equinox 2025Houdinidetails ↗
Rodeo FX's Josee Chapdelaine and Marc Antoine Paquin detail the procedural grooming, fur and feather pipeline built for the creatures of Netflix's The Sandman season 2.
CFX
- talkDressed to Quest: Achieving Dynamic, Efficient Characters in 'Kingdom Come: Deliverance II'GDCdetails ↗
Warhorse Studios presents character systems for KCD2 reducing memory, CPU, and draw calls via material atlasing, ID mapping, UV decals, and layered armor with blood, grime, and damage states.
CFX / Skinning
Practical advice on incrementally adopting Motion Matching in existing animation state-machine projects, demonstrating responsive pose selection with minimal data overhead.
Motion Synthesis / Retargeting
- talkExploring Facial Rigging Techniques in KineFX/APEX | Houdini 21 | Carlos Valcarcel | SIGGRAPH HIVE 2025Houdinidetails ↗
Project Outback phase two: contrasts realistic versus stylized facial rig construction in KineFX, demonstrating multiple facial rigging techniques and their APEX implementation.
Facial / Rigging
Quick-start guide showing how to use MotionMaker in Maya 2026.1 to transform simple motion paths into smooth, lifelike character locomotion cycles for bipeds and quadrupeds.
Motion Synthesis
Anny is a scan-free open-source parametric body model using anthropometric phenotype parameters: gender, age, height, weight, calibrated from WHO population statistics.
Rigging / Skinning / Retargeting
Introduces the first large-scale humanoid rigging dataset of 11,434 T-posed meshes and a transformer-based framework fusing skeleton priors with 3D mesh features for automatic rigging.
Rigging / ML Deformation
- Interactive Facial Animation: Enhancing Facial Rigs With Real-Time Shell And Contact SimulationSCAdetails ↗
Layers real-time thin-shell simulation and contact onto an existing facial rig, with no anatomical priors or extra artist work, adding plausible skin dynamics and self-contact that run interactively on consumer hardware.
Facial / CFX
Framestore Head of Groom and Creature FX presents a full creature FX pipeline from muscle simulation through tissue and skin to fur coat dynamics in KineFX.
CFX
Introduces MotionMaker, Maya 2026.1's AI-driven locomotion synthesis tool that generates biped and quadruped motion from a few keyframes or a guide path, trained on dedicated mocap datasets.
Motion Synthesis / Retargeting
Mesh-free character rig for Elio's implicit-surface liquid supercomputer, giving animators full fidelity control over a rigged shader while preserving renderability.
Rigging
Meta's MHR combines a decoupled skeleton/shape paradigm with a modern rig and pose-corrective system, culminating 9 years of anatomically inspired body model work.
Rigging / Skinning / Retargeting
SideFX's Josh Karlin gives a beginner overview of machine learning in Houdini, breaking down a muscle deformer example for character effects.
ML Deformation / Muscles
- talkModel, Rig, Animate! Houdini a Procedural Character Powerhouse! | Roy Kristoffersen | KineFEST 2025Houdinidetails ↗
Roy Kristoffersen walks through modeling, rigging and animating a character end to end, showing Houdini as a procedural character pipeline.
Rigging
Neural method for transferring facial deformations across characters, generalizing expression retargeting to unseen identities and rig topologies.
Facial / Retargeting / ML Deformation
Large autoregressive transformer generates skeletons and skinning weights for diverse 3D asset categories in a single unified framework.
Rigging / Skinning / ML Deformation
- talkProject Outback: KineFX/APEX Rigging Workflows | Carlos Valcarcel | KineFEST 2025Houdinidetails ↗
Explores the rigging framework built for Project Outback inside KineFX and APEX, covering customized rig workflows and future animation techniques under investigation.
Rigging / Skinning
- Pseudo-Collisions: A Method for Preventing Fur-Skin Intersections Without Physical SimulationDigiProdetails ↗
Lightweight pseudo-collision method preventing fur-skin intersection without full simulation, enabling scalable creature grooming at production scale.
CFX
Under-the-hood look at MetaHuman Animator's latest real-time facial capture capabilities and the updated Live Link pipeline for on-set performance transfer.
Facial / Retargeting
HSMR: first end-to-end image-to-SKEL regressor, jointly recovering the biomechanically accurate skeleton and body mesh from a single photograph.
Skinning / Muscles / Retargeting
This paper introduces a rest shape optimization framework that produces sag-free simulations of discrete elastic rods under gravity.
CFX
A triangulation-agnostic surface network deforms neutral facial meshes into industry-standard FACS poses, using 2D supervision on unlabeled meshes to scale beyond scarce professional-rigged data.
Facial / Rigging
DreamWorks rig system for stylized rubber-hose limb animation, enabling exaggerated cartoon deformation on production characters.
Rigging
Procedural rigging framework using a direct graph-based control model enabling flexible, maintainable character rig construction.
Rigging
Stabilizes cloth and hair collisions in impossible upstream animation configurations without modifying the original animation, integrated into Weta's Loki framework.
CFX
Untold Studios breaks down the CFX pipeline for Disney's The Boy and the Octopus, simulating eight independently moving, shapeshifting, color changing tentacles.
CFX / Skinning
Untold Studios CFX Supervisor and Head of VFX explain Houdini solutions for simulating octopus tentacles, skin, and hair in Disney's 2024 holiday short, covering challenging creature CFX.
CFX
Overview of UE5.6 IK Retargeter enhancements and the roadmap for animation retargeting, covering the journey from IK Rig setup to fully automated skeleton mapping.
Retargeting / Rigging
2024
69Represents a neutral head and expression basis shapes as 3D Gaussians learned from monocular video, enabling real-time blendshape-style face animation with high-frequency detail.
Facial / ML Deformation
Learns non-rigid deformation of 3D Gaussians driven by a skeleton with isometric regularization, achieving real-time 50+ FPS rendering and training in 30 minutes from monocular video.
Skinning / ML Deformation
Anatomy-based pipeline translates mocap markers to FACS muscle activations with explicit passive-muscle modeling for diverse character faces.
Facial / Retargeting
Grooming and moving feathers at DreamWorks had been a technically complicated and specialized process, and the feathered characters of Kung Fu Panda 4 and The Wild Robot prompted a re-imagin
CFX
Neural network approximates full musculoskeletal FEM skin deformation at interactive rates, trained on biomechanically accurate simulation data.
Muscles / ML Deformation / Skinning
This work proposes a practical surface-based appearance model for pennaceous feathers, representing far-field appearance with a BSDF that implicitly captures light scattering from the main b
CFX
Implicit face model constrained by anatomical priors, improving 3D face fitting generalization across diverse identities and expressions.
Facial
Fallen Leaf indie team details Fort Solis character pipeline using runtime deformation, artist-friendly facial rigging, UE5 motion matching locomotion, and PS5 60fps optimisation on limited resources.
Rigging / Facial / Motion Synthesis
This work builds appearance models for biological iridescence using bird feathers as a case study, covering several distinct types of feathers with different structural coloration mechanisms
CFX
Apteryx is a Weta FX feather toolset that provides a complete workflow of procedural generation, hand sculpting and grooming for feathered creatures and costumes.
CFX
Tools and workflows for grooming, simulating, and stylizing Asha's complex tightly-braided locks in Wish, covering braid simulation and art-direction techniques.
CFX
Remedy Entertainment describes integrating OpenUSD into the Northlight engine for Alan Wake 2, covering character asset modularization and a live-edit pipeline from USD to runtime format.
Rigging
- CLoSD: Closing the Loop between Simulation and Diffusion for Multi-Task Character ControlarXivdetails ↗
Autoregressive diffusion planner runs in closed-loop with an RL tracking controller enabling text-guided multi-task physics character animation.
Motion Synthesis
Proximal-algorithm method to bake large facial blendshape sets into a compact linear blend skinning representation for real-time use.
Facial / Skinning
- Creating Infinite Characters From a Single Template: How Automation May Give Super Powers to 3D ArtistsSIGGRAPHdetails ↗
Didimo's talk on generating an unbounded cast from a single template, automating the days of manual work one non-player character normally costs.
Rigging / Facial
Autodesk Animation Product Manager Lance Thornton and Sr. Principal Research Scientist Evan Atherton explore how AI and ML techniques can accelerate rigging and animation production workflows in Maya.
ML Deformation / Rigging
Builds a person-specific facial rig without a light stage by warping real photographs onto a template avatar and projecting them into its texture, then capturing expressions with a Simon Says routine.
Facial / Rigging
Case study on iteratively developing a curve rigging toolset responding to shifting production requirements across multiple film projects.
Rigging
Advanced MetaHuman workflows covering MetaHuman Creator, Mesh to MetaHuman, and MetaHuman Animator best practices including Live Link Face calibration and groom application.
Facial / Rigging / Skinning
Shared finite-scalar-quantisation codebook maps retargeted human skeleton motion to realistic synchronised quadruped animation.
Motion Synthesis / Retargeting
End-to-end pipeline estimates shell-level cloth elasticity parameters from yarn stretch tests via extended homogenization matching.
CFX
- talkExploring the Power of Control Rig for Animation in Unreal Engine 5.4 | Unreal Fest Gold Coast 2024Unrealdetails ↗
Deep dive into Control Rig's animation editing and procedural rigging capabilities in UE5.4, covering real-time authoring workflows for character control rigs.
Rigging / Motion Synthesis
Diffusion model for motion inbetweening that factorizes motion into character-agnostic and character-specific components for precise controllability.
Motion Synthesis
Real-time method for synthesizing temporally consistent dynamic facial wrinkles driven by expression parameters for character faces.
Facial / ML Deformation
Retargets interaction motions between two characters while preserving skinned mesh geometry and contact semantics.
Retargeting / Skinning
Prior-free multi-view hair capture using a neural implicit hair volume that encodes high-resolution 3D orientation and occupancy; best paper award at SIGGRAPH Asia 2024.
CFX
HIT is an implicit volumetric function that classifies body interior points as fat, lean tissue, or bone given the SMPL body shape, trained on full-body MRI scans.
Muscles / Skinning
Production experience implementing a neural network deformer for crowd characters, covering training, integration, and quality tradeoffs.
ML Deformation / Skinning
- talkInnovation Unleashed: High-Performance UE5 Mobile Rendering and Next-Gen Character Creation Pipeline Powered by Machine LearningGDCdetails ↗
Lightspeed Studios (Tencent) on a machine-learning-driven next-gen character creation pipeline for UE5 mobile, alongside high-performance mobile rendering.
ML Deformation / Rigging
Auto-regressive diffusion model generates physically plausible real-time character motion responding interactively to user control signals.
Motion Synthesis
- talkJelly by Name, Jelly by Nature: A Deep Dive into Deforming Characters in UE 5.3 | Unreal Fest 2024Unrealdetails ↗
Brown Bag Films details their transition to an in-engine animation pipeline in UE5.3, focusing on squash, stretch, and melting deformation requirements for the character Jelly.
ML Deformation / Skinning / CFX
Production case study implementing Houdini 20's APEX framework for quadruped rigging and applying the ML Deformer for high-quality real-time skinning deformation.
Rigging / ML Deformation / Skinning
Data-driven generalized physical face model that learns anatomy-consistent tissue mechanics from captured data for novel character synthesis.
Facial / Muscles / ML Deformation
- talkMachine Learning Summit: From Photo to Expression: Generating Photorealistic Facial RigsGDCdetails ↗
EA presented FaceMixer, FaceOptim, and FaceBot: three ML tools that together generate blendshapes, automate expression scanning, and produce photorealistic face textures and meshes with minimal manual work.
Facial / ML Deformation
Decomposes full-body mocap solving into local-part sub-motions aggregated by a graph network, reducing the costly manual labeling step.
Retargeting
- MaskedMimic: Unified Physics-Based Character Control Through Masked Motion InpaintingSIGGRAPH Asiadetails ↗
Frames physics-based character control as motion inpainting so one model handles keyframes, objects, text, and sensor constraints.
Motion Synthesis
VQ-VAE with model-based RL learns scalable discrete motion codes enabling universal tracking, interactive control, and GPT-based motion generation.
Motion Synthesis
Feathers behave in a highly anisotropic way governed by their hierarchical microstructure of barbs clamped onto a rachis and linked by tiny barbules, which prior cloth-strip approximations f
CFX
Explores the toolset behind the Game Animation Sample project, detailing how Motion Matching's pose search schema drives responsive character locomotion in UE5.4.
Motion Synthesis / Retargeting
- talkMotorNerve: A Character Animation System Using Machine Learning (Presented by Tencent Games)GDCdetails ↗
Tencent TiMi Studio combined Motion Matching with a VAE-based in-betweening system encoding leg movement to reduce foot skating, enabling high-quality low-cost locomotion and transition animation in games.
Motion Synthesis / ML Deformation
Deep network generates multi-resolution skeleton-driven soft-body shapes at sub-millisecond speeds for real-time game applications.
ML Deformation / Skinning
- Muscles in Time: Learning to Understand Human Motion by Simulating Muscle ActivationsNeurIPSproject ↗details ↗
MinT: large-scale synthetic dataset of muscle activation sequences enriched from motion capture via OpenSim simulation, covering 227 subjects and 402 muscle strands.
Muscles / Motion Synthesis
Applies high-order continuous B-spline surfaces from isogeometric analysis to cloth deformation, reducing DOFs while capturing nonlinear behavior.
CFX
Diffusion policy for physics-based animation trained with RL corrective actions, demonstrated on perturbation recovery and text-to-motion tracking.
Motion Synthesis
PCA-based frequency-domain strand disentanglement separates global hair structure from local curl patterns for precise editing and reconstruction as a generic prior.
CFX / ML Deformation
Hierarchical control with a muscle layer and trajectory layer reconstructs physically plausible character motion from monocular video.
Muscles / Motion Synthesis
Overview of rig solutions for Inside Out 2, including curvenet cloth controls giving Animation direct garment control in individual shots.
Rigging
- ProbTalk3D: Non-Deterministic Emotion Controllable Speech-Driven 3D Facial Animation Synthesis Using VQ-VAEMIGdetails ↗
Two-stage VQ-VAE learns motion priors; probabilistic codebook sampling produces diverse non-deterministic emotion-controllable facial animations.
Facial / Motion Synthesis
Progressive simulation framework for cloth and thin shells dynamically balancing accuracy and speed during animation production workflows.
CFX
Data-driven framework generating diverse kinematic in-between motions with explicit user control over duration, path, and style at runtime.
Motion Synthesis
This paper tackles joint reconstruction of shape and appearance for thin translucent objects such as leaves and paper from real photographs, where light transmission complicates capture.
CFX
- Refined Inverse Rigging: A Balanced Approach to High-fidelity Blendshape AnimationSIGGRAPH Asiadetails ↗
Inverse rig solver combines l1 sparsity and temporal roughness penalties to produce high-fidelity, smooth blendshape weight sequences.
Facial / Rigging
Relative-feature modifications to GAIL's discriminator observation enable agile physics-based character control from a single motion cycle.
Motion Synthesis
Autodesk University class on integrating the Maya ML Deformer into production pipelines, covering pose generation, training workflows, parameter fine-tuning, and use cases for interactive deformation approximation.
ML Deformation / Rigging
Neural motion inbetweening that reasons about skeleton structure for intuitive, physics-plausible gap filling between sparse keyframes.
Motion Synthesis / Rigging
Sony Pictures Imageworks rebuilds rough layout for feature films using Unreal Engine with OpenUSD export to other DCCs, reducing per-sequence export time from eight hours to five minutes.
Rigging
Self-supervised personalized face capture reconstructing a relightable avatar from multiple unconstrained videos, with real-time tracking of unseen footage.
Facial
Official Autodesk video introducing the Maya ML Deformer, which uses machine learning to approximate complex character deformations for interactive playback speeds during animation, blocking, and crowd work.
ML Deformation / Skinning
- SuperPADL: Scaling Language-Directed Physics-Based Control with Progressive Supervised DistillationSIGGRAPHdetails ↗
Progressive distillation from thousands of RL expert policies into a single real-time controller covering over 5,000 language-specified skills.
Motion Synthesis
Frequency-domain supervision enables a unified neural model to generate dynamic deformations for garments with arbitrary topology and looseness.
CFX / ML Deformation
- TailorMe: Self-Supervised Learning of an Anatomically Constrained Volumetric Human Shape ModelEurographicscode ↗details ↗
Self-supervised volumetric body shape model fitting anatomical template (bones and soft tissue) to surface scans, enabling localized shape manipulation and fast inference.
Muscles / Skinning
Conditional autoregressive motion diffusion model enabling real-time diverse character animation from high-level user control with a single unified model.
Motion Synthesis
Grin Machine and Tumblehead animators present a behind-the-scenes look at character rigging using Houdini 20.5's APEX system for a short film, demonstrating KineFX-based production workflows.
Rigging
PULSE learns a universal motion imitator from large unstructured mocap then builds a comprehensive physics-based motion representation.
Motion Synthesis / Retargeting
In-depth look at how LEGO Fortnite characters were rigged and animated in UE5.4, and how Motion Matching was used to reinvent Fortnite Battle Royale locomotion.
Motion Synthesis / Rigging / Retargeting
Vector-quantized periodic autoencoder learns a shared phase manifold across different morphologies for unsupervised motion alignment and transfer.
Retargeting / Motion Synthesis
Curvenet-based wig rig that shares and reuses hair grooms across Emotion characters of different shapes using surface and volumetric deformations.
CFX / Rigging
Framestore Animation Supervisor details the performance capture pipeline, facial sculpting, and scale-bridging animation process to transpose Hugh Grant's performance onto the Oompa Loompa in Wonka.
Retargeting / Facial
2023
78Edge-convolution network extracts skeleton and rigid weights, then diffuses smooth weight fields before deforming source mesh to a reference pose.
Skinning / Retargeting
- ACE: Adversarial Correspondence Embedding for Cross Morphology Motion Retargeting from Human to Nonhuman CharactersSIGGRAPH Asiadetails ↗
Adversarial correspondence learning retargets human motion to nonhuman characters with different body structure and proportions.
Retargeting
- AddBiomechanics: Automating model scaling, inverse kinematics, and inverse dynamics from human motion data through sequential optimizationPLOS ONEdetails ↗
Open-source cloud service that automates OpenSim skeleton model scaling, marker registration, inverse kinematics, and inverse dynamics from mocap data via bilevel optimization.
Muscles / Retargeting
Implicit neural face model coupling expression controls with physics simulation, enabling expression-driven and style-varied realistic facial deformation.
Facial / Muscles
High-fidelity FEM simulation of the human torso with detailed muscle, organ, and tissue anatomy for realistic breathing and movement.
Muscles
Santa Monica Studio animation leads share quickfire breakdowns covering cinematic storytelling, dismemberment systems, and directorial challenges across God of War Ragnarok's character animation.
Retargeting / Rigging
JALI Research masterclass on facial muscle anatomy, subtext observation, rigging principles, and real-time JALI demonstrations showing how accurate lip sync improves character performance in games.
Facial
EA retrospective on five years of shipping motion matching across multiple titles, covering system evolution, production lessons, and how the technique was adapted for diverse game types.
Motion Synthesis
Introduces Weta FX's Anatomically Plausible Facial System, an evolution of FACS controls that replicates actor facial performance for Avatar: The Way of Water beyond previous techniques.
Facial
Production talk on cloth, hair, and coupled simulation for Avatar 2, covering solver integration and artist workflow at Weta FX.
CFX
ML-driven character deformation pipeline used in Avatar 2 production, combining optimization-based and learned approaches for hero characters.
Skinning / ML Deformation
Deformable full-body model integrating skin, organs, and bones trained on 300 CT scans using SMPL architecture, achieving 3.6 mm bone and 8.8 mm organ accuracy.
Muscles / Skinning
- C·ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based CharactersSIGGRAPH Asiadetails ↗
Divides heterogeneous motion into homogeneous subsets for training a conditional adversarial model that controls diverse skill behaviors.
Motion Synthesis
Jointly learns a physics-based control policy and motion encoder for diverse, directable character behavior from mocap via imitation learning.
Motion Synthesis
Digital Domain adapted feature-film facial capture technology to handle 30 hours of performance for The Quarry, automating emotion transfer onto digital puppets at game-scale workloads.
Facial / Retargeting
Reformulates speech-driven facial animation as code-query in a learned discrete codebook of realistic facial motion priors, reducing cross-modal mapping uncertainty.
Facial / Motion Synthesis
GAN-based decoupled multi-discriminator framework learns composite body-part motions from multiple references without manual annotation.
Motion Synthesis
Curve-based fabric authoring workflow supporting custom weave patterns and fiber thicknesses from fine threads to thick yarns, used for Strange World's costumes.
CFX
Houdini-supplemented XGen groom pipeline for Strange World's dog Legend, translating French-Belgian comic book fur aesthetics into a production groom.
CFX
Crowd optimization pipeline for Cabinet of Curiosities, detailing KineFX-based agent replacement workflows and render-time procedural techniques for fur-bearing crowd characters.
CFX / Retargeting
CT scanning of real-world wigs creates density volumes used to extract guide strands and populate dense hair via neural interpolation across diverse hairstyles.
CFX
Decomposes cloth deformation into static skinning, coarse dynamic, and wrinkle components predicted by three sequential network stages.
CFX / ML Deformation / Skinning
SIGGRAPH Asia 2023 course on OpenUSD best practices covering proceduralism, Hydra 2.0, NVIDIA Omniverse Fabric GPU interoperability, and end-to-end pipeline case studies.
Rigging
FOLKS VFX artist presents a Houdini-native procedural pipeline for creating realistic bird plumage, covering feather design, grooming, and integration into creature shots.
CFX
This learning-based clothing deformation method generates rich, plausible detailed deformations for garments worn by bodies of varying shapes across diverse animations using a single unified framework
ML Deformation / CFX
Transformer diffusion model paired with Jukebox audio features for physically plausible, editable music-driven dance generation.
Motion Synthesis
Generative motion matching framework combining motion database search with generative models for smooth diverse motion synthesis.
Motion Synthesis
Motion Latent Diffusion (MLD) compresses motion into a VAE latent space before diffusion, achieving two-orders-of-magnitude speedup over raw-sequence diffusion.
Motion Synthesis
- Eyes Without a Face: Integrating Detached Facial Features into Pixar's Character PipelineSIGGRAPHdetails ↗
Pipeline for Win or Lose characters with unconnected floating facial features, combining 2D graphic expressiveness with 3D environment integration.
Facial / Rigging
Diffusion model for generating diverse and expressive 3D facial animations driven by speech audio input.
Facial / Motion Synthesis
Fast complementary dynamics simulation using skinning eigenmodes as a reduced subspace for secondary jiggle effects on skinned characters.
Skinning / ML Deformation
Creates animatable, relightable mesh avatars from monocular video using differentiable rasterization and learned blendshapes, compatible with standard rendering pipelines.
Facial / CFX
SKEL model couples a biomechanical skeleton to a SMPL surface, enabling pose estimation with anatomically constrained joint axes and soft-tissue deformation.
Rigging / Muscles / Skinning
Production case study on transitioning a studio to Houdini with KineFX, exploring stylized character animation workflows and practical lessons learned for riggers and FX artists.
Rigging / Retargeting / Motion Synthesis
- GroomGen: A High-Quality Generative Hair Model Using Hierarchical Latent RepresentationsSIGGRAPH Asiadetails ↗
First generative model for dense-strand hair using a hierarchical strand-guide-complete VAE architecture; introduces Strands400, 400-subject reconstructed strand dataset.
CFX / ML Deformation
- talkGrooming and Simulation Methods for Different Hair Types | Andriy Bilichenko | Paris HIVE 2023Houdinidetails ↗
Paris HIVE talk on co-designing groom and simulation: how to build hair appearance in Houdini so dynamics enhance the look rather than destroy it across different hair types.
CFX
Text-driven latent diffusion model generating dense strand-based hairstyles in UV space from VQA-annotated synthetic data, upsampling to 100K strands.
CFX / ML Deformation
Live demonstration of MetaHuman Animator's monocular facial performance capture, shown with a Hellblade actor transferring facial animation to a MetaHuman in real time.
Facial / Retargeting
First framework to synthesize full-body character motion with 3D objects from text-based intent labels, supporting single and two-handed interactions.
Motion Synthesis
Local-global ADMM solver for Discrete Elastic Rods with Coulomb friction fully parallelized on GPU, reproducing stick-slip behavior at interactive rates for high-resolution hair.
CFX
Combines a pose-conditioned invertible network with differentiable LBS to animate implicit surfaces while preserving surface correspondences, outperforming state-of-the-art reposing methods.
Skinning / ML Deformation
Santa Monica Studio described a systematic joint-based rig following muscle fiber curves for volume preservation, plus dynamic bone techniques approximating muscle, fat, and skin jiggle in combat.
Skinning / Muscles
Neural parametric head model using an ensemble of local MLPs in canonical SDF space with forward deformation field, trained on 5,200+ scans from 255 subjects.
Facial
- Learning Robust and Scalable Motion Matching with Lipschitz Continuity and Sparse Mixture of ExpertsMIGdetails ↗
Motion matching approach with Lipschitz-constrained networks and sparse mixture of experts for robust, scalable learned motion synthesis.
Motion Synthesis
Improved graph neural network approach for cloth simulation with better generalization to unseen garment shapes and body poses.
CFX / ML Deformation
- talkMetaHuman Framework & Machine Learning for Next-Gen Character Deformation | GDC 2023Unrealdetails ↗
End-to-end walkthrough of the ML Deformer framework, showing how muscle, flesh, and cloth simulation training data drives real-time deformation for MetaHuman characters.
ML Deformation / Facial / Skinning
Epic Games demonstrated end-to-end MetaHuman assembly and the UE5 ML Deformer workflow, training networks on full muscle, flesh, and cloth simulation data to approximate high-fidelity deformation at runtime.
ML Deformation / Skinning / Facial
- talkMotion Mastery: 4D Facial Performance Capture, KineFX and PDG-Powered MoCap PipelineFMXdetails ↗
3SISTERS studio presents a 4D volumetric capture pipeline for creating Sharon Stone's digital double, coupled with a PDG and KineFX-driven mocap retargeting workflow in Houdini.
Retargeting / Facial
Integrates fatigue dynamics into Hill-type muscle model and trains a VAE motion controller from large unstructured datasets.
Muscles / Motion Synthesis
Dynamic neural radiance fields via hash ensemble deformation for high-fidelity head reconstruction, paired with a 4,700+ sequence multi-view capture dataset.
Facial
End-to-end deep learning method for automatic rigging and retargeting of arbitrary in-the-wild facial meshes without manual blendshape creation.
Facial / Rigging / Retargeting
Two-stage strand-accurate reconstruction from monocular video or multi-view images: coarse volumetric orientation then strand optimization with learned prior.
CFX / ML Deformation
Reconstructs a high-fidelity 3D facial avatar from a single source image using NeRF, enabling photo-realistic reenactment driven by arbitrary target faces.
Facial
- Objective Evaluation Metric for Motion Generative Models: Validating Frechet Motion DistanceMIGdetails ↗
Validates Frechet Motion Distance as an objective metric for evaluating motion generative models, addressing artifacts like foot skating.
Motion Synthesis
Progressive multiplicative control policy (PMCP) scales physics imitation to 10,000 AMASS clips with real-time fault recovery.
Motion Synthesis / Retargeting
RL policy retargets sparse VR sensor streams to morphologically diverse characters including non-human avatars in real time.
Retargeting / Motion Synthesis
Deformable point cloud head avatar disentangling intrinsic albedo from normal-dependent shading, enabling FLAME-driven animation with topological flexibility.
Facial
Neural IK solver aware of skeleton topology and pose context, enabling fast and accurate pose and motion editing for character rigs.
Rigging / ML Deformation
Overview of DreamWorks' Academy Award-winning Premo system featuring pose-centric sculpting workflows that map edits back to underlying pose shapes.
Rigging
Integrates hybrid semantic-kinematic retrieval into a diffusion model to improve rare-motion generation quality.
Motion Synthesis
Fully automatic two-stage method for transferring skin weights between geometrically dissimilar meshes, outperforming commercial software on garments.
Skinning / Rigging
- SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face AnimationCVPRdetails ↗
Generates 3DMM motion coefficients for head pose and expression from audio and modulates a 3D-aware face renderer for stylized talking head generation from a single image.
Facial / Motion Synthesis
Four-stage framework computing stable quasistatic configurations for hybrid strand-based hair so simulations start without gravity-induced sag.
CFX
Learns an embedding space that disentangles skeleton structure from motion semantics, enabling cross-skeleton motion retargeting.
Retargeting / Motion Synthesis
Shaping rig for Pixar's curvenet system that auto-generates surface-aligned animation controls per knot for layered shot-level rigging on Elemental.
Rigging
Digital Domain VFX supervisor details facial animation, muscle and cloth simulation for She-Hulk, including Charlatan, a neural network for ML-based face replacement in production.
Facial / ML Deformation / CFX
Untold Studios FX Supervisor describes rebuilding their internal fur workflow in Houdini to deliver the CGI highland cow groom for Virgin Media's Highland Rider commercial.
CFX
Computationally efficient physics-based facial animation method integrating soft tissue dynamics with the DECA morphable face model.
Facial / Muscles
Derives matrix-valued cage coordinates from the Somigliana boundary integral identity, generalizing Green coordinates with elastic volume control.
Skinning
RL with adversarial imitation trains physically simulated characters to perform carrying, sitting, and lying down from unstructured mocap data.
Motion Synthesis
- T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete RepresentationsCVPRdetails ↗
VQ-VAE plus GPT framework for text-to-motion that outperforms diffusion baselines with FID 0.116 on HumanML3D.
Motion Synthesis
- talkThe Facial Animation Pipeline of 'Call of Duty: Modern Warfare II' (Presented by DI4D)GDCdetails ↗
Infinity Ward and DI4D showed how Light Stage scans and 4D expression data trained rig parameter coefficients, enabling scalable automatic transfer of HMC stereo facial performances without human intervention.
Facial / ML Deformation
Framestore's Head of Groom and CFX covers their feather pipeline, complex grooming for furry creatures, and CFX workflows simulating muscles, fat, skin, and hair at episodic scale.
CFX / Muscles
Omni-directional rig for Strange World's alien Splat allowing limbs to serve as both arms and legs, with versatile setup supporting unanticipated character poses.
Rigging
This hybrid physics-based method targets real-time hair simulation for games, avatar streaming, and metaverse applications.
CFX
This interactive framework unifies skinning transformations and kinematic simulation using position-based dynamics, letting an arbitrarily skinned character be partially manipulated by the user while
Skinning / CFX
Multimodal studio course covering USD asset structures, Maya and Houdini API integration, and context-driven production workflows from Animal Logic, Autodesk, Pixar, SideFX, Weta Digital, and WDAS.
Rigging
2022
71Production pipeline covering offline blendshape generation from facial scans, sticky-lips correction, and real-time dynamic skin microstructure for digital humans.
Facial / Skinning
How The Sims 4 animates fully customizable characters and objects: IK retargeting across body shapes, block modeling, and content verification with the SAGE art graph editor.
Retargeting / Rigging
- talkAnimation Summit: FIFA 22's Hypermotion: Full-Match Mocap Driving Machine Learning TechnologyGDCdetails ↗
EA Sports describes capturing a 90-minute 11v11 professional soccer match with XSens suits to feed the ML Flow machine learning procedural animation system, overcoming traditional optical capture constraints.
Motion Synthesis / Retargeting
- talkAnimation Summit: The Facial Animation Pipeline of 'Marvel's Guardians of The Galaxy'GDCdetails ↗
Eidos Montreal used in-house mocap and Faceware batch processing for five main characters, with photogrammetry scanning ensuring anatomically correct expressions at game production volume and quality.
Facial / Retargeting
- Animatomy: An Animator-Centric, Anatomically Inspired System for 3D Facial Modeling, Animation and TransferSIGGRAPH Asiadetails ↗
Replaces FACS shapes with a muscle-strain basis for the face, the system behind Weta's Avatar 2 facial pipeline.
Facial / Muscles
- ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated CharactersSIGGRAPHdetails ↗
Large-scale adversarial skill embedding space for physically simulated characters enabling diverse and composable motion skill reuse.
Motion Synthesis
Bacon X Co-head of CG shows how Houdini's FEM and Vellum solvers automate reliable skin and fur simulation for a fully digital baby wild hog creature in a small-studio pipeline.
CFX
- Building Scalable and Evolutive USD Pipelines on Distributed Architecture at UbisoftDigiProdetails ↗
Ubisoft deploys multi-site USD pipelines using BPMN workflow notation and microservices, enabling scalable character and asset interchange across distributed game studios.
Rigging
Unit Image CFX supervisors trace the evolution of their cloth and hair simulation department, covering Houdini-based character FX workflows across multiple cinematic projects.
CFX
Spline-based rigging system where artists draw sparse curvenets that profile the surface, producing detail-preserving deformations used in Turning Red.
Rigging / Skinning
- ControlVAE: Model-Based Learning of Generative Controllers for Physics-Based CharactersSIGGRAPH Asiadetails ↗
VAE-based framework learns a latent skill space from unstructured mocap and trains a generative physics-based motion controller.
Motion Synthesis
The Mill FX Supervisor walks through grooming, muscle and skin creation, and Vellum-based fur simulation in Houdini to produce Hattie the Hyena for an Amazon holiday commercial.
CFX / Muscles
Cinesite CG Supervisor details the concept-driven asset pipeline for The Basilisk and Chernobog creatures, covering shape language, anatomy, and adaptability between concept and final shot.
Rigging
Periodic Autoencoder extracts unsupervised spatial-temporal phase features from large unstructured motion datasets, winning SIGGRAPH 2022 Best Paper.
Motion Synthesis
Incorporates muscle inertia into musculoskeletal simulation via a chain-of-Jacobians formulation enabling gradient-based optimization.
Muscles
Procedural Houdini workflow modeling individual cloth fibers and binding them to clothing geometry via XGen, supporting embroidery styles for Encanto costumes.
CFX
Introduces a deep perceptual emotion consistency loss during monocular 3D face reconstruction training, significantly improving the fidelity of reconstructed facial expressions over prior methods.
Facial
Guerrilla Games' Gameplay Animation Director detailed supporting animation systems for Horizon Forbidden West covering player mechanics, robotic creatures, and human adversaries while preserving series visual identity.
Motion Synthesis / Rigging
Transformer autoregressive model encoding long-term audio context with biased cross-modal attention and self-supervised speech representations for 3D facial animation.
Facial / Motion Synthesis
- FaceVerse: A Fine-Grained and Detail-Controllable 3D Face Morphable Model from a Hybrid DatasetCVPRdetails ↗
Coarse-to-fine 3DMM built from 60K RGB-D images and 2K high-fidelity scans, with controllable StyleGAN-based detail generation for both base and fine modules.
Facial
Transformer-based model disentangling facial identity and motion for retargeted animation of novel characters from a reference performance.
Facial / ML Deformation
- FDLS: A Deep Learning Approach to Production Quality, Controllable, and Retargetable Facial PerformancesDigiProdetails ↗
Deep learning facial performance system combining controllability and retargetability for production-quality digital human faces.
Facial / ML Deformation / Retargeting
Introduces HumanML3D dataset (14,616 clips, 44,970 descriptions) and a temporal VAE text-to-motion pipeline.
Motion Synthesis
- Generating Upper-Body Motion for Real-Time Characters Making their Way through Dynamic EnvironmentsSCAdetails ↗
Neural method generating reactive upper-body secondary motion for locomoting characters navigating dynamic obstacles in real time.
Motion Synthesis / Rigging
A deep RL network controls 304 Hill-type musculotendons across a 618-dimensional anatomy-condition space, generating healthy and pathological gaits in real-time physics simulation.
Muscles / Motion Synthesis
- Gravity Preloading for Maintaining Hair Shape Using the Simulator as a Closed-Box FunctionSIGGRAPHdetails ↗
Optimization algorithm that preloads hair rest shapes to compensate for gravitational sag, preserving the groomed design shape during simulation.
CFX
Extends Green coordinates to quadrilateral cage faces in 3D, providing quasi-conformal deformations with closed-form expressions for production cages.
Skinning
Groom style interpolation technique preserving strand features during blending between different hairstyles for digital creature effects.
CFX
Describes Pixar's style-guide system for art-directing millions of hair and fur curves to reflect characters' emotional states in Turning Red.
CFX
Transformer-based diffusion model for text-to-motion and action-to-motion synthesis achieving state-of-the-art while predicting samples not noise.
Motion Synthesis
Implicit head avatar learning from monocular video via neural blendshapes and skinning fields in canonical space with end-to-end analytical gradient training.
Facial
Retargets facial performances across diverse rigs using local anatomical constraints that preserve expression fidelity and prevent implausible deformations.
Facial / Retargeting
Weta's unified solver where muscles, flesh, cloth, hair, and fluids all couple in one framework instead of chained single-physics passes.
Muscles / CFX
- talkMachine Learning Summit: 4 Years of Bringing Characters to Life with Computer BrainsGDCdetails ↗
Four years of Edinburgh and EA research on deep learning for character control, covering quadruped locomotion, scene interactions, basketball, and martial arts from motion capture training data.
Motion Synthesis / ML Deformation
NetEase Games presented a lightweight real-time motion completion network that generates smooth game animation without a large pre-built motion library, outperforming interpolation and standard motion matching.
Motion Synthesis / ML Deformation
- talkMachine Learning Summit: Walk Lizzie, Walk! Emergent Physics-Based Animation through Reinforcement LearningGDCdetails ↗
Embark Studios shows reinforcement learning where user-created creatures autonomously learn locomotion, treating animation as an emergent property of anatomy derived from robotics principles.
Motion Synthesis / ML Deformation
Deep learning pipeline for monocular video facial capture that matches expressions from RGB input to rigged face models at production quality.
Facial
Extends NeRF into a generative morphable model producing multiview-consistent photorealistic head images with controllable identity parameters.
Facial
Rigs and animates 3D character meshes by encoding motion cues from single-view point cloud streams of a performing subject.
Rigging
Overview of MotionBuilder 2023 updates including Python 3 migration, new animation layer colour hints, custom key sets for character rigs, and improved pose controls for mocap data transfer workflows.
Retargeting / Motion Synthesis
Practical walkthrough of MotionBuilder HumanIK characterization and full-body mocap retargeting, covering biped joint mapping, HIK solve settings, and baking animation onto custom character skeletons.
Retargeting
Motion-conditioned neural model generalizes garment dynamics to unseen body shapes and motions by disentangling body and garment representations.
CFX / ML Deformation
- talkMotionBuilder: Essentials Characterization, Retargeting and Baking AnimationsMotionBuilderdetails ↗
Comprehensive guide to MotionBuilder essentials covering biped and quadruped characterization differences, HumanIK retargeting configuration, and animation baking for export-ready mocap data.
Retargeting / Motion Synthesis
Aligns a 3D human motion auto-encoder latent space with CLIP, enabling out-of-domain text and image-driven motion synthesis.
Motion Synthesis
First diffusion-based text-driven motion framework enabling fine-grained body-part control and arbitrary-length synthesis.
Motion Synthesis
Graph convolution on arbitrary-topology cloth and obstacle meshes predicts plausible 3D cloth deformation at 30-45 fps for up to 100K triangles.
CFX / ML Deformation
First unsupervised deep learning framework for garment dynamics using physics-inspired losses without ground-truth simulation data.
CFX
Hybrid avatar representation combining a coarse morphable face model with two networks predicting mesh vertex offsets and view- and expression-dependent textures.
Facial
Joint learning of explicit hair geometry and view-dependent appearance using a neural scalp texture encoding individual strand properties at each texel.
CFX / ML Deformation
- NeuralHDHair: Automatic High-Fidelity Hair Modeling from a Single Image Using Implicit Neural RepresentationsCVPRdetails ↗
Implicit neural representation (IRHairNet) hierarchically infers 3D orientation and occupancy; GrowingNet generates high-fidelity strands from a single image.
CFX / ML Deformation
Parametric hand model comprising 20 bone meshes and 7 tetrahedral muscle groups built from annotated MRI data, enabling anatomy-aware hand pose estimation.
Muscles / Skinning
Learns to predict internal skeletal bone geometry from an external SMPL body surface, trained on 2,000 DXA scans pairing body shape with skeleton.
Muscles / Skinning
Combines NLP with physics-based character control so natural language commands specify tasks and low-level motion skills.
Motion Synthesis
Conditional VAE latent space over motion clips drives a physics controller, enabling goal-directed interactive locomotion from unstructured data.
Motion Synthesis
Progressive Cloth Simulation (PCS) is a forward simulation method for efficient preview of cloth quasistatics on very coarse triangle meshes, with consistent and progressive refinement over a hierarch
CFX
Deep RL drives a full-body simulated avatar in real time using only VR headset and controller signals as input.
Motion Synthesis / Retargeting
Neural interpolation between precomputed hair simulation snapshots achieves real-time performance while preserving physically accurate dynamic behavior.
CFX / ML Deformation
Bird feathers exhibit fascinating reflectance governed by fiber-like structures whose hierarchical patterns span many orders of magnitude in scale, with non-cylindrical fiber cross-sections
CFX
Reviews the evolution of Pixar's cloth authoring tools from 2001 and presents the updated tailoring pipeline deployed on Turning Red and Lightyear.
CFX
Procedural length-preserving rope rig handling over 5000 ropes on the hero tall ship in The Sea Beast with intuitive animator controls.
Rigging / CFX
Builds a volumetric musculoskeletal hand model from MRI data that matches scanned geometry across the full range of motion.
Muscles
Composes new rigged and skinned characters by mixing body parts from production-ready animated models.
Rigging / Skinning
Physics-based self-supervised loss recasts implicit integration as optimization, training garment networks without labeled data at two orders of magnitude faster than supervised methods.
CFX / ML Deformation
- Space Rangers with Cornrows: Methods for Modeling Braids and Curls in Pixar's Groom PipelineSIGGRAPHdetails ↗
Procedural groom tools for generating braids, curls, and edge hairs along hand-sculpted source curves, creating Lightyear characters' hairstyles.
CFX
SUPR jointly trains a full-body and part-specific models from 1.2 million scans, introducing a novel kinematic foot model with contact-aware deformations.
Skinning / ML Deformation
Variational transformer encodes text and motion into a joint latent space, generating diverse motion sequences from a single description.
Motion Synthesis
GAMMA decomposes long-term scene-aware human motion into generative body-marker primitives with a policy for perpetual goal-directed navigation.
Motion Synthesis
MICA predicts metric-accurate FLAME face shapes from single images using supervised learning on 2,000+ identities with face recognition features.
Facial
Presents Pixar's profile mover and curve-net system deployed on Panda Mei, achieving surface-detail-preserving deformations controlled by sparse bezier or Catmull-Rom curve networks.
Rigging
Animal Logic integrates USD into a large legacy pipeline for simultaneous feature film production, documenting architecture decisions that improved toolchain productivity across character and shot work.
Rigging
Zero-shot speech-driven full-body gesture generation using example style references, trained on a diverse high-quality motion dataset.
Motion Synthesis / Facial
2021
62Comprehensive survey of 3D morphable face models from the original Basel Face Model to neural variants, covering fitting and applications.
Facial
Graph-network ODE emulator adds vivid secondary dynamics to skinned characters over 30x faster than full FEM simulation with topology-independent inference.
ML Deformation / CFX
Blue Sky Studios reviews three years building a USD-centric layer on Conduit, delivering six short films and documenting how artist feedback shaped the USD character workflow.
Rigging
End-to-end pipeline for 2D-style multiples and smear geometry on 3D characters, inspired by Looney Tunes, deployed on Boss Baby: Family Business.
Rigging
ACTOR uses a Transformer VAE to synthesize variable-length SMPL motion sequences conditioned on action category labels.
Motion Synthesis
Adversarial motion prior enabling physics-based characters to reproduce diverse motion styles from unstructured motion clip datasets.
Motion Synthesis
Introduces neural blend weight fields driven by a skeletal deformation to map observation space to a canonical NeRF, enabling free-viewpoint video of dynamic humans.
ML Deformation / Skinning
Remedy Entertainment details building a custom motion-matching animation system for Control from scratch after middleware became unavailable, covering pipeline, debugging tools, and cinematic transitions.
Motion Synthesis / Rigging
Official Autodesk overview of MotionBuilder 2022 new features including Python 3 support, expanded Python API, FCurve quaternion visualization, Character Extension improvements, and Story tool stability fixes.
Retargeting / Motion Synthesis
Naughty Dog technical overview of The Last of Us Part II character pipeline covering artist-driven shader workflows, gore tools, and live-production optimisations without destructive asset changes.
Skinning / Facial
Extends IPC to shells, rods, and particles coupled seamlessly, enabling unified interpenetration-free simulation of cloth, hair, and volumetric bodies together.
CFX
A geometry-conditioned recurrent network with encoder-space optimization preserves self-contacts and prevents interpenetration when retargeting motion across different character bodies.
Retargeting
Epic Games VP of Digital Humans Technology presents MetaHuman Creator, detailing the high-fidelity facial rigging system and workflow for generating realistic real-time digital humans.
Facial / Rigging
Compresses DDM models into a two-layer LBS representation using continuous pose-space example data to minimize approximation error.
Skinning
Neural network predicts pose-dependent dynamic wrinkle details for garments directly from skeletal motion without explicit cloth simulation.
CFX / ML Deformation
Naughty Dog presented a systemic emotion pipeline spanning rigging, animation, dialogue, and design to deliver up to 20 emotions for 65 characters across 13 languages in gameplay.
Facial / Rigging
Scalable FEM-quality muscle simulator handling heterogeneous materials including soft muscles, tendons, and bones without geometric coarsening.
Muscles
Predicts fine wrinkles on a coarse shell mesh without training data or tuning: tension field theory gives the coarse shape, then an amplitude and phase field solved over that base mesh describes the wrinkles.
CFX
Portable real-time rig deformation framework providing production-quality character deformation in interactive and game contexts.
Rigging / Skinning
This paper resolves frictional contact between deformable elastic objects against smooth implicit surface representations instead of polygonal meshes, which lack a consistent inside-outside partition
CFX
Transfers musculature from a reference anatomical model to bodies of different proportions while preserving functionality and producing simulation-ready results.
Muscles / Retargeting
- GarMatNet: A Learning-Based Method for Predicting 3D Garment Mesh with Parameterized MaterialsMIGdetails ↗
Two-stream network predicts body-fitted garment mesh deformation conditioned on pose and parameterized fabric material properties.
CFX / ML Deformation
Regular-grid GPU cloth at millions of vertices resolving submillimeter wrinkles, exploiting structured memory access for high-resolution character garment simulation.
CFX
Builds a heterogeneous graph over mesh vertices and skeletal bones with a HollowDist metric, predicting production-quality skin weights for arbitrary character topologies.
Skinning / ML Deformation
Analysis of how rig design decisions directly affect animator workflow, productivity, and the quality of resulting performances.
Rigging
Neural network approach to enhance keyframed or procedural quadruped animations with learned natural motion characteristics.
Motion Synthesis / ML Deformation
Technical tour of MotionBuilder's Story Tool as a non-linear mocap editor, covering clip blending, pose library, track management, and the workflow advantages for real-time motion editing and cut-scene assembly.
Motion Synthesis / Retargeting
First deep implicit 3DMM of full heads including hair, using signed distance functions and disentangled geometry and color latent spaces.
Facial
Volumetric segmentation approach assigns every point in a character volume to muscle, fat, or bone, with interactive muscle-curve-driven authoring tools.
Muscles / Rigging
Unified deformation-based framework preserves spatial relationships among multiple characters and environment during real-time interactive retargeting.
Retargeting
Comprehensive KineFX masterclass for Houdini users, covering procedural rigging concepts, skeleton workflows, constraint systems, and animation retargeting in SOP context.
Rigging / Retargeting / Skinning
DECA reconstructs a detailed animatable 3D face from a single image using a detail-consistency loss to disentangle person-specific wrinkles from expression-dependent deformations.
Facial
Neural blend shapes learned jointly with skeleton articulations, producing pose-dependent non-linear deformations from a single neutral-pose mesh.
Skinning / ML Deformation
NetEase presents a deep learning system generating full-body NPC animation including lips, facial expression, head rotation, and gestures from speech in under 500ms, eliminating manual mocap processing.
Motion Synthesis / Facial
Senior Product Owner Will Telford presents the Maya 2022 rigging updates including Component Tags, Deformer Falloffs, and topology-independent procedural workflows for character deformation.
Rigging / Skinning
This method animates yarn-level cloth geometry on top of an underlying deforming triangle mesh in a mechanics-aware way.
CFX
Disentangles audio-correlated and audio-uncorrelated facial motion via a categorical latent space and cross-modality loss for full-face animation.
Facial / Motion Synthesis
The appearance of a real feather arises from light interacting with complex patterned structures across multiple scales that earlier simplified curve models do not capture.
CFX
Naughty Dog technical animators documented the challenges and solutions of shipping motion matching in The Last of Us Part II, from early excitement through production hurdles to final acclaim.
Motion Synthesis
Neural animation layering system enabling real-time synthesis of complex martial arts movements by composing motion layers with learned networks.
Motion Synthesis
- Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic HumansCVPRdetails ↗
Anchors per-frame neural radiance latent codes to a deformable SMPL mesh so that sparse-view observations are integrated across time for dynamic human reconstruction.
ML Deformation / Skinning
- PBNS: Physically Based Neural Simulation for Unsupervised Garment Pose Space DeformationSIGGRAPH Asiadetails ↗
Formulates physics-based simulation as an implicit deep learning loss to unsupervisedly learn garment pose space deformation bases for dressed humans, matching PBS quality in comparable training time.
CFX / ML Deformation
- PFPN: Continuous Control of Physically Simulated Characters using Particle Filtering Policy NetworkMIGdetails ↗
Particle filtering policy network enabling continuous control of physically simulated characters with improved robustness and diversity.
Motion Synthesis
Upsampling approach that adds high-resolution wrinkle detail to low-resolution cloth simulations using physics-inspired priors for game use.
CFX
Blue Sky Studios defines modular Houdini-based element blocks that allow artists to contribute to USD character and shot pipelines without deep USD knowledge.
Rigging
Real-time neural character deformation combining skeleton-driven skinning with learned dynamic detail including cloth and soft-tissue effects.
ML Deformation / Skinning
- Reinventing a Character Creation Pipeline Using Landmarking, Simulation, and Shared Character DataSIGGRAPHdetails ↗
Blue Sky Studios' Universal Mesh-centered pipeline integrating automated rig landmark placement, geometry-driven rigging tools, and stylized simulation-based deformation.
Rigging / Skinning
A closer look at MetaHuman rigs in Maya and Unreal Engine, covering customization workflows for high-fidelity digital human characters.
Rigging / Facial / Skinning
Jointly learns implicit shape, skeleton topology, and skinning weight fields from data, enabling animation and novel view synthesis from RGB or LiDAR input.
Skinning / ML Deformation / Rigging
Converts raw 3D scans of clothed humans into animatable avatars using locally pose-aware implicit functions for pose-dependent correctives without mesh registration.
Skinning / CFX / ML Deformation
Unsupervised image-to-image translation learns a shared latent space from video, then a supervised linear mapping drives character facial animation coefficients for production.
Facial / Retargeting
Step-by-step guide to configuring the MotionBuilder Live Link plugin for streaming real-time mocap and character animation from MotionBuilder 2022 directly into Unreal Engine 5 for virtual production previsualization.
Retargeting / Motion Synthesis
Production cloth simulator using bilinear quad elements, improving stability and artist controllability over traditional triangle-based approaches.
CFX
An implicit function conditioned on SMPL parameters and a semantically interpretable latent code generates clothing of diverse topologies including open jackets, skirts, and shoes.
CFX / ML Deformation
Proposes forward skinning for neural implicit surfaces via iterative root finding with analytical implicit-differentiation gradients, enabling end-to-end training from posed meshes.
Skinning / ML Deformation
- SuperTrack: Motion Tracking for Physically Simulated Characters Using Supervisory SignalsSIGGRAPH Asiadetails ↗
Supervisory signal method for physics-based motion tracking that enables simulated characters to closely follow diverse motion reference clips.
Motion Synthesis
First shipped game neural cloth system predicting jersey deformations and normal-map details from skeleton pose at real-time rates in Madden NFL 21.
CFX / ML Deformation
Pixar resurrects 33,000 legacy set and prop models using USD for reuse across four feature films, three in-production films, and six short-form projects.
Rigging
Per-vertex deformations derived from skeletal linear and angular velocities add cartoon squash-and-stretch effects on top of standard skinning in real time.
Skinning
This paper presents a soft tissue simulation method that replaces indirect volume preservation via Poisson's ratio with direct enforcement of zonal volume constraints, while controlling fine-scale vol
Muscles
Novel techniques for simulating Southeast Asian wrapped garments (sampot, dhoti, bust-wraps) outside the standard seam-based pattern pipeline in Raya.
CFX
2020
61Represents garment deformations as UV-space images enabling convolutional neural networks to predict pose-dependent clothing deformation efficiently.
CFX / ML Deformation
While cloth dynamics solvers have advanced substantially, progress in fast and reliable collision handling has lagged behind.
CFX
Deep network for approximating complex face rig computations using differential subspace reconstruction for real-time face deformation.
Facial / ML Deformation
CycleGAN on motion words transfers adult mocap into child motion style without temporal alignment of training sequences.
Motion Synthesis / Retargeting
Feathers are sophisticated skin appendages where many barb curves branch out from a central shaft and interlock via barbules to form a vane.
CFX
Hybrid simulation and animation rig for Onward's Dad character using tetrahedral volumes with rest-state deformation and animator-controllable targeting.
CFX / Rigging
Learns autoregressive conditional VAEs of human motion whose latent space serves as action space for deep reinforcement learning controllers achieving goal-directed locomotion.
Motion Synthesis
Triangle mesh CNN regresses clothing deformation from character poses and hand skin deformation from joint angles on manifold meshes.
CFX / ML Deformation / Skinning
Enriches rig animations with elastodynamic secondary motion in the subspace orthogonal to rig displacements.
ML Deformation / Muscles
GPU CUDA implementation of reduced-coordinate deformable-body simulation with optimized memory layout for real-time character deformation.
ML Deformation
- Data-driven Extraction and Composition of Secondary Dynamics in Facial Performance CaptureSIGGRAPHdetails ↗
Data-driven method to extract and separately compose secondary dynamic effects from facial performance capture for enhanced realism.
Facial
Course covering Pixar's Fizt simulator improvements for speed, robustness, and generality deployed across Coco, Cars 3, and Onward.
CFX / ML Deformation
Generates personalized blendshapes, physically-based textures, and full facial rig from a single face scan automatically.
Facial / Rigging
Integer optimization selects a minimal set of scanning poses with non-overlapping blendshapes for efficient blendshape transfer.
Facial
NetEase presents a differentiable neural renderer that translates a single face photo into RPG character rig parameters, enabling automatic character creation from real faces.
Facial / ML Deformation
Machine learning method that approximates complex facial rig deformations, reducing evaluation cost and enabling portability of proprietary Pixar rigs.
Facial / ML Deformation
Scalable facial performance capture system for VFX using deep learning to track and solve detailed facial motion at production scale.
Facial
- FaceScape: A Large-Scale High Quality 3D Face Dataset and Detailed Riggable 3D Face PredictionCVPRdetails ↗
18,760 pore-level textured 3D faces from 938 subjects with 20 expressions, with a riggable 3D face prediction method from single images.
Facial
Global-local multilinear model synthesizes identity-preserving facial expressions that extrapolate well beyond the training data pool.
Facial
Fast neural network deformer for production facial rigs approximating complex corrective shapes with real-time performance.
Facial / ML Deformation
Framestore's highly parallel dynamics solver for fur and feathers that reduced manual post-simulation fixing by 80% in creature productions.
CFX
DNEG documents how Avengers: Endgame and Togo drove a full redesign of their Furball fur authoring pipeline across five standardized stages.
CFX
Production techniques for a wide range of passive and active hair effects across diverse musical troll tribes in Trolls World Tour.
CFX
Homogenization approach capturing yarn-level cloth mechanics in a continuum shell model, balancing fidelity and computational cost.
CFX
- Incremental Potential Contact: Intersection- and Inversion-free Large-Deformation DynamicsSIGGRAPHdetails ↗
Guaranteed intersection- and inversion-free frictional contact for deformables via barrier-augmented incremental potential, independent of time step or material stiffness.
CFX
Interactive face sculpting tool guided by an anatomical model of skull, fat, and tissue, producing physiologically plausible digital faces.
Facial / Rigging
Perceptual study and predictive model ranking facial blendshape importance for games to enable efficient rig compression; won MIG 2020 Best Short Paper.
Facial
Introduction to KineFX character tools for game development, covering geometry-level rigging, motion editing, and animation retargeting to refine motion libraries.
Rigging / Retargeting
Compresses motion matching into neural networks, keeping its controllability with a fraction of the memory.
Motion Synthesis
CAPE trains a conditional Mesh-VAE-GAN to generate pose-dependent clothing deformations as an additive term on SMPL, introducing the first large-scale dynamic clothed human mesh dataset.
CFX / ML Deformation
Local phase representation per body part enabling neural networks to learn multi-contact character movements without global phase ambiguity.
Motion Synthesis
Ubisoft Montreal trained a deep reinforcement learning agent to follow motion-matching output while self-balancing physically, advancing toward interactive ragdoll characters that recover from disturbances.
Motion Synthesis / Muscles
Shows neural network approximations of interactive cloth and physics simulations achieving 300-5000x speedup, enabling new simulation budgets without replacing conventional physics solvers.
ML Deformation / CFX
Describes the pipeline for Soul's volumetric characters, procedurally generating volumes and linework from standard surface geometry rigs on the renderfarm.
Rigging
This work combines triangle-based and yarn-based models within a single cloth simulation to leverage the strengths of both.
CFX
Physics-based character animation using model predictive control paired with a visuomotor perception system for reactive locomotion.
Motion Synthesis
Hybrid SMPL-FEM avatar with custom nonlinear anisotropic material; skin thickness and mechanical properties optimized from 4D captures.
Skinning / Muscles
- MoGlow: Probabilistic and Controllable Motion Synthesis Using Normalising FlowsSIGGRAPH Asiadetails ↗
Autoregressive normalising-flow model produces diverse, controllable locomotion sequences trained with exact maximum likelihood.
Motion Synthesis
Unsupervised temporal dilated convolution network retargets motion across humanoids of different skeleton proportions while preserving high-frequency detail.
Retargeting
Extends XPBD to muscle fibers and fascia constraints, enabling fast controllable character muscle and superficial fascia simulation without FEM complexity.
Muscles / CFX
Audio-driven facial video synthesis via a latent 3D face model space, enabling video dubbing and cross-person reenactment with temporal stability.
Facial
Autodesk University class covering Maya 2020 rigging additions including Offset Parent Matrix, UV Pin, Proximity Pin, Rivet, Motion Library, and animation workflow enhancements for facial and character pipelines.
Rigging / Retargeting
Uses a pose-conditioned neural network to invert LBS deformations, enabling efficient canonical-space queries such as signed distance lookups for deformed characters.
Skinning / ML Deformation
This work extends projective dynamics to handle exact dry frictional contact governed by the Signorini-Coulomb law, integrating contact resolution into the local-global solver structure rather than re
CFX
Couples cage and skeleton deformation spaces into a unified real-time framework, accessing poses unreachable by either control structure alone.
Skinning / Rigging
GDC talk presenting DReCon-based production system combining motion matching and physics control for responsive game character animation.
Motion Synthesis
Neural network predicting skeleton topology and skinning weights from 3D character meshes, automating the character rigging process.
Rigging / ML Deformation
Recurrent neural network for robust keyframe-to-keyframe motion inbetweening producing natural transitions across long time spans.
Motion Synthesis
Suite of geometric tools for sculpt generation and reuse in character rigs: sculpt transfer, surface reconstruction, and relaxation, showcased on Onward and Soul.
Rigging / Skinning
Constitutive model for active elasticity that drives simulated flesh and muscle toward target shapes with production-friendly artist controls.
Muscles
Single-shot facial capture combining polarized spherical gradient illumination with stereo to recover geometry and skin reflectance simultaneously.
Facial
Skeleton-aware graph network for motion retargeting that adapts motion to diverse skeleton proportions while preserving stylistic details.
Retargeting / ML Deformation
The journal account of localized sketch driven blendshape editing: geodesic circles bound each edit and freehand strokes stand in for the weight sliders.
Facial / Rigging
Recurrent network regresses real-time soft-tissue dynamics as a function of body shape and motion encoded in a nonlinear deformation subspace.
Skinning / ML Deformation
The journal version of the transposition work, adding a hybrid that blends in the pseudo-inverse and a geodesic locality term to keep blendshape weight edits stable.
Facial / Rigging
STAR learns spatially local pose-corrective blend shapes with sparse joint influence, reducing SMPL parameters by 80% while improving deformation realism.
Skinning / ML Deformation
- talkTechnical Artist Summit: Freeform Animation Rigging: Evolving the Animation PipelineGDCdetails ↗
Unity presented Freeform Animation, a non-destructive technique to preserve motion content while restructuring control rigs, reducing counter-animation work and bottlenecks in standard rigging workflows.
Rigging
Opens the Microsoft Rocketbox library of rigged avatars for research and academic use, and makes the case for freely available rigged characters as shared infrastructure.
Rigging / Skinning
Single neural controller masters thousands of motion styles by training on large-scale mocap, showing strong transfer to unseen motions and characters.
Motion Synthesis
Encodes motion into disentangled content and style latent codes, applying temporally invariant AdaIN to transfer style extracted directly from RGB video onto 3D animation.
Retargeting / Motion Synthesis
A 3D convolutional neural network places skeleton joints in bipedal characters from mesh volume alone, automating a step most auto-rigging tools leave manual.
Rigging
2019
55Insomniac Games described integrating approximately 150 vendor-supplied facial rigs for Spider-Man, with streamlined tooling to minimize overhead on character-specific revisions and delivery cycles.
Facial / Rigging
Comprehensive SIGGRAPH 2019 course on USD composition, authoring, and UsdSkel skinning schema, including pipeline case studies from multiple studios.
Rigging / Skinning
Ubisoft La Forge presented neural networks for automatic mocap cleanup, end-to-end facial animation from video, and a machine learning system generating facial animation directly from raw audio.
Facial / ML Deformation
Described Weta's FACS-plus-deep-learning performance capture pipeline used to translate Rosa Salazar's performance onto the hyper-stylised Alita character.
Facial / Retargeting
AMASS unifies 15 optical mocap datasets into a single archive of 40+ hours, 300+ subjects, using MoSh++ to fit SMPL meshes to marker data.
Retargeting / Motion Synthesis
Santa Monica Studio detailed how they rebuilt Kratos's animation pipeline to convey humanity and narrative depth, transforming the franchise's approach to character performance.
Motion Synthesis / Rigging
The human face is an anatomical system whose heterogeneous and anisotropic mechanical behavior produces complex deformations even in neutral expressions under external forces such as gravity.
Facial / Muscles
VOCA: speech-driven 3D facial animation system trained on 29 minutes of 4D scans at 60 fps from 12 speakers, generalizing across identities.
Facial / Motion Synthesis
Blue Sky Studios describes Conduit, a USD-centric open-source pipeline framework mapping legacy character and shot workflows into USD constructs for Nimona.
Rigging
Framestore FMX talk on photo-realistic furry creature creation, exploring grooming techniques developed across multiple productions including advertising and episodic work.
CFX
Folds the iterative delta mush smoothing into a single precomputed direct skinning operator, making it real-time and game-ready.
Skinning
Physics-based character controller combining motion matching for reference generation with tracking control for responsive, physically plausible animation.
Motion Synthesis
Two-network framework (HairSpatNet + HairTempNet) inferring 3D occupancy and orientation fields from monocular video to model moving hairstyles dynamically.
CFX / ML Deformation
Demonstrates the Offset Parent Matrix attribute in Maya 2020, which drives transforms via a single matrix connection, eliminating offset group nodes and reducing scene complexity for lighter rigs.
Rigging
SMPL-X unifies body, face, and fully articulated hands into a single 10,475-vertex parametric model with 54 joints and a learned variational pose prior.
Facial / Retargeting / Skinning
Presented real-time facial performance capture and face reenactment using commodity RGB cameras, demonstrating practical applications for character animation.
Facial / Retargeting
- Fast Simulation of Deformable Characters with Articulated Skeletons in Projective DynamicsSCAdetails ↗
Projective dynamics method for simulating deformable character bodies coupled to articulated skeletons with robust contact handling.
Skinning / Muscles
- talkFeathers: From Model to Groom to Render | nineteentwenty | Character FX & Crowds Production TalksHoudinidetails ↗
Head of 3D at nineteentwenty walks the full feather pipeline from modelling through grooming to rendering in Houdini for Royal Marines and KFC commercial creature work.
CFX
- talkFramestore Creatures & Houdini | Framestore | Character FX & Crowds Production TalksHoudinidetails ↗
Framestore's head of CG digs into their creature archive spanning standout productions, discussing grooming and solver challenges overcome with Houdini at the London HUG workshop.
CFX
SideFX TD presents H17 grooming toolset with worked hair examples, covering guide-curve challenges, detailing techniques, and rendering workflows at the London Character FX workshop.
CFX
Axis Studios team presents their move to Houdini for hair simulation, feathers, and fur, detailing technical solutions and challenges across AAA game trailer creature productions.
CFX
Acquires complete hand bone anatomy in multiple poses via stabilized MRI and builds animation-ready volumetric hand rigs from medical imaging data.
Muscles / Skinning
Makes a muscle-based facial system fully differentiable by coupling it with a blendshape basis, enabling both optimization and learning-based performance capture.
Facial / Muscles
Practical force and constraint techniques for art-directing hair simulation shape across Brave, Inside Out, Good Dinosaur, Coco, and Incredibles 2.
CFX
Autodesk AREA tutorial on MotionBuilder character retargeting, covering characterization, merging source and target skeletons, IK Blend settings, fixing retargeting errors, and baking animation to a character.
Retargeting / Motion Synthesis
Hummingbird is the DreamWorks feather system used to interactively groom body feathers and model scales in real time.
CFX
Interactive system for editing performance-captured facial animation, allowing artists to intuitively adjust and correct captured data.
Facial
Unity showcased predefined constraints for procedurally controlling character deformations, physics-based secondary motion simulation, and runtime blending within their Animation Rigging package.
Rigging / Skinning
Autoencoder neural network defines a nonlinear reduced space for deformable solid dynamics, solving implicit integration in latent space.
ML Deformation
- Learning an Intrinsic Garment Space for Interactive Authoring of Garment AnimationSIGGRAPH Asiadetails ↗
Encodes garment deformations in a low-dimensional intrinsic space learned from simulation, enabling interactive authoring and blending of garment animations.
CFX
Parametric physics-based controller generalizes locomotion across characters with different heights, weights, and body proportions.
Motion Synthesis
Disentangled motion representation separating content from style enabling video-to-video motion retargeting without 3D reconstruction.
Retargeting / ML Deformation
Recurrent neural network predicts garment drape and wrinkles as a function of body shape and dynamics in a few milliseconds.
CFX / ML Deformation
Will Telford introduces the Proximity Pin node in Maya 2020, which tracks a transform to the closest point on a deforming surface to support facial rigging and secondary attachment workflows.
Rigging
Senior Maya Product Owner Will Telford demonstrates the GPU-accelerated Proximity Wrap deformer introduced in Maya 2020, which binds geometry by proximity without requiring a rest-pose and is topology-independent.
Skinning / Rigging
MPC's proprietary grooming software Furtility has long created hair, fur and feathers for film characters, but feather grooms were time consuming and technically challenging.
CFX
- talkML Tutorial Day: From Motion Matching to Motion Synthesis, and All the Hurdles In BetweenGDCdetails ↗
EA covered the gap between motion matching and full synthesis, detailing Phase-Functioned and Mode-Adaptive Neural Networks as practical next steps for animation system design in games.
Motion Synthesis / ML Deformation
GAN framework maps speech to 3D conversational gesture motion using separate adversaries for dynamics, joint plausibility, and diversity.
Motion Synthesis / Facial
Neural state machine for character-scene interaction synthesis generating contextual motions like sitting, picking up objects, and navigating environments.
Motion Synthesis
Learns a dynamic volumetric representation from multi view video with an encoder decoder and a warp field, rendered by differentiable ray marching.
Facial / ML Deformation
- NeuroSkinning: Automatic Skin Binding for Production Characters with Deep Graph NetworksSIGGRAPHdetails ↗
Deep graph network for automatic skinning weight prediction generalizing to production characters from learned geometric and topological features.
Skinning / ML Deformation
Multi-view imaging system and parametric rig estimate person-specific eyeball shape, rotation center, and visual axis at submillimeter accuracy.
Rigging / Facial
This work presents a method for procedurally generating biologically driven geometry to model feathers for computer graphics.
CFX
First real-time physics-based facial animation method driven by performance capture, using projective dynamics on volumetric skin.
Facial
Ubisoft ALICE studios showed how neural networks can fully automate motion capture cleanup and delivery, covering implementation challenges and practical integration into capture studio workflows.
Motion Synthesis / ML Deformation
Automatic method for repairing missing and noisy marker trajectories in mocap data using kinematic skeleton as a reference.
Retargeting
Two-level imitation learning drives a full-body model with 346 muscles to reproduce diverse locomotion skills at interactive rates.
Muscles / Motion Synthesis
Scriptable CFX framework integrating cloth, hair, and secondary dynamics into a unified character effects pipeline.
CFX / Rigging
Extends Kelvinlet sculpting with a multi-scale convolution scheme enabling cusp-like elastic edits with sharp, localised falloff profiles.
Rigging / Skinning
DreamWorks production fur dynamics system driving secondary motion on characters through efficient simulation and procedural techniques.
CFX
Head rig for Spies in Disguise pigeons where beak and facial features slide freely on curved head volumes, enabling 2D-inspired expressions on 3D characters.
Rigging / Facial
Shows that many small substeps with simple per-step constraint projection outperforms fewer large-step implicit integration for cloth and soft bodies.
CFX
- SoftCon: Simulation and Control of Soft-Bodied Animals with Biomimetic ActuatorsSIGGRAPH Asiadetails ↗
Simulates and controls deformable invertebrate characters using muscle-like actuators with contact-rich locomotion.
Muscles / Motion Synthesis
First method to capture hair with sub-millimeter strand-level accuracy from a multi-view rig using slanted stereo correspondences and mean-shift strand growth.
CFX
Neural network trained in a learned subspace to replace expensive physics simulation with fast interactive deformation for characters.
ML Deformation / Skinning
2018
48Represents the 3D hairstyle manifold via a volumetric VAE trained on orientation fields; synthesizes new hairstyles from a single image in one second.
CFX / ML Deformation
Framework for abstracting core rigging concepts to build extensible, future-proof character rigging systems for production.
Rigging
System for continuously monitoring rig performance health metrics at Blue Sky Studios, enabling real-time rig evaluation during production using ChopRig and Conduit.
Rigging
Empirically derived rig for realistic jaw animation, capturing biomechanical jaw motion from data for use in facial character rigs.
Facial / Rigging
Implicit frictional contact solver integrated with adaptive remeshing for robust, stable cloth simulation under complex contact scenarios.
CFX
Guerrilla Games covered the full machine character pipeline for Horizon Zero Dawn, from pre-production prototyping to final polish including animation-tech, AI behavior, and motion style.
Rigging / Motion Synthesis
- Art-Directed Costumes at Pixar: Design, Tailoring, and Simulation in ProductionSIGGRAPH Asia Coursesdetails ↗
Course covering Pixar's full costume pipeline from design through tailoring and simulation, illustrated with examples from Coco and Incredibles 2.
CFX
- Aura Mesh: Motion Retargeting to Preserve the Spatial Relationships between Skinned CharactersCGFdetails ↗
Volumetric aura mesh surrounding each character encodes proximity relationships, preserving interaction semantics during motion retargeting.
Retargeting
Direct Drive retargeting system used on Thanos in Avengers, bypassing traditional blendshape solvers by learning a direct mapping from actor performance to character.
Facial
Improves Pixar's Fizt cloth solver with enhanced collision handling and performance gains, addressing the high cloth demand of Coco's skeleton cast.
CFX
Ubisoft La Forge demonstrated how neural networks can build scalable animation systems for games, covering Phase-Functioned and Mode-Adaptive Neural Networks for character locomotion.
Motion Synthesis / ML Deformation
Blue Sky Studios technique that fragments character geometry into independently-evaluating pieces processed in parallel, then recombined via SubDeform to hit 24 fps targets.
Rigging
Applies volume simulation to character meshes before cloth simulation to eliminate self-intersections, used in production on Pixar's short Bao.
CFX
EA presented a predictive-contact approach to cloth self-collision that supports large simulation timesteps with only a single collision sweep, costing a few milliseconds per CPU thread.
CFX
Cubic Motion CEO traces the evolution of their markerless facial tracking and mocap-solving AI across three real-time digital human projects, showing advances in performance fidelity.
Retargeting / Facial
Autoregressive RNN conditioned on target keyframes automatically completes motions matching sparse user-specified poses; won MIG 2018 Best Paper.
Motion Synthesis
Deep generative model for face appearance and geometry enabling photorealistic rendering and synthesis of facial expressions.
Facial / ML Deformation
- DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character SkillsSIGGRAPHproject ↗details ↗
Physics-based character controller using deep RL to imitate reference motion clips, achieving diverse athletic skills with natural-looking dynamics.
Motion Synthesis
Confines blendshape direct manipulation to a geodesic neighbourhood and drives it from a sketch interface, so a drag edits local geometry instead of the whole face.
Facial / Rigging
- Dynamic Kelvinlets: Secondary Motions Based on Fundamental Solutions of ElastodynamicsSIGGRAPHdetails ↗
Real-time physically based secondary animation using analytic elastodynamic solutions, enabling compressive and shear wave effects on characters.
Rigging / ML Deformation
Neural networks learn a film rig's nonlinear deformations so approximated characters run interactively, the paper that opened the ML deformer era.
ML Deformation / Skinning
This paper introduces an operator-splitting approach for corotated FEM simulation by separating the corotated linear deformation energy into a stretching term and a volume-preservation term.
CFX
Animal Logic integrates USD into Maya via AL_USDMaya for Peter Rabbit, animating 5 hero characters across 1100 shots with a production-proven USD-based animation system.
Rigging
Reconstructs simulatable strands from artist-created hair meshes and applies style-specific simulation per cluster for efficiency.
CFX
HairControl adds artistic control to physics-based hair simulation by constraining a high-resolution detail-hair simulation to follow an input animation of coarse guide hairs.
CFX
CNN mapping 2D orientation field input to scalp-parameterized strand features; generates 30K-strand hairstyle in real time with a novel collision loss.
CFX / ML Deformation
Introduces hierarchical sculpting controls into Disney's hair pipeline for layered art-direction of hair motion across varying simulation scales.
CFX
This work presents a model-reduction scheme for projective dynamics that accelerates the simulation of deformable objects.
CFX
Dual-representation graph engine that separates authoring nodes from evaluation tasks, achieving a 100x authoring speedup over LibEE v1 in the Premo system.
Rigging
Presented the pipeline behind the MEETMIKE real-time avatar: performance capture, solver, and photorealistic rendering in a live interactive context.
Facial / Retargeting
- Mobilizing Mocap, Motion Blending, and Mayhem: Rig Interoperability for Crowd Simulation on Incredibles 2SIGGRAPHdetails ↗
Pixar approximates complex Presto crowd rigs with skinned skeletons to enable mocap, motion blending, and ragdoll physics interchange for Incredibles 2 crowd pipeline.
Rigging / Skinning
Mode-adaptive neural network with learned gating for quadruped locomotion control handling diverse gaits and transitions.
Motion Synthesis
Follow-up GDC bootcamp session expanding motion matching with advanced trajectory control and production implementation strategies.
Motion Synthesis
Optimal keyframe selection algorithm for motion capture data that minimizes reconstruction error while enabling interactive artist-driven control.
Retargeting
Surveyed ILM's multi-decade evolution in photoreal character and digital human creation, from early tests through modern deep-learning-assisted pipelines.
Facial / Skinning
Transfers a desired edge-loop patch layout from a reference mesh to deformed meshes via decal-map-weighted relaxation, used on Bao and Incredibles 2.
Rigging / Skinning
A physically-based model of the sticky-lip effect for facial animation, using total Lagrangian explicit dynamics FEM with a new breaking element for the saliva, so the lips stick and separate realistically as the mouth opens.
Facial
EA Frostbite explains driven-ragdoll technology blending physics reactivity with animation adherence, covering performance optimisation, multiplayer synchronisation, and emergent procedural motion generation.
Rigging / Muscles
Physics-based character controller that imitates motion capture reference with deep reinforcement learning, producing physically plausible results.
Motion Synthesis / Retargeting
Projective Skinning is a physics-based character skinning approach that overcomes well-known artifacts of geometric skinning while maintaining real-time performance, enabling dynamic effects and resol
Skinning / CFX
MPC Asset Supervisor details creation of the photoreal digital Rachael character, presenting techniques for crossing the uncanny valley on a human CG face.
Facial
Addresses Incredibles 2 skin simulation using 2D ray-tracing over mesh surfaces for fast, robust secondary motion on superhero characters.
CFX / Muscles
Physics-based character learns to imitate athletic motions reconstructed from monocular video using deep RL.
Motion Synthesis
ADMM-based creature tools for muscle, skin, and fatty tissue simulation achieving anatomically accurate dynamic deformation, demonstrated on Avengers: Infinity War characters.
Muscles / CFX
Retargeting method preserving spatial relationships between body surface vertices rather than only skeletal joints.
Retargeting / Skinning
Compared classical FACS/blend-shape facial pipelines against emerging neural-network approaches for character face deformation at production scale.
ML Deformation / Facial
SIGGRAPH Asia 2018 course demystifying USD composition, scene interoperability, and how Pixar's pipeline uses USD for asset interchange across feature film production.
Rigging
DreamWorks transitioned How to Train Your Dragon 3 to USD as primary asset and shot representation in 80 working days, covering adoption strategy and implementation challenges.
Rigging
2017
35Takes four-view hair photos and estimates a 3D direction field to grow dense strands; allows mixing views from different hairstyles for flexible modeling.
CFX
This work extends microfacet theory to model iridescent reflections produced by thin films of varying thickness layered on top of an arbitrarily rough base surface.
CFX
- talkAnimation Bootcamp: Uncharted 4: Naughty Dog's Animation Workflow and Animation PrototypingGDCdetails ↗
Naughty Dog lead animators cover Uncharted 4's full animation pipeline from previs through motion capture and final polish, plus rapid animation prototyping to accelerate design decisions.
Retargeting
This paper introduces an anisotropic elastoplastic constitutive model that resolves frictional contact for codimensional materials such as cloth, knit, and hair within a continuum simulation.
CFX
End-to-end deep learning system for speech-driven facial animation jointly learning lip sync, head pose, and emotional expression.
Facial / Motion Synthesis
Official Autodesk feature demo of the Delta Mush deformer, which acts as a low-pass filter to remove skinning artifacts and restore rest-shape volume on deforming characters.
Skinning / ML Deformation
Dexter Studios presents ZENN node-network, a procedural grooming pipeline for fur, feathers, and scales used in commercial creature productions.
CFX
- talkCG Hair Fur workflow in Houdini for VFX and Games | Saber Jlassi's GDC 2017 PresentationGDCdetails ↗
Blizzard Cinematics Senior TD presents at the SideFX GDC booth: custom procedural grooming system for VFX, auto-generating real-time hair cards and Nvidia Hairworks export.
CFX
4D scanning system that captures detailed clothing geometry and body motion simultaneously, enabling garment retargeting to new body shapes.
CFX / Retargeting
Learns pose-dependent soft-tissue dynamics from FEM simulation data and embeds them in a real-time statistical skin model.
Muscles / Skinning / ML Deformation
Builds a motion graph over facial animation clips, so new performances come from walking the graph instead of authoring every expression by hand.
Facial / Motion Synthesis
Efficient simulation of skin sliding over underlying anatomy, capturing the biomechanical offset behavior of skin relative to muscle.
Skinning / Muscles
End-to-end facial performance pipeline for real-time games combining performance capture, blendshape solving, and photoreal rendering.
Facial
Augments blendshape rigs with finite-element tissue simulation to add physically plausible secondary dynamics during facial animation.
Facial / Muscles
Automatically aligns source and target blendshape ranges of motion for retargeting, reducing artist intervention while preserving intended expression style.
Facial / Retargeting
Official SideFX masterclass introducing Houdini 16.5 guide-curve groom tools including Curve Advect, white-hair generation, and partition-based local groom workflows.
CFX
FLAME model: articulated jaw, neck, and eyeballs with pose-dependent and expression blendshapes trained on 33,000 3D scans.
Facial
Systematic study of action space design choices for deep reinforcement learning locomotion controllers for simulated characters.
Motion Synthesis
Retrospective on developing and refining a physics-based facial muscle model for production, covering lessons in anatomical modeling.
Muscles / Facial
Modular ML pipeline that adds fine-scale wrinkle and expression detail to sparse head-mounted camera marker data, used in Digital Domain's production capture workflow.
Facial
Autodesk walkthrough of two deformation tools added in Maya 2017 Update 3: the Tension deformer for surface-tension effects and the Bake Deformer Tool for converting complex deformers to skin weights for game engine export.
Skinning / Rigging
Frame-based retargeting using normalized Euclidean distance matrices of inter-joint distances to transfer motion across differently proportioned skeletons.
Retargeting
Simulates facial expressions via nonlinear energies modeling passive flesh, active muscles, and rigid bone; supports inertia, skin sliding, and collision handling.
Facial / Muscles
A phase-conditioned network that generates real-time locomotion, the breakthrough for neural character controllers.
Motion Synthesis
Describes Naughty Dog's physics layer on top of gameplay animation in Uncharted 4, enabling cloth and secondary-motion with predictable artist control and minimal visual distortion.
CFX
Deep CNN system for production facial performance capture achieving real-time tracking speed with production-quality reconstruction accuracy.
Facial / ML Deformation
- Regularized Kelvinlets: Sculpting Brushes Based on Fundamental Solutions of ElasticitySIGGRAPHdetails ↗
Closed-form elastic sculpting brushes for volume-preserving grab, scale, twist, and pinch used in character pose-space sculpting workflows.
Rigging / Skinning
Derives skinning weights for skeleton-driven animation from a watershed mesh segmentation, working for characters in T-pose or arbitrary poses.
Skinning
First method to capture dynamic hair and infer physical simulation parameters from video, enabling playback-and-edit of captured hairstyle dynamics.
CFX
Optimization method for computing sparse rig parameter values that reproduce animator-specified poses with minimal parameter usage.
Rigging
Production pipeline for Moana's complex curly hair with heavy character and environment interaction, introducing a new hair model with overhauled collision handling.
CFX
Describes the grooming, rigging, and simulation pipeline for character-connected hair shared between conjoined twins in Trolls.
CFX
Swaps the pseudo-inverse at the heart of blendshape direct manipulation for a transposition step, mapping dragged points onto the deformation directions to stop the unexpected jumps.
Facial / Rigging
Real-time full-body 3D pose estimation from a single RGB camera at over 30fps enabling markerless mocap for interactive applications.
Retargeting
2016
38Convolutional autoencoder for human motion that enables synthesis and editing of character motion sequences in a compact latent space.
Motion Synthesis
Anatomically constrained local deformation model for monocular face capture that prevents physically implausible face reconstructions.
Facial
Ubisoft Toronto presented motion matching as a practical replacement for manually crafted animation trees, demonstrating high-quality fluid locomotion from dense mocap databases.
Motion Synthesis
- talkAnimation Bootcamp: The Animate Button: Mocap Automation Techniques at Ubisoft MontrealGDCdetails ↗
Presents Ubisoft Montreal's scripted mocap automation toolset that reduces manual cleanup and retargeting labour across large-scale game productions with hundreds of characters.
Retargeting
Transfers skeleton structure and skinning weights between characters with different mesh topologies without manual re-rigging.
Rigging / Skinning / Retargeting
Art-directable muscle simulation system for face and body allowing artists to achieve specific looks while respecting physics constraints.
Muscles / Facial
First fully automatic single-image hair modeling method using a hierarchical deep network for segmentation and direction estimation, building a 50K-model hairstyle database.
CFX / ML Deformation
Shape space construction method for planar mechanical design, enabling balanced motion planning for articulated characters and mechanisms.
Rigging
Treats blendshapes as force bases rather than shape bases, enabling dynamic and physically plausible facial animation and retargeting.
Facial
System for constructing personalized volumetric facial rigs from scans, combining blendshapes with physics simulation for expressive animation.
Facial / Rigging / Muscles
- CAMA: Contact-Aware Matrix Assembly with Unified Collision Handling for GPU-based Cloth SimulationCGFdetails ↗
GPU cloth pipeline that integrates contact forces into implicit time integration via parallelized sparse matrix assembly for 100-300K triangle garments.
CFX
Pipeline for building a personalized facial rig directly from performance-capture data, fitting blendshape bases to actor-specific motion.
Facial / Rigging
Covered MPC techniques for photorealistic digital humans including skin shader behaviour, facial animation, and underlying muscle simulation.
Facial / Muscles / Skinning
Low-rank helper bone framework efficiently captures pose-dependent skinning deformations by learning auxiliary joint transforms from examples.
Skinning
Real-time face reenactment system transferring facial expressions from a source actor to a target in monocular video using dense tracking.
Facial
Workshop showing DI4D surface capture pipelines for Remedy's Quantum Break and Blur Studio's Agent Six virtual-Angela-Bassett character.
Facial / Retargeting
Describes the simulation rig for Finding Dory's septapus Hank, covering flesh simulation, sucker dynamics, and mantle behavior built on a complex animation rig.
CFX / Rigging
Ubisoft replaced reactive foot IK with a predictive biomechanical model for Assassin's Creed, producing more fluid and accurate foot placement that preserves source animation detail.
Rigging / Skinning
Character soft-tissue simulation system for Zootopia scaling from hero to crowd characters, capturing subtle animal flesh and fur dynamics with artistic controls.
Muscles / CFX / Skinning
Production overview of physics-based character animation combining FEM muscles, skin, and collision for anatomically driven deformation.
Muscles / Skinning
GDC talk introducing IK Rig architecture for procedural pose correction and layered animation, foundational to Unreal Engine IK framework.
Rigging
Confines Verlet integration to a selected patch of the face, picked by geodesic distance from a heat kernel, so a local deformation does not ripple through the whole model.
Facial / Rigging
Uses formal grammar rewriting rules to synthesize structured motion sequences obeying behavioral rules for multiple characters.
Motion Synthesis
Ubisoft's nearest-neighbour search through raw mocap that replaced state-machine locomotion in AAA games (For Honor).
Motion Synthesis
Multiple FEM subspace models are precomputed around representative poses and blended at runtime, adding millisecond-cost secondary dynamics to rigged characters.
ML Deformation / Muscles
The dissertation behind Cetinaslan's blendshape interface papers: sketch driven direct manipulation localized with geodesic circles, a Jacobian transpose solver that stops the pseudo-inverse jumps, and a localized Verlet framework, validated on production facial models.
Facial / Rigging
This paper presents a robust real-time hair simulation method built on the hair mesh representation, which describes the hair volume as a coarse polygonal mesh.
CFX
Optimizes per-vertex rotation centers for skeletal skinning, nearly eliminating candy-wrapper and volume-loss artifacts in real time.
Skinning
- Reconstructing Personalized Anatomical Models for Physics-based Body AnimationSIGGRAPH Asiadetails ↗
Reconstructs internal anatomical structures from surface scans to drive physics-based soft-tissue deformation personalized to individual subjects.
Muscles / Skinning
Builds personalized 3D facial rigs from monocular video, recovering identity-specific blendshapes for downstream animation and editing.
Facial / Rigging
Method for repurposing authored hand animation across different interactive contexts by adaptively retargeting motion to new constraints.
Rigging / Retargeting
Production cloth technique for selectively smoothing folds and resolving collisions to improve visual quality of dynamic garment animation.
CFX
Detailed how real-time characters Senua, Siren, and Meetmike were built using motion capture solving and Cubic Motion's performance-transfer pipeline.
Facial / Retargeting
Sketch-based interface for editing articulated character motion, enabling intuitive spatial control over limb trajectories and poses.
Rigging / Retargeting
Deep reinforcement learning for terrain-adaptive character locomotion that generalizes to novel obstacles without motion capture references.
Motion Synthesis
Pixar open-sources USD, a scalable system for authoring, reading, and interchanging time-sampled scene descriptions across DCC tools and production pipelines.
Rigging
Parallel randomized Gauss-Seidel via graph coloring for PBD and Projective Dynamics constraints, achieving millisecond per-frame cloth and soft-body solve on GPU.
CFX
Extended PBD formulation with compliant constraints providing physically consistent stiffness control independent of timestep size.
CFX
2015
28Multi-domain subspace simulation efficiently animates the deformation of a large deformable body by constraining each domain's deformation to a separate subspace, with the key challenge being how to c
CFX
Reshapes body scans to human proportions and auto-rigs them into skinned virtual characters using a SCAPE deformable model.
Rigging / Skinning
Simulates hand soft tissue and tendons as a coupled tendon-routing system driven by muscle activations, producing anatomically plausible finger motion.
Muscles / Rigging
Naughty Dog examines the motion capture pipeline for The Last of Us, covering data acquisition tools, large dataset management, raw data cleanup, and retargeting animation onto character skeletons.
Retargeting
Data-driven anatomical body modeling framework assembling muscles, bones, and fat to build parameterized human body shapes from measurements.
Muscles / Skinning
- Dataflow: ILM's Framework for Procedural Geometry Generation, Simulation Authoring, Crowds, and MoreDigiProdetails ↗
Presents ILM's node-based procedural graph system used for hair instancing, geometry, and character crowd pipelines across dozens of productions.
Rigging / CFX
Overview of DreamWorks Animation's facial motion system covering deformation pipeline, blendshape solving, and production integration.
Facial / Rigging
Drives sub-millimeter facial scans from video-based performance capture by solving blendshape coefficients from tracked video features.
Facial
Data-driven model of soft-tissue dynamics learned from 4D body scans, capturing pose-dependent deformations beyond standard skinning.
Skinning / ML Deformation
System for creating personalized animatable 3D face avatars from casual handheld video using blendshape fitting and rig transfer.
Facial / Rigging
Hybrid direct and projective iterative algorithm for hair simulation with a comprehensive elasticity model and stable collision handling.
CFX
Post-production tool allowing directors to blend between different takes of a facial performance, enabling new emotion transitions via image-space blending.
Facial
Fast contact determination for intersecting deformable solids with detailed surfaces, using a barycentric BVH and a topological flood to find contact regions.
CFX
Fast fully-automatic morphing algorithm creates simulatable flesh and muscle models for human and humanoid faces from a target surface mesh alone.
Facial / Muscles
UVN-space facial rig for The Peanuts Movie letting features slide along curved head volumes while preserving 2D shape language, developed with Autodesk for Maya.
Facial / Rigging
Neural network inverts the rig function, mapping low-level joint positions or surface geometry back to animator-friendly rig control values in real time.
Rigging / Retargeting
Convolutional autoencoder learning a compact motion manifold from raw motion capture data for synthesis and style transfer.
Motion Synthesis
Presents real-time motion retargeting and interactive motion blending within the Golaem Crowd plugin, reducing asset count for production crowd shots.
Retargeting
Two-layer skinning that applies position-based dynamics constraints on top of LBS to achieve volume preservation and soft jiggle in real time.
Skinning
Real-time method adding plausible wrinkle details to coarsely simulated or keyframed cloth by using a data-driven wrinkle prediction model.
CFX
Real-time system for capturing high-fidelity facial performance from RGB cameras using a personalized blendshape model.
Facial
Data-driven pipeline reconstructing complete 3D hairstyles from a single photograph using USC-HairSalon database retrieval and user-guided strand growing.
CFX
Stroke-based posing tool that snaps multiple joints to a drawn silhouette, used heavily on Inside Out for character and cloth-simulation results tuning.
Rigging
Puts sketched controllers on the blendshape face itself, the opening move in Cetinaslan's line of work on making weight editing feel like drawing rather than hunting through sliders.
Facial / Rigging
Algebraic multigrid method for accelerating cloth simulation on unstructured meshes with varying material properties and collision constraints.
CFX
SMPL body model factoring shape and pose-dependent deformations for efficient synthesis of realistic human body shapes and animations.
Skinning / Retargeting
- talkUbisoft Cloth Simulation: Performance Postmortem and Journey from C++ to Compute ShadersGDCdetails ↗
Ubisoft analyzed cloth simulation performance in Assassin's Creed Unity and Far Cry 4, then ported the system to GPU compute shaders achieving over 10x performance improvement.
CFX
- Vdub: Modifying Face Video of Actors for Plausible Visual Alignment to a Dubbed Audio TrackEurographicsdetails ↗
Monocular face modification system for dubbing, aligning lip motion to dubbed audio by warping the actor's mouth region.
Facial
2014
27Guide-strand reduced model with optimal interpolation relationships simulates 150K hair strands in real time with a hair-correction collision pass.
CFX
Eulerian-on-Lagrangian framework simulating volumetric muscles in close contact with volume preservation, large deformation, and active contraction.
Muscles / CFX
Stable simulation of large rod assemblies by adapting nonlinearity in collision response, addressing the severe time-step restrictions caused by transversal impacts.
CFX
Irrational Games details the cross-disciplinary animation, systemic, and narrative techniques that gave BioShock Infinite's Elizabeth the illusion of humanity through art, design, and systems collaboration.
Facial / Retargeting
Rhythm and Hues' detail-preserving smoothing deformer that cleans rough skinning automatically, now a standard node in every DCC.
Skinning
- Displaced Dynamic Expression Regression for Real-Time Facial Tracking and AnimationSIGGRAPHdetails ↗
Regresses displaced expression shapes from RGB video enabling real-time facial tracking and animation with detailed wrinkle representation.
Facial
Bungie shared how 42 player-selectable heads across different alien races and genders shared a single facial animation set via parameterized topology and rig design.
Facial / Retargeting
Large-scale 3D facial expression database with bilinear model fitting enabling data-driven face tracking, synthesis, and editing.
Facial
Enhances dynamic facial performance captures by propagating high-frequency detail from a reference scan through the sequence.
Facial
Learns face-motion retargeting from actor to virtual model using MLP and RBF neural networks trained on small datasets.
Facial / Retargeting
Inverse optimal control framework for generalizing locomotion style to novel animal morphologies by regressing locomotion objectives.
Motion Synthesis / Retargeting
Production talk introducing Furball, DNEG's GPU-accelerated procedural node-graph fur grooming tool used for the lion character in Hercules.
CFX
Postmortem of Harmonix's object-oriented Maya Python rigging framework, covering the framework's evolution from early failures to a production-proven system for character rig and tool development.
Rigging
Penalty-based contact is simple and popular, but it suffers from stability problems caused by highly variable and unpredictable net stiffness, especially with time-varying distributed contact over geo
CFX
Custom pipeline processes photogrammetry facial scans and mocap data into real-time blendshapes, delivering high-quality facial animation at moderate cost drawing on EA and Naughty Dog experience.
Facial / Retargeting
State-of-the-art report on blendshape facial models covering theory, practice, workflow, and mathematical foundations used in VFX and games.
Facial
Fast implicit simulation framework using local-global constraint projection, unifying cloth, soft bodies, and position-based dynamics.
CFX
Robust skeleton extraction and skinning weight computation from mesh animation sequences using SSDR with improved stability.
Rigging / Skinning
Data-driven capture framework fitting hair strands to multi-view point clouds via a voting algorithm using a database of physics-simulated example strands.
CFX
A robust scheme for collapsed and inverted elements in interactive corotational FEM, giving faster, smoother degeneration recovery for deformable-object simulation.
CFX
Describes wind field rigs and simulation integration developed for Frozen, capturing cloth and hair interaction with arctic environmental wind conditions.
CFX
Comprehensive SIGGRAPH course covering LBS, DQS, pose-space deformation, and example-based skinning methods for real-time character deformation.
Skinning
Physics-based surface-only skinning method that captures full volumetric flesh behavior using surface degrees of freedom with collision support.
Skinning / Muscles
PBD extension constraining Green-St Venant strain tensor entries directly, enabling anisotropic cloth behavior without polar decomposition overhead.
CFX
Subspace cloth simulation using pose-dependent adaptive bases, enabling fast and plausible garment simulation for animated characters.
CFX
Unified particle system handling cloth, fluids, rigid bodies, and soft bodies in a single GPU-accelerated position-based framework.
CFX
Yarn-level simulation of woven cloth using efficient contact handling between yarns to reproduce fabric appearance and mechanical behavior.
CFX
2013
13Real-time 3D face shape regression from RGB video, tracking both rigid head pose and non-rigid expression deformation simultaneously.
Facial
Transfers a full anatomical model (bones, muscles, fat) onto arbitrary character shapes, automating anatomy-based rig setup.
Muscles
Pixar production hair simulation for curly hair using a novel curl model that preserves artistic intent throughout the simulation.
CFX
Multi-camera capture and semi-parametric statistical model of shoulder-arm skin and muscle deformations across subjects and poses.
Muscles / Skinning
Voxelization-based geodesic distance approach automatically computes LBS influence weights tolerating non-manifold and multi-component production meshes.
Skinning / Rigging
Contour-based facial animation capture system enabling high-fidelity retargeting of subtle expressions to CG character rigs.
Facial / Retargeting
Implicit surface composition on top of geometric skinning that produces contact and bulge effects at the joints in real time.
Skinning
Precomputation approach for secondary cloth motion on articulated characters, enabling real-time playback of complex garment dynamics.
CFX
Online 3D morphable model fitting for real-time facial animation from depth sensor input with continuous model adaptation.
Facial
Real-time facial animation system that fits corrective blendshapes on-the-fly from depth input to handle fine wrinkle and contact deformation.
Facial
Facial blendshape transfer method that enforces smooth contact constraints during deformation to prevent interpenetration artifacts.
Facial / Skinning
Multi-view hair capture system that reconstructs coherent, wisp-aware strand geometry from still photographs without special lighting setups.
CFX
Compact two-layer representation for dense skinning weights enabling efficient compression while preserving deformation quality.
Skinning
2012
21Extends blendshape facial models with physics-based collision response so blendshape targets automatically account for contact deformation.
Facial / Skinning
Editing tool for blendshape facial rigs enabling composite operations, mixing and retargeting facial expressions for production characters.
Facial
State of the art report reviewing the fundamentals of facial rigging, the available techniques, their uses and their problems, and what makes preparing a face for animation hard.
Facial / Rigging
Adaptive cloth remeshing system adding resolution where needed for fine wrinkles while coarsening in flat regions for efficiency.
CFX
DICE covers animation philosophy and production challenges for Battlefield 3, addressing single and multiplayer pipeline issues and solutions for their largest and most complex title.
Retargeting
Automatically creates skeletons, rigid skin weights, and joint mappings for multi-component 3D characters from shape databases.
Rigging
Generalizes harmonic coordinates by interpolating boundary derivatives, yielding smoother 2D cage deformations with fewer global distortions.
Skinning
Measures complex 3D cloth deformation from physical samples and fits nonlinear simulation model parameters to the observations.
CFX
Example-based material simulation system enabling artists to specify target deformation examples that guide realistic elastic behavior.
CFX / Skinning
Optimizes LBS and DQS weights to minimize elastic energy, yielding deformations that mimic nonlinear simulation quality.
Skinning
Fast linear optimization over bounded biharmonic weight space for automatic linear blend skinning from sparse user-provided handles.
Skinning
- FEM Simulation of 3D Deformable Solids: A Practitioner's Guide to Theory, Discretization and Model ReductionCoursedetails ↗
These SIGGRAPH course notes give a practical, self-contained introduction to finite element method simulation of 3D deformable solids, covering the deformation gradient, strain and stress measures, el
CFX
Multithreaded dependency graph architecture for character rig evaluation, enabling scalable parallel computation of complex DreamWorks rigs.
Rigging
EA DICE built a modular deformation rig combined with the ANT animation system and motion capture to raise character quality across Battlefield 3's large asset volume.
Rigging / Skinning
Fabrication-oriented method for cloning the physical mechanics of a human face into a robotic or animatronic face system.
Facial / Muscles
Physics-based facial rig coupling blendshape controls with a finite-element tissue model for artist-directed, anatomically plausible animation.
Facial / Muscles
Runs physical simulation directly in the space of an artist rig's parameters, so secondary motion lands on animator-friendly controls.
Rigging / CFX
The journal version of Sketch Express: strokes on a 2D canvas pose a face independently of its rig, and those poses can be stored and retargeted to other characters.
Facial / Rigging / Retargeting
SSDR: automatically extracting bone transforms and weights from example animations, widely used for rig conversion and crowd pipelines.
Skinning / ML Deformation
Spacetime optimization framework for cloning facial expressions across blendshape rigs while preserving timing and dynamic feel.
Facial / Retargeting
Motion synthesis approach using tiled motion patches for seamlessly transitioning and looping character locomotion in interactive applications.
Motion Synthesis
2011
17- A Hybrid Iterative Solver for Robustly Capturing Coulomb Friction in Hair DynamicsSIGGRAPH Asiadetails ↗
Hybrid iterative solver robustly handling Coulomb friction in hair dynamics using a Signorini-Coulomb contact model.
CFX
Describes a scripted pipeline that automatically generates character runtime rigs, reducing manual technical director work and improving rig consistency across all character assets in production.
Rigging
Retargeting method for facial animation that maps captured motion to diverse character rigs while preserving artistic intent.
Facial / Retargeting
Bounded biharmonic weight computation for cage and skeleton deformation providing smooth, localized, non-negative influence functions.
Rigging / Skinning
- Character Rigging, Deformations, and Simulations in Film and Game ProductionSIGGRAPH Coursesdetails ↗
Production oriented SIGGRAPH course on character rigging, deformation and simulation across film, visual effects and games, taught by veterans from Texas A&M, DreamWorks and Electronic Arts.
Rigging / Skinning / Muscles
Compression scheme for large blendshape models that preserves direct manipulation capabilities, reducing memory without sacrificing editability.
Facial
Hybrid simulation and keyframe approach for art-directing Tangled's hair to match story-driven 2D draw-over targets during complex character interactions.
CFX
Near-interactive corotational elasticity on hexahedral lattices for character soft-tissue deformation, handling contact and collisions in production at Disney.
Skinning / CFX / Muscles
Epic Games technical animator presented a universal facial rig pipeline for Gears of War 3 emphasizing speed and efficiency in character facial setup.
Facial / Rigging
Digital birds are used in computer graphics to replace live animals for safety and to allow more control over performance, but the current treatment of avian wings is often over-simplified,
Rigging
Passive multi-view facial performance capture using anchor frames for temporal coherence, achieving high-quality reconstruction without active illumination.
Facial
Multi-domain subspace deformation method for real-time physics-based character skinning using model reduction per body segment.
Skinning / Muscles
Real-time performance-based facial animation driven by depth camera input, enabling live facial retargeting at interactive rates.
Facial
Rigid motion stabilization for facial performance capture, separating head pose from expression motion for improved downstream processing.
Facial
Volume animation technique using MRI scan data with locally adaptive articulated registration, enabling realistic volumetric character deformation.
Skinning / Retargeting
Sketch based interface where strokes drawn on a canvas pose a face directly, independent of the underlying rig, so poses can be stored and reused across characters.
Facial / Rigging / Retargeting
Extends LBS bones to support stretch and twist DOF, eliminating candy-wrapper artifacts without extra helper joints.
Skinning / Rigging
2010
22Examines partial and additive animation layering, remapping, and flipping techniques that gave Naughty Dog Uncharted characters responsive, feel-good player-controlled movement on PS3.
Retargeting
Covers God of War III character animation from concept through in-game implementation, including contact-sensitive moves and maintaining Kratos visual consistency across gameplay demands.
Retargeting
BioWare described an automated system that selects and blends animator-authored facial performance libraries to handle high-volume dialog in Star Wars: The Old Republic.
Facial / Retargeting
Direct manipulation interface for blendshape rigs allowing artists to sculpt corrections on the face mesh with automatic weight solving.
Facial
- Easy Rigging of Face by Automatic Registration and Transfer of Skinning ParametersICCVGproject ↗details ↗
Transfers the feature points and their point-vertex weights from an already rigged reference face onto a new mesh with radial basis functions and automatic registration, so nobody marks correspondences by hand.
Rigging / Skinning / Facial
Adaptive contact linearization for yarn-yarn penalty forces in knitted cloth, exploiting temporal coherence to reduce contact solve cost substantially.
CFX
Optimization method for constructing blendshape facial rigs directly from example expression scans using sparse deformation decomposition.
Facial / Rigging
Data-driven wrinkle synthesis adding fine detail to coarse cloth animation using a database of example wrinkle patterns.
CFX
Iterative coordinate-descent algorithm that decomposes arbitrary mesh animations into standard linear blend skinning without manual rigging.
Skinning
For Clash of the Titans, MPC developed a sophisticated feather system used on several flying creatures across more than a hundred shots, delivering photo-realistic results over a wide range
CFX
Multi-view passive capture system for facial performance without markers, recovering high-resolution dynamic geometry from synchronized cameras.
Facial
Pore-level facial geometry from a single passive stereo shot, the start of the Medusa capture line at Disney Research.
Facial
Coordinate-invariant strain limiting via SVD of the deformation gradient at multiple resolutions, enforcing isotropic inextensibility for cloth and shells.
CFX
Explains how physics and IK were fused in Just Cause 2 for skydiving, grappling, and vehicle clinging, reducing animation asset creation while enabling novel emergent gameplay interactions.
Rigging
Production techniques for simulating 70 feet of Rapunzel's hair in Tangled using a mass-spring dynamicWires system with art-direction controls.
CFX
Differential IK formulation providing stable, efficient inverse kinematics for complex character rigs with redundant degrees of freedom.
Rigging
Data-driven conditional cloth model learned from simulation that enables real-time animation of thousands of garments with approximate collision resolution.
CFX / ML Deformation
Panel from 5th Cell, BioWare, and 343 Industries covering mocap integration, blendshapes, shader-based deformation, procedural helpers, and muscle systems in character pipelines.
Rigging / Skinning / Muscles
USC ICT and Image Metrics cross the uncanny valley with a fully digital photoreal face built from Light Stage scans.
Facial
Presents full-body IK targeting, physics and animation blending techniques, and character navigation solutions used in UFC 2009 Undisputed for responsive fighter animation.
Rigging
Naughty Dog details proprietary modeling tools, Maya referencing for skeletal assets, a shared male/female facial rig skeleton, sculpting workflows, and UV seam solutions for Uncharted 2.
Rigging / Facial
Attaches a fine-resolution wrinkle mesh to a coarse animated base mesh, solving wrinkle geometry with a static solver at interactive rates.
CFX / Skinning
2009
8Unified statistical model of human pose and body shape learned from 550 laser scans, capturing pose-dependent muscle deformations.
Skinning / ML Deformation
Synthesizes complex contact-rich motions such as dressing by embedding topological relationships of body segments into motion coordinates.
Motion Synthesis
This paper presents a scheme for constructing complex, non-penetrating feather geometry suitable for feature animation.
CFX
Continuum-based strain limiting for cloth simulation that prevents over-stretching while maintaining simulation stability and physical plausibility.
CFX
Continuum-based hair simulation using SPH-like discretization preserving fine strand detail while handling large numbers of interacting hairs.
CFX
Demonstrates semi-procedural techniques for real-time bipedal locomotion, blending keyframe animation with procedural IK to adapt foot placement dynamically on uneven terrain.
Rigging
Interactive facial expression modelling where a learned prior over real faces keeps every edit plausible, so a handful of user constraints resolves into a natural pose.
Facial / Rigging
Mesh-based representation for volumetric hair enabling efficient simulation and rendering of dense hair interacting with the body.
CFX
2008
14A practical mass-spring formulation able to simulate full heads of individual hairs with stable contact and collision.
CFX
Reconstructs articulated character mesh animation from multi-view silhouette sequences enabling markerless performance capture.
Retargeting
Data-driven model of coupled skin and muscle deformation learned from 4D scan sequences of real human motion.
Skinning / Muscles
Discrete differential geometry formulation for elastic rod simulation capturing bending and twisting for hair, cables, and filamentary structures.
CFX
- Facial Performance Synthesis using Deformation-Driven Polynomial Displacement MapsSIGGRAPH Asiadetails ↗
Learns polynomial maps from mocap markers to high-res face geometry for wrinkle and pore detail synthesis.
Facial
Dual quaternion blending for skeletal skinning that eliminates the candy-wrapper artifact of LBS at negligible extra computational cost.
Skinning
Derives shape-preserving cage coordinates from Green's integral identity, inducing quasi-conformal mappings for realistic mesh deformation.
Skinning
Musculotendon simulation for anatomically detailed hand animation, modeling tendon routing and muscle fiber contraction for realistic grasping.
Muscles
Real-time motion retargeting for highly varied character body shapes, enabling game characters with diverse proportions to share animation.
Retargeting
This talk presents a scheme for constructing complex feather geometry suitable for feature animation.
CFX
Introduces reusable per-joint cage deformation templates that transfer skinning across characters with similar skeletons.
Skinning / Rigging
Fail-safe collision response that cancels impact but preserves sliding, incorporating Coulomb friction approximation for cloth self-collision at scale.
CFX
Yarn-level cloth simulation capturing the mechanical behavior of knitted fabrics through individual yarn dynamics and contact.
CFX
The journal account of Orvalho's reusable facial rigging: a generic labelled rig (controls, skeleton, muscles) is transferred to arbitrary target faces by correspondence, so one authored rig and its animations drive many characters.
Facial / Retargeting
2007
9Automatic skeleton embedding and skinning weight computation for arbitrary 3D meshes, enabling one-click rigging of novel characters.
Rigging / Skinning
Efficient inextensibility constraint formulation for cloth using a fast filter-based approach preventing stretching without sacrificing speed.
CFX
Harmonic coordinate space for cage-based character deformation providing non-negative, smooth weights that satisfy the maximum principle.
Rigging / Skinning
Low-dimensional basis representation over motion capture enables automatic computation of near-optimal real-time character controllers.
Motion Synthesis
- talkNext-Generation Facial Rigging: Development of an Infinite Pose Combination Facial SystemGDCdetails ↗
Naughty Dog's Infinite Pose Combination system enabled facial rigs capable of arbitrary pose combinations, advancing character expressiveness beyond fixed blendshape limits.
Facial / Rigging
Position-based simulation framework for real-time cloth, hair, and deformable bodies widely adopted in games and interactive applications.
CFX
PhD thesis on a portable facial pipeline: build a sophisticated rig once on a generic model, then automatically transfer its controls, anatomy and animation to many different face models.
Facial / Rigging
Simple feedback-based bipedal locomotion controller achieving robust walking and running on varied terrain with minimal parameter tuning.
Motion Synthesis
Dual quaternion blending fixes the collapsing-joint and candy-wrapper artifacts of linear blend skinning at almost the same cost.
Skinning
2006
6Data-driven model of skin and muscle deformation extracted from human motion, enabling realistic soft-tissue dynamics on animated characters.
Skinning / Muscles
Automated pipeline converts unarticulated example shapes into a controllable articulated reduced-deformable model with intuitive IK-style control.
Rigging / Skinning
GPU-parallel example-based pose-space deformation that automatically computes per-vertex blend weights from sample poses.
Skinning
Super-helix model for hair strand dynamics using Kirchhoff elastic rods, capturing natural curl and wave patterns with high physical fidelity.
CFX
Adapts a generic facial rig to different face models through a labelling system that carries muscles and skeleton across, so the same deformation parameters give each face its own expressions.
Facial / Rigging
Finds the correspondence between a generic facial rig and a target face, then transfers controls and anatomy so the same deformation parameters yield expressions across different 3D face models.
Facial / Retargeting
2005
11- Automatic Determination of Facial Muscle Activations from Sparse Motion Capture Marker DataSIGGRAPHdetails ↗
FEM-based facial muscle simulation with automatic activation estimation from sparse mocap markers, enabling physics-driven facial animation.
Facial / Muscles
Finite element musculoskeletal simulation built from anatomical data, groundwork for the production flesh systems that followed.
Muscles
Multilinear model factoring facial identity and expression for transferring performances between individuals and editing facial animation.
Facial / Retargeting
Geostatistical approach to motion interpolation using kriging for smooth synthesis of human movement from sparse example motion clips.
Motion Synthesis
Extends mean value coordinates to closed triangular meshes in 3D, enabling smooth and natural cage-based space deformations.
Skinning
Deformation-gradient feature vectors and nonlinear example span enable direct mesh posing through vertex constraints without an explicit skeleton.
Rigging / Skinning
Drives an elastic volumetric body model with the animator's skeleton, so skeletal motion induces physically plausible secondary deformation and dynamics, combining skeleton-based control with elasticity-based realism.
Rigging / Skinning
Foundational FEM flesh simulation using quasistatic Newton-Raphson iteration robust to element inversion, enabling character soft-tissue deformation.
Muscles
Statistical body shape model factoring body shape from pose deformation, foundational for parameterized human body models used in vision and animation.
Skinning / Retargeting
Method to extract linear blend skinning weights and skeleton from animated mesh sequences, enabling compact representation of captured deformations.
Skinning
2004
5Puss in Boots, a new character in Shrek 2, wears an ostrich feather in his hat that had to move convincingly.
CFX
Discovers logically similar motion variants in large capture databases and builds continuous parameterized motion families automatically.
Motion Synthesis / Retargeting
Transfers the deformation of a source mesh onto a different target mesh, the standard tool behind blendshape and rig transfer.
Retargeting / Skinning
Encodes each vertex by the mesh Laplacian relative to its neighbourhood, an intrinsic differential representation that preserves surface detail under deformation and lets detail be transferred or transplanted between meshes.
Skinning / Retargeting
Gaussian process model for style-aware inverse kinematics generating human-like poses respecting learned stylistic priors.
Rigging / Retargeting
2003
7Discrete differential geometry formulation for thin elastic shells using hinge-angle bending energy, foundational for cloth and thin surface simulation.
CFX
User paints a timeline with semantic annotations and the system assembles motion-capture frames via dynamic programming to satisfy them.
Motion Synthesis
This paper describes a physics-based method for synthesizing realistic bird flight animations.
Motion Synthesis
Mixed implicit/explicit integrator with physically correct bending and interface forecasting to preserve folds in cloth-character collisions.
CFX
Resolves deeply interpenetrating cloth using a global geometry-based untangling approach, essential for garment initialization and collision recovery.
CFX
Drives a 3D face rig from ordinary video, tracking a performer with a single camera instead of markers and mapping the tracked motion onto the character.
Facial / Retargeting
Foundational WDAS sketch presenting XGen, a system for instancing curves and geometry on surfaces for fur, feathers, foliage, and hair with grooming brush tools.
CFX
2002
7This work defines the structure of an individual feather using a parameterization derived from the biological structure and substructures of real feathers.
CFX
Compresses pose-dependent skinning corrections into per-joint eigenbases (PCA of displacement deltas) and evaluates them on the GPU, real-time corrective skinning in hardware.
Skinning
Drives a volumetric character's elastic deformation with the animator's skeleton via a multiresolution linear-elasticity solve, giving interactively controllable, physically based secondary motion.
Skinning / Rigging
This paper presents techniques for modeling and rendering realistic feathers and feathered birds.
CFX
Builds a graph of transitions inside a mocap corpus so arbitrary streams of motion can be synthesized from clips.
Motion Synthesis
- Robust Treatment of Collisions, Contact and Friction for a Skinned Cloth SimulationSIGGRAPHdetails ↗
Robust collision handling for cloth simulation using impulse-based contact resolution and continuous collision detection for stable production use.
CFX
Foundational algorithm for cloth collision, contact, and Coulomb friction, introduced velocity-filter-style resolution for simultaneous impacts.
CFX
2000
2Light stage system capturing the full reflectance field of a human face enabling relighting with arbitrary illumination for photoreal CG faces.
Facial
- Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven DeformationSIGGRAPHdetails ↗
Corrective shapes interpolated in pose space on top of skeletal skinning, the backbone idea behind modern corrective workflows.
Skinning
1999
2The 3D morphable face model: a statistical face space fit to images, ancestor of every data-driven face model since.
Facial
Edits captured motion through a spacetime optimization over a simplified physical character model, so the transformed motion stays physically plausible while meeting new animator constraints.
Motion Synthesis / Retargeting
1998
5Implicit integration makes cloth simulation stable at large time steps, the foundation of production cloth (and of Maya nCloth's lineage).
CFX
Spacetime constraint-based motion retargeting adapting motion capture data to new character proportions while preserving dynamic qualities.
Retargeting
Introduced subdivision surfaces into Pixar's production pipeline for Geri's Game, enabling smooth deformable character meshes from arbitrary topology.
Rigging / Skinning
Radial basis function interpolation framework for blending motion clips along semantic dimensions like speed and emotion for interactive characters.
Motion Synthesis
Deforms a surface by associating it with editable curves (wires); moving a wire pulls the nearby surface, a deformation paradigm widely used for facial and character rigs.
Rigging / Skinning
1997
2Builds animals from anatomical components, bones, muscles, and generalized tissue, and grows a deformable skin over them, an early template for muscle-driven character deformation.
Muscles / Skinning
Models human muscles with anatomically motivated primitives that bulge and change shape with joint angle, driving realistic skin deformation over the musculature.
Muscles
1996
1Scripting system for interactive character behaviors combining procedural motion layering with behavioral state machines for real-time actors.
Motion Synthesis
1995
2Physics-based simulation of human athletic activities including running, jumping, and gymnastics with reactive balance control.
Motion Synthesis
Motion editing technique warping captured animations to meet user-defined spacetime constraints while preserving dynamic continuity.
Retargeting
1994
1Genetic algorithm evolution of virtual creature morphologies and neural locomotion controllers, pioneering learned physics-based animation.
Motion Synthesis
1992
1Lets the user drag points on the model directly and solves for the lattice control points that achieve it, making FFD usable without manipulating the cage by hand.
Skinning
1990
2Extends FFD to non-parallelepiped and arbitrarily shaped lattices, so the deformation tool can match the feature being sculpted rather than a rigid box.
Skinning
Drives a digital face directly from tracked human performance, the founding paper of performance capture.
Facial / Retargeting
1989
1Layered character model with skeleton, muscle, and skin layers using proximity-based deformation for realistic anatomical character animation.
Skinning / Muscles
1988
2Introduced joint-dependent local deformations (JLD) for hand animation, an early precursor to pose-space deformation and corrective skinning.
Skinning / Rigging
Spacetime optimization formulation for physics-based character animation, optimizing motions over time to satisfy user-specified constraints.
Motion Synthesis
1987
2Parameterized face muscle model using linear and sphincter muscle types to animate facial expressions, influencing decades of facial animation research.
Facial / Muscles
The paper that brought physically based elastic simulation to graphics, ancestor of all cloth and flesh solvers.
CFX / Muscles
1986
2Introduces FFD lattices: deforming models by warping the space around them, a foundation for countless rig deformers.
Skinning
One of the first computer graphics cloth methods: drape a fabric hung from constraint points by approximating it with catenary curves, then relax it under gravity.
CFX
1984
1Deforms solid primitives with global operators (twist, bend, taper, scale) applied as a position-dependent transform, and derives how surface normals carry through via the inverse-transpose of the deformation's Jacobian.
Skinning
1981
1Early muscle-based facial animation system using pseudo-muscles anchored to a facial mesh to drive expression deformations.
Facial / Muscles
1978
3The psychology taxonomy of facial action units that became the de facto vocabulary of every film and game facial rig.
Facial
Distorts embedded shapes by trapping them in a triparametric Bernstein lattice and warping that lattice, the embed-and-warp idea later formalized as free-form deformation.
Skinning
Defines Catmull-Clark subdivision surfaces: recursively refine an arbitrary-topology polygon mesh toward a smooth limit surface, the substrate later adopted for production character meshes.
Skinning
1976
1- Interactive Skeleton Techniques for Enhancing Motion Dynamics in Key Frame AnimationSIGGRAPHdetails ↗
Early interactive skeleton system for keyframe animation using interpolation between poses, foundational for articulated character animation tools.
Rigging
1974
1First parameterized 3D face model enabling controllable facial expression animation through a set of continuous deformation parameters.
Facial
1972
2The system behind the Computer Animated Hand, one of the first 3D computer character animations: Catmull digitized a model of his own hand into roughly 350 polygons and animated it, an origin point for articulated 3D characters.
Rigging
First known computerized 3D facial animation, creating a parametric model of a human face and producing the first CG facial animation.
Facial
Nothing matches these filters.
Sources
RSS ↗Per-year link lists for every SIGGRAPH, SIGGRAPH Asia and Eurographics technical-papers program.
The Medusa and Anyma facial capture line, rig-space physics, and character simulation.
WDAS production papers on hair, cloth, and skinning from Tangled through Moana 2.
Loki, Animatomy, and the systems behind the Avatar-era face and creature pipelines.
Character articulation, cloth and hair, and the deformation papers behind Presto.
Masquerade and Charlatan: the face pipelines behind Thanos and digital doubles.
Tables of contents for the production and animation-specific venues.
The talks that moved game animation: motion matching, IK rigs, facial pipelines.
Studio breakdowns of creature, face, and CFX pipelines from the Stuttgart conference.
Learned motion matching, motion in-betweening, and physics-based characters.
MetaHuman, Control Rig, the ML Deformer, Chaos Cloth, and Motion Matching talks.
KineFX and APEX rigging, ML skinning, muscle and tissue, and crowd character FX.
Delta Mush, Proximity Wrap, Bifrost rigging, HumanIK, and the Maya ML Deformer.
Preprints for the ML character animation wave.