← ArchivePaper2019
Learning-Based Animation of Clothing for Virtual Try-On
Recurrent neural network predicts garment drape and wrinkles as a function of body shape and dynamics in a few milliseconds.
Abstract
This paper presents a learning‐based clothing animation method for highly efficient virtual try‐on simulation. Given a garment, we preprocess a rich database of physically‐based dressed character simulations, for multiple body shapes and animations. Then, using this database, we train a learning‐based model of cloth drape and wrinkles, as a function of body shape and dynamics. We propose a model that separates global garment fit, due to body shape, from local garment wrinkles, due to both pose dynamics and body shape. We use a recurrent neural network to regress garment wrinkles, and we achieve highly plausible nonlinear effects, in contrast to the blending artifacts suffered by previous methods. At runtime, dynamic virtual try‐on animations are produced in just a few milliseconds for garments with thousands of triangles. We show qualitative and quantitative analysis of results.
How to read this
- Category
- Method: learning-based clothing animation for virtual try-on
- Contributions
- Trains a learned cloth model from a database of physically based dressed-character simulations across many body shapes and animations
- Separates global garment fit (from body shape) from local wrinkles (from pose dynamics and body shape)
- Uses a recurrent network to regress nonlinear wrinkles and produces try-on animations in a few milliseconds, avoiding prior blending artifacts
- Context
- Combines a parametric body model with learned cloth deformation, building on Loper et al.'s 'SMPL' (2015) and the real-time clothing-space idea of de Aguiar et al.'s 'Stable Spaces for Real-time Clothing' (2010).Builds on: SMPL: A Skinned Multi-Person Linear Model · Stable Spaces for Real-time Clothing
- Correctness
- The fit-versus-wrinkle decomposition and RNN dynamics give plausible, fast results, but quality is bounded by the precomputed simulation database covering the relevant body shapes and motions, and it targets a fixed garment per trained model.
- Clarity
- Clear structure and well-motivated; a first pass conveys the fit/wrinkle split, while the RNN formulation and training setup reward a second pass.
- How to read it
- First pass for the global-fit-plus-local-wrinkle decomposition and the millisecond runtime claim; second pass on the RNN and the simulation-database construction if you plan to train or extend it.
Built upon by
- Learning an Intrinsic Garment Space for Interactive Authoring of Garment Animation 2019
- A Pixel-Based Framework for Data-Driven Clothing 2020
- Cloth and Skin Deformation with a Triangle Mesh Based Convolutional Neural Network 2020
- Dynamic Neural Garments 2021
- GarMatNet: A Learning-Based Method for Predicting 3D Garment Mesh with Parameterized Materials 2021
- PBNS: Physically Based Neural Simulation for Unsupervised Garment Pose Space Deformation 2021
- Swish: Neural Network Cloth Simulation on Madden NFL 21 2021
- Motion Guided Deep Dynamic 3D Garments 2022
- SNUG: Self-Supervised Neural Dynamic Garments 2022
- Detail-Aware Deep Clothing Animations Infused with Multi-Source Attributes 2023
- SwinGar: Spectrum-Inspired Neural Dynamic Deformation for Free-Swinging Garments 2024
Related work
- GarMatNet: A Learning-Based Method for Predicting 3D Garment Mesh with Parameterized Materials 2021 / MIG
- PBNS: Physically Based Neural Simulation for Unsupervised Garment Pose Space Deformation 2021 / SIGGRAPH Asia
- SMPLicit: Topology-aware Generative Model for Clothed People 2021 / CVPR
- SNUG: Self-Supervised Neural Dynamic Garments 2022 / CVPR
Keywords
This page summarises the entry and links to its original source. The archive never hosts or redistributes the publication itself.Show it in the full archive list →