← ArchivePaper2019
Practical Person-Specific Eye Rigging
Multi-view imaging system and parametric rig estimate person-specific eyeball shape, rotation center, and visual axis at submillimeter accuracy.
Abstract
We present a novel parametric eye rig for eye animation, including a new multi‐view imaging system that can reconstruct eye poses at submillimeter accuracy to which we fit our new rig. This allows us to accurately estimate person‐specific eyeball shape, rotation center, interocular distance, visual axis, and other rig parameters resulting in an animation‐ready eye rig. We demonstrate the importance of several aspects of eye modeling that are often overlooked, for example that the visual axis is not identical to the optical axis, that it is important to model rotation about the optical axis, and that the rotation center of the eye should be measured accurately for each person. Since accurate rig fitting requires hand annotation of multi‐view imagery for several eye gazes, we additionally propose a more user‐friendly “lightweight” fitting approach, which leverages an average rig created from several pre‐captured accurate rigs. Our lightweight rig fitting method allows for the estimation of eyeball shape and eyeball position given only a single pose with a known look‐at point (e.g. looking into a camera) and few manual annotations.
How to read this
- Category
- Capture system and parametric model: a person-specific eye rig
- Contributions
- Presents a parametric eye rig plus a multi-view imaging system that reconstructs eye poses at submillimeter accuracy
- Accurately estimates person-specific eyeball shape, rotation center, interocular distance, and visual axis, stressing that visual and optical axes differ and that rotation about the optical axis matters
- Proposes a lightweight fitting variant using an average rig that needs only a single known look-at pose and few manual annotations
- Context
- Builds on production facial performance capture, notably the Medusa system (Beeler et al. 2012), extending high-accuracy capture and parametric fitting to the eyeball region.Builds on: High-Quality Passive Facial Performance Capture Using Anchor Frames
- Correctness
- Demonstrated to submillimeter accuracy via multi-view capture; accurate fitting depends on hand annotation across several gazes, and the lightweight variant trades accuracy for an average-rig prior, a limitation the authors acknowledge.
- Clarity
- Clear and well-motivated, with the often-overlooked eye-anatomy points made explicit; a first pass conveys the model, a second pass is needed for the fitting math.
- How to read it
- First pass for the rig parameterization and the anatomical insights (visual vs optical axis, rotation center); second pass on the fitting procedure and the lightweight approximation if you build or evaluate eye rigs.
Built upon by
Nothing yet.
Related work
- A Mass Spring Model for Hair Simulation 2008 / SIGGRAPH
Keywords
This page summarises the entry and links to its original source. The archive never hosts or redistributes the publication itself.Show it in the full archive list →