Open Collections

Abstract

Real-time animations are limited by a computational budget and often trade realism for performance. Simulating the shape of a realistic human body requires a tremendous amount of computational resources and may be infeasible in real-time applications. In recent years, deep learning approaches have proven their effectiveness in fields such as computer vision. We present a new method that combines ideas from deep learning and example-based skinning. The method approximates corrections to skin deformation from a skeleton-based animation baseline. A key aspect of the approach is to factor the network into two parts, with part of the network evaluated using shaders in the standard real-time graphics rendering pipeline. Our method adds a minimum overhead to a skeleton-based animation while improving its visual results.