Measurement and animation of the eye region of the human face in reduced coordinates
department or school: Science, Faculty of
department or school: Computer Science, Department of
data provider: DSpace
degree campus: UBCV
creator: Neog, Debanga Raj
issued: 2018-06-14T22:36:30Z
issued: 2018
related degree: Doctor of Philosophy - PhD
degree grantor: University of British Columbia
description: The goal of this dissertation is to develop methods to measure, model, and animate facial tissues of the region around the eyes, referred to as the eye region. First, we measure the subtle movements of the soft tissues of the eye region using a monocular RGB-D camera setup, and second, we model and animate these movements using parameterized motion models. The muscles and skin of the eye region are very thin and sheetlike. By representing these tissues as thin elastic sheets in reduced coordinates, we have shown how we can measure and animate these tissues efficiently. To measure tissue movements, we optically track both eye and skin motions using monocular video sequences. The key idea here is to use a reduced coordinates framework to model thin sheet-like facial skin of the eye region. This framework implicitly constrains skin to conform to the shape of the underlying object when it slides. The skin configuration can then be efficiently reconstructed in 3D by tracking two dimensional skin features in video. This reduced coordinates model allows interactive real-time animation of the eye region in WebGL enabled devices using a small number of animation parameters, including gaze. Additionally, we have shown that the same reduced coordinates framework can also be used for physics-based simulation of the facial tissue movements and to produce tissue deformations that occur in facial expressions. We validated our skin measurement and animation algorithms using skin movement sequences with known skin motions, and we can recover skin sliding motions with low reconstruction errors. We also propose an image-based algorithm that corrects accumulated inaccuracy of standard 3D anatomy registration systems that occurs during motion capture, anatomy transfer, image generation, and animation. After correction, we can overlay the anatomy on input video with low misalignment errors for augmented reality applications, such as anatomy mirroring. Our results show that the proposed i…
aggregated CHO: https://circle.library.ubc.ca/rest/handle/2429/66300
note: Measurement and Animation of the Eye Region of theHuman Face in Reduced CoordinatesbyDebanga Raj NeogB. Tech., Indian Institute of Technology Guwahati, 2011A THESIS SUBMITTED IN PARTIAL FULFILLMENTOF THE REQUIREMENTS FOR THE DEGREE OFDoctor of PhilosophyinTHE FACULTY OF GRADUATE AND POSTDOCTORALSTUDIES(Computer Science)The University of British Columbia(Vancouver)June 2018c© Debanga Raj Neog, 2018CommitteeThe following individuals certify that they have read, and recommend to the Fac-ulty of Graduate and Postdoctoral Studies for acceptance, the dissertation entitled:“Measurement and Animation of the Eye Region of the Human Face in ReducedCoordinates” submitted by Debanga Raj Neog in partial fulfillment of the require-ments for the degree of Doctor of Philosophy in Computer Science.Examining Committee:Co-supervisor: Dinesh K. Pai, Computer ScienceCo-supervisor: Robert J. Woodham, Computer ScienceSupervisory Committee Member: Jim Little, Computer ScienceUniversity Examiner: Alan Mackworth, Computer ScienceUniversity Examiner: Sidney Fels, Electrical and Computer Engineering.iiAbstractThe goal of this dissertation is to develop methods to measure, model, and animatefacial tissues of the region around the eyes, referred to as the eye region. First, wemeasure the subtle movements of the soft tissues of the eye region using a monoc-ular RGB-D camera setup, and second, we model and animate these movementsusing parameterized motion models. The muscles and skin of the eye region arevery thin and sheetlike. By representing these tissues as thin elastic sheets in re-duced coordinates, we have shown how we can measure and animate these tissuesefficiently.To measure tissue movements, we optically track both eye and skin motions us-ing monocular video sequences. The key idea here is to use a reduced coordinatesframework to model thin sheet-like facial skin of the eye region. This frameworkimplicitly constrains skin to conform to the shape of the underlying object when itslides. T…
has type: Thesis/Dissertation
date issued: 2018-09
is shown at: 10.14288/1.0368664
language: eng
degree discipline: Computer Science
provider: Vancouver : University of British Columbia Library
publisher: University of British Columbia
rights: Attribution-NonCommercial-NoDerivatives 4.0 International
rights URI: http://creativecommons.org/licenses/by-nc-nd/4.0/
scholar level: Graduate
type: Text
identifier URI: http://hdl.handle.net/2429/66300