Exploiting temporal structures in computational photography
department or school: Science, Faculty of
department or school: Computer Science, Department of
data provider: DSpace
degree campus: UBCV
creator: Su, Shuochen
issued: 2018-04-18T15:48:34Z
issued: 2018
related degree: Doctor of Philosophy - PhD
degree grantor: University of British Columbia
description: Despite the tremendous progress in computer vision over the last decade, images captured by a digital camera are often regarded as the instantaneous 2D projection of the scene for simplification. This assumption poses a significant challenge to machine perception algorithms due to the existence of many imaging- and scene-induced artifacts in the camera's measurements such as the hand-shake blur and time-of-flight multi-path interference. In this thesis we introduce time-resolved image formation models for color and depth cameras by exploiting the temporal structure within their raw sensor measurements of the scene. Specifically, we present our efforts on leveraging the inter-scanline and cross-frame content correlations for image and video deblurring, as well as utilizing the complementary components of time-of-flight frequency measurements in collaboration for improved depth acquisition. By tackling these limitations we also enable novel imaging applications such as direct material classification from raw time-of-flight data. In addition, we devise post-processing algorithms with temporal structure awareness so that the hidden information can be decoded efficiently with existing off-the-shelf hardware devices. We believe that the proposed time-resolved modeling of the encoding-decoding process of a digital camera opens the door to many exciting directions in computational photography research.
aggregated CHO: https://circle.library.ubc.ca/rest/handle/2429/65446
note: Exploiting Temporal Structures in ComputationalPhotographybyShuochen SuB.Eng., Tsinghua University, 2013A THESIS SUBMITTED IN PARTIAL FULFILLMENTOF THE REQUIREMENTS FOR THE DEGREE OFDoctor of PhilosophyinTHE FACULTY OF GRADUATE AND POSTDOCTORALSTUDIES(Computer Science)The University of British Columbia(Vancouver)April 2018© Shuochen Su, 2018AbstractDespite the tremendous progress in computer vision over the last decade, imagescaptured by a digital camera are often regarded as the instantaneous 2D projectionof the scene for simplification. This assumption poses a significant challenge tomachine perception algorithms due to the existence of many imaging- and scene-induced artifacts in the camera’s measurements such as the hand-shake blur andtime-of-flight multi-path interference. In this thesis we introduce time-resolved im-age formation models for color and depth cameras by exploiting the temporal struc-ture within their raw sensor measurements of the scene. Specifically, we presentour efforts on leveraging the inter-scanline and cross-frame content correlations forimage and video deblurring, as well as utilizing the complementary components oftime-of-flight frequency measurements in collaboration for improved depth acqui-sition. By tackling these limitations we also enable novel imaging applicationssuch as direct material classification from raw time-of-flight data. In addition, wedevise post-processing algorithms with temporal structure awareness so that thehidden information can be decoded efficiently with existing off-the-shelf hardwaredevices. We believe that the proposed time-resolved modeling of the encoding-decoding process of a digital camera opens the door to many exciting directions incomputational photography research.iiLay SummaryPhotos are the most common way of capturing an instance of our life, and the worldsurrounding us. While most people think of the images as snapshots that freeze in-stantaneous moments, they are in fact the integral over small ti…
has type: Thesis/Dissertation
date issued: 2018-05
is shown at: 10.14288/1.0365768
language: eng
degree discipline: Computer Science
provider: Vancouver : University of British Columbia Library
publisher: University of British Columbia
rights: Attribution-NonCommercial-NoDerivatives 4.0 International
rights URI: http://creativecommons.org/licenses/by-nc-nd/4.0/
scholar level: Graduate
type: Text
identifier URI: http://hdl.handle.net/2429/65446