Efficient compression, human-inspired refocusing, and quality assessment of light field videos
department or school: Applied Science, Faculty of
department or school: Electrical and Computer Engineering, Department of
data provider: DSpace
degree campus: UBCV
creator: Mehajabin, Nusrat
issued: 2024-07-10T15:51:14Z
issued: 2024
related degree: Doctor of Philosophy - PhD
degree grantor: University of British Columbia
description: Light field (LF) technology has transformed digital media by capturing scenes from multiple viewpoints, introducing a new level of visual immersion and interactivity. This thesis explores the complexities of LF technology, with a specific focus on compression techniques, quality metrics for assessing processed light fields, and refocusing strategies aligned with the principles of the human visual system. Efficient compression plays a crucial role in LF technology due to the inherent richness of data. Within this thesis, we introduce innovative pseudo-sequence-based prediction structures and coding orders for LF compression. The first structure, informed by interview-similarity, optimizes compression by leveraging reference adjacency and maximizing B-frame usage. This approach excels in bitrate efficiency, real-time decoding, and competitive encoding times, making it suitable for delay-tolerant applications such as broadcasting. The second compression technique employs a frame distance aware structure, enhancing random-access efficiency through diagonal references. This structure offers the shortest encoding time with competitive bitrate gains, making it suitable for real-time interactive applications. Existing LF refocusing methods often fall short of mimicking the natural behavior of the human visual system, resulting in refocused images that appear artificial. Therefore, we developed an innovative LF refocusing technique aimed at producing human perception consistent refocused LFs from camera arrays. By integrating view synthesis, depth estimation, and object segmentation, the proposed method addresses the challenges of depth-dependent refocusing, yielding authentic-looking, natural post-shoot refocusing for camera-array-based content. Traditional quality assessment metrics prove inadequate in capturing the multidimensional nature of LF, underscoring the necessity for novel quality metrics tailored to LF. Finally, we introduce the first LF quality metric tailored …
aggregated CHO: https://circle.library.ubc.ca/rest/handle/2429/88602
note: EFFICIENT COMPRESSION, HUMAN-INSPIRED REFOCUSING, AND QUALITY ASSESSMENT OF LIGHT FIELD VIDEOS by Nusrat Mehajabin B.Sc., The University of Dhaka, 2013 M.S., The University of Dhaka, 2015 A THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY in THE FACULTY OF GRADUATE AND POSTDOCTORAL STUDIES (Electrical and Computer Engineering) THE UNIVERSITY OF BRITISH COLUMBIA (Vancouver) July 2024 © Nusrat Mehajabin, 2024 ii The following individuals certify that they have read, and recommend to the Faculty of Graduate and Postdoctoral Studies for acceptance, the dissertation entitled: Efficient Compression, Human-Inspired Refocusing, and Quality Assessment of Light Field Videos submitted by Nusrat Mehajabin in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Electrical and Computer Engineering Examining Committee: Panos Nasiopoulos, Professor, Electrical and Computer Engineering, UBC Supervisor Jane Z. Wang, Professor, Electrical and Computer Engineering, UBC Supervisory Committee Member Shahriar Mirabbasi, Professor, Electrical and Computer Engineering, UBC Supervisory Committee Member John D. Madden, Professor, Electrical and Computer Engineering, UBC University Examiner Ryozo Nagamune, Professor, Mechanical Engineering, UBC University Examiner iii Abstract Light field (LF) technology has transformed digital media by capturing scenes from multiple viewpoints, introducing a new level of visual immersion and interactivity. This thesis explores the complexities of LF technology, with a specific focus on compression techniques, quality metrics for assessing processed light fields, and refocusing strategies aligned with the principles of the human visual system. Efficient compression plays a crucial role in LF technology due to the inherent richness of data. Within this thesis, we introduce innovative pseudo-sequence-based prediction structures and coding orders for LF compression. The first structure,…
has type: Thesis/Dissertation
date issued: 2024-11
is shown at: 10.14288/1.0444120
language: eng
degree discipline: Electrical and Computer Engineering
provider: Vancouver : University of British Columbia Library
publisher: University of British Columbia
rights: Attribution-NonCommercial-NoDerivatives 4.0 International
rights URI: http://creativecommons.org/licenses/by-nc-nd/4.0/
scholar level: Graduate
contributor: Nasiopoulos, Panos
type: Text
identifier URI: http://hdl.handle.net/2429/88602