Flexible application-directed virtual memory management for data-intensive applications and heterogeneous hardware
department or school: Applied Science, Faculty of
department or school: Electrical and Computer Engineering, Department of
data provider: DSpace
degree campus: UBCV
creator: Jalalian, Sepehr
issued: 2024-04-29T16:11:10Z
issued: 2024
related degree: Master of Applied Science - MASc
degree grantor: University of British Columbia
description: For over forty years, researchers have demonstrated that operating system memory managers often fall short for memory-hungry applications. The problem is even more critical today, with disaggregated memory and new memory technologies and in the presence of tera-scale machine learning models, large-scale graph processing, and other memory-intensive applications. Past attempts to provide application-specific memory management either require significant in-kernel changes or suffer from high overhead. We present ExtMem, a flexible framework for providing application-specific memory management. It differs from prior solutions in three ways: (1) It is compatible with todayâs Linux deployments, (2) it is a general-purpose substrate for addressing various memory and storage backends, and (3) it is performant in multithreaded environments. Before presenting ExtMem, we study the Linux paging system, identifying its needs and challenges, and provide our insight in design. ExtMem allows for easy and rapid prototyping of new memory management algorithms, easy collection of memory patterns and statistics, and immediate deployment of isolated custom memory management. Our work demonstrates a new path for faster and more insightful memory management research in the future.
aggregated CHO: https://circle.library.ubc.ca/rest/handle/2429/88061
note: Flexible Application-directed Virtual MemoryManagement for Data-intensive Applications andHeterogeneous HardwarebySepehr JalalianB.Sc. in Electrical Engineering, Sharif University of Technology, 2021A THESIS SUBMITTED IN PARTIAL FULFILLMENTOF THE REQUIREMENTS FOR THE DEGREE OFMaster of Applied ScienceinTHE FACULTY OF GRADUATE AND POSTDOCTORALSTUDIES(Electrical and Computer Engineering)The University of British Columbia(Vancouver)April 2024© Sepehr Jalalian, 2024The following individuals certify that they have read, and recommend to the Fac-ulty of Graduate and Postdoctoral Studies for acceptance, the thesis entitled:Flexible Application-directed Virtual Memory Management for Data-intensive Applications and Heterogeneous Hardwaresubmitted by Sepehr Jalalian in partial fulfillment of the requirements for the de-gree of Master of Applied Science in Electrical and Computer Engineering.Examining Committee:Alexandra (Sasha) Fedorova, Professor, Electrical and Computer Engineering, UBCSupervisorSathish Gopalakrishnan, Associate Professor, Electrical and Computer Engineer-ing, UBCSupervisory Committee ChairMargo I. Seltzer, Professor, Computer Science, UBCSupervisory Committee MemberiiAbstractFor over forty years, researchers have demonstrated that operating system memorymanagers often fall short for memory-hungry applications. The problem is evenmore critical today, with disaggregated memory and new memory technologies andin the presence of tera-scale machine learning models, large-scale graph process-ing, and other memory-intensive applications. Past attempts to provide application-specific memory management either require significant in-kernel changes or sufferfrom high overhead. We present EXTMEM, a flexible framework for providingapplication-specific memory management. It differs from prior solutions in threeways: (1) It is compatible with todayâs Linux deployments, (2) it is a general-purpose substrate for addressing various memory and storage backends, and (3) itis …
has type: Thesis/Dissertation
date issued: 2024-05
is shown at: 10.14288/1.0442017
language: eng
degree discipline: Electrical and Computer Engineering
provider: Vancouver : University of British Columbia Library
publisher: University of British Columbia
rights: Attribution-NonCommercial-NoDerivatives 4.0 International
rights URI: http://creativecommons.org/licenses/by-nc-nd/4.0/
scholar level: Graduate
contributor: Fedorova, Alexandra
type: Text
identifier URI: http://hdl.handle.net/2429/88061