- Library Home /
- Search Collections /
- Open Collections /
- Browse Collections /
- UBC Theses and Dissertations /
- Smart dynamic trajectory planning of autonomous underwater...
Open Collections
UBC Theses and Dissertations
UBC Theses and Dissertations
Smart dynamic trajectory planning of autonomous underwater vehicles using reinforcement learning and historical data Amanitehrani, Mahdi
Abstract
Underwater wireless sensors are essential in ocean studies and applications, providing continuous monitoring and recording of critical data. Their remote operation over extended periods requires energy-efficient designs, and one major challenge is collecting data from these sensors, as long-range communication increases energy consumption. Furthermore, unlike terrestrial GPS, the lack of reliable localization underwater means the exact locations of these sensors are initially unknown. Autonomous Underwater Vehicles (AUVs) play a crucial role in detecting and retrieving data from these sensors. To achieve this, intelligent AUVs must dynamically plan their trajectories based on current detection information, aiming to collect as much data as possible from wireless networks. In this thesis, we first mathematically examine the AUV dynamic trajectory planning problem. Recognizing the inherent challenges, we propose methods to improve upon existing approaches by incorporating historical AUV data into real-time decision-making. Two trajectory planning methods are introduced, with the second utilizing Deep Reinforcement Learning (DRL) to optimize path planning. Simulation results show promising improvements over prior methods, significantly narrowing the gap between dynamic trajectory planning and the upper bounds of ideal methods under strong assumptions.
Item Metadata
Title |
Smart dynamic trajectory planning of autonomous underwater vehicles using reinforcement learning and historical data
|
Creator | |
Supervisor | |
Publisher |
University of British Columbia
|
Date Issued |
2024
|
Description |
Underwater wireless sensors are essential in ocean studies and applications, providing continuous monitoring and recording of critical data. Their remote operation over extended periods requires energy-efficient designs, and one major challenge is collecting data from these sensors, as long-range communication increases energy consumption. Furthermore, unlike terrestrial GPS, the lack of reliable localization underwater means the exact locations of these sensors are initially unknown. Autonomous Underwater Vehicles (AUVs) play a crucial role in detecting and retrieving data from these sensors. To achieve this, intelligent AUVs must dynamically plan their trajectories based on current detection information, aiming to collect as much data as possible from wireless networks. In this thesis, we first mathematically examine the AUV dynamic trajectory planning problem. Recognizing the inherent challenges, we propose methods to improve upon existing approaches by incorporating historical AUV data into real-time decision-making. Two trajectory planning methods are introduced, with the second utilizing Deep Reinforcement Learning (DRL) to optimize path planning. Simulation results show promising improvements over prior methods, significantly narrowing the gap between dynamic trajectory planning and the upper bounds of ideal methods under strong assumptions.
|
Genre | |
Type | |
Language |
eng
|
Date Available |
2024-11-15
|
Provider |
Vancouver : University of British Columbia Library
|
Rights |
Attribution-NonCommercial-NoDerivatives 4.0 International
|
DOI |
10.14288/1.0447279
|
URI | |
Degree | |
Program | |
Affiliation | |
Degree Grantor |
University of British Columbia
|
Graduation Date |
2025-02
|
Campus | |
Scholarly Level |
Graduate
|
Rights URI | |
Aggregated Source Repository |
DSpace
|
Item Media
Item Citations and Data
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International