UBC Theses and Dissertations

UBC Theses Logo

UBC Theses and Dissertations

Smart dynamic trajectory planning of autonomous underwater vehicles using reinforcement learning and historical data Amanitehrani, Mahdi

Abstract

Underwater wireless sensors are essential in ocean studies and applications, providing continuous monitoring and recording of critical data. Their remote operation over extended periods requires energy-efficient designs, and one major challenge is collecting data from these sensors, as long-range communication increases energy consumption. Furthermore, unlike terrestrial GPS, the lack of reliable localization underwater means the exact locations of these sensors are initially unknown. Autonomous Underwater Vehicles (AUVs) play a crucial role in detecting and retrieving data from these sensors. To achieve this, intelligent AUVs must dynamically plan their trajectories based on current detection information, aiming to collect as much data as possible from wireless networks. In this thesis, we first mathematically examine the AUV dynamic trajectory planning problem. Recognizing the inherent challenges, we propose methods to improve upon existing approaches by incorporating historical AUV data into real-time decision-making. Two trajectory planning methods are introduced, with the second utilizing Deep Reinforcement Learning (DRL) to optimize path planning. Simulation results show promising improvements over prior methods, significantly narrowing the gap between dynamic trajectory planning and the upper bounds of ideal methods under strong assumptions.

Item Citations and Data

Rights

Attribution-NonCommercial-NoDerivatives 4.0 International