- Library Home /
- Search Collections /
- Open Collections /
- Browse Collections /
- UBC Theses and Dissertations /
- Investigation of different social agents in reinforcement...
Open Collections
UBC Theses and Dissertations
UBC Theses and Dissertations
Investigation of different social agents in reinforcement learning for autonomous driving training in simulation Tian, Yuan
Abstract
Automated driving has been pursued for more than fifty years, but with the widespread adoption of machine learning to train autonomous driving agents, simulators have begun to play an increasing role in the development and deployment of autonomous vehicles because they are not only faster, cheaper, and safer than physical experiments, but also more controllable, observable, and repeatable. In order to create realistic simulations, it is critical to have a good ``social agent'' to control the action of the other vehicles in the simulation. To date, however, no systematic comparison between different social agents has been performed. Here we describe a series of experiments which trained reinforcement learning (RL) agents in the SMARTS (Scalable Multi-Agent RL Training School) traffic simulation environment with three different social agents, and performed a comparison of the performance of the resulting RL agent. Along with SMARTS supported social agents SUMO (Simulation of Urban Mobility) and ZOO (provided by SMARTS), we integrated the DRIVE social agent (provided by Inverted AI) into the simulator for this study. The RL agents were trained and tested in six different task scenarios on five different maps. Overall, the experimental results show that RL agents trained in the environment with the DRIVE social agent performed more consistently on criteria including completion rate, collision rate and off-road rate, indicating DRIVE's heightened behavioral diversity and meaningful interactivity with the ego vehicle. We further conducted an analysis of some of the characteristics of the traffic generated by the different social agents: Traffic density, traffic speed and acceleration distribution, and average neighbor distance.
Item Metadata
Title |
Investigation of different social agents in reinforcement learning for autonomous driving training in simulation
|
Creator | |
Supervisor | |
Publisher |
University of British Columbia
|
Date Issued |
2023
|
Description |
Automated driving has been pursued for more than fifty years, but with the widespread adoption of machine learning to train autonomous driving agents, simulators have begun to play an increasing role in the development and deployment of autonomous vehicles because they are not only faster, cheaper, and safer than physical experiments, but also more controllable, observable, and repeatable.
In order to create realistic simulations, it is critical to have a good ``social agent'' to control the action of the other vehicles in the simulation.
To date, however, no systematic comparison between different social agents has been performed. Here we describe a series of experiments which trained reinforcement learning (RL) agents in the SMARTS (Scalable Multi-Agent RL Training School) traffic simulation environment with three different social agents, and performed a comparison of the performance of the resulting RL agent. Along with SMARTS supported social agents SUMO (Simulation of Urban Mobility) and ZOO (provided by SMARTS), we integrated the DRIVE social agent (provided by Inverted AI) into the simulator for this study. The RL agents were trained and tested in six different task scenarios on five different maps. Overall, the experimental results show that RL agents trained in the environment with the DRIVE social agent performed more consistently on criteria including completion rate, collision rate and off-road rate, indicating DRIVE's heightened behavioral diversity and meaningful interactivity with the ego vehicle. We further conducted an analysis of some of the characteristics of the traffic generated by the different social agents: Traffic density, traffic speed and acceleration distribution, and average neighbor distance.
|
Genre | |
Type | |
Language |
eng
|
Date Available |
2024-01-12
|
Provider |
Vancouver : University of British Columbia Library
|
Rights |
Attribution-NonCommercial-NoDerivatives 4.0 International
|
DOI |
10.14288/1.0438656
|
URI | |
Degree | |
Program | |
Affiliation | |
Degree Grantor |
University of British Columbia
|
Graduation Date |
2024-05
|
Campus | |
Scholarly Level |
Graduate
|
Rights URI | |
Aggregated Source Repository |
DSpace
|
Item Media
Item Citations and Data
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International