71 0

A Real-Time Intelligent Speed Optimization Planner Using Reinforcement Learning

Title
A Real-Time Intelligent Speed Optimization Planner Using Reinforcement Learning
Author
이웅
Issue Date
2021-04
Publisher
SAE International
Citation
SAE Technical Papers, Page. 1-8
Abstract
As connectivity and sensing technologies become more mature, automated vehicles can predict future driving situations and utilize this information to drive more energy-efficiently than human-driven vehicles. However, future information beyond the limited connectivity and sensing range is difficult to predict and utilize, limiting the energy-saving potential of energy-efficient driving. Thus, we combine a conventional speed optimization planner, developed in our previous work, and reinforcement learning to propose a real-time intelligent speed optimization planner for connected and automated vehicles. We briefly summarize the conventional speed optimization planner with limited information, based on closed-form energy-optimal solutions, and present its multiple parameters that determine reference speed trajectories. Then, we use a deep reinforcement learning (DRL) algorithm, such as a deep Q-learning algorithm, to find the policy of how to adjust these parameters in real-time to dynamically changing situations in order to realize the full potential of energy-efficient driving. The model-free DRL algorithm, based on the experience of the system, can learn the optimal policy through iteratively interacting with different driving scenarios without increasing the limited connectivity and sensing range. The training process of the parameter adaptation policy exploits a high-fidelity simulation framework that can simulate multiple vehicles with full powertrain models and the interactions between vehicles and their environment. We consider intersection-approaching scenarios where there is one traffic light with different signal phase and timing setup. Results show that the learned optimal policy enables the proposed intelligent speed optimization planner to properly adjust the parameters in a piecewise constant manner, leading to additional energy savings without increasing total travel time compared to the conventional speed optimization planner.
URI
https://saemobilus.sae.org/content/2021-01-0434/https://repository.hanyang.ac.kr/handle/20.500.11754/171753
ISSN
0148-7191; 2688-3627
DOI
10.4271/2021-01-0434
Appears in Collections:
RESEARCH INSTITUTE[E](부설연구소) > RESEARCH INSTITUTE OF ENGINEERING & TECHNOLOGY(공학기술연구소) > Articles
Files in This Item:
There are no files associated with this item.
Export
RIS (EndNote)
XLS (Excel)
XML


qrcode

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

BROWSE