Uncertainty-aware Energy Management of Extended Range Electric Delivery Vehicles with Bayesian Ensemble

Pengyue Wang, Yan Li, Shashi Shekhar, William F. Northrop

Research output: Contribution to conferencePaperpeer-review

Abstract

In recent years, deep reinforcement learning (DRL) algorithms have been widely studied and utilized in the area of Intelligent Transportation Systems (ITS). DRL agents are mostly trained with transition pairs and interaction trajectories generated from simulation, and they can achieve satisfying or near optimal performances under familiar input states. However, for relative rare visited or even unvisited regions in the state space, there is no guarantee that the agent could perform well. Unfortunately, novel conditions are inevitable in real-world problems and there is always a gap between the real data and simulated data. Therefore, to implement DRL algorithms in real-world transportation systems, we should not only train the agent learn a policy that maps states to actions, but also the model uncertainty associated with each action. In this study, we adapt the method of Bayesian ensemble to train a group of agents with imposed diversity for an energy management system of a delivery vehicle. The agents in the ensemble agree well on familiar states but show diverse results on unfamiliar or novel states. This uncertainty estimation facilitates the implementation of interpretable postprocessing modules which can ensure robust and safe operations under high uncertainty conditions.

Original languageEnglish (US)
Pages1556-1562
Number of pages7
DOIs
StatePublished - 2020
Event31st IEEE Intelligent Vehicles Symposium, IV 2020 - Virtual, Las Vegas, United States
Duration: Oct 19 2020Nov 13 2020

Conference

Conference31st IEEE Intelligent Vehicles Symposium, IV 2020
CountryUnited States
CityVirtual, Las Vegas
Period10/19/2011/13/20

Bibliographical note

Funding Information:
*Corresponding author The information, data, or work presented herein was funded in part by the Advanced Research Projects Agency-Energy (ARPA-E) U.S. Department of Energy, under Award Number DE-AR0000795.

Funding Information:
ACKNOWLEDGMENT The information, data, or work presented herein was funded in part by the Advanced Research Projects Agency-Energy (ARPA-E) U.S. Department of Energy, under Award Number DE-AR0000795. The views and opinions of authors expressed herein do not necessarily state or reflect those of thenUitedtSteasoGvernment or anygaencyetrehof.

Publisher Copyright:
© 2020 IEEE.

Fingerprint Dive into the research topics of 'Uncertainty-aware Energy Management of Extended Range Electric Delivery Vehicles with Bayesian Ensemble'. Together they form a unique fingerprint.

Cite this