Reinforcement Learning through Asynchronous Advantage Actor-Critic on a GPU
Mohammad BabaeizadehIuri FrosioStephen TyreeJason ClemonsJan Kautz
Abstract
We introduce a hybrid CPU/GPU version of the Asynchronous Advantage Actor-Critic (A3C) algorithm, currently the state-of-the-art method in reinforcement learning for various gaming tasks. We analyze its computational traits and concentrate on aspects critical to leveraging the GPU's computational power. We introduce a system of queues and a dynamic scheduling strategy, potentially helpful for other asynchronous algorithms as well. Our hybrid CPU/GPU version of A3C, based on TensorFlow, achieves a significant speed up compared to a CPU implementation; we make it publicly available to other researchers at https://github.com/NVlabs/GA3C .
Metrics
Citation History
Topics
Related Documents
Quantum Advantage Actor-Critic for Reinforcement Learning
Michael KölleMohamad HgogFabian RitzPhilipp J. AltmannMaximilian ZornJonas SteinClaudia Linnhoff‐Popien
Application of Improved Asynchronous Advantage Actor Critic Reinforcement Learning Model on Anomaly Detection
Kun ZhouWenyong WangTeng HuKai Deng
Locating algorithm of steel stock area with asynchronous advantage actor-critic reinforcement learning
Young-in ChoByeong-Seop KimHee-Chang YoonJong Hun Woo
Variational value learning in advantage actor-critic reinforcement learning
Yao-Zhong ZhangJiaqi HanXiaofang HuShihao Dan
An Asynchronous Advantage Actor-Critic Reinforcement Learning Method for Stock Selection and Portfolio Management
Qinma KangHuizhuo ZhouYunfan Kang