Open Access System for Information Sharing

Login Library

 

Article
Cited 0 time in webofscience Cited 0 time in scopus
Metadata Downloads

Sparse Variational Deterministic Policy Gradient for Continuous Real Time Control

Title
Sparse Variational Deterministic Policy Gradient for Continuous Real Time Control
Authors
BAEK, JONGCHANJEON, HAYEONGPARK, JONGYEOKLEE, HAKJUNHAN, SOOHEE
Date Issued
2021-09
Publisher
Institute of Electrical and Electronics Engineers
Abstract
Recent advancements in deep reinforcement learning for real control tasks have received interest from many researchers and field engineers in a variety of industrial areas. However, in most cases, optimal policies obtained by deep reinforcement learning are difficult to implement on cost-effective and lightweight platforms such as mobile devices. This can be attributed to their computational complexity and excessive memory usage. For this reason, this study proposes an off-policy deep reinforcement learning algorithm called the sparse variational deterministic policy gradient (SVDPG). SVDPG provides highly efficient policy network compression under the standard reinforcement learning framework. The proposed SVDPG integrates Bayesian pruning, which is known as a state-of-the-art neural network compression technique, with the policy update in an actor-critic architecture for reinforcement learning. It is demonstrated that SVDPG achieves a high compression rate of policy networks for continuous control benchmark tasks while preserving a competitive performance. The superiority of SVDPG in low-computing power devices is proven by comparing the level of compression in terms of the memory requirements and computation time on a commercial microcontroller unit. Finally, it is confirmed that the proposed SVDPG is also reliable in real-world scenarios since it can be applied to the swing-up control of an inverted pendulum system.
URI
https://oasis.postech.ac.kr/handle/2014.oak/105104
ISSN
0278-0046
Article Type
Article
Citation
IEEE Transactions on Industrial Electronics, 2021-09
Files in This Item:
There are no files associated with this item.

qr_code

  • mendeley

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Related Researcher

Researcher

한수희HAN, SOOHEE
Dept of Electrical Enginrg
Read more

Views & Downloads

Browse