收藏切换
Rule-Based Constrained Deep Reinforcement Learning for Intelligent Vehicle Driving Decisions in Highway Scenarios
收藏切换
PDF
Xinkai Wang1, 2, Shufeng Wang1, Shihao Wang1, 2
Automobile Technology | 2023, (9) : 18 - 26
Less
收藏切换
Automobile Technology | 2023, (9): 18-26
Rule-Based Constrained Deep Reinforcement Learning for Intelligent Vehicle Driving Decisions in Highway Scenarios
Full
Xinkai Wang1, 2, Shufeng Wang1, Shihao Wang1, 2
Affiliations
  • 1 Shandong University of Science and Technology, Qingdao 266590
  • 2 Shandong Wuzheng Group Co., Ltd., Rizhao 262306
Published: 2023-09-24 doi: 10.19620/j.cnki.1000-3703.20220752
Outline
收藏切换

For the problems of strong randomness and low training efficiency in intelligent vehicle training under reinforcement learning algorithm, this paper proposed a driving decision framework of intelligent vehicle based on rule constraints and Deep Q Network (DQN) algorithm. The introduced rules were divided into hard constraints related to lane change and soft constraints related to lane keeping, which were implemented by Action Detection Module and reward function respectively. At the same time, the network structure of DQN was improved by combining Dueling DQN and Double DQN, N-Step Bootstrapping learning was introduced to accelerate the training efficiency of DQN. Finally, the effectiveness of the model was verified by comprehensive comparison with the original DQN algorithm in the highway scene of Highway-env platform. The improved algorithm improved the task success rate and training efficiency of intelligent vehicles.

Intensive learning  /  Driving decision  /  Intelligent vehicle  /  Rule constraint  /  Improved DQN algorithm
Xinkai Wang, Shufeng Wang, Shihao Wang. Rule-Based Constrained Deep Reinforcement Learning for Intelligent Vehicle Driving Decisions in Highway Scenarios[J]. Automobile Technology, 2023 , (9) : 18 -26 . DOI: 10.19620/j.cnki.1000-3703.20220752
Year 2023 volume Issue 9
PDF
302
130
Cite this Article
BibTeX
Article Info
doi: 10.19620/j.cnki.1000-3703.20220752
  • Online Date:2025-12-07
  • Published:2023-09-24
Article Data
Affiliations
History
  • Revised:2022-11-17
Funding
Affiliations
    1 Shandong University of Science and Technology, Qingdao 266590
    2 Shandong Wuzheng Group Co., Ltd., Rizhao 262306
References
Share
https://castjournals.cast.org.cn/joweb/qcjs/EN/10.19620/j.cnki.1000-3703.20220752
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT