For the problems of strong randomness and low training efficiency in intelligent vehicle training under reinforcement learning algorithm, this paper proposed a driving decision framework of intelligent vehicle based on rule constraints and Deep Q Network (DQN) algorithm. The introduced rules were divided into hard constraints related to lane change and soft constraints related to lane keeping, which were implemented by Action Detection Module and reward function respectively. At the same time, the network structure of DQN was improved by combining Dueling DQN and Double DQN, N-Step Bootstrapping learning was introduced to accelerate the training efficiency of DQN. Finally, the effectiveness of the model was verified by comprehensive comparison with the original DQN algorithm in the highway scene of Highway-env platform. The improved algorithm improved the task success rate and training efficiency of intelligent vehicles.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |