收藏切换
An Intelligent Automatic Train OperationTrain Control Method Integrating Large Language Models and Proximal Policy Optimization
收藏切换
Kai Gao1, 2, Li Zhu1, Jia Miao1, Lei Liu1
Urban Rapid Rail Transit | 2026, 39(4) : 114 - 122
Less
收藏切换
Urban Rapid Rail Transit | 2026, 39(4): 114-122
• Artifical Intelligence •
An Intelligent Automatic Train OperationTrain Control Method Integrating Large Language Models and Proximal Policy Optimization
Full
Kai Gao1, 2, Li Zhu1, Jia Miao1, Lei Liu1
Affiliations
  • 1.Institute of Autonomous Operation Technology, Beijing Jiaotong University, Beijing 100044
  • 2.Guangxi Traffic Control Zhiwei Technology Development Co., Ltd., Nanning 530200
doi: 10.3969/j.issn.1672-6073.2026.04.013
Outline
收藏切换

With advancement of intelligent urban rail transit, automatic train operation needs to achieve an effective balance between energy efficiency and punctuality. However, existing dispatching regulations are mostly expressed in natural language, making them difficult to directly incorporate into control modeling. To address this problem, this paper proposes an automated train operation control method integrating large language models (LLMs) and proximal policy optimization (PPO). The proposed method employs an LLMs to perform semantic parsing of dispatching regulations and operational experience, and automatically constructs a Markov decision process (MDP) model under the constraints of a knowledge graph (KG). The generated MDP includes the state space, action set, reward function, and safety constraints. On this basis, an action masking mechanism and an adaptive reward-weight adjustment strategy are introduced, and PPO is used to train a safe and controllable automated train operation policy in a simulation environment. Simulation results show that, compared with conventional rule-based control, Model Predictive Control (MPC), and Deep Q-Network (DQN), the proposed method reduces the average traction energy consumption by approximately 2.5%, 1.5%, and 1.0%, respectively, and reduces the average delay time by approximately 13.7%, 19.6%, and 16.3%, respectively. In addition, the average jerk is reduced to 0.59 m/s3. These results verify the effectiveness of combining LLM-based semantic modeling with reinforcement learning for automated train operation control. Further hardware-in-the-loop tests indicate that KG-based consistency checking can reduce rule omissions and physical inconsistencies in semantic parsing. The action masking mechanism embeds hard constraints, including speed limits and safe headway distances, into policy execution, while the adaptive reward-weight mechanism adjusts the trade-off among energy consumption, punctuality, and ride comfort according to operational feedback. The proposed method therefore establishes a closed-loop framework of semantic modeling, policy optimization, and feedback adjustment, providing an interpretable approach for incorporating natural-language dispatching knowledge into automated train operation control.

rail transit  /  automated train operation  /  large language model  /  proximal policy optimization  /  semantic modeling  /  multi-objective control
高凯, 朱力, 苗佳, 刘磊. 融合大模型与近端策略优化的列车自动驾驶智能控制研究. 都市快轨交通, 2026 , 39 (4) : 114 -122 . DOI: 10.3969/j.issn.1672-6073.2026.04.013
Kai Gao, Li Zhu, Jia Miao, Lei Liu. An Intelligent Automatic Train OperationTrain Control Method Integrating Large Language Models and Proximal Policy Optimization[J]. Urban Rapid Rail Transit, 2026 , 39 (4) : 114 -122 . DOI: 10.3969/j.issn.1672-6073.2026.04.013
Year 2026 volume 39 Issue 4
332
47
Cite this Article
BibTeX
Article Info
doi: 10.3969/j.issn.1672-6073.2026.04.013
  • Receive Date:2025-07-21
  • Online Date:2026-09-20
Article Data
Affiliations
History
  • Received:2025-07-21
  • Revised:2026-04-13
Funding
Affiliations
    1.Institute of Autonomous Operation Technology, Beijing Jiaotong University, Beijing 100044
    2.Guangxi Traffic Control Zhiwei Technology Development Co., Ltd., Nanning 530200
References
Share
https://castjournals.cast.org.cn/joweb/dskgjt/EN/10.3969/j.issn.1672-6073.2026.04.013
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT