Home Journals Articles Updates About
CN
image
收藏切换
Research on Multimodal Rejection Model of Cockpit Based on ChatGLM2 Large Model
收藏切换
PDF
Qiang Zhang1, 4, Qin Shi1, 2, 3, Teng Cheng1, 2, 3, Hao Ni1, 2, 3
Automotive Engineering | 2025, 47(3) : 412 - 417
Less
收藏切换
Automotive Engineering | 2025, 47(3): 412-417
• Feature Topic：Key Technologies on Intelligent and Connected Vehicles •
Research on Multimodal Rejection Model of Cockpit Based on ChatGLM2 Large Model
Full
Qiang Zhang1, 4, Qin Shi1, 2, 3, Teng Cheng1, 2, 3, Hao Ni1, 2, 3
Affiliations
  • 1 School of Automotive and Transportation Engineering，Hefei University of Technology，Hefei 230009
  • 2 Key Laboratory for Automated Vehicle Safety Technology of Anhui Province，Hefei 230009
  • 3 Engineering Research Center for Intelligent Transportation and Cooperative Vehicle-Infrastructure of Anhui Province，Hefei 230009
  • 4 Chery Automobile Co.，Ltd.，Wuhu 241000
Published: 2025-03-25 doi: 10.19562/j.chinasae.qcgc.2025.03.003
Outline
收藏切换

In the field of intelligent connected vehicles, the recognition accuracy of incar systems for noncommand voice input in complex environment (the proportion of correct voice input recognition by the system) is of great significance. To address this challenge, in this paper a multimodal rejection model is proposed. The model is based on the opensource ChatGLM26B large language model and has undergone exclusive rejection dataset construction and model finetuning for the invehicle interaction scenario. The rejection dataset is collected from real driving scenarios, integrating voice information with the driver's facial orientation, gestures, and emotion, and other nonverbal signals to provide richer interaction information, effectively overcoming the limitation of pure language recognition mechanisms in complex environment. Through experiments, it is found that the multimodal rejection model shows higher recognition accuracy (ACC) and lower false rejection rate (FRR) on the test set compared to the pure language rejection model.

intelligent connected vehicles  /  in-vehicle speech interaction  /  rejection  /  large model
Qiang Zhang, Qin Shi, Teng Cheng, Hao Ni. Research on Multimodal Rejection Model of Cockpit Based on ChatGLM2 Large Model[J]. Automotive Engineering, 2025 , 47 (3) : 412 -417 . DOI: 10.19562/j.chinasae.qcgc.2025.03.003
Appendix
Less
Year 2025 volume 47 Issue 3
PDF
445
178
Cite this Article
BibTeX
Article Info
doi: 10.19562/j.chinasae.qcgc.2025.03.003
  • Receive Date：2024-05-20
  • Online Date：2025-07-09
  • Published：2025-03-25
Article Data
Affiliations
History
  • Received：2024-05-20
  • Revised：2024-07-23
Funding
Affiliations
    1 School of Automotive and Transportation Engineering，Hefei University of Technology，Hefei 230009
    2 Key Laboratory for Automated Vehicle Safety Technology of Anhui Province，Hefei 230009
    3 Engineering Research Center for Intelligent Transportation and Cooperative Vehicle-Infrastructure of Anhui Province，Hefei 230009
    4 Chery Automobile Co.，Ltd.，Wuhu 241000
References
Share
https://castjournals.cast.org.cn/joweb/qcygc/EN/10.19562/j.chinasae.qcgc.2025.03.003
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family		 属数
Number of
genus		 种数
Number of
species		 占总种数比例
Percentage of
total species (%)		 属
Genus		 种数
Number of
species		 占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT
Links
Articles
Latest Articles
Most Read
Collections
Updates
Events
News
Multimedia
About
About Us
Contact
No. 86 Xueyuan South Road, Haidian District, Beijing
100081
010-62199257
qkjq@cast.org.cn

Copyright © 2025 China Association for Science and Technology. All rights reserved. For all open access content, the relevant licensing terms apply.
Sponsored by the Office of the Leading Group for Cybersecurity and Informatization of CAST, and supported by Science and Technology Review Publishing House