收藏切换
A Joint Emotion-Cognition Based Approach for Moral Judgement
收藏切换
Di Wu, Yanyan Zhao*, Bing Qin
Journal of Computer Research and Development | 2024, 61(5) : 1193 - 1205
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(5): 1193-1205
• Special Issue on Large Models and Safety •
A Joint Emotion-Cognition Based Approach for Moral Judgement
Full
Di Wu, Yanyan Zhao*, Bing Qin
Affiliations
  • Research Center for Social Computing and Information Retrieval(Harbin Institute of Technology), Harbin 150001
  • Key Laboratory of Cognitive Intelligence and Content Security (Harbin Institute of Technology), Ministry of Education, Harbin 150001
  • born in 2000. PhD candidate. Student member of CCF. His main research interests include large language model safety, value alignment, and affective computing

    born in 1983. PhD, professor, PhD supervisor. Member of CCF. Her main research interests include large language model safety, value alignment, and affective computing

    born in 1968. PhD, professor, PhD supervisor. Member of CCF. Her main research interests include large language model safety, affective computing, and text generation

About Author:

born in 2000. PhD candidate. Student member of CCF. His main research interests include large language model safety, value alignment, and affective computing

born in 1983. PhD, professor, PhD supervisor. Member of CCF. Her main research interests include large language model safety, value alignment, and affective computing

born in 1968. PhD, professor, PhD supervisor. Member of CCF. Her main research interests include large language model safety, affective computing, and text generation

Published: 2024-05-01 doi: 10.7544/issn1000-1239.202330812
Outline
收藏切换

With the rapid development of large language models, their safety has become a growing concern among researchers and the public. To prevent potential harm in collaboration, aligning these models’ judgments with human moral values in daily scenarios is essential. A key challenge is ensuring that large language models can adaptively adjust or reassess rules in moral judgment, like humans, to maintain consistency with human morals in various contexts. Inspired by psychological and cognitive science research on the emotional and cognitive influences on human moral judgments, this study leverages the strengths of large language models in cognitive reasoning and emotional analysis. We develop an approach that emulates the interaction between emotional and cognitive judgment in human moral reasoning, thus enhancing these models’ moral judgment capabilities. Experimental results demonstrate the effectiveness of our approach in this task. Overall, this study not only presents an innovative approach to the moral judgment of large language models but also highlights the importance of integrating psychological and cognitive science theories in this field, setting a foundation for future research.

moral judgement  /  large language model safety  /  cognitive judgment capability  /  emotional judgment capability  /  prompt learning
吴迪, 赵妍妍, 秦兵. 基于情感和认知协同的道德判断方法. 计算机研究与发展, 2024 , 61 (5) : 1193 -1205 . DOI: 10.7544/issn1000-1239.202330812
Di Wu, Yanyan Zhao, Bing Qin. A Joint Emotion-Cognition Based Approach for Moral Judgement[J]. Journal of Computer Research and Development, 2024 , 61 (5) : 1193 -1205 . DOI: 10.7544/issn1000-1239.202330812
Year 2024 volume 61 Issue 5
83
40
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202330812
  • Receive Date:2023-10-11
  • Online Date:2026-11-17
  • Published:2024-05-01
Article Data
Affiliations
History
  • Received:2023-10-11
  • Revised:2024-02-08
Affiliations
    Research Center for Social Computing and Information Retrieval(Harbin Institute of Technology), Harbin 150001
    Key Laboratory of Cognitive Intelligence and Content Security (Harbin Institute of Technology), Ministry of Education, Harbin 150001
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330812
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT