收藏切换
Solving GuanDan Poker Games with Deep Reinforcement Learning
收藏切换
Zhenxing Ge1, Shuai Xiang1, Pinzhuo Tian2, Yang Gao1, 3, *
Journal of Computer Research and Development | 2024, 61(1) : 145 - 155
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(1): 145-155
• Artificial Intelligence •
Solving GuanDan Poker Games with Deep Reinforcement Learning
Full
Zhenxing Ge1, Shuai Xiang1, Pinzhuo Tian2, Yang Gao1, 3, *
Affiliations
  • 1National Key Laboratory for Novel Software Technology (Nanjing University), Nanjing 210023
  • 2School of Computer Engineering and Science, Shanghai University, Shanghai 200444
  • 3Shenzhen Research Institute of Nanjing University, Shenzhen, Guangdong 518057
  • born in 1998. PhD candidate. Student member of CCF. His main research interests include game theory, multi-agent systems, and reinforcement learning

    born in 1997. Master candidate. Student member of CCF. His main research interests include game theory, reinforcement learning, and multi-agent systems

    born in 1991. PhD, lecturer. His main research interests include machine learning, meta-learning, and transfer learning. ()

    born in 1972. PhD, professor, PhD supervisor. Committee member of CCF. His main research interests include reinforcement learning, multi-agent systems, computer vision, and big data analysis

About Author:

born in 1998. PhD candidate. Student member of CCF. His main research interests include game theory, multi-agent systems, and reinforcement learning

born in 1997. Master candidate. Student member of CCF. His main research interests include game theory, reinforcement learning, and multi-agent systems

born in 1991. PhD, lecturer. His main research interests include machine learning, meta-learning, and transfer learning. ()

born in 1972. PhD, professor, PhD supervisor. Committee member of CCF. His main research interests include reinforcement learning, multi-agent systems, computer vision, and big data analysis

Published: 2024-01-02 doi: 10.7544/issn1000-1239.202220697
Outline
收藏切换

Decisions are often made in complex environment without exact information in many real-world occasions. Hence the capability of making proper decisions is expected for artificial intelligence agents. As abstractions of the real world, games provoke interests of researchers with the benefits of well-defined game structure and the facility to evaluate various algorithms. Among these games, GuanDan poker games are typical games with large action space and huge information set size, which exacerbates the problem and increases the difficulty to solve these games. In this work, we propose a novel soft deep Monte Carlo(SDMC) method to overcome the above-mentioned difficulties. By considering how the expert strategy acts in the training process, SDMC can better utilize the expert knowledge and accelerate the convergence of training process. Meanwhile, SDMC applies an action sample strategy in real time playing to confuse the opponents and prohibits the potentional exploitation of them, which could also lead to significant improvement of the performance against different agents. SDMC agent was the champion of the 2nd Chinese Artificial Intelligence Game Algorithm competition. Comprehensive experiments that evaluate the training time and final performance are conducted in this work, showing superior performance of SDMC against other agents such as the champion of 1st competition.

imperfect information  /  deep reinforcement learning  /  multi-agent system  /  soft deep Monte Carlo method  /  poker game
葛振兴, 向帅, 田品卓, 高阳. 基于深度强化学习的掼蛋扑克博弈求解. 计算机研究与发展, 2024 , 61 (1) : 145 -155 . DOI: 10.7544/issn1000-1239.202220697
Zhenxing Ge, Shuai Xiang, Pinzhuo Tian, Yang Gao. Solving GuanDan Poker Games with Deep Reinforcement Learning[J]. Journal of Computer Research and Development, 2024 , 61 (1) : 145 -155 . DOI: 10.7544/issn1000-1239.202220697
Year 2024 volume 61 Issue 1
77
36
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202220697
  • Receive Date:2022-08-08
  • Online Date:2026-11-17
  • Published:2024-01-02
Article Data
Affiliations
History
  • Received:2022-08-08
  • Revised:2023-04-06
Affiliations
    1National Key Laboratory for Novel Software Technology (Nanjing University), Nanjing 210023
    2School of Computer Engineering and Science, Shanghai University, Shanghai 200444
    3Shenzhen Research Institute of Nanjing University, Shenzhen, Guangdong 518057
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202220697
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT