收藏切换
Universal Approximation and Approximation Advantages of Quaternion-Valued Neural Networks
收藏切换
Jinhui Wu, Yuan Jiang*
Journal of Computer Research and Development | 2025, 62(5) : 1205 - 1215
Less
收藏切换
Journal of Computer Research and Development | 2025, 62(5): 1205-1215
• Artificial Intelligence •
Universal Approximation and Approximation Advantages of Quaternion-Valued Neural Networks
Full
Jinhui Wu, Yuan Jiang*
Affiliations
  • National Key Laboratory for Novel Software Technology (Nanjing University), Nanjing 210023
  • School of Artificial Intelligence, Nanjing University, Nanjing 210023
  • born in 1998. PhD candidate. His main research interests include neural network theories and machine learning

    born in 1976. PhD, professor, PhD supervisor. Her main research interests include artificial intelligence, machine learning, and intelligent medical applications

About Author:

born in 1998. PhD candidate. His main research interests include neural network theories and machine learning

born in 1976. PhD, professor, PhD supervisor. Her main research interests include artificial intelligence, machine learning, and intelligent medical applications

Published: 2025-05-01 doi: 10.7544/issn1000-1239.202440410
Outline
收藏切换

Quaternion-valued neural networks extend real-valued neural networks to the algebra of quaternions. Quaternion-valued neural networks achieve higher accuracy or faster convergence than real-valued neural networks in some tasks, such as singular point compensation in polarimetric synthetic aperture, spoken language understanding, and radar robot control. The performance of quaternion-valued neural networks is widely supported by empirical studies, but there are few studies about theoretical properties of quaternion-valued neural networks, especially why quaternion-valued neural networks can be more efficient than real-valued neural networks. In this paper, we investigate theoretical properties of quaternion-valued neural networks and the advantages of quaternion-valued neural networks compared with real-valued neural networks from the perspective of approximation. Firstly, we prove the universal approximation of quaternion-valued neural networks with a non-split ReLU (rectified linear unit)-type activation function. Secondly, we demonstrate the approximation advantages of quaternion-valued neural networks compared with real-valued neural networks. For split ReLU-type activation functions, we show that one-hidden-layer real-valued neural networks need about 4 times the number of parameters to possess the same maximum number of convex linear regions as one-hidden-layer quaternion-valued neural networks. For the non-split ReLU-type activation function, we prove the approximation separation between one-hidden-layer quaternion-valued neural networks and one-hidden-layer real-valued neural networks, i.e., a quaternion-valued neural network can express a real-valued neural network using the same number of hidden neurons and the same parameter norm, while a real-valued neural network cannot approximate a quaternion-valued neural network unless the number of hidden neurons is exponentially large or the parameters are exponentially large. Finally, simulation experiments support our theoretical findings.

quaternion-valued neural networks  /  universal approximation  /  approximation advantage  /  maximum number of convex linear regions  /  approximation separation  /  neural network theory
吴锦辉, 姜远. 四元数神经网络的通用近似与逼近优势. 计算机研究与发展, 2025 , 62 (5) : 1205 -1215 . DOI: 10.7544/issn1000-1239.202440410
Jinhui Wu, Yuan Jiang. Universal Approximation and Approximation Advantages of Quaternion-Valued Neural Networks[J]. Journal of Computer Research and Development, 2025 , 62 (5) : 1205 -1215 . DOI: 10.7544/issn1000-1239.202440410
Year 2025 volume 62 Issue 5
94
42
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440410
  • Receive Date:2024-05-31
  • Online Date:2026-11-10
  • Published:2025-05-01
Article Data
Affiliations
History
  • Received:2024-05-31
  • Revised:2024-10-08
  • Accepted:2024-10-16
Affiliations
    National Key Laboratory for Novel Software Technology (Nanjing University), Nanjing 210023
    School of Artificial Intelligence, Nanjing University, Nanjing 210023
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440410
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT