Article(id=1329435572625585014, tenantId=1146029695717560320, journalId=1324759914146529478, issueId=1329435571803501430, articleNumber=null, orderNo=null, doi=10.7544/issn1000-1239.202550866, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1764864000000, receivedDateStr=2025-12-05, revisedDate=1783526400000, revisedDateStr=2026-07-09, acceptedDate=null, acceptedDateStr=null, onlineDate=1794891740232, onlineDateStr=2026-11-17, pubDate=1793462400000, pubDateStr=2026-11-01, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1794891740232, onlineIssueDateStr=2026-11-17, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1794891740232, creator=13701087609, updateTime=1794891740232, updator=13701087609, issue=Issue{id=1329435571803501430, tenantId=1146029695717560320, journalId=1324759914146529478, year='2026', volume='63', issue='11', pageStart='2767', pageEnd='3031', issueExtLink='null', onlineDate='null', pubDate='1793462400000', pubDateStr='2026-11-01', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=1, specialIssue=null, createTime=1794891740036, creator='13701087609', updateTime=1794891740036, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext=null, issueFiles=null, downloadFileDto=null}, startPage=2788, endPage=2806, ext={EN=ArticleExt(id=1329435572873048951, articleId=1329435572625585014, tenantId=1146029695717560320, journalId=1324759914146529478, language=EN, title=TH-FCAD: Automated Deployment Framework for Large-Scale Neural Networks on FPGA Clusters, columnId=1325489901852041729, journalTitle=Journal of Computer Research and Development, columnName=Computer Architecture, runingTitle=null, highlight=null, articleAbstract=

With the rapid growth of neural network model sizes, single FPGA resources have become insufficient for accelerating large-scale models, while FPGA clusters face critical challenges, including complex architecture design, inefficient task partitioning, and the lack of automated toolchains. To address these issues, an end-to-end automated deployment framework for neural networks on FPGA clusters, named TH-FCAD (automated deployment framework for large-scale neural networks on FPGA clusters) is proposed. First, a two-level interconnect FPGA cluster architecture based on TH-Express is constructed. By integrating a high-speed global GTH (gigabit transceiver high-speed) network with a local LVDS (low voltage differential signaling) full-mesh interconnect, it achieves high-bandwidth and low-latency cross-node communication. Second, a latency-balancing optimization and model partitioning method is introduced to evenly partition large-scale neural networks into multiple acceleration kernels while maintaining inter-kernel delay equilibrium, which is essential for pipeline efficiency. Finally, a cluster-aware mapping algorithm is designed to automatically generate optimal placement schemes by jointly considering FPGA resource constraints and the cluster communication topology, thereby minimizing communication overhead. Furthermore, a complete automated toolchain is developed to streamline the entire deployment process, enabling seamless compilation from PyTorch/TensorFlow trained models to FPGA cluster configurations. Evaluations on a built 16 node FPGA cluster demonstrate that when deploying ResNet-8, SqueezeNet, and ResNet-50, TH-FCAD achieves inference latencies of 0.051 ms, 1.24 ms, and 1.36 ms, respectively, alongside a peak computational performance of 5.95 TOPS. Compared with state-of-the-art multi-FPGA approaches, the proposed framework delivers a 28.4% performance improvement and outperforms corresponding CPU and GPU implementations.

, authors=Yankang Zhao, Yuan Li, Xingyun Qi, Yihang Lu, Puguang Liu, Qiang Wang, Min Xie, Lin Peng, Mingche Lai*, authorsList=Yankang Zhao, Yuan Li, Xingyun Qi, Yihang Lu, Puguang Liu, Qiang Wang, Min Xie, Lin Peng, Mingche Lai, authorCompany=null, correspAuthors=Mingche Lai, authorNote=

born in 2000. PhD candidate. His main research interests include hardware acceleration and computer architecture

born in 1984. PhD, associate professor. His main research interests include high performance computer architecture, high speed interconnection network, and artificial intelligence

born in 1979. PhD, associate professor. His main research interests include high performance computer architecture and high speed interconnection network

born in 1999. Master. His main research interests include computer architecture and artificial intelligence

born in 1995. PhD, assistant professor. His main research interests include algorithm accelerator, reconfigurable computing, and high-performance network

born in 1989. PhD, assistant professor. His main research interests include computer architecture, high speed interconnection network, and artificial intelligence

born in 1972. PhD, professor. His main research interest includes parallel and distributed computing

born in 1979. PhD, associate professor. His main research interest includes high performance computing

born in 1982. PhD, professor. His main research interests include computer architecture, high performance interconnection, and VLSI design

, correspAuthorsNote=null, copyrightStatement=Copyright © 2026 Journal of Computer Research and Development. All rights reserved., copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1329435576417235872, articleId=1329435572625585014, tenantId=1146029695717560320, journalId=1324759914146529478, language=CN, title=TH-FCAD:面向FPGA集群的大规模神经网络自动化部署框架, columnId=1325489904427344387, journalTitle=计算机研究与发展, columnName=体系结构, runingTitle=null, highlight=null, articleAbstract=

针对单颗FPGA资源受限难以加速大规模神经网络,且FPGA集群面临架构设计复杂、任务划分低效及自动化工具链缺失等挑战,提出面向FPGA集群的端到端自动化部署框架TH-FCAD(automated deployment framework for large-scale neural networks on FPGA clusters)。首先,构建基于TH-Express的2级互连集群架构,融合全局互连与局部互连,实现高带宽、低延迟的跨节点通信;其次,提出延迟平衡优化与模型切分方法,将大规模模型均匀切分为多加速核并保持核间延时均衡;最后,设计集群感知映射算法,联合FPGA资源约束与通信拓扑自动生成最优映射,以最小化通信开销。构建了完整的工具链,实现了从PyTorch/TensorFlow模型到集群的端到端自动化编译部署。基于16节点FPGA集群的评估表明,部署ResNet-8,SqueezeNet,ResNet-50时,推理延迟分别为0.051 ms,1.24 ms,1.36 ms,峰值算力达5.95 TOPS;较现有多FPGA方案性能提升28.4%,且优于CPU与GPU平台。

, authors=赵言亢, 黎渊, 齐星云, 陆亿行, 刘谱光, 王强, 谢旻, 彭林, 赖明澈*, authorsList=赵言亢, 黎渊, 齐星云, 陆亿行, 刘谱光, 王强, 谢旻, 彭林, 赖明澈, authorCompany=null, correspAuthors=赖明澈, authorNote=

作者贡献声明

赵言亢和黎渊负责整体实验方案的设计与实现、论文整体架构的设计和撰写;齐星云负责指导方法设计;陆亿行、刘谱光、王强负责部分实验的设计与实施;谢旻、彭林负责系统工程实现与测试验证;赖明澈提出研究思路与整体方案指导,并负责论文审阅与修改。赵言亢和黎渊为共同第一作者。

2000年生。博士研究生。主要研究方向为硬件加速、计算机体系结构

1984年生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络、人工智能

1979生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络

1999年生。硕士。主要研究方向为计算机体系结构、人工智能

1995年生。博士,助理研究员。主要研究方向为算法加速、可重构计算、高性能网络

1989年生。博士,助理研究员。主要研究方向为体系结构、高速互连网络、人工智能

1972年生。博士,研究员。主要研究方向为并行与分布式计算

1979年生。博士,副研究员。主要研究方向为高性能计算

1982年生。博士,研究员。主要研究方向为体系结构、高性能互连、超大规模集成电路设计

, correspAuthorsNote=
赖明澈()
, copyrightStatement=版权所有 © 2026 计算机研究与发展编辑部, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=Hf8GVEn1AY8RBsEWmxm93Q==, magXml=2g2+9TW+ncEohCvhVYoy0g==, pdfUrl=null, pdf=EMnjTfFHUO6GACR5qnzZVQ==, pdfFileSize=1535279, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=Nak0p+vHalKvA4eDc2UyhA==, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=NtEIusppsreY/PLh/6me3w==, mapNumber=null, fund=null)}, authors=[Author(id=1329435576861832101, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=zhaoyankangnudt@nudt.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435576979272615, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435576861832101, language=EN, stringName=Yankang Zhao, firstName=Yankang, middleName=null, lastName=Zhao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 2000. PhD candidate. His main research interests include hardware acceleration and computer architecture

"}, bioImg=null, bioContent=

born in 2000. PhD candidate. His main research interests include hardware acceleration and computer architecture

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435577042187176, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435576861832101, language=CN, stringName=赵言亢, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"Wk6Wifs/FSZ+3CiZ39RfLQ==","content":"

2000年生。博士研究生。主要研究方向为硬件加速、计算机体系结构

"}, bioImg=Wk6Wifs/FSZ+3CiZ39RfLQ==, bioContent=

2000年生。博士研究生。主要研究方向为硬件加速、计算机体系结构

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435577117684650, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435577222542252, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577117684650, language=EN, stringName=Yuan Li, firstName=Yuan, middleName=null, lastName=Li, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1984. PhD, associate professor. His main research interests include high performance computer architecture, high speed interconnection network, and artificial intelligence

"}, bioImg=null, bioContent=

born in 1984. PhD, associate professor. His main research interests include high performance computer architecture, high speed interconnection network, and artificial intelligence

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435577314816941, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577117684650, language=CN, stringName=黎渊, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"ep6mfddh6oDJD5GCU4vX9w==","content":"

1984年生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络、人工智能

"}, bioImg=ep6mfddh6oDJD5GCU4vX9w==, bioContent=

1984年生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络、人工智能

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435577398703023, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435577474200497, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577398703023, language=EN, stringName=Xingyun Qi, firstName=Xingyun, middleName=null, lastName=Qi, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1979. PhD, associate professor. His main research interests include high performance computer architecture and high speed interconnection network

"}, bioImg=null, bioContent=

born in 1979. PhD, associate professor. His main research interests include high performance computer architecture and high speed interconnection network

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435577566475186, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577398703023, language=CN, stringName=齐星云, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"RH97HOT5fxRQU/auJ4Wi8g==","content":"

1979生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络

"}, bioImg=RH97HOT5fxRQU/auJ4Wi8g==, bioContent=

1979生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435577633584052, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435577717470134, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577633584052, language=EN, stringName=Yihang Lu, firstName=Yihang, middleName=null, lastName=Lu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1999. Master. His main research interests include computer architecture and artificial intelligence

"}, bioImg=null, bioContent=

born in 1999. Master. His main research interests include computer architecture and artificial intelligence

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435577797161911, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577633584052, language=CN, stringName=陆亿行, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"cEXTiNzey1zgRFy+Z7pAwQ==","content":"

1999年生。硕士。主要研究方向为计算机体系结构、人工智能

"}, bioImg=cEXTiNzey1zgRFy+Z7pAwQ==, bioContent=

1999年生。硕士。主要研究方向为计算机体系结构、人工智能

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435577876853689, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435577960739771, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577876853689, language=EN, stringName=Puguang Liu, firstName=Puguang, middleName=null, lastName=Liu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1995. PhD, assistant professor. His main research interests include algorithm accelerator, reconfigurable computing, and high-performance network

"}, bioImg=null, bioContent=

born in 1995. PhD, assistant professor. His main research interests include algorithm accelerator, reconfigurable computing, and high-performance network

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435578023654332, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577876853689, language=CN, stringName=刘谱光, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"luaetcdAx6//g/MBoTk6BA==","content":"

1995年生。博士,助理研究员。主要研究方向为算法加速、可重构计算、高性能网络

"}, bioImg=luaetcdAx6//g/MBoTk6BA==, bioContent=

1995年生。博士,助理研究员。主要研究方向为算法加速、可重构计算、高性能网络

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435578086568894, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435578162066368, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578086568894, language=EN, stringName=Qiang Wang, firstName=Qiang, middleName=null, lastName=Wang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1989. PhD, assistant professor. His main research interests include computer architecture, high speed interconnection network, and artificial intelligence

"}, bioImg=null, bioContent=

born in 1989. PhD, assistant professor. His main research interests include computer architecture, high speed interconnection network, and artificial intelligence

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435578224980929, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578086568894, language=CN, stringName=王强, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"gIxC0NCAUl/wWNeGE4GHXw==","content":"

1989年生。博士,助理研究员。主要研究方向为体系结构、高速互连网络、人工智能

"}, bioImg=gIxC0NCAUl/wWNeGE4GHXw==, bioContent=

1989年生。博士,助理研究员。主要研究方向为体系结构、高速互连网络、人工智能

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435578296284099, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=6, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435578363392965, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578296284099, language=EN, stringName=Min Xie, firstName=Min, middleName=null, lastName=Xie, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1972. PhD, professor. His main research interest includes parallel and distributed computing

"}, bioImg=null, bioContent=

born in 1972. PhD, professor. His main research interest includes parallel and distributed computing

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435578434696134, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578296284099, language=CN, stringName=谢旻, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"r/L0WZJkORJuGF/LiHm8vA==","content":"

1972年生。博士,研究员。主要研究方向为并行与分布式计算

"}, bioImg=r/L0WZJkORJuGF/LiHm8vA==, bioContent=

1972年生。博士,研究员。主要研究方向为并行与分布式计算

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435578493416392, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=7, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435578556330954, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578493416392, language=EN, stringName=Lin Peng, firstName=Lin, middleName=null, lastName=Peng, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1979. PhD, associate professor. His main research interest includes high performance computing

"}, bioImg=null, bioContent=

born in 1979. PhD, associate professor. His main research interest includes high performance computing

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435578615051211, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578493416392, language=CN, stringName=彭林, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"1VVqXSrSCZMY2rUkGULULw==","content":"

1979年生。博士,副研究员。主要研究方向为高性能计算

"}, bioImg=1VVqXSrSCZMY2rUkGULULw==, bioContent=

1979年生。博士,副研究员。主要研究方向为高性能计算

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435578673771469, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=8, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=mingchelai@nudt.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1329435578753463247, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578673771469, language=EN, stringName=Mingche Lai, firstName=Mingche, middleName=null, lastName=Lai, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=*, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1982. PhD, professor. His main research interests include computer architecture, high performance interconnection, and VLSI design

"}, bioImg=null, bioContent=

born in 1982. PhD, professor. His main research interests include computer architecture, high performance interconnection, and VLSI design

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435578824766416, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578673771469, language=CN, stringName=赖明澈, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=*, address=国防科技大学计算机学院 长沙 410073, bio={"img":"Y80o9yzhSP2u/0RsAYsGGw==","content":"

1982年生。博士,研究员。主要研究方向为体系结构、高性能互连、超大规模集成电路设计

"}, bioImg=Y80o9yzhSP2u/0RsAYsGGw==, bioContent=

1982年生。博士,研究员。主要研究方向为体系结构、高性能互连、超大规模集成电路设计

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])])], keywords=[Keyword(id=1329435578904458193, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, orderNo=1, keyword=neural network), Keyword(id=1329435578971567058, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, orderNo=2, keyword=hardware acceleration), Keyword(id=1329435579051258835, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, orderNo=3, keyword=FPGA cluster), Keyword(id=1329435579109979092, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, orderNo=4, keyword=task partition), Keyword(id=1329435579198059477, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, orderNo=5, keyword=automated deployment framework), Keyword(id=1329435579269362646, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, orderNo=1, keyword=神经网络), Keyword(id=1329435579390997463, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, orderNo=2, keyword=硬件加速), Keyword(id=1329435579466494936, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, orderNo=3, keyword=FPGA集群), Keyword(id=1329435579567158233, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, orderNo=4, keyword=任务划分), Keyword(id=1329435579701375962, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, orderNo=5, keyword=自动化部署框架)], refs=[Reference(id=1329435582092129275, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=1, rfOrder=0, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Guoqing, Zhang Meng, Li Jiaojie, et al. Efficient densely connected convolutional neural networks[J]. Pattern Recognition, 2021, 109: 107610, articleTitle=null, refAbstract=null), Reference(id=1329435582176015356, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=2, rfOrder=1, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Zewen, Liu Fan, Yang Wenjie, et al. A survey of convolutional neural networks: Analysis, applications, and prospects[J]. IEEE Transactions on Neural Networks and Learning Systems, 2022, 33(12): 6999−7019, articleTitle=null, refAbstract=null), Reference(id=1329435582259901437, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=3, rfOrder=2, authorNames=null, journalName=null, refType=null, unstructuredReference=Nechi A, Groth L, Mulhem S, et al. FPGA-based deep learning inference accelerators: Where are we standing?[J]. ACM Transactions on Reconfigurable Technology and Systems, 2023, 16(4): 60, articleTitle=null, refAbstract=null), Reference(id=1329435582327010302, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=4, rfOrder=3, authorNames=null, journalName=null, refType=null, unstructuredReference=Hill M, Reddi V. Accelerator-level parallelism[J]. Communications of the ACM, 2021, 64(12): 36−38, articleTitle=null, refAbstract=null), Reference(id=1329435582415090687, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=5, rfOrder=4, authorNames=null, journalName=null, refType=null, unstructuredReference=Cong J, Fang Zhenman, Lo M, et al. Understanding performance differences of FPGAs and GPUs[C]//Proc of the 26th Annual Int Symp on Field-Programmable Custom Computing Machines (FCCM). Piscataway, NJ: IEEE, 2018: 93−96, articleTitle=null, refAbstract=null), Reference(id=1329435582482199552, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=6, rfOrder=5, authorNames=null, journalName=null, refType=null, unstructuredReference=Amin R, Obermaisser R. Towards resource efficient and low latency CNN accelerator for FPGAs: Review and evaluation[C]//Proc of the 3rd Int Conf on Embedded Systems and Artificial Intelligence (ESAI). Piscataway, NJ: IEEE, 2024: 1−10, articleTitle=null, refAbstract=null), Reference(id=1329435582561890304, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=7, rfOrder=6, authorNames=null, journalName=null, refType=null, unstructuredReference=Mohaidat T, Khalil K. A survey on neural network hardware accelerators[J]. IEEE Transactions on Artificial Intelligence, 2024, 5(8): 3801−3822, articleTitle=null, refAbstract=null), Reference(id=1329435582624804865, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=8, rfOrder=7, authorNames=null, journalName=null, refType=null, unstructuredReference=Curzel S, Ferrandi F, Fiorin L, et al. A survey on design methodologies for accelerating deep learning on heterogeneous architectures[J]. arXiv preprint, arXiv: 2311.17815, 2025, articleTitle=null, refAbstract=null), Reference(id=1329435582700302338, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=9, rfOrder=8, authorNames=null, journalName=null, refType=null, unstructuredReference=Yuan Tian, Liu Weiqiang, Han Jie, et al. High performance CNN accelerators based on hardware and algorithm co-optimization[J]. IEEE Transactions on Circuits and Systems I: Regular Papers, 2021, 68(1): 250−263, articleTitle=null, refAbstract=null), Reference(id=1329435582771605507, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=10, rfOrder=9, authorNames=null, journalName=null, refType=null, unstructuredReference=Zeng Shulin, Liu Jun, Dai Guohao, et al. FlightLLM: Efficient large language model inference with a complete mapping flow on FPGAs[C]//Proc of the 32nd ACM/SIGDA Int Symp on Field Programmable Gate Arrays (FPGA’24). New York: ACM, 2024: 223−234, articleTitle=null, refAbstract=null), Reference(id=1329435582838714372, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=11, rfOrder=10, authorNames=null, journalName=null, refType=null, unstructuredReference=Liu Jun, Zeng Shulin, Ding Li, et al. FlightVGM: Efficient video generation model inference with online sparsification and hybrid precision on FPGAs[C]//Proc of the 33rd ACM/SIGDA Int Symp on Field Programmable Gate Arrays (FPGA’25). New York: ACM, 2025: 2−13, articleTitle=null, refAbstract=null), Reference(id=1329435582910017541, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=12, rfOrder=11, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhang Xiaofan, Ye Hanchen, Wang Junsong, et al. DNNExplorer: A framework for modeling and exploring a novel paradigm of FPGA-based DNN accelerator[C]//Proc of the 2020 IEEE/ACM Int Conf on Computer Aided Design (ICCAD). Piscataway, NJ: IEEE, 2020: 1−9, articleTitle=null, refAbstract=null), Reference(id=1329435582985515014, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=13, rfOrder=12, authorNames=null, journalName=null, refType=null, unstructuredReference=Wei Xuechao, Liang Yun, Li Xiuhong, et al. TGPA: Tile-grained pipeline architecture for low latency CNN inference[C]//Proc of the 2018 IEEE/ACM Int Conf on Computer-Aided Design (ICCAD). Piscataway, NJ: IEEE, 2018: 1−8, articleTitle=null, refAbstract=null), Reference(id=1329435583056818183, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=14, rfOrder=13, authorNames=null, journalName=null, refType=null, unstructuredReference=Ye Hanchen, Jun H, Chen Deming. HIDA: A hierarchical dataflow compiler for high-level synthesis[C]//Proc of the 29th ACM Int Conf on Architectural Support for Programming Languages and Operating Systems (ASPLOS ’24). New York: ACM, 2024: 215−230, articleTitle=null, refAbstract=null), Reference(id=1329435583144898568, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=15, rfOrder=14, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhang Chen, Wu Di, Sun Jiayu, et al. Energy-efficient CNN implementation on a deeply pipelined FPGA cluster[C]//Proc of the 2016 Int Symp on Low Power Electronics and Design (ISLPED). New York: ACM, 2016: 326−331, articleTitle=null, refAbstract=null), Reference(id=1329435583224590345, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=16, rfOrder=15, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhang Wentai, Zhang Jiaxi, Shen Minghua, et al. An efficient mapping approach to large-scale DNNs on multi-FPGA architectures[C]//Proc of the 2019 Design, Automation & Test in Europe Conf & Exhibition (DATE). Piscataway, NJ: IEEE, 2019: 1241−1244, articleTitle=null, refAbstract=null), Reference(id=1329435583316865034, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=17, rfOrder=16, authorNames=null, journalName=null, refType=null, unstructuredReference=Jiang Weiwen, Sha E, Zhang Xinyi, et al. Achieving super-linear speedup across multi-FPGA for real-time DNN inference[J]. ACM Transactions on Embedded Computing Systems, 2019, 18(5s): 67, articleTitle=null, refAbstract=null), Reference(id=1329435583383973899, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=18, rfOrder=17, authorNames=null, journalName=null, refType=null, unstructuredReference=Boutros A, Betz V. FPGA Architecture: Principles and progression[J]. IEEE Circuits and Systems Magazine, 2021, 21(2): 4−29, articleTitle=null, refAbstract=null), Reference(id=1329435583459471372, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=19, rfOrder=18, authorNames=null, journalName=null, refType=null, unstructuredReference=Mittal S. A survey on modeling and improving reliability of DNN algorithms and accelerators[J]. Journal of Systems Architecture, 2020, 104(C): 101689, articleTitle=null, refAbstract=null), Reference(id=1329435583522385933, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=20, rfOrder=19, authorNames=null, journalName=null, refType=null, unstructuredReference=Schulte J, Ramhorst B, Sun Chang, et al. HLS4ML: A flexible, open source platform for deep learning acceleration on reconfigurable hardware[J]. ACM Transactions on Reconfigurable Technology and Systems, 2026, 19(2): 19, articleTitle=null, refAbstract=null), Reference(id=1329435583589494798, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=21, rfOrder=20, authorNames=null, journalName=null, refType=null, unstructuredReference=Umuroglu Y, Fraser N, Gambardella G, et al. FINN: A framework for fast, scalable binarized neural network inference[C]//Proc of the 2017 ACM/SIGDA Int Symp on Field-Programmable Gate Arrays (FPGA’17). New York: ACM, 2017: 65−74, articleTitle=null, refAbstract=null), Reference(id=1329435583660797967, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=22, rfOrder=21, authorNames=null, journalName=null, refType=null, unstructuredReference=Knapheide J, Stabernack B, Kuhnke M. A high throughput MobileNetV2 FPGA implementation based on a flexible architecture for depthwise separable convolution[C]//Proc of the 30th Int Conf on Field-Programmable Logic and Applications (FPL). Piscataway, NJ: IEEE, 2020: 277−283, articleTitle=null, refAbstract=null), Reference(id=1329435583727906832, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=23, rfOrder=22, authorNames=null, journalName=null, refType=null, unstructuredReference=Wu Xiao, Ma Yufei, Wang Meiqi, et al. A flexible and efficient FPGA accelerator for various large-scale and lightweight CNNs[J]. IEEE Transactions on Circuits and Systems I: Regular Papers, 2022, 69(3): 1185−1198, articleTitle=null, refAbstract=null), Reference(id=1329435583795015697, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=24, rfOrder=23, authorNames=null, journalName=null, refType=null, unstructuredReference=Yu Yunxuan, Zhao Tiandong, Wang Kun, et al. Light-OPU: An FPGA-based overlay processor for lightweight convolutional neural networks[C]//Proc of the 28th ACM/SIGDA Int Symp on Field-Programmable Gate Arrays (FPGA’20). New York: ACM, 2020: 122−132, articleTitle=null, refAbstract=null), Reference(id=1329435583857930258, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=25, rfOrder=24, authorNames=null, journalName=null, refType=null, unstructuredReference=Venieris S, Bouganis C. fpgaConvNet: A framework for mapping convolutional neural networks on FPGAs[C]//Proc of the 24th IEEE Annual Int Symp on Field-Programmable Custom Computing Machines (FCCM). Piscataway, NJ: IEEE, 2016: 40−47, articleTitle=null, refAbstract=null), Reference(id=1329435583925039123, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=26, rfOrder=25, authorNames=null, journalName=null, refType=null, unstructuredReference=Venieris S, Bouganis C. Latency-driven design for FPGA-based convolutional neural networks[C]//Proc of the 27th Int Conf on Field Programmable Logic and Applications (FPL). Piscataway, NJ: IEEE, 2017: 1−8, articleTitle=null, refAbstract=null), Reference(id=1329435583992147988, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=27, rfOrder=26, authorNames=null, journalName=null, refType=null, unstructuredReference=Petrica L, Alonso T, Kroes M, et al. Memory-efficient dataflow inference for deep CNNs on FPGA[C]//Proc of the 2020 Int Conf on Field-Programmable Technology (ICFPT). Piscataway, NJ: IEEE, 2020: 48−55, articleTitle=null, refAbstract=null), Reference(id=1329435584063451157, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=28, rfOrder=27, authorNames=null, journalName=null, refType=null, unstructuredReference=Huang Yingbing, Wan L, Ye Hanchen, et al. Invited: New solutions on LLM acceleration, optimization, and application[C]//Proc of the 61st ACM/IEEE Design Automation Conf. New York: ACM, 2024: 1−4, articleTitle=null, refAbstract=null), Reference(id=1329435584134754326, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=29, rfOrder=28, authorNames=null, journalName=null, refType=null, unstructuredReference=AMD/Xilinx. Vivado design suite user guid high-level synthesis (UG902)[EB/OL]. (2021-05-04)[2025-11-28]. https://docs.amd.com/v/u/en-US/ug902-vivado-high-level-synthesis, articleTitle=null, refAbstract=null), Reference(id=1329435584210251799, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=30, rfOrder=29, authorNames=null, journalName=null, refType=null, unstructuredReference=AMD/Xilinx. Xilinx Vitis AI overview[EB/OL]. (2023-09-28)[2025-11-28]. https://docs.amd.com/r/en-US/ug1414-vitis-ai/Vitis-AI-Overview, articleTitle=null, refAbstract=null), Reference(id=1329435584281554968, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=31, rfOrder=30, authorNames=null, journalName=null, refType=null, unstructuredReference=Blott M, Preußer T, Fraser N, et al. FINN-R: An end-to-end deep-learning framework for fast exploration of quantized neural networks[J]. ACM Transactions on Reconfigurable Technology and Systems, 2018, 11(3): 16, articleTitle=null, refAbstract=null), Reference(id=1329435584352858137, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=32, rfOrder=31, authorNames=null, journalName=null, refType=null, unstructuredReference=Chung E, Fowers J, Ovtcharov K, et al. Serving DNNs in real time at datacenter scale with project brainwave[J]. IEEE Micro, 2018, 38(2): 8−20, articleTitle=null, refAbstract=null), Reference(id=1329435584424161306, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=33, rfOrder=32, authorNames=null, journalName=null, refType=null, unstructuredReference=Tarafdar N, Eskandari N, Sharma V, et al. Galapagos: A full stack approach to FPGA integration in the cloud[J]. IEEE Micro, 2018, 38(6): 18−24, articleTitle=null, refAbstract=null), Reference(id=1329435584503853083, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=34, rfOrder=33, authorNames=null, journalName=null, refType=null, unstructuredReference=Tarafdar N, Di G, Harris P, et al. AIgean: An open framework for deploying machine learning on heterogeneous clusters[J]. ACM Transactions on Reconfigurable Technology and Systems, 2022, 15(3): 23, articleTitle=null, refAbstract=null), Reference(id=1329435584570961948, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=35, rfOrder=34, authorNames=null, journalName=null, refType=null, unstructuredReference=Alonso T, Petrica L, Ruiz M, et al. Elastic-DF: Scaling performance of DNN inference in FPGA clouds through automatic partitioning[J]. ACM Transactions on Reconfigurable Technology and Systems, 2022, 15(2): 15, articleTitle=null, refAbstract=null), Reference(id=1329435584646459421, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=36, rfOrder=35, authorNames=null, journalName=null, refType=null, unstructuredReference=Gan Xinbiao, Tang Qian, Xiong Feng, et al. TianheStar: Orchestrating sssp applications on Tianhe supercomputer[C]//Proc of the 24th IEEE Int Symp on Cluster, Cloud and Internet Computing (CCGrid). Piscataway, NJ: IEEE, 2024: 534−542, articleTitle=null, refAbstract=null), Reference(id=1329435584713568286, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=37, rfOrder=36, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Ruibo, Lu Kai, Chen Juan, et al. Brief introduction of TianHe exascale prototype system[J]. Tsinghua Science and Technology, 2021, 26(3): 361−369, articleTitle=null, refAbstract=null), Reference(id=1329435584793260063, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=38, rfOrder=37, authorNames=null, journalName=null, refType=null, unstructuredReference=Gan Xinbiao, Zhang Yiming, Zeng Ruigeng, et al. XTree: Traversal-based partitioning for extreme-scale graph processing on supercomputers[C]//Proc of the 38th IEEE Int Conf on Data Engineering (ICDE). Piscataway, NJ: IEEE, 2022: 2046−2059, articleTitle=null, refAbstract=null), Reference(id=1329435584860368928, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=39, rfOrder=38, authorNames=null, journalName=null, refType=null, unstructuredReference=Pang Zhengbin, Xie Min, Zhang Jun, et al. The TH express high performance interconnect networks[J]. Frontiers of Computer Science, 2014, 8(3): 357−366, articleTitle=null, refAbstract=null), Reference(id=1329435584961032225, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=40, rfOrder=39, authorNames=null, journalName=null, refType=null, unstructuredReference=Liao Xiangke, Pang Zhengbin, Wang Kefei, et al. High performance interconnect network for tianhe system[J]. Journal of Computer Science and Technology, 2015, 30(2): 259−272, articleTitle=null, refAbstract=null), Reference(id=1329435585032335394, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=41, rfOrder=40, authorNames=null, journalName=null, refType=null, unstructuredReference=Caulfield A, Chung E, Putnam A, et al. A cloud-scale acceleration architecture[C]//Proc of the 49th Annual IEEE/ACM Int Symp on Microarchitecture (MICRO). Piscataway, NJ: IEEE, 2016: 1−13, articleTitle=null, refAbstract=null), Reference(id=1329435585120415779, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=42, rfOrder=41, authorNames=null, journalName=null, refType=null, unstructuredReference=Çatalyürek Ü, Devine K, Faraj M, et al. More recent advances in (Hyper) graph partitioning[J]. ACM Computing Surveys, 2023, 55(12): 253, articleTitle=null, refAbstract=null), Reference(id=1329435585204301860, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=43, rfOrder=42, authorNames=null, journalName=null, refType=null, unstructuredReference=Banbury C, Reddi V, Torelli P, et al. MLPerf tiny benchmark[J]. arXiv preprint, arXiv: 2106.07597, 2021, articleTitle=null, refAbstract=null), Reference(id=1329435585267216421, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=44, rfOrder=43, authorNames=null, journalName=null, refType=null, unstructuredReference=Iandola F, Han Song, Moskewicz M, et al. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size[J]. arXiv preprint, arXiv: 1602.07360, 2016, articleTitle=null, refAbstract=null), Reference(id=1329435585334325286, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=45, rfOrder=44, authorNames=null, journalName=null, refType=null, unstructuredReference=He Kaiming, Zhang Xiangyu, Ren Shaoqing, et al. Deep residual learning for image recognition[C]//Proc of the 2016 IEEE Conf on Computer Vision and Pattern Recognition (CVPR). Piscataway, NJ: IEEE, 2016: 770−778, articleTitle=null, refAbstract=null), Reference(id=1329435585393045543, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=46, rfOrder=45, authorNames=null, journalName=null, refType=null, unstructuredReference=Mageiropoulos E, Chrysos N, Dimou N, et al. Using HLS4ML to map convolutional neural networks on interconnected FPGA devices[C]//Proc of the 29th IEEE Annual Int Symp on Field-Programmable Custom Computing Machines (FCCM). Piscataway, NJ: IEEE, 2021: 277−277, articleTitle=null, refAbstract=null), Reference(id=1329435585489514536, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=47, rfOrder=46, authorNames=null, journalName=null, refType=null, unstructuredReference=Ding Yuhao, Wu Jiajun, Gao Yizhao, et al. Model-platform optimized deep neural network accelerator generation through mixed-integer geometric programming[C]//Proc of the 31st IEEE Int Symp on Field-Programmable Custom Computing Machines (FCCM). Piscataway, NJ: IEEE, 2023: 83−93, articleTitle=null, refAbstract=null), Reference(id=1329435585560817705, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=48, rfOrder=47, authorNames=null, journalName=null, refType=null, unstructuredReference=Ibrahim M, Zhao Zhipeng, Hall M, et al. Extending data flow architectures for convolutional neural networks to multiple FPGAs[C]//Proc of the 2023 Int Conf on Field Programmable Technology (ICFPT). Piscataway, NJ: IEEE, 2023: 132−141, articleTitle=null, refAbstract=null), Reference(id=1329435585632120874, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=49, rfOrder=48, authorNames=null, journalName=null, refType=null, unstructuredReference=Hall M, Betz V. From tensorflow graphs to LUTs and wires: Automated sparse and physically aware CNN hardware generation[C]//Proc of the 2020 Int Conf on Field-Programmable Technology (ICFPT). Piscataway, NJ: IEEE, 2020: 56−65, articleTitle=null, refAbstract=null), Reference(id=1329435585695035435, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=50, rfOrder=49, authorNames=null, journalName=null, refType=null, unstructuredReference=Liang Shiyan, Lin Jingui, Liu Dongwei, et al. RTMF: Routing based on TDM for multi-FPGA system[J]. ACM Transactions on Design Automation of Electronic Systems, 2025, 30(5): 81, articleTitle=null, refAbstract=null)], funds=null, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])], figs=[ArticleFig(id=1329435579802039259, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 1, caption=Comparison of two accelerator architectures, figureFileSmall=Ht2cmsyORrC8dbcJLDfrMA==, figureFileBig=Nak0p+vHalKvA4eDc2UyhA==, tableContent=null), ArticleFig(id=1329435579864953820, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图1, caption=2种加速器架构对比, figureFileSmall=Ht2cmsyORrC8dbcJLDfrMA==, figureFileBig=Nak0p+vHalKvA4eDc2UyhA==, tableContent=null), ArticleFig(id=1329435580028531677, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 2, caption=Comparison of different cluster architectures, figureFileSmall=jwXZCS6Ql4uOoxY0F+tw7Q==, figureFileBig=ouNb/t3zgnVv1G2ilXScTA==, tableContent=null), ArticleFig(id=1329435580083057630, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图2, caption=不同的集群架构对比, figureFileSmall=jwXZCS6Ql4uOoxY0F+tw7Q==, figureFileBig=ouNb/t3zgnVv1G2ilXScTA==, tableContent=null), ArticleFig(id=1329435580150166495, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 3, caption=TH-Express-based FPGA cluster architecture with two-level interconnect, figureFileSmall=MsV5C8NOrt9ZTAJuhoMzVQ==, figureFileBig=d7P/yX9+qbVl2jNdrFvKbg==, tableContent=null), ArticleFig(id=1329435580217275360, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图3, caption=基于TH-Express 的2级互连FPGA 集群架构, figureFileSmall=MsV5C8NOrt9ZTAJuhoMzVQ==, figureFileBig=d7P/yX9+qbVl2jNdrFvKbg==, tableContent=null), ArticleFig(id=1329435580275995617, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 4, caption=Stream switch module microarchitecture and integration example with acceleration cores, figureFileSmall=dliSfbhnnKkgs6K7th6t1Q==, figureFileBig=43MwYBwGBeFQfn1MgosTdA==, tableContent=null), ArticleFig(id=1329435580338910178, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图4, caption=流交换模块微架构及其与加速核连接示例, figureFileSmall=dliSfbhnnKkgs6K7th6t1Q==, figureFileBig=43MwYBwGBeFQfn1MgosTdA==, tableContent=null), ArticleFig(id=1329435580389241827, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 5, caption=TH-FCAD automated deployment framework, figureFileSmall=RrFv0Z5RxqxAUr85LBCxqQ==, figureFileBig=d/demhBgzkPHUvKUpHbVuA==, tableContent=null), ArticleFig(id=1329435580456350692, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图5, caption=TH-FCAD 自动化部署框架, figureFileSmall=RrFv0Z5RxqxAUr85LBCxqQ==, figureFileBig=d/demhBgzkPHUvKUpHbVuA==, tableContent=null), ArticleFig(id=1329435580527653861, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 6, caption=Model partition acceleration kernel and its latency, figureFileSmall=W8W/xBNjW/2q6OSDBBz8bw==, figureFileBig=AInkuPw/JmAkytheaey/tQ==, tableContent=null), ArticleFig(id=1329435580598957030, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图6, caption=模型切分加速核及其延迟, figureFileSmall=W8W/xBNjW/2q6OSDBBz8bw==, figureFileBig=AInkuPw/JmAkytheaey/tQ==, tableContent=null), ArticleFig(id=1329435580661871591, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 7, caption=Architecture of the automated cluster building tool, figureFileSmall=CWGmrFq9WDcfgu8tK8hpCA==, figureFileBig=TsmnDJuE0WIsjcZYmecg1w==, tableContent=null), ArticleFig(id=1329435580724786152, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图7, caption=自动化集群构建工具架构, figureFileSmall=CWGmrFq9WDcfgu8tK8hpCA==, figureFileBig=TsmnDJuE0WIsjcZYmecg1w==, tableContent=null), ArticleFig(id=1329435580783506409, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 8, caption=Comparison of communication data volume with two mapping algorithms for ResNet-50, figureFileSmall=u/9N5HdgPMeMEOSamDOH1w==, figureFileBig=CO9JLJuR2xkqUKkwUu0eEA==, tableContent=null), ArticleFig(id=1329435580846420970, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图8, caption=ResNet-50在2种映射算法下的通信数据量对比, figureFileSmall=u/9N5HdgPMeMEOSamDOH1w==, figureFileBig=CO9JLJuR2xkqUKkwUu0eEA==, tableContent=null), ArticleFig(id=1329435580913529835, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 9, caption=Comparison of resource usage with two mapping algorithms for ResNet-50, figureFileSmall=8X3P4FOzyBfdK+VTR5JN5w==, figureFileBig=MoxLHSgs0ldNIlUZUwr0/A==, tableContent=null), ArticleFig(id=1329435580980638700, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图9, caption=ResNet-50在2种映射算法下的资源消耗情况, figureFileSmall=8X3P4FOzyBfdK+VTR5JN5w==, figureFileBig=MoxLHSgs0ldNIlUZUwr0/A==, tableContent=null), ArticleFig(id=1329435581043553261, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 10, caption=Comparison of layer-wise latency before and after latency balancing in ResNet-50, figureFileSmall=yVl+qf0G/2R9TNNR/Zg6/A==, figureFileBig=P743QGl6Aj44RGdUKjMG/A==, tableContent=null), ArticleFig(id=1329435581102273518, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图10, caption=ResNet-50 延迟平衡前后各层延迟对比, figureFileSmall=yVl+qf0G/2R9TNNR/Zg6/A==, figureFileBig=P743QGl6Aj44RGdUKjMG/A==, tableContent=null), ArticleFig(id=1329435581156799471, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Figure 11, caption=Effect of local LVDS interconnect on communication time, figureFileSmall=igSkfNp05TBpbTJIMJWAhg==, figureFileBig=15rx9WwHuUclOLHKvqOFMw==, tableContent=null), ArticleFig(id=1329435581211325424, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=图11, caption=局部LVDS互连对通信时间的影响, figureFileSmall=igSkfNp05TBpbTJIMJWAhg==, figureFileBig=15rx9WwHuUclOLHKvqOFMw==, tableContent=null), ArticleFig(id=1329435581307794417, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Table 1, caption=

Latency and Bandwidth of Cluster Links

, figureFileSmall=null, figureFileBig=null, tableContent=
链路延迟/μs带宽/Gbps
Host-FPGA18.280
FPGA-FPGA (GTH)1.5680
FPGA-FPGA (LVDS)0.21100
FPGA 内部0.08-
), ArticleFig(id=1329435581370708978, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=表1, caption=

集群链路的延迟和带宽

, figureFileSmall=null, figureFileBig=null, tableContent=
链路延迟/μs带宽/Gbps
Host-FPGA18.280
FPGA-FPGA (GTH)1.5680
FPGA-FPGA (LVDS)0.21100
FPGA 内部0.08-
), ArticleFig(id=1329435581433623539, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Table 2, caption=

Resource Consumption of Shell Architecture %

, figureFileSmall=null, figureFileBig=null, tableContent=
模块LUTFFBRAMDSP
Shell4.730.960.490
流交换模块0.350.2700
), ArticleFig(id=1329435581496538100, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=表2, caption=

Shell架构的资源消耗

, figureFileSmall=null, figureFileBig=null, tableContent=
模块LUTFFBRAMDSP
Shell4.730.960.490
流交换模块0.350.2700
), ArticleFig(id=1329435581588812789, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Table 3, caption=

Experimental Results of Different Models

, figureFileSmall=null, figureFileBig=null, tableContent=
模型(计算操作数)平台框架稀疏度/%位宽/b频率/MHz延迟/ms吞吐量/FPS
ResNet-8
(25.4 MOP)
Intel i7-12700HKeras0326.4
RTX 5090Keras0321.7
1个FPGAHLS4ML0161560.1327575
3个FPGA本文0161560.05119607
SqueezeNet
(1.0 GOP)
Intel i7-12700HKeras0328.5
RTX 5090Keras0323.4
6个FPGA文献[46]082003.9251
4个FPGA本文081251.24806
ResNet-50
(8.1 GOP)
Intel i7-12700HKeras03256.3
RTX 5090Keras0326.9
1 Alveo U250文献[27]011951.92703
1 Alveo U200AGNA[47]082004.55
2 Alveo U280Elastic-DF[35]012201.553617
2 Stratix 10 MX
2100
HPIPE[48]85164001.752621
12个FPGAAIgean[34]082001.9660
14个FPGA贪心映射081251.42704
12个FPGASA映射(本文)081251.36735
), ArticleFig(id=1329435581672698870, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=表3, caption=

不同模型的实验结果

, figureFileSmall=null, figureFileBig=null, tableContent=
模型(计算操作数)平台框架稀疏度/%位宽/b频率/MHz延迟/ms吞吐量/FPS
ResNet-8
(25.4 MOP)
Intel i7-12700HKeras0326.4
RTX 5090Keras0321.7
1个FPGAHLS4ML0161560.1327575
3个FPGA本文0161560.05119607
SqueezeNet
(1.0 GOP)
Intel i7-12700HKeras0328.5
RTX 5090Keras0323.4
6个FPGA文献[46]082003.9251
4个FPGA本文081251.24806
ResNet-50
(8.1 GOP)
Intel i7-12700HKeras03256.3
RTX 5090Keras0326.9
1 Alveo U250文献[27]011951.92703
1 Alveo U200AGNA[47]082004.55
2 Alveo U280Elastic-DF[35]012201.553617
2 Stratix 10 MX
2100
HPIPE[48]85164001.752621
12个FPGAAIgean[34]082001.9660
14个FPGA贪心映射081251.42704
12个FPGASA映射(本文)081251.36735
), ArticleFig(id=1329435581752390647, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Table 4, caption=

Comparison of Performance Across Different Hardware and Algorithm Configurations

, figureFileSmall=null, figureFileBig=null, tableContent=
配置互连方案映射算法FPGA个数延迟/ms
a仅GTH贪心141.47
bGTH+LVDS贪心141.42
cGTH+LVDSSA121.36
), ArticleFig(id=1329435581819499512, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=表4, caption=

不同硬件与算法配置下的性能对比

, figureFileSmall=null, figureFileBig=null, tableContent=
配置互连方案映射算法FPGA个数延迟/ms
a仅GTH贪心141.47
bGTH+LVDS贪心141.42
cGTH+LVDSSA121.36
), ArticleFig(id=1329435581890802681, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=EN, label=Table 5, caption=

FIFO Depth Analysis of Branch Merging Structures

, figureFileSmall=null, figureFileBig=null, tableContent=
延迟差/ms理论需求深度设定深度仿真最大占用深度是否死锁
1.12169418641731否
1.84278430632773否
2.68405544614056否
), ArticleFig(id=1329435581991465978, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, language=CN, label=表5, caption=

分支汇聚结构FIFO深度分析

, figureFileSmall=null, figureFileBig=null, tableContent=
延迟差/ms理论需求深度设定深度仿真最大占用深度是否死锁
1.12169418641731否
1.84278430632773否
2.68405544614056否
)], attaches=null, journal=Journal(id=1324759606947315908, delFlag=0, nameCn=计算机研究与发展, nameEn=Journal of Computer Research and Development, nameHistory1=null, nameHistory2=null, issn=1000-1239, eissn=null, cn=11-1777/TP, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=k2l8zgqwstuxxevFX2qxVA==, journalPrice=null, startedYear=null, abbrevIsoEn=Journal of Computer Research and Development, journalRemark=null, publicationField=null, createdTime=1793776903141, updatedTime=1793850698612, createdBy=18614031015, updatedBy=13701087609, firstLetterCn=J, firstLetterEn=J, subjectCode=Electronic Information, subjectName=null, subjectCodeEn=Electronic Information, subjectNameEn=null, picCn=k2l8zgqwstuxxevFX2qxVA==, picEn=r6k0Ry+RD+c/VXj5QarmDw==, jcr=null, cjcr=null, exts=[JournalExt(id=1325069127710286688, language=CN, name=计算机研究与发展, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1793850698640, updatedTime=1793850698640, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://crad.ict.ac.cn/journalx/authorLogOn.action, submissionEditorUrl=https://crad.ict.ac.cn/journalx/editorLogOn.action, submissionReviewUrl=https://crad.ict.ac.cn/journalx/expertLogOn.action, submissionCeEditorUrl=https://crad.ict.ac.cn/journalx/editorInChiefLogOn.action, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1325069127777395553, language=EN, name=Journal of Computer Research and Development, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1793850698656, updatedTime=1793850698656, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://crad.ict.ac.cn/journalx/authorLogOn.action, submissionEditorUrl=https://crad.ict.ac.cn/journalx/editorLogOn.action, submissionReviewUrl=https://crad.ict.ac.cn/journalx/expertLogOn.action, submissionCeEditorUrl=https://crad.ict.ac.cn/journalx/editorInChiefLogOn.action, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1324759914146529478, websiteList=[Website(id=1325070300139892771, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1324759914146529478, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN, language=CN, createTime=1793850978169, createBy=18614031015, updateTime=1793851040259, updateBy=18614031015, name=计算机研究与发展-中文, tplId=1146099689490845704, title=计算机研究与发展, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1325070893751349360, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=articleTextType, value=kx, createTime=1793851119697, updateTime=1793851119697, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893730377837, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=banner, value=null, createTime=1793851119692, updateTime=1793851119692, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893772320883, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=grayFlag, value=0, createTime=1793851119702, updateTime=1793851119702, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893721989228, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=logo, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/file/pic?fileId=U27tDsy717YF7XSPA+Vwdw==, createTime=1793851119690, updateTime=1793851119690, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893784903797, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=minRunFlag, value=0, createTime=1793851119705, updateTime=1793851119705, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893742960751, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/file/pic, createTime=1793851119695, updateTime=1793851119695, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893780709492, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=silenceFlag, value=0, createTime=1793851119704, updateTime=1793851119704, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893738766446, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1793851119694, updateTime=1793851119694, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893755543665, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=themeColor, value=null, createTime=1793851119698, updateTime=1793851119698, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893763932274, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=themeStyle, value=null, createTime=1793851119700, updateTime=1793851119700, creator=18614031015, updator=18614031015)]), Website(id=1325070300580294698, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1324759914146529478, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN, language=EN, createTime=1793850978274, createBy=18614031015, updateTime=1793851036638, updateBy=18614031015, name=计算机研究与发展-英文, tplId=1146101810881728533, title=Journal of Computer Research and Development, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1325070925288321148, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=articleTextType, value=kx, createTime=1793851127216, updateTime=1793851127216, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925263155321, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=banner, value=null, createTime=1793851127210, updateTime=1793851127210, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925309292671, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=grayFlag, value=0, createTime=1793851127221, updateTime=1793851127221, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925254766712, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=logo, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/file/pic?fileId=U27tDsy717YF7XSPA+Vwdw==, createTime=1793851127208, updateTime=1793851127208, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925326069889, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=minRunFlag, value=0, createTime=1793851127225, updateTime=1793851127225, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925279932539, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/file/pic, createTime=1793851127214, updateTime=1793851127214, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925317681280, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=silenceFlag, value=0, createTime=1793851127223, updateTime=1793851127223, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925271543930, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1793851127212, updateTime=1793851127212, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925292515453, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=themeColor, value=null, createTime=1793851127217, updateTime=1793851127217, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925300904062, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=themeStyle, value=null, createTime=1793851127219, updateTime=1793851127219, creator=18614031015, updator=18614031015)])], journalTitle=计算机研究与发展, weixinUrl=null, journalUrl=https://crad.ict.ac.cn/, iacademicId=null, status=1, seqNo=null, journalTitleEn=Journal of Computer Research and Development, journalPhotoCn=k2l8zgqwstuxxevFX2qxVA==, journalPhotoEn=r6k0Ry+RD+c/VXj5QarmDw==, journalFirstLetter=J, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/10.7544/issn1000-1239.202550866, detailUrlEn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202550866, pdfUrlCn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/PDF/10.7544/issn1000-1239.202550866, pdfUrlEn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/PDF/10.7544/issn1000-1239.202550866, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=1, orderTime=1793462400000, fullTextJson=null, articleText=null, reference=null)
收藏切换
TH-FCAD:面向FPGA集群的大规模神经网络自动化部署框架
赵言亢 , 黎渊 , 齐星云 , 陆亿行 , 刘谱光 , 王强 , 谢旻 , 彭林 , 赖明澈 *
计算机研究与发展 | 体系结构 2026,63(11): 2788-2806
收起
收藏切换
计算机研究与发展 |体系结构 2026 , 63 (11) : 2788 -2806
TH-FCAD:面向FPGA集群的大规模神经网络自动化部署框架
全屏
[Author(id=1329435576861832101, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=zhaoyankangnudt@nudt.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435576979272615, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435576861832101, language=EN, stringName=Yankang Zhao, firstName=Yankang, middleName=null, lastName=Zhao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 2000. PhD candidate. His main research interests include hardware acceleration and computer architecture

"}, bioImg=null, bioContent=

born in 2000. PhD candidate. His main research interests include hardware acceleration and computer architecture

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435577042187176, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435576861832101, language=CN, stringName=赵言亢, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"Wk6Wifs/FSZ+3CiZ39RfLQ==","content":"

2000年生。博士研究生。主要研究方向为硬件加速、计算机体系结构

"}, bioImg=Wk6Wifs/FSZ+3CiZ39RfLQ==, bioContent=

2000年生。博士研究生。主要研究方向为硬件加速、计算机体系结构

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435577117684650, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435577222542252, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577117684650, language=EN, stringName=Yuan Li, firstName=Yuan, middleName=null, lastName=Li, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1984. PhD, associate professor. His main research interests include high performance computer architecture, high speed interconnection network, and artificial intelligence

"}, bioImg=null, bioContent=

born in 1984. PhD, associate professor. His main research interests include high performance computer architecture, high speed interconnection network, and artificial intelligence

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435577314816941, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577117684650, language=CN, stringName=黎渊, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"ep6mfddh6oDJD5GCU4vX9w==","content":"

1984年生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络、人工智能

"}, bioImg=ep6mfddh6oDJD5GCU4vX9w==, bioContent=

1984年生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络、人工智能

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435577398703023, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435577474200497, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577398703023, language=EN, stringName=Xingyun Qi, firstName=Xingyun, middleName=null, lastName=Qi, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1979. PhD, associate professor. His main research interests include high performance computer architecture and high speed interconnection network

"}, bioImg=null, bioContent=

born in 1979. PhD, associate professor. His main research interests include high performance computer architecture and high speed interconnection network

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435577566475186, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577398703023, language=CN, stringName=齐星云, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"RH97HOT5fxRQU/auJ4Wi8g==","content":"

1979生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络

"}, bioImg=RH97HOT5fxRQU/auJ4Wi8g==, bioContent=

1979生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435577633584052, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435577717470134, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577633584052, language=EN, stringName=Yihang Lu, firstName=Yihang, middleName=null, lastName=Lu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1999. Master. His main research interests include computer architecture and artificial intelligence

"}, bioImg=null, bioContent=

born in 1999. Master. His main research interests include computer architecture and artificial intelligence

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435577797161911, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577633584052, language=CN, stringName=陆亿行, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"cEXTiNzey1zgRFy+Z7pAwQ==","content":"

1999年生。硕士。主要研究方向为计算机体系结构、人工智能

"}, bioImg=cEXTiNzey1zgRFy+Z7pAwQ==, bioContent=

1999年生。硕士。主要研究方向为计算机体系结构、人工智能

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435577876853689, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435577960739771, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577876853689, language=EN, stringName=Puguang Liu, firstName=Puguang, middleName=null, lastName=Liu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1995. PhD, assistant professor. His main research interests include algorithm accelerator, reconfigurable computing, and high-performance network

"}, bioImg=null, bioContent=

born in 1995. PhD, assistant professor. His main research interests include algorithm accelerator, reconfigurable computing, and high-performance network

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435578023654332, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435577876853689, language=CN, stringName=刘谱光, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"luaetcdAx6//g/MBoTk6BA==","content":"

1995年生。博士,助理研究员。主要研究方向为算法加速、可重构计算、高性能网络

"}, bioImg=luaetcdAx6//g/MBoTk6BA==, bioContent=

1995年生。博士,助理研究员。主要研究方向为算法加速、可重构计算、高性能网络

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435578086568894, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435578162066368, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578086568894, language=EN, stringName=Qiang Wang, firstName=Qiang, middleName=null, lastName=Wang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1989. PhD, assistant professor. His main research interests include computer architecture, high speed interconnection network, and artificial intelligence

"}, bioImg=null, bioContent=

born in 1989. PhD, assistant professor. His main research interests include computer architecture, high speed interconnection network, and artificial intelligence

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435578224980929, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578086568894, language=CN, stringName=王强, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"gIxC0NCAUl/wWNeGE4GHXw==","content":"

1989年生。博士,助理研究员。主要研究方向为体系结构、高速互连网络、人工智能

"}, bioImg=gIxC0NCAUl/wWNeGE4GHXw==, bioContent=

1989年生。博士,助理研究员。主要研究方向为体系结构、高速互连网络、人工智能

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435578296284099, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=6, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435578363392965, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578296284099, language=EN, stringName=Min Xie, firstName=Min, middleName=null, lastName=Xie, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1972. PhD, professor. His main research interest includes parallel and distributed computing

"}, bioImg=null, bioContent=

born in 1972. PhD, professor. His main research interest includes parallel and distributed computing

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435578434696134, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578296284099, language=CN, stringName=谢旻, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"r/L0WZJkORJuGF/LiHm8vA==","content":"

1972年生。博士,研究员。主要研究方向为并行与分布式计算

"}, bioImg=r/L0WZJkORJuGF/LiHm8vA==, bioContent=

1972年生。博士,研究员。主要研究方向为并行与分布式计算

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435578493416392, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=7, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329435578556330954, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578493416392, language=EN, stringName=Lin Peng, firstName=Lin, middleName=null, lastName=Peng, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1979. PhD, associate professor. His main research interest includes high performance computing

"}, bioImg=null, bioContent=

born in 1979. PhD, associate professor. His main research interest includes high performance computing

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435578615051211, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578493416392, language=CN, stringName=彭林, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国防科技大学计算机学院 长沙 410073, bio={"img":"1VVqXSrSCZMY2rUkGULULw==","content":"

1979年生。博士,副研究员。主要研究方向为高性能计算

"}, bioImg=1VVqXSrSCZMY2rUkGULULw==, bioContent=

1979年生。博士,副研究员。主要研究方向为高性能计算

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])]), Author(id=1329435578673771469, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, orderNo=8, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=mingchelai@nudt.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1329435578753463247, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578673771469, language=EN, stringName=Mingche Lai, firstName=Mingche, middleName=null, lastName=Lai, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=*, address=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, bio={"content":"

born in 1982. PhD, professor. His main research interests include computer architecture, high performance interconnection, and VLSI design

"}, bioImg=null, bioContent=

born in 1982. PhD, professor. His main research interests include computer architecture, high performance interconnection, and VLSI design

, aboutCorrespAuthor=null), CN=AuthorExt(id=1329435578824766416, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, authorId=1329435578673771469, language=CN, stringName=赖明澈, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=*, address=国防科技大学计算机学院 长沙 410073, bio={"img":"Y80o9yzhSP2u/0RsAYsGGw==","content":"

1982年生。博士,研究员。主要研究方向为体系结构、高性能互连、超大规模集成电路设计

"}, bioImg=Y80o9yzhSP2u/0RsAYsGGw==, bioContent=

1982年生。博士,研究员。主要研究方向为体系结构、高性能互连、超大规模集成电路设计

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329435576698254241, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, xref=null, ext=[AuthorCompanyExt(id=1329435576710837154, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Computer Science and Technology, National University of Defense Technology, Changsha 410073), AuthorCompanyExt(id=1329435576727614371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329435572625585014, companyId=1329435576698254241, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国防科技大学计算机学院 长沙 410073)])])]
赵言亢 , 黎渊, 齐星云, 陆亿行, 刘谱光, 王强, 谢旻, 彭林, 赖明澈*
作者信息
  • 国防科技大学计算机学院 长沙 410073
通讯作者:
赖明澈()
作者简介:

作者贡献声明

赵言亢和黎渊负责整体实验方案的设计与实现、论文整体架构的设计和撰写;齐星云负责指导方法设计;陆亿行、刘谱光、王强负责部分实验的设计与实施;谢旻、彭林负责系统工程实现与测试验证;赖明澈提出研究思路与整体方案指导,并负责论文审阅与修改。赵言亢和黎渊为共同第一作者。

2000年生。博士研究生。主要研究方向为硬件加速、计算机体系结构

1984年生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络、人工智能

1979生。博士,副研究员。主要研究方向为高性能计算机体系结构、高速互连网络

1999年生。硕士。主要研究方向为计算机体系结构、人工智能

1995年生。博士,助理研究员。主要研究方向为算法加速、可重构计算、高性能网络

1989年生。博士,助理研究员。主要研究方向为体系结构、高速互连网络、人工智能

1972年生。博士,研究员。主要研究方向为并行与分布式计算

1979年生。博士,副研究员。主要研究方向为高性能计算

1982年生。博士,研究员。主要研究方向为体系结构、高性能互连、超大规模集成电路设计

TH-FCAD: Automated Deployment Framework for Large-Scale Neural Networks on FPGA Clusters
Yankang Zhao , Yuan Li, Xingyun Qi, Yihang Lu, Puguang Liu, Qiang Wang, Min Xie, Lin Peng, Mingche Lai*
Affiliations
  • College of Computer Science and Technology, National University of Defense Technology, Changsha 410073
  • born in 2000. PhD candidate. His main research interests include hardware acceleration and computer architecture

    born in 1984. PhD, associate professor. His main research interests include high performance computer architecture, high speed interconnection network, and artificial intelligence

    born in 1979. PhD, associate professor. His main research interests include high performance computer architecture and high speed interconnection network

    born in 1999. Master. His main research interests include computer architecture and artificial intelligence

    born in 1995. PhD, assistant professor. His main research interests include algorithm accelerator, reconfigurable computing, and high-performance network

    born in 1989. PhD, assistant professor. His main research interests include computer architecture, high speed interconnection network, and artificial intelligence

    born in 1972. PhD, professor. His main research interest includes parallel and distributed computing

    born in 1979. PhD, associate professor. His main research interest includes high performance computing

    born in 1982. PhD, professor. His main research interests include computer architecture, high performance interconnection, and VLSI design

出版时间: 2026-11-01 doi: 10.7544/issn1000-1239.202550866
文章导航
收藏切换

针对单颗FPGA资源受限难以加速大规模神经网络,且FPGA集群面临架构设计复杂、任务划分低效及自动化工具链缺失等挑战,提出面向FPGA集群的端到端自动化部署框架TH-FCAD(automated deployment framework for large-scale neural networks on FPGA clusters)。首先,构建基于TH-Express的2级互连集群架构,融合全局互连与局部互连,实现高带宽、低延迟的跨节点通信;其次,提出延迟平衡优化与模型切分方法,将大规模模型均匀切分为多加速核并保持核间延时均衡;最后,设计集群感知映射算法,联合FPGA资源约束与通信拓扑自动生成最优映射,以最小化通信开销。构建了完整的工具链,实现了从PyTorch/TensorFlow模型到集群的端到端自动化编译部署。基于16节点FPGA集群的评估表明,部署ResNet-8,SqueezeNet,ResNet-50时,推理延迟分别为0.051 ms,1.24 ms,1.36 ms,峰值算力达5.95 TOPS;较现有多FPGA方案性能提升28.4%,且优于CPU与GPU平台。

神经网络  /  硬件加速  /  FPGA集群  /  任务划分  /  自动化部署框架

With the rapid growth of neural network model sizes, single FPGA resources have become insufficient for accelerating large-scale models, while FPGA clusters face critical challenges, including complex architecture design, inefficient task partitioning, and the lack of automated toolchains. To address these issues, an end-to-end automated deployment framework for neural networks on FPGA clusters, named TH-FCAD (automated deployment framework for large-scale neural networks on FPGA clusters) is proposed. First, a two-level interconnect FPGA cluster architecture based on TH-Express is constructed. By integrating a high-speed global GTH (gigabit transceiver high-speed) network with a local LVDS (low voltage differential signaling) full-mesh interconnect, it achieves high-bandwidth and low-latency cross-node communication. Second, a latency-balancing optimization and model partitioning method is introduced to evenly partition large-scale neural networks into multiple acceleration kernels while maintaining inter-kernel delay equilibrium, which is essential for pipeline efficiency. Finally, a cluster-aware mapping algorithm is designed to automatically generate optimal placement schemes by jointly considering FPGA resource constraints and the cluster communication topology, thereby minimizing communication overhead. Furthermore, a complete automated toolchain is developed to streamline the entire deployment process, enabling seamless compilation from PyTorch/TensorFlow trained models to FPGA cluster configurations. Evaluations on a built 16 node FPGA cluster demonstrate that when deploying ResNet-8, SqueezeNet, and ResNet-50, TH-FCAD achieves inference latencies of 0.051 ms, 1.24 ms, and 1.36 ms, respectively, alongside a peak computational performance of 5.95 TOPS. Compared with state-of-the-art multi-FPGA approaches, the proposed framework delivers a 28.4% performance improvement and outperforms corresponding CPU and GPU implementations.

neural network  /  hardware acceleration  /  FPGA cluster  /  task partition  /  automated deployment framework
赵言亢, 黎渊, 齐星云, 陆亿行, 刘谱光, 王强, 谢旻, 彭林, 赖明澈. TH-FCAD:面向FPGA集群的大规模神经网络自动化部署框架. 计算机研究与发展, 2026 , 63 (11) : 2788 -2806 . DOI: 10.7544/issn1000-1239.202550866
Yankang Zhao, Yuan Li, Xingyun Qi, Yihang Lu, Puguang Liu, Qiang Wang, Min Xie, Lin Peng, Mingche Lai. TH-FCAD: Automated Deployment Framework for Large-Scale Neural Networks on FPGA Clusters[J]. Journal of Computer Research and Development, 2026 , 63 (11) : 2788 -2806 . DOI: 10.7544/issn1000-1239.202550866
神经网络的广泛应用[1-2]与模型规模的指数级增长[3]使传统计算架构面临严峻的功耗与存储墙限制[4]。相比高功耗的GPGPU[5]与缺乏灵活性的ASIC,FPGA凭借可重构性、低功耗及细粒度流水线并行能力,成为神经网络高能效加速的理想选择[6-7]。然而,单颗FPGA有限的片上存储和计算资源难以适应神经网络模型规模的快速增长[8]。
为应对这一挑战,传统方案主要采取2种策略:一方面,利用稀疏化、量化等模型压缩技术减少参数量和计算量;另一方面,依赖片外存储器存储庞大的权重参数设计统一的硬件架构,并通过复用计算单元来串行执行网络层。这类架构通过编译指令控制计算和数据调度,虽然实现了一些大规模模型在单FPGA芯片上的部署[9-11],但存在明显缺陷:模型压缩导致精度损失,层间串行执行和频繁的片外访存引入了显著的延迟开销[3]。
数据流架构为应对上述挑战提供了新的途径。该架构将神经网络层映射为独立的硬件加速核,实现层间流水并行与加速核间的片上直接数据传输,从而有效消除了中间结果的片外访存需求,显著降低了系统推理延时。同时,其固有的高度可扩展性,为突破单FPGA资源瓶颈提供了可能。该架构天然的分布式特征使其能够将计算任务有效地划分到多个FPGA节点上,通过跨节点的协同计算来突破单个芯片的资源限制。已有实证研究表明,这种架构能有效克服传统“内存墙”问题,在神经网络加速中实现更低的推理延迟[12-14]。正是基于数据流架构展现的高度可扩展性与性能潜力,研究者们开始尝试挖掘FPGA集群加速神经网络的潜力[15-17]。然而,现有方案大多仅针对特定应用实现定制化设计,在架构设计、编程抽象和通信优化等关键维度上缺乏系统性解决方案。
具体而言,在FPGA集群平台上实现大规模神经网络模型的高效加速,仍面临以下三大挑战:1)可扩展FPGA集群架构设计。如何设计高效可扩展的FPGA集群架构,确保多节点间实现高带宽、低延迟的数据传输,以支撑大规模并行协同计算。2)任务划分方法。如何设计大规模神经网络模型推理任务到多FPGA的划分策略,并实现与之匹配的并行策略和协同机制。3)自动化工具链缺失。如何建立端到端的编译优化框架,将模型描述自动映射为多FPGA配置方案,同时优化硬件资源利用率与通信开销。
此外,由于FPGA的开发流程较为复杂,研究人员不仅需掌握底层硬件开发技能,还需深入理解神经网络的执行机制[18-19]。在FPGA集群环境中,更需针对每个节点进行定制化设计,并处理跨设备的数据通信与任务同步,进一步加大了开发难度。这些因素共同导致当前面向FPGA集群的神经网络加速研究工作仍然相对匮乏。
针对上述挑战,本文提出一种面向FPGA集群的神经网络端到端自动化部署框架——TH-FCAD(automated deployment framework for large-scale neural networks on FPGA clusters),主要贡献包括:
1)提出2级互连的FPGA集群架构。通过全局GTH(gigabit transceiver high-speed)高速网络与局部LVDS(low voltage differential signaling)全互连的分层通信机制,实现了多FPGA节点间高带宽、低延迟的数据交换,局部互连特性可将通信延时降低18.7%。
2)提出延迟平衡优化与模型切分方法。基于性能-资源模型的延迟平衡方法能够自动优化各层设计参数,实现流水线延迟均衡;同时提出支持多加速核协同推理的模型切分策略,使神经网络模型能够在多FPGA上分布式部署加速。
3)提出集群感知的加速核映射算法与自动化集群构建工具。针对多加速核的部署需求,提出集群感知的映射算法,在满足资源约束条件下最小化通信开销,并开发自动化集群构建流程,实现了加速核到多FPGA节点的高效映射与工程自动生成,大幅提升了部署效率与系统性能。
4)构建了包含16节点的FPGA集群进行实验验证。结果表明,TH-FCAD框架在ResNet-8,SqueezeNet,ResNet-50上分别实现0.051 ms,1.24 ms,1.36 ms推理延迟,以及5.95 TOPS的峰值计算性能,相比现有多FPGA方法提升了28.4%。
需要说明的是,本文中“大规模神经网络”的界定,主要立足于FPGA集群自动化部署加速的特定视角。在单FPGA数据流架构下,片上资源(尤其是DSP和BRAM)严格制约着可直接部署的模型规模;现有代表性的自动化部署工具(如HLS4ML[20],FINN[21]等)通常仅能高效支持较小或经高度压缩的网络。因此,从硬件资源承载能力的角度来看,ResNet-50这类包含50余层及残差连接的模型已对单芯片构成显著挑战,足以成为验证多FPGA协同计算与自动化部署框架有效性的代表性案例。而参数量更大的Transformer系列模型(如BERT,Llama等),则超出了当前框架验证范围,将其高效部署于FPGA集群将是我们未来的重点研究方向。
神经网络的推理过程本质上是通过层次化结构的乘累加(multiply-accumulate,MAC)运算和非线性变换组合实现的。在满足数据依赖的前提下,推理计算可以通过多个计算单元沿不同维度进行并行化处理,包括层间并行、输入批次并行以及通道并行等。从架构上看,当前主流的FPGA加速架构主要分为处理单元阵列(processing element array,PEA)和数据流(dataflow)两类,具体如图1所示。
处理单元阵列架构采用固定并行度的MAC单元阵列,通过灵活编译执行多种模型计算任务[22-24]。该架构采用统一的硬件架构适配所有网络层,不同层需按照数据依赖关系串行执行,通过编译指令控制计算流程和调度数据搬运,并依赖片外存储器存储权重和中间结果。这种架构虽然具有设计复用性高、资源消耗少的优点,但其存在3个根本性缺陷:1)固定的计算结构难以适配不同层的计算特征,导致资源利用率低下;2)层间数据依赖导致流水线执行效率受限,且中间数据的频繁搬移会产生额外延迟;3)加速器需要存储整个模型的权重和大量中间结果,而FPGA片上存储器容量有限,使得片外存储器带宽成为性能瓶颈。
数据流架构则采用多个加速核协作完成模型推理任务,各层被映射到不同的计算单元并行执行,并采用片上缓存流式传输中间结果[20-21,25-27]。该架构从3个层面有效突破了传统冯·诺伊曼架构所面临的“内存墙”瓶颈问题[28]:1)通过片上数据流传输消除中间结果的存储需求;2)参数完全存储在片上,消除了片外存储访问开销;3)通过层间计算重叠技术打破顺序执行限制,从而显著降低总体延时。
数据流架构通过将网络各层展开为独立的硬件加速核以实现并行计算,其固有的分布式特性赋予了其优异的扩展性。然而,这种资源完全展开的设计特性也导致其资源消耗与模型复杂度(如层数和参数量)成正比。现有研究如HLS4ML[20],FINN[21]等实现的数据流架构加速器,在单块FPGA芯片的物理资源约束下,其所能实现的神经网络规模仍然受限。正是为了充分利用数据流架构的扩展性优势以突破单FPGA的资源瓶颈,研究者转向探索多FPGA协同计算方案。然而,此类方案在实现过程中也面临跨设备协同计算、通信开销优化等一系列新的技术挑战。
随着高层次综合(high-level synthesis, HLS)[29]技术的不断发展,FPGA开发门槛显著降低,并呈现出众多自动化工具。然而,现有工具在功能和适用性方面仍存在诸多局限性。例如,fpgaConvNet[25]基于同步数据流模型实现了设计空间探索,但在跨层优化方面能力不足;Vitis AI[30]虽提供端到端部署方案,但其闭源特性限制了定制化扩展的灵活性;FINN[21,31]专注于低位宽网络,适用范围相对狭窄;HLS4ML[20]虽支持主流框架模型转换,但其架构优化局限于单FPGA资源约束。综上所述,现有FPGA自动化框架的共同缺陷在于:其设计普遍局限于单设备部署场景,缺乏设备间通信接口的协同设计能力,同时未能建立多FPGA协同优化机制,因此难以满足大规模模型的分布式部署需求。
为此,已有研究开始探索在FPGA集群上实现神经网络加速。FPGA集群架构根据互连结构可分为专用型与通用型2类。专用型架构通过定制互连实现特定模型的加速,例如文献[15]通过SATA电缆构建了由6个FPGA组成的集群,其实现的AlexNet和VGG16模型相比CPU和GPU分别获得了21倍和2倍的能效比提升。文献[16]通过PCIe将16块FPGA连接到主机,实现的ResNet-152模型在计算性能上相比已有工作获得16.4倍的提升。文献[17]在SFP+连接的2块ZCU102 FPGA上部署YOLO模型,相对于单FPGA设计实现了3.48的加速比。这些架构虽然对特定模型进行了优化,但缺乏通用性和可扩展性。
通用型集群架构致力于提升系统的灵活性和可扩展性。其代表性工作包括微软Brainwave[32],其采用数据中心网络构建了包含280个FPGA的集群,用于加速搜索算法和深度学习模型,但闭源架构限制了其应用范围。Galapagos[33]通过网络堆栈抽象实现了FPGA虚拟化,隐藏了底层通信细节,为软件编程及任务调度提供了灵活性。AIgean框架[34]进一步基于以太网构建了通用集群,实现了AutoEncoder与ResNet-50模型的加速,但其软件协议栈引入的通信延迟(>5 ms)严重制约了加速核流水线执行效率,且缺乏模型的自动化切分方法。此外,Elastic-DF[35]针对多Die FPGA(multi-die FPGA)设计资源平衡策略,在ResNet-50和MobileNetV1模型上分别获得了44%的延迟降低和78%的吞吐量提升,但其仅在少量FPGA上实现低位宽(1b)模型,且未考虑面向集群架构的优化。
综上所述,现有研究工作在3个方面存在不足:1)在集群架构方面,专用型架构的互连方式缺乏灵活性,而通用型互连方式通信效率较低;2)在加速框架方面,现有的面向单FPGA的加速框架无法直接应用于集群环境;3)缺乏自动化的任务划分和映射方法。针对上述问题,本文提出系统化的解决方案:基于高速互连网络的透明化集群架构、融合资源与通信开销优化的任务划分映射算法以及支持集群部署的全流程自动化工具链。
TH-Express[36-40]高性能互连网络由网络路由芯片(network routing chip,NRC)和网络接口芯片(network interface chip,NIC)两种专用芯片构成。NRC提供多端口高吞吐交换;NIC支持短报文(mini-packet,MP)与远程直接内存访问(remote direct memory access,RDMA),并基于硬件逻辑实现可靠传输与流量控制。相较于传统PCIe与以太网,TH-Express在拓扑灵活性与协议效率方面具有显著优势,适于构建大规模FPGA集群。现有研究尚未充分挖掘其在深度学习FPGA集群加速中的潜力,本文基于TH-Express构建FPGA集群系统,实现节点间高速通信,为大规模神经网络的集群化部署提供可靠网络基础。
现有FPGA集群架构主要可分为3类,其组织方式对计算效率具有决定性影响,如图2所示。协处理器架构[16]将FPGA作为CPU附属设备,所有跨节点通信均需通过CPU进行中转。尽管这种架构能够兼容传统数据中心网络,但FPGA间的高通信延迟严重制约了协同计算效率。Catapult[41]提出的Bump-in-the-wire架构,将FPGA嵌入NIC。该架构虽可利用数据中心现有网络拓扑,但FPGA需同时处理计算与网络数据流,导致约15%逻辑资源的额外开销[32,41]。专用互连架构[15]为特定模型定制FPGA互连网络结构,能够获得极低的通信开销。然而其刚性拓扑结构导致扩展性受限,且需为不同模型重新设计物理连接。此外,由于FPGA互连网络与CPU等设备存在拓扑异构性,实际部署时还需考虑跨架构网络结构通信所带来的性能损耗。
本文提出的基于TH-Express的2级互连集群架构(如图2(d)所示)属于融合通用型与专用型拓扑优势的混合架构。该架构通过分层网络设计实现高效互连:全局层采用光纤连接至高速路由芯片,构建通用互连网络,支持任意规模节点的灵活扩展;局部层则在相邻FPGA节点间采用低延迟、高带宽的LVDS实现点对点专用通信。该混合架构通过分层设计融合了通用互连与专用互连的优势,有效兼顾了系统通用性和通信效率的双重需求。虽然双模互连设计增加了硬件复杂度(如FPGA逻辑资源消耗与接口设计难度),但通过本文提出的自动化工具链(详见第4节),我们实现了端到端的全自动化部署流程,有效解决了这些工程挑战。
此外,FPGA与CPU通过GTH网络直接相连,构成对等计算节点,避免了传统架构中主从通信模式带来的性能瓶颈。在软件层面,主机可通过用户态接口直接访问任意FPGA节点,消除了传统层次化访问模式下的性能开销。同时,Shell/Role架构将物理分散的FPGA资源虚拟化为单一逻辑设备,并彻底隐藏了设备间的底层通信细节。在此架构下,计算任务被拆分为多个阶段,每个阶段由一个独立的加速核执行。系统采用统一编址方案为各加速核分配唯一地址,并通过自动部署将其映射至指定FPGA节点,同时动态配置路由表。推理时,主机将计算请求封装为TH-Express MP报文,经NRC路由至首节点。数据流驱动加速核计算,流交换模块基于路由表自主将计算结果转发至下一目标加速核。后续加速核以相同机制自动传递数据,最终结果经NRC网络返回主机。该架构通过数据流驱动与自主路由的有机结合,实现了全程无需主机干预的自动化推理计算。
本文所提出的层次化2级互连架构如图3所示。该架构基于GTH全局网络与LVDS直接连接的协同设计,构建了全局与局部2级通信模式。其中:第1级采用基于TH-Express的GTH网络,负责实现系统全局范围内的高效通信;第2级则通过LVDS直接连接,构建局部高带宽通信通道。2级网络协同工作,形成了层次化的通信拓扑结构,从而在全局通信能力和局部数据传输效率之间实现优化平衡。
全局互连网络基于NRC与GTH高速串行链路构建,采用胖树拓扑结构以支持系统的大规模扩展[39]。每个NRC芯片集成多个全双工SerDes端口,支持灵活的通道速率配置,具备高带宽传输能力。在路由机制方面,采用基于分布式查找表的自适应路由策略,各端口内置预定义路由表,报文仅需携带目标物理地址即可实现自主寻址与高效转发。
在FPGA实现方面,本文设计了专用协议栈,以支持FPGA节点接入TH-Express互连网络,并实现AXI Stream数据与网络报文的高效转换。该协议栈采用分层架构,包括物理层、链路层、网络层、传输层与应用层。物理层集成多通道SerDes硬核,支持可配置传输速率;链路层通过数据校验确保可靠传输;网络层实现地址解析和动态路由;传输层主要采用MP协议,适用于低延迟通信;应用层则提供AXI Stream接口,实现网络数据流与计算核之间的无缝对接。
在Blade内部(4个FPGA构成1个刀片),采用LVDS全互连架构实现板内FPGA间的低延迟、高带宽点对点通信。为提升传输效率,设计了3层精简协议栈,包括物理层、链路层与应用层。物理层集成LVDS收发器与时钟同步电路,提供高带宽传输能力;链路层实现多通道数据同步与基于信用的流控机制,确保数据可靠传输并避免接收端溢出;应用层则实现AXI Stream接口的无缝对接,支持反压传递以优化流量控制。该协议在满足低延迟要求的同时,保障了数据流的高效处理。
每个FPGA节点的设计分为静态的Shell层和动态的Role层。其中,Shell层包含流交换模块、GTH网络栈模块和LVDS转换桥模块,分别提供GTH和LVDS通信接口。Role层则动态集成分配到该节点的所有加速核,形成可重构的任务执行单元。
流交换模块采用参数化设计,数据交换端口数量与位宽可根据系统需求灵活配置,其微架构如图4所示。各端口遵循AXI Stream协议,利用数据包中的TDEST字段携带目的地址信息。端口间通过交叉开关实现互连,由控制状态机统一管理连接状态,支持多端口并行传输。
当数据包到达输入端口时,控制状态机依据TDEST字段查询转发路由表,确定目标输出端口。若目标端口处于空闲状态,交叉开关立即建立连接并开始数据传输;若端口忙碌,则通过AXI Stream协议的反压机制使输入端口等待。每个输出端口均设有FIFO缓冲区,可在连接建立阶段缓存首数据,并借助AXI Stream协议的反压机制避免溢出。当多个输入端口同时请求时,状态机通过仲裁机制选择其中之一优先传输。
本文设计的Shell/Role架构实现了FPGA通信硬件与加速器逻辑设计的解耦。集群中所有FPGA的Shell层保持统一设计,通过标准化流式接口为Role层提供透明化的集群通信能力。加速器的设计无需考虑FPGA底层通信细节,只需完成加速核端口与流交换模块的拼接,并配置对应的路由表项,即可实现加速核在集群上的部署。该过程通过自动化映射部署工具AutoDeploy实现。针对每个FPGA节点,该工具能够自动完成模块拼接、转发路由表配置及FPGA工程生成,随后执行综合、布局布线等操作,最终生成FPGA集群每个节点的位流,并实现位流的自动下载与部署。
为了构建高效的CPU-FPGA通信机制,本文设计并实现了3层式软件通信栈。设备驱动层实现NIC硬件资源管理与内核态通信服务。软件通信库层提供面向应用的NIC直接访问接口,并采用连接协议保证数据传输的可靠性。应用层对数据传输的实现细节进行了封装,支持应用程序通过用户接口与任意FPGA节点建立直连通道。用户在准备好待计算的数据后,可直接调用接口函数将其发送到FPGA首节点,并等待计算完成后的结果返回。整个过程无需额外操作,显著降低了应用程序的开发复杂度。
基于2级互连的FPGA集群架构,本文提出了一种面向FPGA集群的端到端全流程自动化映射与部署框架TH-FCAD,其架构如图5所示。该框架可将PyTorch或TensorFlow训练生成的神经网络模型自动映射部署至FPGA集群,其核心流程包含以下4个关键阶段:
1)模型解析与优化阶段。TH-FCAD接收预训练神经网络模型描述文件(如h5格式),通过模型解析模块构建模型层次结构。以ResNet-50模型为例,能够精确识别模型包含的53个卷积层、50个ReLU层以及跨层连接组件。基于扩展的HLS4ML框架,工具自动优化设计参数,平衡各层延迟,最终生成高效的流水线设计。
2)模型切分阶段。为实现模型在FPGA集群上的分布式部署,工具将原始模型切分为多个子模型,每个子模型被封装为一个加速核,并插入标准化接口以对接流交换模块。通过流交换模块,加速核间可以实现点对点的高效数据传输,从而支持在FPGA集群上的灵活部署与协同推理加速。
3)加速核映射阶段。模型切分得到的加速核连接图表示了核间数据传输结构。为优化集群通信效率,采用集群感知的加速核映射算法,获得加速核到FPGA的最佳映射,并生成包含FPGA分配信息、各FPGA流交换模块配置信息以及NRC路由表信息的映射配置文件。
4)集群构建阶段。工具为集群中的每个FPGA创建独立的Vivado工程,完成Shell模块实例化、Role模块集成以及约束文件生成等关键步骤。将加速核IP与Shell设计无缝拼接,并调用Vivado工具链,最终生成可部署的比特流文件。
TH-FCAD由AutoPartition和AutoDeploy这2个子模块构成。其中,AutoPartition模块主要负责前2个阶段的工作,将模型描述文件转换成加速核的HLS实现。AutoDeploy模块则实现了工作流程中后2个阶段的任务,负责多核设计的自动化划分与映射,并生成面向多FPGA集群的可执行位流文件。
本文开发的AutoPartition工具在HLS4ML[20]基础上实现了神经网络多核加速架构的自动生成,主要改进包括:1)提出了基于性能-资源模型的延迟平衡方法,可自动优化各层重用因子(reuse factor,RF),解决了HLS4ML需手动调整RF的问题,实现延迟均衡与推理性能提升;2)提出模型切分方法,突破HLS4ML仅面向单FPGA设计的限制,支持多加速核协同推理,并实现FPGA集群的分布式部署能力。
HLS4ML架构中,卷积与全连接层均由矩阵向量乘(matrix-vector multiplication,MVM)部件实现,其规模与延迟由RF调节。RF定义为完成1次MVM计算时单个DSP的复用次数。对于卷积层,单次等效规模为$ {f}_{\text{h}}\cdot {f}_{\text{w}}\cdot i{n}_{\text{c}}\cdot ou{t}_{\text{c}} $的MVM计算。所需DSP数量为$ {f}_{\text{h}}\cdot {f}_{\text{w}}\cdot i{n}_{\text{c}}\cdot ou{t}_{\text{c}}/RF $。其中,$ {f}_{\text{h}} $,$ {f}_{\text{w}} $,$ i{n}_{\text{c}} $,$ ou{t}_{\text{c}} $分别为卷积核高度、宽度、输入通道数和输出通道数。
考虑数据位宽影响,DSP消耗与RF的关系如式(1)所示。
$ {R}^{\text{DSP}}\left(RF\right)=\gamma \cdot {f}_{\text{h}}\cdot {f}_{\text{w}}\cdot i{n}_{\text{c}}\cdot ou{t}_{\text{c}}/RF\;, $
其中系数$ \gamma $为单个DSP处理字长与目标精度的比值。采用8b量化方案时,利用数据拼接优化,单个DSP可单周期并行完成2次8b乘法,此时$ \gamma $=0.5。
RF直接影响层延迟。卷积层需执行$ ou{t}_{\text{h}}\cdot ou{t}_{\text{w}} $次MVM计算,其中$ ou{t}_{\text{h}} $,$ ou{t}_{\text{w}} $为输出特征图的高度和宽度。基于Vivado HLS综合仿真分析MVM时序行为,其时钟周期消耗包含初始化、数据读取及乘累加执行等阶段,由此得卷积层延迟模型如式(2)所示(单位:时钟周期)。
$ L\left(RF\right)=\left\{\begin{aligned} & out_{\text{h}}\cdot out_{\text{w}}\cdot\left(RF+6\right),\; \; RF \gt 1\; , \\ & out_{\text{h}}\cdot out_{\text{w}}\cdot3,\; \; RF=1\; 。\end{aligned}\right. $
此外,为保证规则DSP阵列结构,RF需满足式(3)约束。
$ \left({f}_{\text{h}}\cdot {f}_{\text{w}}\cdot i{n}_{\text{c}}\cdot ou{t}_{\text{c}}\right)\mathrm{mod}\;RF=0\;。 $
全连接层可视为$ {f}_{\text{h}}={f}_{\text{w}}=ou{t}_{\text{h}}=ou{t}_{\text{w}}=1 $的特例,前述分析同样适用。
为最大化流水线执行效率,本文提出一种延迟平衡算法来自动优化各层RF,其具体实现如算法1所示。该算法首先遍历计算层获取特征图尺寸并生成满足式(3)的RF候选集;随后计算各层在最小RF下的延迟,取其最大值为基准延迟$ {L}_{\text{base}} $;最后,将基准层RF设为最小值,调整其余层RF使其延迟逼近$ {L}_{\text{base}} $,并在候选集生成阶段实施资源约束检查。默认情况下,限制单层消耗的DSP资源不超过一块FPGA总资源的80%,以实现性能与资源的最佳平衡。
算法1. 延迟平衡算法。
输入:神经网络层集合$ Layers $, FPGA可用DSP资源$ {C}^{\text{DSP}} $;
输出:重用因子配置$ R{F}_{\text{opt}} $。
① foreach $ {l}_{i}\in Layers $ do
② 提取特征图尺寸;
③  $ \mathcal{R}\mathcal{F}\leftarrow $根据式(3)初始化候选$ RF $集合;
④  $ \mathcal{R}\mathcal{F}_{\text{cand}}^{i}\leftarrow \{rf\in \mathcal{R}\mathcal{F}|{R}^{\text{DSP}}\left(rf\right)\leq 0.8\cdot {C}^{\text{DSP}}\} $;/*过 滤掉不满足DSP约束的候选RF*/
⑤  $ L_{i}^{\min }\leftarrow \underset{rf\in \mathcal{R}\mathcal{F}_{\text{cand}}^{i}}{\min }\,{L}_{i}\left(rf\right) $;/*根据式(2)计算该层 的最小延迟*/
⑥ end for
⑦ $ {L}_{\text{base}}\leftarrow \max (L_{i}^{\min }) $;/*确定基准延迟*/
⑧ foreach $ {l}_{i}\in Layers $ do
⑨  $ RF_{i}^{*}\leftarrow \underset{r\in \mathcal{R}\mathcal{F}_{\text{cand}}^{i}}{\text{arg min}}\,|{L}_{i}(rf)-{L}_{\text{base}}| $;/*选择最优RF 值*/
⑩ end for
⑪ return $ R{F}_{\text{opt}}\leftarrow \{RF_{1}^{*},RF_{2}^{*},… ,RF_{N}^{*}\} $。
原始的HLS4ML工具将神经网络整体转换为单一加速核,仅支持单FPGA部署,无法满足大规模神经网络在FPGA集群上的分布式加速需求。为此,本文提出一种模型切分方法,通过层次化切分将神经网络模型分解为多个子模型,每个子模型实现为一个独立加速核,并采用标准AXI-Stream接口实现高效的核间通信,从而支持在FPGA集群的灵活部署。如图6所示。
模型切分首先对神经网络进行层融合。基于其典型结构(包含卷积层、全连接层、激活层和池化层),以计算密集的卷积层和全连接层为核心,将相邻的轻量级池化层和激活层合并。融合后的层级延迟和资源需求计算方法与前文一致。随后,将神经网络切分为多个子模型,每个子模型包含若干相邻的层并自动转化为对应加速核的HLS实现。
加速核采用细粒度流水线结构实现层间并行计算(如图6左下图)。核内各计算层均采用数据流驱动的工作模式,一旦接收到满足MVM计算所需的最小数据量时立即启动计算,从而形成极小启动间隔的计算流水线。加速核的延迟由其中延迟最大的层决定,即
$ {L}_{\text{total}}=\mathrm{max}\left({L}_{1},{L}_{2},… {,L}_{N}\right)\;。 $
切分后的加速核采用点对点数据流通信机制,并在核间构建粗粒度流水线(如图6右下图)。具体实现方式为:在每个加速核的输出端加入数据流转换模块,将数据流统一封装为有效载荷为512 b的数据包,并通过AXI-Stream协议传输到下一级加速核。该机制支持输出与输入操作并行执行,实现核间流水线的并行计算。由于数据需要等待足够的计算结果写入缓存后才能进行打包传输,因此形成的流水线粒度相对较粗。
整体流水线的阶段数等于加速核的数量。为确保流水线效率,各传输路径需保持加速核数量均衡,以避免因路径长度不均导致的流水线阻塞。
对于仅包含链式连接的神经网络模型(没有分支连接),本文提出一种基于资源约束的贪心合并策略实现模型切分:首先将每一层初始化为一个加速核并评估其DSP资源使用量;随后迭代合并资源消耗最少的相邻加速核对,约束条件为合并后DSP资源不超过单块FPGA的$ \alpha $倍;重复上述过程,直到无可合并的加速核为止。
因此,参数$ \alpha $决定了加速核规模,其取值直接影响系统性能与后续加速核映射的灵活性。增大$ \alpha $可实现更细粒度流水线并降低端到端延迟,但若单个加速核的资源消耗过高,将限制其在集群中的灵活放置,导致后续映射算法难以通过核间组合优化资源利用率与通信开销。实验表明,将加速核的资源消耗控制在单块FPGA总资源的30%左右,既能保证核内包含多个层以实现细粒度流水线并行,又能为后续映射提供足够的组合空间(通常单块FPGA可容纳3个核),从而在系统性能与映射灵活性之间取得良好平衡。因此,本文设定$ \alpha $=0.3作为经验阈值,后续实验结果也验证了该取值的有效性。需要说明的是,由于延迟平衡阶段已允许单层资源消耗最高可达80%,因此切分过程中对于资源超过30%的层不再进行合并,而是直接将其封装为一个独立的加速核。
对于包含分支结构的神经网络(如ResNet的残差连接),首先将模型输入到输出包含层数最多的路径作为主链,其余路径作为分支,并将主链按照前述切分方法处理。而分支上的层数量少于主链,本文通过在分支末端引入FIFO缓存使其与主链保持相同流水线深度,从而消除流水线不均衡问题,确保核间流水线高效运行。然而,多分支汇聚可能引发死锁:若分支数据先于主链到达汇聚点,汇聚点因缺少主链输入而通过反压机制阻塞分支,分支FIFO填满后继续向上游传递反压,最终可能导致全局阻塞。死锁避免的关键在于确保分支FIFO具有足够的深度,以缓存主链延迟差内产生的全部数据。假设主链与分支延迟差为$ \text{Δ}L $(含可能引入的跨FPGA通信延迟),分支输出吞吐量为$ T $,则所需FIFO深度为$ \text{Δ}L\cdot T $。基于此,AutoDeploy在完成映射后,根据实际延迟差自动计算各分支FIFO的深度需求,并额外增加10%的设计冗余。该设计与图拓扑无环性验证、信用流控协同作用,理论上可彻底避免死锁。我们通过仿真进一步验证了这一结论。
AutoPartition工具已经将完整的神经网络切分成多个延迟均衡的子模型,每个子模型包含若干层,并对应一个加速核实现。此时,已经具备手动部署条件,然而要实现高效的自动化部署仍面临两大关键挑战:1)如何将众多加速核合理映射到集群中的各FPGA节点是一个复杂的问题,需要综合考虑FPGA的资源约束、集群的通信开销等因素。传统手动映射方法难以实现最优权衡。2)尽管Shell/Role架构简化了通信设计,但针对集群的每个FPGA手动创建工程,并拼接加速核IP和Shell接口仍是一项复杂繁琐的任务。为此,本文开发了AutoDeploy工具,其核心技术包括:
1)集群感知的加速核映射算法。该算法综合考虑了FPGA资源约束和集群通信拓扑结构,能够自动生成最优映射方案,在满足资源限制的前提下,最小化通信开销,同时提升整体推理吞吐量和资源利用效率。
2)自动化集群构建。根据映射方案,工具自动为每个FPGA创建工程完成加速核IP与Shell架构的集成,并通过调用Vivado工具链生成可部署的比特流文件。这一过程有效隐藏了创建FPGA工程的复杂细节,提高了集群部署效率。
加速核间的数据流连接可建模为有向无环图(directed acyclic graph,DAG),其在FPGA集群上的映射问题可转化为带资源约束的图划分问题。图划分问题属于NP难问题[42],其计算复杂度随节点规模与划分数量的增加呈指数级增长。对于小规模问题,可通过整数规划或枚举法获得精确解;而对于大规模场景,需采用启发式算法进行近似求解。
1)问题建模
加速核映射问题可被建模成带约束的图划分优化问题,具体形式化定义如下:
① 符号定义。以每个加速核作为图的节点,节点集合记为$ V $。以加速核的数据流向作为边,边集合记为$ E $。边权重$ {w}_{ij} $表示加速核$ i $到$ j $的归一化通信数据量(单位为B),具体而言,$ {w}_{ij} $表示加速核$ i $的输出特征图(也是$ j $的输入特征图)字节大小除以归一化常量$ \eta $,$ \eta $取所有边输出特征图字节数的平均值,$ {w}_{ij} $的计算过程如式(5)所述。
$ {w}_{ij}=\frac{{B}_{ij}}{\eta }\;, $
其中
$ \begin{aligned} &{B}_{ij}=F_{\text{w}}^{ij}\cdot F_{\text{h}}^{ij}\cdot F_{\text{c}}^{ij}\cdot D\;,\\&\eta =\frac{1}{\left| E\right| }\sum\limits_{\left\langle i,j\right\rangle \in E}\,{B}_{ij}\;,\end{aligned} $
$ {B}_{ij} $表示特征图的字节数,$ F_{\text{w}}^{ij} $,$ F_{\text{h}}^{ij} $,$ F_{\text{c}}^{ij} $分别表示核$ i $到$ j $传输特征图的宽度、高度和通道数,$ D $为单个数据元素的字节大小(8b数据取$ D=1 $)。
② 加速核连接关系图记为$ G(V,E) $。定义分配向量$ \boldsymbol{x}=({x}_{1},{x}_{2},… ,{x}_{n}) $,其中$ {x}_{i}\in {\mathbb{N}}_{+} $表示节点$ i\in V $分配的FPGA编号。定义$ {S}_{k}=\{i|{x}_{i}=k\} $为分配到FPGA的$ k $的节点集合。在FPGA集群中,编号为$ k $的FPGA属于第$ \lfloor (k-1)/4\rfloor $组(每组包含4个FPGA),组内通过LVDS互连,组间通过GTH互连。
③ 输入。加速核连接关系图$ G(V,E) $。节点$ i $的资源消耗$ r_{i}^{(t)} $和单个FPGA的资源上限$ {C}^{(t)} $,其中$ t\in \{{\rm DSP,LUT,FF,BRAM}\} $。
④ 输出。划分方案$ P=\{{S}_{1},{S}_{2},… ,{S}_{K}\} $,其中$ {S}_{k}= \{i|{x}_{i}=k\} $表示划分到第k个FPGA上的节点集合。划分方案需满足$ \bigcup {S}_{k}=V $且$ {S}_{p}\cap {S}_{q}=\varnothing,(\forall p\neq q) $,其中$ K $为所使用的FPGA数量(即$ K=\underset{i}{\max } {x}_{i} $)。
⑤ 约束条件。对于任意FPGA节点k以及资源类型$ t\in \{{\rm DSP,LUT,FF,BRAM}\} $,满足约束:
$ R_{k}^{\left(t\right)}=\sum\limits_{i\in {S}_{k}}r_{i}^{\left(t\right)}\leq 0.8{C}^{\left(t\right)}\;, $
即确保每个FPGA每种资源使用率均不超过80%。
⑥ 目标函数。本文研究是以最小化跨FPGA通信开销与硬件资源消耗作为综合优化目标。在系统拓扑特性约束下定义目标优化函数为:
$ \begin{aligned} &{W}_{\text{L}}=\sum\limits_{\left\langle i,j\right\rangle \in E,\lfloor ({x}_{i}-1)/4\rfloor =\lfloor ({x}_{j}-1)/4\rfloor ,{x}_{i}\neq {x}_{j}}\,{w}_{ij}\;,\\&{W}_{\text{G}}=\sum\limits_{\langle i,j\rangle \in E,\lfloor ({x}_{i}-1)/4\rfloor \neq \lfloor ({x}_{j}-1)/4\rfloor }\,{w}_{ij}\;,\\&Cost=\min \left(\beta \cdot {W}_{\text{L}}+\left(1-\beta \right)\cdot {W}_{\text{G}}+\lambda \cdot K\right)\;,\end{aligned}$
其中$ {W}_{\text{L}} $表示通过组内LVDS互连的通信开销,$ {W}_{\text{G}} $则表示通过全局GTH互连的通信开销,K为FPGA总数,作为惩罚项用于优化资源消耗。权重系数$ \beta (0< \beta \lt 1) $用于平衡组内与全局通信,由于LVDS互连(组内通信)性能优于GTH互连(全局通信),设置$ \beta \lt 0.5 $以优先优化$ {W}_{\text{G}} $;但$ \beta $不宜过小,以免弱化对$ {W}_{{\mathrm{L}}} $的优化。我们对$ \beta $在0.2~0.5区间内的取值进行了多次迭代尝试,发现在$ \beta =0.4 $时,可使用模拟退火算法求解得到显著的优化效果。在该配置下,全局通信开销$ {W}_{\text{G}} $降低了24.66%,组内通信开销$ {W}_{\text{L}} $降低了4.52%,取得了相对最优的权衡效果,并使总通信开销降低了13.62%,实现了对通信性能的整体优化。正则化参数$ \lambda $用于调节资源消耗惩罚项$ K $(即所需FPGA总数),以优化硬件资源利用率。其取值原则是使惩罚项$ (\lambda \cdot K) $与通信开销项$ (\beta \cdot {W}_{\text{L}}+\left(1-\beta \right)\cdot {W}_{\text{G}}) $在数值量级上可比。由于$ {W}_{\text{L}} $和$ {W}_{\text{G}} $值均已进行归一化处理,直接取$ \lambda =1 $即可满足这一条件。
通过上述建模,加速核映射问题可转化为在资源约束下的图$ G(V,E) $最优划分问题,以实现资源分配与通信代价的联合优化。
2)问题求解
本文采用模拟退火(simulated annealing,SA)算法求解FPGA集群上的加速核映射问题,求解过程如算法2所示。该算法以加速核连接关系图和各加速核的资源需求为输入,输出满足资源约束且通信开销最优的划分方案,具体步骤如下。
① 初始化。通过贪心法生成初始可行解。依次将每个节点$ i\in V $分配至第1个满足资源约束条件的FPGA的k,即$ \forall t,R_{k}^{\left(t\right)}+r_{i}^{\left(t\right)}\leq 0.8{C}^{(t)} $,若所有现有FPGA均不满足条件则创建新的FPGA。该过程持续至所有节点完成映射,确保每个FPGA的资源使用率不超过80%。
② 邻域解生成。通过合并子集和迁移节点2种随机操作生成新的邻域解。
合并子集时,随机选取FPGA的$ {k}_{1} $和$ {k}_{2} $($ {k}_{1}\neq {k}_{2} $)。若满足约束$ \forall t,R_{{k}_{1}}^{\left(t\right)}+R_{{k}_{2}}^{\left(t\right)}\leq 0.8{C}^{\left(t\right)} $,则删除FPGA的$ {k}_{2} $,并将所有$ {k}_{2} $上的节点迁移至$ {k}_{1} $,同时,更新资源信息:$ R_{{k}_{1}}^{\left(t\right)}\leftarrow R_{{k}_{1}}^{\left(t\right)}+R_{{k}_{2}}^{\left(t\right)},R_{{k}_{2}}^{\left(t\right)}\leftarrow 0 $。
迁移节点时,随机选择节点$ i\in V $(当前位于的FPGA的$ {k}_{1} $)。筛选出所有满足资源约束条件的FPGA的$ k\neq {k}_{1} $,即$ \forall k\neq {k}_{1},R_{k}^{\left(t\right)}+r_{i}^{\left(t\right)}\leq 0.8{C}^{\left(t\right)} $。若现有FPGA均无法容纳该节点,则创建新的FPGA。随机选择一个候选FPGA的$ {k}_{\rm new} $,并将节点$ i $迁移到$ {k}_{\text{new}} $。相应地,更新节点分配关系$ {x}_{i}\leftarrow {k}_{\text{new}} $,以及资源使用信息$ R_{{k}_{1}}^{\left(t\right)}\leftarrow R_{{k}_{1}}^{\left(t\right)}-r_{i}^{\left(t\right)},R_{{k}_{\text{new}}}^{\left(t\right)}\leftarrow R_{{k}_{\text{new}}}^{\left(t\right)}+r_{i}^{\left(t\right)} $。
③ 接受准则。根据式(8)计算目标函数变化量,$ \text{Δ}Cost=Cos{t}_{\text{new}}-Cos{t}_{\text{old}} $,并依据概率$ \exp (-\text{Δ}Cost/T) $决定是否接受新邻域解。
④ 终止条件。当温度降至预设阈值$ {T}_{\min } $时,停止迭代并返回记录的最优解。
算法2. 基于模拟退火的加速核映射算法。
输入:加速核连接关系图$ G\left(V,E\right) $,节点的资源消耗$ r_{i}^{\left(t\right)} $,单个FPGA的资源上限$ {C}^{\left(t\right)} $;
输出:加速核到FPGA集群的映射方案$ {P}_{\text{best}}= \{{S}_{1},{S}_{2},… ,{S}_{K}\} $。
① $ {P}_{\text{best}}\leftarrow P\leftarrow GreedyPartition(G) $;
② $ Cos{t}_{\text{best}}\leftarrow Cost\leftarrow Cost(P) $;
③ $ T\leftarrow 100\cdot Cost $;
④ while $ T> {T}_{\min } $ do
⑤ for $ 1{,}2,… ,M $ do
⑥   $ {P'}\leftarrow \text{随机生成邻域解} $;
⑦   $ Cos{t'}\leftarrow Cost({P'}) $;
⑧   $ \text{Δ}Cost\leftarrow Cos{t'}-Cost $;
⑨  if $ rand()< \exp (-\text{Δ}Cost/T) $ then
⑩    $ P\leftarrow {P'} $;
⑪  end if
⑫  if $ Cos{t'}< Cos{t}_{\text{best}} $ then
⑬    $ Cos{t}_{\text{best}}\leftarrow Cos{t'} $;
⑭    $ {P}_{\text{best}}\leftarrow {P'} $;
⑮  end if
⑯ end for
⑰  $ T\leftarrow 0.95\cdot T $;
⑱ end while
⑲ return $ {P}_{\text{best}} $。
本文实现的自动化集群部署工具AutoDeploy的架构如图7所示。该工具采用模块化设计与Python-Tcl协同工作机制,实现了从加速核到物理部署的全流程自动化。其中,Python控制层负责高层逻辑实现,Tcl驱动层负责底层物理实现。Python控制层运行集群感知的加速核映射算法,生成加速核映射描述文件,并同步生成FPGA集群的NRC配置参数、Shell模块配置以及加速核拼接的Tcl命令。Tcl驱动层则负责动态创建多个FPGA工程结构,实例化加速核IP与Shell模块IP,自动完成流交换模块的AXI-Stream端接口与加速核接口的拼接,实现协议转换模块与物理通道的绑定,并生成时序约束。最终通过调用Vivado工具链生成可部署的比特流文件。该混合架构在保持算法灵活性的同时,充分调用Vivado工具链的物理优化能力,实现了高效自动化部署。
本文构建了基于16块Virtex UltraScale+系列FPGA芯片的异构计算集群系统。系统中4个FPGA作为一个Blade,采用LVDS的全互连实现板内通信,FPGA和NIC均通过光纤与NRC互连。为进行对比实验,同时租赁了Nvidia RTX 5090云服务器平台。集群网络采用集成了NRC与NIO芯片的TH-Express高速互连架构,并搭载了我们开发的软件通信栈。开发环境基于Vivado 2020.2和Vitis 2023工具链构建。
表1详细列出了集群中不同互连链路的性能测试结果。GTH链路总带宽达80 Gbps,端到端延迟为1.56 μs。主机CPU与FPGA间的通信虽然采用相同的GTH物理链路,但由于软件通信栈的额外开销,延迟增加至18.2 μs。LVDS链路采用8组×8通道×1.6 Gbps的配置,最大带宽可达100 Gbps。FPGA内部的流交换模块,支持全端口的并行传输,其带宽由端口位宽和频率决定,而延迟则主要取决于仲裁延迟,经测试最大不超过16个时钟周期。
表2展示了FPGA板卡资源分布及Shell/Role架构资源消耗情况。其中,Shell部分设计固定,各节点资源消耗基本一致。流交换模块资源消耗与端口数量正相关,表中数据基于16端口配置。实验数据显示,Shell架构仅消耗约5%的片上资源。
为了验证本文提出的自动化框架在不同规模神经网络模型上的适用性,我们选取了ResNet-8[43],SqueezeNet[44],ResNet-50[45]三种不同规模的模型进行实验评估,所有实验均在Batch-1配置下进行,结果如表3所示。我们首先使用ResNet-8模型验证自动化框架的有效性。ResNet-8模型规模较小,可以使用原始HLS4ML工具在单个FPGA上实现,但需要增大参数RF以实现较高的资源复用,导致较大的推理延迟。相比之下,采用本文提出的自动化框架,将模型拆分至3个FPGA进行分布式部署,虽然引入了一定的通信开销,但能显著提升模型的整体推理性能。
具体而言,我们使用官方提供的HLS4ML工具对ResNet-8模型进行了手动优化。通过手动调整RF参数,成功实现了ResNet-8模型在单个FPGA上的部署。采用本文框架后,系统自动调整RF并切分模型结构,成功实现了模型在3个FPGA上的分布式部署。我们对比了CPU和GPU在相同任务下的性能表现。实验结果表明,单个FPGA版本相对CPU和GPU分别获得了48.5倍和12.9倍的加速效果。而3-FPGA分布式方案相对单个FPGA实现获得了2.6倍的性能提升。该结果充分证明了自动化框架在多个FPGA并行计算中的有效性。
为系统验证框架对不同规模网络的适应性,在ResNet-8验证基础上,我们进一步选取了模型规模适中但计算密集的SqueezeNet进行测试。实验结果表明,通过自动优化各层加速架构,本框架成功实现了SqueezeNet在4个FPGA芯片上的高效分布式部署,最终推理延迟仅为1.24 ms,较CPU和GPU方案分别提升6.9倍和2.7倍。对比现有工作,文献[46]虽然在6个FPGA上部署了相同模型,并达到200 MHz工作频率,但由于缺乏延迟平衡策略,未能自动优化参数RF,导致各层计算延迟不均衡,显著降低了流水线效率。与之相比,我们的方案在FPGA数量更少的情况下,仍实现了3.1倍的性能优势,充分证明了本文自动优化框架的有效性。
为进一步验证自动化框架在大规模神经网络模型上的性能表现,我们以ResNet-50模型为基准进行了实验。该模型包含53个卷积层和1个全连接层,在实验中,我们通过延迟平衡方法自动优化每层的RF,并利用层次化切分工具将模型分解为27个独立的加速核,运行时钟频率设置为125 MHz。每个加速核均可独立运行,整体延迟由最长的加速核延迟、网络通信延迟以及主机CPU与FPGA之间的传输延迟共同决定。对比实验中,贪心算法需消耗14个FPGA,而本文提出的集群感知映射算法仅需12个FPGA即可实现部署。
测试结果表明,12个FPGA的部署方案实现了1.36 ms的推理延迟,计算性能达到5.95 TOPS(8.1 GOP·735 FPS)。与CPU和GPU相比,分别获得了41.4倍和5.1倍的加速效果。
文献[27]采用1b的权重量化策略在单个FPGA上部署ResNet-50模型,实现了1.9 ms的推理延迟。其1b量化策略虽能通过细粒度流水线实现更高吞吐量,但其模型精度仅为67.27%,低于本文8b量化模型75%的推理精度。AGNA[47]采用PEA架构,受限于片外存储访问开销,在U200FPGA板卡上的推理延迟高达4.55 ms,显著落后于本文DataFlow架构的低延迟表现,这验证了DataFlow架构在延迟优化上的优势。
我们进一步对比了其他现有的多FPGA加速框架的性能,Elastic-DF[35]和HPIPE框架[48-49]分别采用1b量化与85%稀疏度模型,通过轻量化设计在2块FPGA实现部署。这类方案本质仍聚焦小规模模型加速,虽能获得较高吞吐量,但延迟表现不及本文框架,并且产生较大的推理精度损失。作为当前SOTA研究,AIgean[34]在12个FPGA以太网集群上实现了1.9 ms的纯FPGA模式推理延迟,但引入CPU通信后延迟骤增至7 ms。相较而言,本文框架的性能相比其提升了28.4%。
综上所述,本文提出的自动化框架在大规模神经网络加速中展现显著优势,尤其是在低延迟和高吞吐量方面,优于现有的相关工作。
本文提出的集群感知的加速核映射算法(SA)成功实现了ResNet-50模型在12个FPGA上的高效部署。实验结果表明,和传统的贪心算法相比较,该优化方法表现出明显的优势:首先,贪心算法由于易陷入局部最优解,导致需要14个FPGA才能容纳所有加速核,且因通信带宽受限使得片间延迟增加至1.42 ms;其次,优化算法通过全局启发式搜索策略,有效降低了GTH和LVDS链路的传输数据量,分别减少了24.66%和4.52%,总体片外数据传输量减少13.62%,如图8所示。
图9对比了2种映射算法的资源消耗情况,斜线填充条柱为贪心算法的14个FPGA实现,实心条柱为模拟退火算法的12个FPGA实现。从图9中可以看出:1)集群感知映射方法通过优化加速核划分,使FPGA平均资源利用率提升了9.3%;2)在获得更高计算性能的同时,硬件成本降低14.3%。实验结果表明,通过合理划分加速核并优化加速核映射,基于模拟退火算法的集群感知加速核映射方法能够更有效地利用有限的FPGA资源(特别是关键DSP资源),在保持高性能的同时减少硬件开销。需要强调的是,本文研究的卷积神经网络加速任务属于计算密集型任务。在实现过程中,我们为提高系统性能,明确限定使用片上DSP实现卷积计算中的乘法操作,这一策略显著降低了对LUT资源的依赖,导致LUT利用率维持在较低水平。此外,为确保时序收敛,我们将单个FPGA中各类资源(包括DSP,LUT,FF,BRAM)的消耗上限设定为80%。映射后,DSP资源的峰值消耗达到73.3%(平均64.9%),明显高于其他资源。
为进一步验证本文所提出方法的有效性,我们将其与现有代表性多个FPGA划分方法进行深入比较。在现有工作中,Algean框架[34]的划分过程依赖人工经验进行任务分配,缺乏自动寻优机制,难以保证划分质量且无法适应不同模型与集群规模。HPIPE[48-49]虽采用贪心策略实现了自动化划分,但其目标仅为满足单个FPGA资源约束,算法仅针对链式拓扑设计,难以扩展到更大规模集群;同时,贪心策略仅依据当前层的资源可用性做局部决策,无法从全局视角优化资源利用,易陷入局部最优。Elastic-DF[35]采用整数线性规划求解划分问题,理论上可获得全局最优解,但其算法主要面向芯片内部多Die划分,优化目标设定为最小化跨Die切边数量。在多个FPGA场景下,该策略难以直接等价于通信开销最优,且无法区分不同物理链路(如GTH与LVDS)的性能差异,因而难以适配异构互连的集群架构。
相比之下,本文提出的集群感知映射算法通过设置权重系数$ \beta $(实验中$\beta $=0.4)区分GTH全局网络与LVDS局部链路的性能差异,有效避免了切边数量优化目标的局限性。与HPIPE的贪心策略不同,本算法基于模拟退火进行全局启发式搜索,能够在满足资源约束的前提下系统探索划分空间,获得更优的映射方案。
值得注意的是,本文方法着眼于系统级优化,通过优化加速核的物理部署位置减少跨节点通信总量。底层通信实现上,当前框架为每个连接预设固定时分复用(time division multiplexing,TDM)比率,虽简化了链路调度设计,却限制了物理链路通信潜力。近期研究RTMF[50]提出基于路由权重的竞争性TDM分配算法,通过精细调度TDM比率降低共享链路传输延迟。与本文相比,RTMF侧重链路层面优化通信执行,而本文侧重系统层面减少通信需求,二者互为补充。未来工作可将二者结合,在集群感知映射算法中引入含TDM比率与带宽的精细链路模型,进一步降低关键路径传输延迟,实现系统级与链路级跨层次协同优化。
在实验中,我们通过延迟平衡方法调整每层的重用因子,使各层的计算延迟和吞吐量基本保持一致,从而消除性能瓶颈并提升资源利用效率。图10对比了延迟平衡前后各层的延迟差异,在延迟平衡优化前,因各层特征图与卷积核计算规模不同导致延迟差异显著(最大值为15.7 ms,最小值为0.4 ms),这会降低资源利用率和流水线效率。在延迟平衡优化后,各层的延迟趋于一致(最大值为1.26 ms,最小值为0.8 ms),最大延迟仅为原来的8%,差异缩小为原来的3%,显著优化了系统性能。
本文提出的2级互连架构将每4个FPGA组成1个局部互连分组,组内通过LVDS实现高速直连通信。为评估局部LVDS互连对通信效率的提升效果,我们测量了不同局部互连规模下FPGA集群执行ResNet-50模型所需的总数据传输时间。
当局部互连规模为1个FPGA时,表示系统中仅使用全局GTH互连。局部互连规模为4个FPGA则对应本文默认架构。此外,为增强实验的普适性,我们还随机生成了多个具有神经网络结构特征的加速核连接图,数据传输需求也随机设定。每种配置下的通信时间取多次实验的平均值,结果如图11所示。图中“相对通信时间”定义为在特定局部互连规模下的FPGA与规模为1个FPGA时的通信时间比值。
实验结果表明,局部LVDS互连显著降低了通信延迟,尤其适用于具有局部连接特性的深度神经网络模型。在默认的4个FPGA互连的配置下,相对通信时间为0.813,较无局部互连(即规模为1时)降低18.7%。值得注意的是,随着局部互连规模的扩大,通信效率的提升呈现明显的边际递减趋势,然而,过大的局部互连规模不仅增加LVDS布线复杂度,还难以实现局部全互连网络。在实际设计中,需在互连规模、布线复杂度和通信效率之间寻求最优平衡。
为明确TH-FCAD性能提升的来源,本文设计了消融实验,分别评估硬件平台与映射算法的独立贡献。如前文4.5节所述,延迟平衡是确保多核流水线高效运行的前提。未使用延迟平衡时,各层延迟差异高达15 ms,严重制约系统性能;引入延迟平衡后,各层延迟被有效均衡至0.8~1.26 ms范围内,后续通信优化与资源调度才具备实际意义。因此,所有消融实验均以延迟平衡为基础,以保证实验设置的有效性。
在此前提下,我们设置了3种实验配置:配置a仅使用全局GTH互连模拟通用互连环境,映射算法采用贪心策略;配置b在配置a的基础上引入局部LVDS互连,保留贪心映射算法;配置c在配置b的基础上将映射算法替换为集群感知的SA映射算法。所有实验均在相同的ResNet-50模型和Batch-1配置下进行,结果如表4所示。
表4表明,硬件与算法的协同优化带来了显著的性能增益。配置a仅依靠全局GTH互连和贪心映射,在14个FPGA上实现了1.47 ms的推理延迟。与现有AIgean框架在以太网集群上实现的1.9 ms延迟相比,配置a获得的0.43 ms提升主要归因于TH-Express高速互连硬件本身的低延迟特性。配置b将延迟进一步降低至1.42 ms,较配置a减少0.05 ms,这得益于局部LVDS互连带来的通信效率提升。配置c在此基础上采用集群感知的SA映射算法,延迟降至1.36 ms,较配置b减少0.06 ms,同时所需FPGA数量从贪心算法的14个缩减至12个,显著提升了资源利用率。
综合来看,TH-FCAD相较于AIgean框架总延迟降低0.54 ms。其中,硬件层面(GTH与LVDS互连)的低延迟特性贡献了约88.9%的延迟降低(0.48 ms/0.54 ms),是系统性能提升的决定性因素;而SA映射算法贡献了约11.1%的延迟降低(0.06 ms/0.54 ms)。此外,算法还额外带来了硬件资源的节约。上述结果表明,TH-FCAD的性能提升是以硬件低延迟特性为基石,并通过算法创新进一步挖掘资源潜力与性能极限的协同优化结果。
本文构建了周期精确的RTL仿真环境,以验证所提出FIFO深度设计方法的有效性以及系统的无死锁运行能力。针对可能发生死锁的分支汇聚结构,我们配置了多组延迟差进行仿真测试。由于ResNet-50中分支路径通常比主链少1~2个加速核,且单个加速核的计算延迟为0.8~1.26 ms,据此我们设定了1.12 ms与1.84 ms这2种典型延迟差。为进一步验证设计在更严苛条件下的鲁棒性,额外增加了2.68 ms(对应3个核延迟差)的边界测试用例在仿真环境中,以系统能够支持的最大数据注入速率施加激励,并在所有加速核的输入输出端部署性能监视器,实时监控每个FIFO的瞬时占用率和最大占用深度。
表5汇总了不同延迟差配置下的仿真结果。结果显示,在最大吞吐激励下,各分支路径FIFO的最大占用深度均未超过设定值,未出现写满现象,且实测值与理论需求深度高度吻合。系统在整个运行周期内未发生死锁,验证了所提出FIFO深度设计方法的有效性。
本文提出的TH-FCAD自动化部署框架,以“通信-计算解耦”与“分层抽象”为核心设计思想,在体系结构层面实现了良好的硬件适应性与模型扩展性。当前实验基于天河高速互连网络集群展开,并主要针对卷积神经网络进行了部署优化。然而,得益于框架核心机制的通用性,TH-FCAD具备支持更广泛的硬件平台与更大规模的模型(如Transformer)的拓展潜力。
如3.2节所述,TH-FCAD通过Shell/Role双层架构实现了通信与计算的解耦:Role层完全聚焦于神经网络计算任务,并通过标准化的AXI-Stream接口与Shell层进行交互;Shell层则负责封装所有底层通信细节,当前实现针对TH-Express网络进行了优化部署,集成了GTH网络栈和LVDS转换桥。该设计使得算法层面的贡献(如延迟平衡、模型切分和映射算法)与底层硬件无关,具备良好的通用性。
将TH-FCAD适配至通用以太网或InfiniBand集群时,仅需对Shell层及主机侧软件栈进行模块化替换,具体包括:1)替换Shell层中的网络协议栈模块。例如,将以太网MAC/IP核接入框架,负责将以太网报文转换为符合Role层要求的AXI-Stream协议数据流。2)相应地,主机侧的软件通信栈仅需将TH-Express专用接口替换为标准以太网Socket接口,同时将底层驱动替换为以太网驱动程序,无需改动上层通信逻辑。整个Role层(包含由AutoPartition生成的加速核)以及自动化工具链(如AutoDeploy的映射算法、流交换模块配置)均无需做任何修改。综上所述,TH-FCAD是一个具备良好硬件适应性的通用框架,其设计思想为实现在不同互连架构上进行深度学习模型的分布式部署,提供了一套统一的自动化解决方案。
TH-FCAD不仅在硬件层面具备良好的适应性,其算法与架构设计也为支持更广泛的深度学习模型(如Transformer)奠定了扩展基础。
在硬件层面,FPGA集群采用的2级互连架构(全局通用互连+局部专用互连)兼具扩展性与高效性。全局互连支持集群规模的弹性扩展,能够灵活适应Transformer等大模型对大规模并行计算需求,确保计算资源可随模型规模线性增长。局部专用互连则为相邻的计算节点提供了低延迟、高带宽的数据传输通道,满足计算密集型模块间的高性能通信需求(如Transformer中矩阵乘法与Softmax操作间的数据交互)。此外,Shell/Role设计实现了计算与通信的解耦,开发者仅需按照标准接口规范设计新型加速核(如注意力机制),即可将Transformer等模型集成到框架中部署。
在算法层面,框架的核心算法——延迟平衡、模型切分与映射算法——均独立于具体的硬件和网络结构,具备良好的通用性。延迟平衡方法仅需各层的计算特征与资源需求信息即可实现流水线均衡;模型切分策略以层为粒度,通过贪心合并与分支对齐策略,适用于层次化堆叠的神经网络;集群感知映射算法以加速核连接图为输入,其目标函数与约束条件仅涉及资源消耗与通信开销,不依赖于特定模型的计算语义。因此,这些算法为支持Transformer等复杂网络提供了基础保障。
然而,将TH-FCAD高效应用于BERT,Llama等超大模型仍面临若干关键挑战,这也构成了我们下一步明确的研究方向:
1)新型算子加速核库的构建。针对Transformer的核心算子(如多头注意力机制和Softmax等非线性运算),现有基于HLS4ML的算子库缺乏高效支持。未来将设计专用加速架构,探索DataFlow与PEA架构相融合的方案,实现高吞吐、低延迟的注意力计算。
2)更细粒度的模型切分策略。当前“按层切分”方法适用于计算量均衡的卷积神经网络,但Transformer模型计算高度密集(如BERT-base单次推理超48 GOP),粗粒度切分易导致加速核过大或流水线气泡。未来将探索层内矩阵分块计算,将大型矩阵乘法拆分为子块并跨FPGA并行执行,同时设计高效的数据聚合机制以协调各分块间的中间结果同步。
3)存储管理策略。BERT等模型参数量远超片上BRAM容量,长序列推理中KV Cache等中间结果存储需求激增。目前仅使用片上存储的策略不再可行,需研究分层存储策略,结合片上缓存与高效片外存储访问,并设计数据预取单元以隐藏访存延迟。此外,还需支持动态KV Cache的灵活管理,以适应可变长序列推理需求。
综上所述,TH-FCAD框架在设计层面已为支持更大规模模型奠定了软硬件基础,但要充分发挥其性能优势,仍需在算子加速核、细粒度切分与存储管理等方面开展深入研究,这也正是我们后续工作的重点方向。
本文针对神经网络日益增长的计算需求与现有计算架构的能效瓶颈,提出一种基于FPGA集群的高效加速方案。通过设计新型的2级互连FPGA集群架构、延迟平衡优化与模型切分方法,以及集群感知的加速核映射算法与自动化集群构建工具,本研究成功实现了神经网络在FPGA集群上的高性能计算。实验结果表明,所提出的方案在ResNet-8,SqueezeNet,ResNet-50模型上实现了显著的性能提升,优于CPU,GPU以及其他多FPGA实现。
本文所提出的TH-FCAD框架不仅实现了在FPGA集群上对神经网络的高效自动化部署,更从体系结构层面构建了一套可扩展、可复用的方法论体系。其核心贡献在于:通过Shell/Role架构实现通信与计算的解耦,使得延迟平衡、模型切分与映射等算法具备硬件无关性;通过2级互连与集群感知映射策略,兼顾了通信效率与资源利用率;通过自动化工具链,将复杂的多FPGA部署流程封装为端到端的黑盒操作。上述设计使得TH-FCAD不仅适用于当前的TH-Express集群与卷积神经网络模型,也可扩展支持以太网等通用互连,并为实现Transformer等更大规模模型的自动化部署奠定了基础。因此,TH-FCAD不仅在特定任务上具有性能优势,还提供了一种面向FPGA集群的通用化、自动化部署范式,为未来异构计算集群上的大规模智能模型部署提供了可借鉴的系统性解决方案。

参考文献 引证文献
排序方式:
1
Li Guoqing, Zhang Meng, Li Jiaojie, et al. Efficient densely connected convolutional neural networks[J]. Pattern Recognition, 2021, 109: 107610
2
Li Zewen, Liu Fan, Yang Wenjie, et al. A survey of convolutional neural networks: Analysis, applications, and prospects[J]. IEEE Transactions on Neural Networks and Learning Systems, 2022, 33(12): 6999−7019
3
Nechi A, Groth L, Mulhem S, et al. FPGA-based deep learning inference accelerators: Where are we standing?[J]. ACM Transactions on Reconfigurable Technology and Systems, 2023, 16(4): 60
4
Hill M, Reddi V. Accelerator-level parallelism[J]. Communications of the ACM, 2021, 64(12): 36−38
5
Cong J, Fang Zhenman, Lo M, et al. Understanding performance differences of FPGAs and GPUs[C]//Proc of the 26th Annual Int Symp on Field-Programmable Custom Computing Machines (FCCM). Piscataway, NJ: IEEE, 2018: 93−96
6
Amin R, Obermaisser R. Towards resource efficient and low latency CNN accelerator for FPGAs: Review and evaluation[C]//Proc of the 3rd Int Conf on Embedded Systems and Artificial Intelligence (ESAI). Piscataway, NJ: IEEE, 2024: 1−10
7
Mohaidat T, Khalil K. A survey on neural network hardware accelerators[J]. IEEE Transactions on Artificial Intelligence, 2024, 5(8): 3801−3822
8
Curzel S, Ferrandi F, Fiorin L, et al. A survey on design methodologies for accelerating deep learning on heterogeneous architectures[J]. arXiv preprint, arXiv: 2311.17815, 2025
9
Yuan Tian, Liu Weiqiang, Han Jie, et al. High performance CNN accelerators based on hardware and algorithm co-optimization[J]. IEEE Transactions on Circuits and Systems I: Regular Papers, 2021, 68(1): 250−263
10
Zeng Shulin, Liu Jun, Dai Guohao, et al. FlightLLM: Efficient large language model inference with a complete mapping flow on FPGAs[C]//Proc of the 32nd ACM/SIGDA Int Symp on Field Programmable Gate Arrays (FPGA’24). New York: ACM, 2024: 223−234
11
Liu Jun, Zeng Shulin, Ding Li, et al. FlightVGM: Efficient video generation model inference with online sparsification and hybrid precision on FPGAs[C]//Proc of the 33rd ACM/SIGDA Int Symp on Field Programmable Gate Arrays (FPGA’25). New York: ACM, 2025: 2−13
12
Zhang Xiaofan, Ye Hanchen, Wang Junsong, et al. DNNExplorer: A framework for modeling and exploring a novel paradigm of FPGA-based DNN accelerator[C]//Proc of the 2020 IEEE/ACM Int Conf on Computer Aided Design (ICCAD). Piscataway, NJ: IEEE, 2020: 1−9
13
Wei Xuechao, Liang Yun, Li Xiuhong, et al. TGPA: Tile-grained pipeline architecture for low latency CNN inference[C]//Proc of the 2018 IEEE/ACM Int Conf on Computer-Aided Design (ICCAD). Piscataway, NJ: IEEE, 2018: 1−8
14
Ye Hanchen, Jun H, Chen Deming. HIDA: A hierarchical dataflow compiler for high-level synthesis[C]//Proc of the 29th ACM Int Conf on Architectural Support for Programming Languages and Operating Systems (ASPLOS ’24). New York: ACM, 2024: 215−230
15
Zhang Chen, Wu Di, Sun Jiayu, et al. Energy-efficient CNN implementation on a deeply pipelined FPGA cluster[C]//Proc of the 2016 Int Symp on Low Power Electronics and Design (ISLPED). New York: ACM, 2016: 326−331
16
Zhang Wentai, Zhang Jiaxi, Shen Minghua, et al. An efficient mapping approach to large-scale DNNs on multi-FPGA architectures[C]//Proc of the 2019 Design, Automation &amp; Test in Europe Conf &amp; Exhibition (DATE). Piscataway, NJ: IEEE, 2019: 1241−1244
17
Jiang Weiwen, Sha E, Zhang Xinyi, et al. Achieving super-linear speedup across multi-FPGA for real-time DNN inference[J]. ACM Transactions on Embedded Computing Systems, 2019, 18(5s): 67
18
Boutros A, Betz V. FPGA Architecture: Principles and progression[J]. IEEE Circuits and Systems Magazine, 2021, 21(2): 4−29
19
Mittal S. A survey on modeling and improving reliability of DNN algorithms and accelerators[J]. Journal of Systems Architecture, 2020, 104(C): 101689
20
Schulte J, Ramhorst B, Sun Chang, et al. HLS4ML: A flexible, open source platform for deep learning acceleration on reconfigurable hardware[J]. ACM Transactions on Reconfigurable Technology and Systems, 2026, 19(2): 19
21
Umuroglu Y, Fraser N, Gambardella G, et al. FINN: A framework for fast, scalable binarized neural network inference[C]//Proc of the 2017 ACM/SIGDA Int Symp on Field-Programmable Gate Arrays (FPGA’17). New York: ACM, 2017: 65−74
22
Knapheide J, Stabernack B, Kuhnke M. A high throughput MobileNetV2 FPGA implementation based on a flexible architecture for depthwise separable convolution[C]//Proc of the 30th Int Conf on Field-Programmable Logic and Applications (FPL). Piscataway, NJ: IEEE, 2020: 277−283
23
Wu Xiao, Ma Yufei, Wang Meiqi, et al. A flexible and efficient FPGA accelerator for various large-scale and lightweight CNNs[J]. IEEE Transactions on Circuits and Systems I: Regular Papers, 2022, 69(3): 1185−1198
24
Yu Yunxuan, Zhao Tiandong, Wang Kun, et al. Light-OPU: An FPGA-based overlay processor for lightweight convolutional neural networks[C]//Proc of the 28th ACM/SIGDA Int Symp on Field-Programmable Gate Arrays (FPGA’20). New York: ACM, 2020: 122−132
25
Venieris S, Bouganis C. fpgaConvNet: A framework for mapping convolutional neural networks on FPGAs[C]//Proc of the 24th IEEE Annual Int Symp on Field-Programmable Custom Computing Machines (FCCM). Piscataway, NJ: IEEE, 2016: 40−47
26
Venieris S, Bouganis C. Latency-driven design for FPGA-based convolutional neural networks[C]//Proc of the 27th Int Conf on Field Programmable Logic and Applications (FPL). Piscataway, NJ: IEEE, 2017: 1−8
27
Petrica L, Alonso T, Kroes M, et al. Memory-efficient dataflow inference for deep CNNs on FPGA[C]//Proc of the 2020 Int Conf on Field-Programmable Technology (ICFPT). Piscataway, NJ: IEEE, 2020: 48−55
28
Huang Yingbing, Wan L, Ye Hanchen, et al. Invited: New solutions on LLM acceleration, optimization, and application[C]//Proc of the 61st ACM/IEEE Design Automation Conf. New York: ACM, 2024: 1−4
29
AMD/Xilinx. Vivado design suite user guid high-level synthesis (UG902)[EB/OL]. (2021-05-04)[2025-11-28]. https://docs.amd.com/v/u/en-US/ug902-vivado-high-level-synthesis
30
AMD/Xilinx. Xilinx Vitis AI overview[EB/OL]. (2023-09-28)[2025-11-28]. https://docs.amd.com/r/en-US/ug1414-vitis-ai/Vitis-AI-Overview
31
Blott M, Preußer T, Fraser N, et al. FINN-R: An end-to-end deep-learning framework for fast exploration of quantized neural networks[J]. ACM Transactions on Reconfigurable Technology and Systems, 2018, 11(3): 16
32
Chung E, Fowers J, Ovtcharov K, et al. Serving DNNs in real time at datacenter scale with project brainwave[J]. IEEE Micro, 2018, 38(2): 8−20
33
Tarafdar N, Eskandari N, Sharma V, et al. Galapagos: A full stack approach to FPGA integration in the cloud[J]. IEEE Micro, 2018, 38(6): 18−24
34
Tarafdar N, Di G, Harris P, et al. AIgean: An open framework for deploying machine learning on heterogeneous clusters[J]. ACM Transactions on Reconfigurable Technology and Systems, 2022, 15(3): 23
35
Alonso T, Petrica L, Ruiz M, et al. Elastic-DF: Scaling performance of DNN inference in FPGA clouds through automatic partitioning[J]. ACM Transactions on Reconfigurable Technology and Systems, 2022, 15(2): 15
36
Gan Xinbiao, Tang Qian, Xiong Feng, et al. TianheStar: Orchestrating sssp applications on Tianhe supercomputer[C]//Proc of the 24th IEEE Int Symp on Cluster, Cloud and Internet Computing (CCGrid). Piscataway, NJ: IEEE, 2024: 534−542
37
Wang Ruibo, Lu Kai, Chen Juan, et al. Brief introduction of TianHe exascale prototype system[J]. Tsinghua Science and Technology, 2021, 26(3): 361−369
38
Gan Xinbiao, Zhang Yiming, Zeng Ruigeng, et al. XTree: Traversal-based partitioning for extreme-scale graph processing on supercomputers[C]//Proc of the 38th IEEE Int Conf on Data Engineering (ICDE). Piscataway, NJ: IEEE, 2022: 2046−2059
39
Pang Zhengbin, Xie Min, Zhang Jun, et al. The TH express high performance interconnect networks[J]. Frontiers of Computer Science, 2014, 8(3): 357−366
40
Liao Xiangke, Pang Zhengbin, Wang Kefei, et al. High performance interconnect network for tianhe system[J]. Journal of Computer Science and Technology, 2015, 30(2): 259−272
41
Caulfield A, Chung E, Putnam A, et al. A cloud-scale acceleration architecture[C]//Proc of the 49th Annual IEEE/ACM Int Symp on Microarchitecture (MICRO). Piscataway, NJ: IEEE, 2016: 1−13
42
Çatalyürek Ü, Devine K, Faraj M, et al. More recent advances in (Hyper) graph partitioning[J]. ACM Computing Surveys, 2023, 55(12): 253
43
Banbury C, Reddi V, Torelli P, et al. MLPerf tiny benchmark[J]. arXiv preprint, arXiv: 2106.07597, 2021
44
Iandola F, Han Song, Moskewicz M, et al. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and &lt;0.5 MB model size[J]. arXiv preprint, arXiv: 1602.07360, 2016
45
He Kaiming, Zhang Xiangyu, Ren Shaoqing, et al. Deep residual learning for image recognition[C]//Proc of the 2016 IEEE Conf on Computer Vision and Pattern Recognition (CVPR). Piscataway, NJ: IEEE, 2016: 770−778
46
Mageiropoulos E, Chrysos N, Dimou N, et al. Using HLS4ML to map convolutional neural networks on interconnected FPGA devices[C]//Proc of the 29th IEEE Annual Int Symp on Field-Programmable Custom Computing Machines (FCCM). Piscataway, NJ: IEEE, 2021: 277−277
47
Ding Yuhao, Wu Jiajun, Gao Yizhao, et al. Model-platform optimized deep neural network accelerator generation through mixed-integer geometric programming[C]//Proc of the 31st IEEE Int Symp on Field-Programmable Custom Computing Machines (FCCM). Piscataway, NJ: IEEE, 2023: 83−93
48
Ibrahim M, Zhao Zhipeng, Hall M, et al. Extending data flow architectures for convolutional neural networks to multiple FPGAs[C]//Proc of the 2023 Int Conf on Field Programmable Technology (ICFPT). Piscataway, NJ: IEEE, 2023: 132−141
49
Hall M, Betz V. From tensorflow graphs to LUTs and wires: Automated sparse and physically aware CNN hardware generation[C]//Proc of the 2020 Int Conf on Field-Programmable Technology (ICFPT). Piscataway, NJ: IEEE, 2020: 56−65
50
Liang Shiyan, Lin Jingui, Liu Dongwei, et al. RTMF: Routing based on TDM for multi-FPGA system[J]. ACM Transactions on Design Automation of Electronic Systems, 2025, 30(5): 81
2026年第63卷第11期
94
42
0
引用本文
BibTeX
文章信息
doi: 10.7544/issn1000-1239.202550866
  • 接收时间:2025-12-05
  • 首发时间:2026-11-17
  • 出版时间:2026-11-01
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2025-12-05
  • 修回日期:2026-07-09
基金
作者信息
    国防科技大学计算机学院 长沙 410073

通讯作者:

赖明澈()
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/10.7544/issn1000-1239.202550866
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏