Article(id=1329461181250646298, tenantId=1146029695717560320, journalId=1324759914146529478, issueId=1329460877864055544, articleNumber=null, orderNo=null, doi=10.7544/issn1000-1239.202330966, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1701360000000, receivedDateStr=2023-12-01, revisedDate=1710086400000, revisedDateStr=2024-03-11, acceptedDate=1710086400000, acceptedDateStr=2024-03-11, onlineDate=1794897845804, onlineDateStr=2026-11-17, pubDate=1714492800000, pubDateStr=2024-05-01, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1794897845804, onlineIssueDateStr=2026-11-17, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1794897845804, creator=13701087609, updateTime=1794897845804, updator=13701087609, issue=Issue{id=1329460877864055544, tenantId=1146029695717560320, journalId=1324759914146529478, year='2024', volume='61', issue='5', pageStart='1085', pageEnd='1347', issueExtLink='null', onlineDate='null', pubDate='1714492800000', pubDateStr='2024-05-01', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1794897773471, creator='13701087609', updateTime=1794897773471, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext=null, issueFiles=null, downloadFileDto=null}, startPage=1218, endPage=1229, ext={EN=ArticleExt(id=1329461181431001371, articleId=1329461181250646298, tenantId=1146029695717560320, journalId=1324759914146529478, language=EN, title=A Fast and Secure Transformer Inference Scheme with Secure Multi-Party Computation, columnId=1329460878547727097, journalTitle=Journal of Computer Research and Development, columnName=Special Issue on Large Models and Safety, runingTitle=null, highlight=null, articleAbstract=
Transformer has been widely used in many fields such as natural language processing and computer vision, and has outstanding performance. The users’ data will be leaked to the Transformer model provider during inference. With the increasing public attention on data privacy, the above data leakage problem has triggered researchers’ study on secure Transformer inference. Implementing secure Transformer inference with secure multi-party computation (MPC) is today’s hot topic. Due to the widely existence of non-linear functions in Transformer, it is hard to use MPC to implement secure Transformer inference, which leads to huge computation and communication cost. We focus on Softmax attention, bottleneck in secure Transformer inference, and propose two kinds of MPC-friendly attention mechanism, Softmax freeDiv Attention and 2Quad freeDiv Attention. By replacing the Softmax attention in Transformer with the MPC-friendly attention mechanism proposed, combining with the replacement of activation function GeLU and knowledge distillation, we propose an MPC-friendly Transformer convert framework, which can convert Transformer model to an MPC-friendly one, so as to improve the performance of secure Transformer inference later. Based on the proposed MPC-friendly Transformer convert framework , we perform secure Bert-Base inference on SST-2 in the LAN setting, using privacy computing protocols provided by secure processing unit (SPU). The result shows that the secure inference achieves 2.26 times speedup while maintaining the accuracy with non-approximation model.
, authors=Weixin Liu
1, Yewei Guan
1, Jiarong Huo
1, Yuanchao Ding
1, Hua Guo
1, 2, *, Bo Li
2, authorsList=Weixin Liu, Yewei Guan, Jiarong Huo, Yuanchao Ding, Hua Guo, Bo Li, authorCompany=null, correspAuthors=Hua Guo, authorNote=
born in 2001. Master candidate. His main research interests include privacy-preserving machine learning, cryptography
born in 1999. PhD candidate. His main research interests include secure multi-party computation and privacy-preserving machine learning
born in 2002. Undergraduate. His main research interest includes applied cryptography
born in 1999. Master candidate. His main research interests include privacy-preserving machine learning and cryptography
born in 1980. PhD, associate professor. Member of CCF. Her main research interests include privacy-preserving machine learning and cryptography
born in 1981. PhD, associate professor. Member of CCF. His main research interests include privacy-preserving machine learning and network security
, correspAuthorsNote=null, copyrightStatement=Copyright © 2024 Journal of Computer Research and Development. All rights reserved., copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1329461185226846519, articleId=1329461181250646298, tenantId=1146029695717560320, journalId=1324759914146529478, language=CN, title=一种基于安全多方计算的快速Transformer安全推理方案, columnId=1329460878694527739, journalTitle=计算机研究与发展, columnName=大模型与安全专题, runingTitle=null, highlight=null, articleAbstract=
Transformer模型在自然语言处理、计算机视觉等众多领域得到了广泛应用,并且有着突出的表现. 在Transformer的推理应用中用户的数据会被泄露给模型提供方. 随着数据隐私问题愈发得到公众的关注,上述数据泄露问题引发了学者们对Transformer安全推理的研究,使用安全多方计算(secure multi-party computation,MPC)实现Transformer模型的安全推理是当前的一个研究热点. 由于Transformer模型中存在大量非线性函数,因此使用MPC技术实现Transformer安全推理会造成巨大的计算和通信开销. 针对Transformer安全推理过程中开销较大的Softmax注意力机制,提出了2种MPC友好的注意力机制Softmax freeDiv Attention和2Quad freeDiv Attention. 通过将Transformer模型中的Softmax注意力机制替换为新的MPC友好的注意力机制,同时结合激活函数GeLU的替换以及知识蒸馏技术,提出了一个MPC友好的Transformer转换框架,通过将Transformer模型转化为MPC友好的Transformer模型,提高Transformer安全推理的效率. 在局域网环境下使用安全处理器(secure processing unit, SPU)提供的隐私计算协议,基于所提出的MPC友好的Transformer转换框架,在SST-2上使用Bert-Base进行安全推理. 测试结果表明,在保持推理准确率与无近似模型一致的情况下,安全推理计算效率提高2.26倍.
, authors=刘伟欣
1, 管晔玮
1, 霍嘉荣
1, 丁元朝
1, 郭华
1, 2, *, 李博
2, authorsList=刘伟欣, 管晔玮, 霍嘉荣, 丁元朝, 郭华, 李博, authorCompany=null, correspAuthors=郭华, authorNote=
 |
2001年生. 硕士研究生. 主要研究方向为隐私保护机器学习、密码学 |
 |
1999年生. 博士研究生. 主要研究方向为安全多方计算、隐私保护机器学习 |
 |
2002年生. 本科生. 主要研究方向为应用密码学 |
 |
1999年生. 硕士研究生. 主要研究方向为隐私保护机器学习、密码学 |
 |
1980年生. 博士,副教授. CCF会员. 主要研究方向为隐私保护机器学习、密码学 |
 |
1981年生. 博士,副教授. CCF会员. 主要研究方向为隐私保护机器学习、网络安全 |
, correspAuthorsNote=
, copyrightStatement=版权所有 © 2024 计算机研究与发展编辑部, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=LvG0NZcFC1bu6tM0bzaYXQ==, magXml=ydHEmZ9aMUPJ53QjYxza/g==, pdfUrl=null, pdf=rRhRg3QJC6O4NmYKvBpjuA==, pdfFileSize=1701343, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=dMSK+euXaN91XduyHtrh4g==, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=zCjT4ZNhYkmQHBTuFfBhrw==, mapNumber=null, fund=null)}, authors=[Author(id=1329461185600139583, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=sy2339130lwx@buaa.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329461185663054145, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461185600139583, language=EN, stringName=Weixin Liu, firstName=Weixin, middleName=null, lastName=Liu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, address=
1School of Cyber Science and Technology, Beihang University, Beijing 100191, bio={"content":"
born in 2001. Master candidate. His main research interests include privacy-preserving machine learning, cryptography
"}, bioImg=null, bioContent=
born in 2001. Master candidate. His main research interests include privacy-preserving machine learning, cryptography
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329461185734357314, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461185600139583, language=CN, stringName=刘伟欣, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, address=
1北京航空航天大学网络空间安全学院 北京 100191, bio={"img":"w14iN/nyXmi0b5gI7jd+Tg==","content":"
2001年生. 硕士研究生. 主要研究方向为隐私保护机器学习、密码学
"}, bioImg=w14iN/nyXmi0b5gI7jd+Tg==, bioContent=
2001年生. 硕士研究生. 主要研究方向为隐私保护机器学习、密码学
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329461185436561720, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, xref=1, ext=[AuthorCompanyExt(id=1329461185449144633, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1School of Cyber Science and Technology, Beihang University, Beijing 100191), AuthorCompanyExt(id=1329461185457533242, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1北京航空航天大学网络空间安全学院 北京 100191)])]), Author(id=1329461185814049092, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329461185876963654, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461185814049092, language=EN, stringName=Yewei Guan, firstName=Yewei, middleName=null, lastName=Guan, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, address=
1School of Cyber Science and Technology, Beihang University, Beijing 100191, bio={"content":"
born in 1999. PhD candidate. His main research interests include secure multi-party computation and privacy-preserving machine learning
"}, bioImg=null, bioContent=
born in 1999. PhD candidate. His main research interests include secure multi-party computation and privacy-preserving machine learning
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329461185948266823, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461185814049092, language=CN, stringName=管晔玮, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, address=
1北京航空航天大学网络空间安全学院 北京 100191, bio={"img":"n8eryvL6alcGtG8ngVuApA==","content":"
1999年生. 博士研究生. 主要研究方向为安全多方计算、隐私保护机器学习
"}, bioImg=n8eryvL6alcGtG8ngVuApA==, bioContent=
1999年生. 博士研究生. 主要研究方向为安全多方计算、隐私保护机器学习
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329461185436561720, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, xref=1, ext=[AuthorCompanyExt(id=1329461185449144633, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1School of Cyber Science and Technology, Beihang University, Beijing 100191), AuthorCompanyExt(id=1329461185457533242, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1北京航空航天大学网络空间安全学院 北京 100191)])]), Author(id=1329461186019569993, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329461186090873163, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461186019569993, language=EN, stringName=Jiarong Huo, firstName=Jiarong, middleName=null, lastName=Huo, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, address=
1School of Cyber Science and Technology, Beihang University, Beijing 100191, bio={"content":"
born in 2002. Undergraduate. His main research interest includes applied cryptography
"}, bioImg=null, bioContent=
born in 2002. Undergraduate. His main research interest includes applied cryptography
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329461186153787724, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461186019569993, language=CN, stringName=霍嘉荣, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, address=
1北京航空航天大学网络空间安全学院 北京 100191, bio={"img":"OK3mx3xIMhIvXPEwJOiMsA==","content":"
2002年生. 本科生. 主要研究方向为应用密码学
"}, bioImg=OK3mx3xIMhIvXPEwJOiMsA==, bioContent=
2002年生. 本科生. 主要研究方向为应用密码学
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329461185436561720, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, xref=1, ext=[AuthorCompanyExt(id=1329461185449144633, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1School of Cyber Science and Technology, Beihang University, Beijing 100191), AuthorCompanyExt(id=1329461185457533242, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1北京航空航天大学网络空间安全学院 北京 100191)])]), Author(id=1329461186233479502, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329461186313171280, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461186233479502, language=EN, stringName=Yuanchao Ding, firstName=Yuanchao, middleName=null, lastName=Ding, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, address=
1School of Cyber Science and Technology, Beihang University, Beijing 100191, bio={"content":"
born in 1999. Master candidate. His main research interests include privacy-preserving machine learning and cryptography
"}, bioImg=null, bioContent=
born in 1999. Master candidate. His main research interests include privacy-preserving machine learning and cryptography
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329461186380280145, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461186233479502, language=CN, stringName=丁元朝, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, address=
1北京航空航天大学网络空间安全学院 北京 100191, bio={"img":"LYSy2heXEILnbgGIz9MmrQ==","content":"
1999年生. 硕士研究生. 主要研究方向为隐私保护机器学习、密码学
"}, bioImg=LYSy2heXEILnbgGIz9MmrQ==, bioContent=
1999年生. 硕士研究生. 主要研究方向为隐私保护机器学习、密码学
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329461185436561720, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, xref=1, ext=[AuthorCompanyExt(id=1329461185449144633, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1School of Cyber Science and Technology, Beihang University, Beijing 100191), AuthorCompanyExt(id=1329461185457533242, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1北京航空航天大学网络空间安全学院 北京 100191)])]), Author(id=1329461186472554835, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=hguo@buaa.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1329461186548052310, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461186472554835, language=EN, stringName=Hua Guo, firstName=Hua, middleName=null, lastName=Guo, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, 2, *, address=
1School of Cyber Science and Technology, Beihang University, Beijing 100191
2State Key Laboratory of Complex & Critical Software Environment (Beihang University), Beijing 100878, bio={"content":"
born in 1980. PhD, associate professor. Member of CCF. Her main research interests include privacy-preserving machine learning and cryptography
"}, bioImg=null, bioContent=
born in 1980. PhD, associate professor. Member of CCF. Her main research interests include privacy-preserving machine learning and cryptography
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329461186623549783, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461186472554835, language=CN, stringName=郭华, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, 2, *, address=
1北京航空航天大学网络空间安全学院 北京 100191
2复杂关键软件环境全国重点实验室(北京航空航天大学) 北京 100878, bio={"img":"98sFdXx5RqbSU2tgXeaOdQ==","content":"
1980年生. 博士,副教授. CCF会员. 主要研究方向为隐私保护机器学习、密码学
"}, bioImg=98sFdXx5RqbSU2tgXeaOdQ==, bioContent=
1980年生. 博士,副教授. CCF会员. 主要研究方向为隐私保护机器学习、密码学
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329461185436561720, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, xref=1, ext=[AuthorCompanyExt(id=1329461185449144633, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1School of Cyber Science and Technology, Beihang University, Beijing 100191), AuthorCompanyExt(id=1329461185457533242, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1北京航空航天大学网络空间安全学院 北京 100191)]), AuthorCompany(id=1329461185524642107, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, xref=2, ext=[AuthorCompanyExt(id=1329461185533030716, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185524642107, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2State Key Laboratory of Complex & Critical Software Environment (Beihang University), Beijing 100878), AuthorCompanyExt(id=1329461185541419325, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185524642107, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2复杂关键软件环境全国重点实验室(北京航空航天大学) 北京 100878)])]), Author(id=1329461188242551129, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329461188372574555, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461188242551129, language=EN, stringName=Bo Li, firstName=Bo, middleName=null, lastName=Li, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
2, address=
2State Key Laboratory of Complex & Critical Software Environment (Beihang University), Beijing 100878, bio={"content":"
born in 1981. PhD, associate professor. Member of CCF. His main research interests include privacy-preserving machine learning and network security
"}, bioImg=null, bioContent=
born in 1981. PhD, associate professor. Member of CCF. His main research interests include privacy-preserving machine learning and network security
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329461188427100508, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, authorId=1329461188242551129, language=CN, stringName=李博, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
2, address=
2复杂关键软件环境全国重点实验室(北京航空航天大学) 北京 100878, bio={"img":"r6ckzWpanNAIEVm/Ev6JLQ==","content":"
1981年生. 博士,副教授. CCF会员. 主要研究方向为隐私保护机器学习、网络安全
"}, bioImg=r6ckzWpanNAIEVm/Ev6JLQ==, bioContent=
1981年生. 博士,副教授. CCF会员. 主要研究方向为隐私保护机器学习、网络安全
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329461185524642107, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, xref=2, ext=[AuthorCompanyExt(id=1329461185533030716, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185524642107, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2State Key Laboratory of Complex & Critical Software Environment (Beihang University), Beijing 100878), AuthorCompanyExt(id=1329461185541419325, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185524642107, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2复杂关键软件环境全国重点实验室(北京航空航天大学) 北京 100878)])])], keywords=[Keyword(id=1329461188531958109, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, orderNo=1, keyword=secure inference), Keyword(id=1329461188603261278, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, orderNo=2, keyword=Transformer), Keyword(id=1329461188670370143, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, orderNo=3, keyword=secure multi-party computation (MPC)), Keyword(id=1329461188754256224, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, orderNo=4, keyword=secure processing unit (SPU)), Keyword(id=1329461188821365089, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, orderNo=5, keyword=knowledge distillation), Keyword(id=1329461188896862562, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, orderNo=1, keyword=安全推理), Keyword(id=1329461188980748643, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, orderNo=2, keyword=Transformer), Keyword(id=1329461189039468900, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, orderNo=3, keyword=安全多方计算), Keyword(id=1329461189102383461, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, orderNo=4, keyword=安全处理器), Keyword(id=1329461189161103718, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, orderNo=5, keyword=知识蒸馏)], refs=[Reference(id=1329461192759816578, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=1, rfOrder=0, authorNames=null, journalName=null, refType=null, unstructuredReference=Hoffmann J, Borgeaud S, Mensch A, et al. An empirical analysis of compute-optimal large language model training[J]. Advances in Neural Information Processing Systems, 2022, 35: 30016−30030, articleTitle=null, refAbstract=null), Reference(id=1329461192822731139, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=2, rfOrder=1, authorNames=null, journalName=null, refType=null, unstructuredReference=Chan S, Santoro A, Lampinen A, et al. Data distributional properties drive emergent in-context learning in transformers[J]. Advances in Neural Information Processing Systems, 2022, 35: 18878−18891, articleTitle=null, refAbstract=null), Reference(id=1329461192881451396, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=3, rfOrder=2, authorNames=null, journalName=null, refType=null, unstructuredReference=Liu Ze, Lin Yutong, Cao Yue, et al. Swin transformer: Hierarchical vision transformer using shifted windows[C]//Proc of the IEEE/CVF Int Conf on Computer Vision. Piscataway, NJ: IEEE , 2021: 10012−10022, articleTitle=null, refAbstract=null), Reference(id=1329461192944365957, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=4, rfOrder=3, authorNames=null, journalName=null, refType=null, unstructuredReference=Liu Ze, Hu Han, Lin Yutong, et al. Swin transformer v2: Scaling up capacity and resolution[C]//Proc of the IEEE/CVF Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2022: 12009−12019, articleTitle=null, refAbstract=null), Reference(id=1329461193019863430, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=5, rfOrder=4, authorNames=null, journalName=null, refType=null, unstructuredReference=Jawalkar N, Gupta K, Basu A, et al. Orca: FSS-based secure training with GPUs[J]. Cryptology ePrint Archive, 2023, articleTitle=null, refAbstract=null), Reference(id=1329461193082777991, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=6, rfOrder=5, authorNames=null, journalName=null, refType=null, unstructuredReference=Hao Meng, Li Hongwei, Chen Hanxiao, et al. Iron: Private inference on transformers[J]. Advances in Neural Information Processing Systems, 2022, 35: 15718−15731, articleTitle=null, refAbstract=null), Reference(id=1329461193149886856, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=7, rfOrder=6, authorNames=null, journalName=null, refType=null, unstructuredReference=Chen Tianyu, Bao Hangbo, Huang Shaohan, et al. THE-X: Privacy-preserving transformer inference with homomorphic encryption[C]//Findings of the Association for Computational Linguistics: ACL 2022. Stroudsburg, PA: ACL, 2022: 3510−3520, articleTitle=null, refAbstract=null), Reference(id=1329461193208607113, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=8, rfOrder=7, authorNames=null, journalName=null, refType=null, unstructuredReference=Zheng Mengxin, Lou Qian, Lei Jiang. Primer: Fast private transformer inference on encrypted data[J]. arXiv preprint, arXiv: 2303.13679, 2023, articleTitle=null, refAbstract=null), Reference(id=1329461193275715978, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=9, rfOrder=8, authorNames=null, journalName=null, refType=null, unstructuredReference=Gupta K, Jawalkar N, Mukherjee A, et al. Sigma: Secure gpt inference with function secret sharing[J]. Cryptology ePrint Archive, 2023, articleTitle=null, refAbstract=null), Reference(id=1329461193334436235, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=10, rfOrder=9, authorNames=null, journalName=null, refType=null, unstructuredReference=Juvekar C, Vaikuntanathan V, Chandrakasan A. GAZELLE: A low latency framework for secure neural network inference[C]//Proc of the 27th USENIX Conf on Security Symp. Berkeley, CA: USENIX Association, 2018: 1651−1669, articleTitle=null, refAbstract=null), Reference(id=1329461193388962188, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=11, rfOrder=10, authorNames=null, journalName=null, refType=null, unstructuredReference=Jiang Xiaoqian, Kim M, Lauter K, et al. Secure outsourced matrix computation and application to neural networks[C]//Proc of the 2018 ACM SIGSAC Conf on Computer and Communications Security. New York: Association for Computing Machinery, 2018: 1209−1222, articleTitle=null, refAbstract=null), Reference(id=1329461193447682445, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=12, rfOrder=11, authorNames=null, journalName=null, refType=null, unstructuredReference=Mohassel P, Zhang Y. SecureML: A system for scalable privacy-preserving machine learning[C]//Proc of 2017 IEEE Symp on Security and Privacy (SP). Piscataway, NJ: IEEE, 2017: 19−38, articleTitle=null, refAbstract=null), Reference(id=1329461193527374222, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=13, rfOrder=12, authorNames=null, journalName=null, refType=null, unstructuredReference=Huang Zhicong, Lu Wenjie, Hong Cheng, et al. Cheetah: Lean and fast secure two-party deep neural network inference[C]//Proc of the 31st USENIX Security Symp (USENIX Security 22). Berkeley, CA: USENIX Association, 2022: 809−826, articleTitle=null, refAbstract=null), Reference(id=1329461193594483087, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=14, rfOrder=13, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Ning, Xiao Xiaohui, Yang Yin, et al. Collecting and analyzing multidimensional data with local differential privacy[C]//Proc of the 2019 IEEE 35th Int Conf on Data Engineering (ICDE). Piscataway, NJ: IEEE, 2019: 638−649, articleTitle=null, refAbstract=null), Reference(id=1329461193657397648, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=15, rfOrder=14, authorNames=null, journalName=null, refType=null, unstructuredReference=Truong J B, Gallagher W, Guo Tian, et al. Memory-efficient deep learning inference in trusted execution environments[C]//Proc of the 2021 IEEE Int Conf on Cloud Engineering (IC2E). Piscataway, NJ: IEEE, 2021: 161−167, articleTitle=null, refAbstract=null), Reference(id=1329461193728700817, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=16, rfOrder=15, authorNames=null, journalName=null, refType=null, unstructuredReference=Akavia A, Leibovich M, Resheff Y S, et al. Privacy-preserving decision trees training and prediction[J]. ACM Transactions on Privacy and Security, 2022, 25(3): 1−30, articleTitle=null, refAbstract=null), Reference(id=1329461193779032466, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=17, rfOrder=16, authorNames=null, journalName=null, refType=null, unstructuredReference=Park S, Byun J, Lee J. Privacy-preserving fair learning of support vector machine with homomorphic encryption[C]//Proc of the ACM Web Conf 2022. New York: ACM, 2022: 3572−3583, articleTitle=null, refAbstract=null), Reference(id=1329461193850335635, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=18, rfOrder=17, authorNames=null, journalName=null, refType=null, unstructuredReference=Mohassel P, Rindal P. ABY3: A mixed protocol framework for machine learning[C]//Proc of the 2018 ACM SIGSAC Conf on Computer and Communications Security. New York: ACM, 2018: 35−52, articleTitle=null, refAbstract=null), Reference(id=1329461193930027412, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=19, rfOrder=18, authorNames=null, journalName=null, refType=null, unstructuredReference=Rathee D, Rathee M, Kumar N, et al. Cryptflow2: Practical 2-party secure inference[C]//Proc of the 2020 ACM SIGSAC Conf on Computer and Communications Security. New York: ACM, 2020: 325−342, articleTitle=null, refAbstract=null), Reference(id=1329461193992941973, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=20, rfOrder=19, authorNames=null, journalName=null, refType=null, unstructuredReference=Hou Xiaoyang, Liu Jian, Li Jingyu, et al. Ciphergpt: Secure two-party gpt inference[J]. Cryptology ePrint Archive, 2023, articleTitle=null, refAbstract=null), Reference(id=1329461194064245142, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=21, rfOrder=20, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Dacheng, Shao Rulin, Wang Hongyi, et al. MPCFormer: Fast, performant and private transformer inference with MPC[J]. arXiv preprint, arXiv: 2211.01452, 2022, articleTitle=null, refAbstract=null), Reference(id=1329461194131354007, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=22, rfOrder=21, authorNames=null, journalName=null, refType=null, unstructuredReference=Zeng Wenxuan, Li Meng, Xiong Wenjie, et al. MPCViT: Searching for MPC-friendly vision transformer with heterogeneous attention[J]. arXiv preprint, arXiv: 2211.13955, 2022, articleTitle=null, refAbstract=null), Reference(id=1329461194194268568, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=23, rfOrder=22, authorNames=null, journalName=null, refType=null, unstructuredReference=Mishra P, Lehmkuhl R, Srinivasan A, et al. Delphi: A cryptographic inference system for neural networks[C]//Proc of the 29th USENIX Conf on Security Symp. Berkeley, CA: USENIX Association, 2020: 2505−2522, articleTitle=null, refAbstract=null), Reference(id=1329461194257183129, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=24, rfOrder=23, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Xiaolong, Girshick R, Gupta A, et al. Non-local neural networks[C]//Proc of the IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2018: 7794−7803, articleTitle=null, refAbstract=null), Reference(id=1329461194336874906, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=25, rfOrder=24, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Sinong, Li B Z, Khabsa M, et al. Linformer: Self-attention with linear complexity[J]. arXiv preprint, arXiv: 2006.04768, 2020, articleTitle=null, refAbstract=null), Reference(id=1329461194403983771, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=26, rfOrder=25, authorNames=null, journalName=null, refType=null, unstructuredReference=Rathee D, Rathee M, Goli R K K, et al. Sirnn: A math library for secure RNN inference[C]//Proc of 2021 IEEE Symp on Security and Privacy (SP). Piscataway, NJ: IEEE, 2021: 1003−1020, articleTitle=null, refAbstract=null), Reference(id=1329461194462704028, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=27, rfOrder=26, authorNames=null, journalName=null, refType=null, unstructuredReference=Dong Ye, Lu Wenjie, Zheng Yancheng, et al. Puma: Secure inference of LLaMA-7B in five minutes[J]. arXiv preprint, arXiv: 2307.12533, 2023, articleTitle=null, refAbstract=null), Reference(id=1329461194546590110, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=28, rfOrder=27, authorNames=null, journalName=null, refType=null, unstructuredReference=Akimoto Y, Fukuchi K, Akimoto Y, et al. Privformer: Privacy-preserving transformer with MPC[C]//Proc of 2023 IEEE 8th European Symp on Security and Privacy (EuroS&P). Piscataway, NJ: IEEE, 2023: 392−410, articleTitle=null, refAbstract=null), Reference(id=1329461194613698975, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=29, rfOrder=28, authorNames=null, journalName=null, refType=null, unstructuredReference=Wagh S, Tople S, Benhamouda F, et al. Falcon: Honest-majority maliciously secure framework for private deep learning[J]. arXiv preprint, arXiv: 2004.02229, 2020, articleTitle=null, refAbstract=null), Reference(id=1329461194672419232, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=30, rfOrder=29, authorNames=null, journalName=null, refType=null, unstructuredReference=Chou E, Beal J, Levy D, et al. Faster Cryptonets: Leveraging sparsity for real-world encrypted inference[J]. arXiv preprint, arXiv: 1811.09953, 2018, articleTitle=null, refAbstract=null), Reference(id=1329461194739528097, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=31, rfOrder=30, authorNames=null, journalName=null, refType=null, unstructuredReference=Hinton G, Vinyals O, Dean J. Distilling the knowledge in a neural network[J]. arXiv preprint , arXiv: 1503.02531, 2015, articleTitle=null, refAbstract=null), Reference(id=1329461194798248354, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=32, rfOrder=31, authorNames=null, journalName=null, refType=null, unstructuredReference=Ma Junming, Zheng Yancheng, Feng Jun, et al. SecretFlow-SPU: A performant and user-friendly framework for privacy-preserving machine learning[C]//Proc of 2023 USENIX Annual Technical Conf (USENIX ATC 23). Berkeley, CA: USENIX Associatioin, 2023: 17−33, articleTitle=null, refAbstract=null)], funds=null, companyList=[AuthorCompany(id=1329461185436561720, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, xref=1, ext=[AuthorCompanyExt(id=1329461185449144633, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1School of Cyber Science and Technology, Beihang University, Beijing 100191), AuthorCompanyExt(id=1329461185457533242, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185436561720, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1北京航空航天大学网络空间安全学院 北京 100191)]), AuthorCompany(id=1329461185524642107, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, xref=2, ext=[AuthorCompanyExt(id=1329461185533030716, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185524642107, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2State Key Laboratory of Complex & Critical Software Environment (Beihang University), Beijing 100878), AuthorCompanyExt(id=1329461185541419325, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, companyId=1329461185524642107, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2复杂关键软件环境全国重点实验室(北京航空航天大学) 北京 100878)])], figs=[ArticleFig(id=1329461189274349927, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Figure 1, caption=
Process of training and using ChatGPT, figureFileSmall=a52etatokTakyDFCvXFl8g==, figureFileBig=dMSK+euXaN91XduyHtrh4g==, tableContent=null), ArticleFig(id=1329461189345653096, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=图1, caption=
ChatGPT训练及使用过程, figureFileSmall=a52etatokTakyDFCvXFl8g==, figureFileBig=dMSK+euXaN91XduyHtrh4g==, tableContent=null), ArticleFig(id=1329461189538591081, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Figure 2, caption=
Architecture of Encoder-only Transformer, figureFileSmall=jBHRFP17EYpvYLaOr2borw==, figureFileBig=+8VPwFrEUYikuloxbRC2Uw==, tableContent=null), ArticleFig(id=1329461189614088554, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=图2, caption=
Encoder-only Transformer 结构, figureFileSmall=jBHRFP17EYpvYLaOr2borw==, figureFileBig=+8VPwFrEUYikuloxbRC2Uw==, tableContent=null), ArticleFig(id=1329461189672808811, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Figure 3, caption=
Secure Transformer inference framework, figureFileSmall=wiy/CoevWdO+dfmhdGzgCA==, figureFileBig=c8Lp4pI+KT5Z+HG9O2BPtw==, tableContent=null), ArticleFig(id=1329461189735723372, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=图3, caption=
Transformer安全推理框架, figureFileSmall=wiy/CoevWdO+dfmhdGzgCA==, figureFileBig=c8Lp4pI+KT5Z+HG9O2BPtw==, tableContent=null), ArticleFig(id=1329461189798637933, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Figure 4, caption=
MPC-friendly Transformer convert framework, figureFileSmall=oXh5s48YT6duDUaJez78FA==, figureFileBig=35dgymF7Pso6Db8MehzxaA==, tableContent=null), ArticleFig(id=1329461189857358190, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=图4, caption=
MPC友好的Transformer转换框架, figureFileSmall=oXh5s48YT6duDUaJez78FA==, figureFileBig=35dgymF7Pso6Db8MehzxaA==, tableContent=null), ArticleFig(id=1329461189928661359, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Figure 5, caption=
Scattergram of the mean of denominator in Softmax attention mechanism, figureFileSmall=YwgM3pJTRZOVyeZSMFqxjQ==, figureFileBig=g5CXXLGb/QFVTw1UhyMEnA==, tableContent=null), ArticleFig(id=1329461189999964528, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=图5, caption=
Softmax注意力机制中分母均值的散点图, figureFileSmall=YwgM3pJTRZOVyeZSMFqxjQ==, figureFileBig=g5CXXLGb/QFVTw1UhyMEnA==, tableContent=null), ArticleFig(id=1329461190075462001, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Figure 6, caption=
Function fitting of the mean of denominator in Softmax attention mechanism, figureFileSmall=+uNrUrnA0VNQMOw7nAqowQ==, figureFileBig=yTTu5RlSHDwn2eeOTl8Zgg==, tableContent=null), ArticleFig(id=1329461190138376562, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=图6, caption=
Softmax注意力机制中分母均值的函数拟合, figureFileSmall=+uNrUrnA0VNQMOw7nAqowQ==, figureFileBig=yTTu5RlSHDwn2eeOTl8Zgg==, tableContent=null), ArticleFig(id=1329461190209679731, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Figure 7, caption=
Function fitting of the mean of denominator in 2Quad attention mechanism, figureFileSmall=Z/srEc3KajRu2YiDyAqThA==, figureFileBig=hwjZb7U/AAA+V0psjAaS9Q==, tableContent=null), ArticleFig(id=1329461190272594292, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=图7, caption=
2Quad 注意力机制中分母均值的函数拟合, figureFileSmall=Z/srEc3KajRu2YiDyAqThA==, figureFileBig=hwjZb7U/AAA+V0psjAaS9Q==, tableContent=null), ArticleFig(id=1329461190343897461, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Table 1, caption=
Secure Computational Latency of Different Attention Mechanisms
, figureFileSmall=null, figureFileBig=null, tableContent=
| 注意力机制 | 延迟/s | 速度提升倍数 |
|---|
| Softmax Attention | 0.236 | 1 |
| 2ReLU Attention | 0.159 | 1.48 |
| 2Quad Attention | 0.157 | 1.50 |
| Scaling Attention | 0.060 | 3.93 |
| Softmax freeDiv Attention(本文) | 0.153 | 1.54 |
| 2Quad freeDiv Attention(本文) | 0.064 | 3.69 |
), ArticleFig(id=1329461190419394934, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=表1, caption=
不同的注意力机制的安全计算延迟
, figureFileSmall=null, figureFileBig=null, tableContent=
| 注意力机制 | 延迟/s | 速度提升倍数 |
|---|
| Softmax Attention | 0.236 | 1 |
| 2ReLU Attention | 0.159 | 1.48 |
| 2Quad Attention | 0.157 | 1.50 |
| Scaling Attention | 0.060 | 3.93 |
| Softmax freeDiv Attention(本文) | 0.153 | 1.54 |
| 2Quad freeDiv Attention(本文) | 0.064 | 3.69 |
), ArticleFig(id=1329461190482309495, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Table 2, caption=
Performance of Different Function Replacement Schemes Compared with the Benchmark
, figureFileSmall=null, figureFileBig=null, tableContent=
| 注意力机制 | 激活函数 | 速度提升倍数 | 准确率/% |
|---|
Softmax Attention | GeLU | 1 | 91.5 |
| ReLU | 1.36 | 92.0 |
| Quad | 1.42 | 92.0 |
2ReLU Attention | GeLU | 1.18 | 91.7 |
| ReLU | 1.75 | 91.5 |
| Quad | 1.78 | 90.9 |
2Quad Attention | GeLU | 1.2 | 91.6 |
| ReLU | 1.79 | 91.5 |
| Quad | 1.84 | 91.8 |
Scaling Attention | GeLU | 1.38 | 50.9 |
| ReLU | 2.17 | 50.9 |
| Quad | 2.26 | 50.9 |
Softmax freeDiv Attention(本文方法) | GeLU | 1.17 | 91.7 |
| ReLU | 1.59 | 91.7 |
| Quad | 1.63 | 92.1 |
2Quad freeDiv Attention(本文方法) | GeLU | 1.37 | 91.6 |
| ReLU | 2.16 | 91.7 |
| Quad | 2.26 | 91.8 |
), ArticleFig(id=1329461190545224056, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=表2, caption=
不同函数替换方案相比于基准方案的表现
, figureFileSmall=null, figureFileBig=null, tableContent=
| 注意力机制 | 激活函数 | 速度提升倍数 | 准确率/% |
|---|
Softmax Attention | GeLU | 1 | 91.5 |
| ReLU | 1.36 | 92.0 |
| Quad | 1.42 | 92.0 |
2ReLU Attention | GeLU | 1.18 | 91.7 |
| ReLU | 1.75 | 91.5 |
| Quad | 1.78 | 90.9 |
2Quad Attention | GeLU | 1.2 | 91.6 |
| ReLU | 1.79 | 91.5 |
| Quad | 1.84 | 91.8 |
Scaling Attention | GeLU | 1.38 | 50.9 |
| ReLU | 2.17 | 50.9 |
| Quad | 2.26 | 50.9 |
Softmax freeDiv Attention(本文方法) | GeLU | 1.17 | 91.7 |
| ReLU | 1.59 | 91.7 |
| Quad | 1.63 | 92.1 |
2Quad freeDiv Attention(本文方法) | GeLU | 1.37 | 91.6 |
| ReLU | 2.16 | 91.7 |
| Quad | 2.26 | 91.8 |
), ArticleFig(id=1329461190616527225, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Table 3, caption=
Performance of the Converted Model Compared with the Original Model
, figureFileSmall=null, figureFileBig=null, tableContent=
| 模型 | 速度提升倍数 | 准确率/% |
|---|
| 原模型 | 1 | 91.5 |
| 转换后的MPC友好的模型 | 2.26 | 91.8 |
), ArticleFig(id=1329461190679441786, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=表3, caption=
转换后的模型与原模型的性能对比
, figureFileSmall=null, figureFileBig=null, tableContent=
| 模型 | 速度提升倍数 | 准确率/% |
|---|
| 原模型 | 1 | 91.5 |
| 转换后的MPC友好的模型 | 2.26 | 91.8 |
), ArticleFig(id=1329461190750744955, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Table 4, caption=
Performance of Different Function Replacement Schemes in Different Tasks
, figureFileSmall=null, figureFileBig=null, tableContent=
| 替换方案 | 任务 | 蒸馏前的 评估指标 /% | 蒸馏后的 评估指标 /% |
|---|
Softmax Attention +GeLU | SST-2 | 91.5 | |
| STS-B | 88.7 | |
| RTE | 63.2 | |
Softmax freeDiv Attention +GeLU(本文方法) | SST-2 | 91.3 | 91.6 |
| STS-B | 84.0 | 89.0 |
| RTE | 55.6 | 61.4 |
Softmax Attention +Quad | SST-2 | 50.9 | 92.0 |
| STS-B | 4.2 | 89.2 |
| RTE | 52.7 | 65.3 |
Softmax freeDiv Attention +Quad(本文方法) | SST-2 | 50.9 | 91.5 |
| STS-B | 4.2 | 88.0 |
| RTE | 52.7 | 47.3 |
2Quad Attention +Quad | SST-2 | 50.9 | 91.8 |
| STS-B | −5.7 | 84.5 |
| RTE | 52.7 | 59.2 |
2Quad freeDiv Attention +Quad(本文方法) | SST-2 | 49.2 | 91.5 |
| STS-B | 2.9 | 81.0 |
| RTE | 52.0 | 54.9 |
), ArticleFig(id=1329461190830436732, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=表4, caption=
不同函数替换方案在不同任务中的表现
, figureFileSmall=null, figureFileBig=null, tableContent=
| 替换方案 | 任务 | 蒸馏前的 评估指标 /% | 蒸馏后的 评估指标 /% |
|---|
Softmax Attention +GeLU | SST-2 | 91.5 | |
| STS-B | 88.7 | |
| RTE | 63.2 | |
Softmax freeDiv Attention +GeLU(本文方法) | SST-2 | 91.3 | 91.6 |
| STS-B | 84.0 | 89.0 |
| RTE | 55.6 | 61.4 |
Softmax Attention +Quad | SST-2 | 50.9 | 92.0 |
| STS-B | 4.2 | 89.2 |
| RTE | 52.7 | 65.3 |
Softmax freeDiv Attention +Quad(本文方法) | SST-2 | 50.9 | 91.5 |
| STS-B | 4.2 | 88.0 |
| RTE | 52.7 | 47.3 |
2Quad Attention +Quad | SST-2 | 50.9 | 91.8 |
| STS-B | −5.7 | 84.5 |
| RTE | 52.7 | 59.2 |
2Quad freeDiv Attention +Quad(本文方法) | SST-2 | 49.2 | 91.5 |
| STS-B | 2.9 | 81.0 |
| RTE | 52.0 | 54.9 |
), ArticleFig(id=1329461190897545597, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Table 5, caption=
Time Consuming of MPC-friendly Transformer Convert Framework for Different Tasks
, figureFileSmall=null, figureFileBig=null, tableContent=
| 任务(数据集大小) | 耗时/min |
|---|
| SST-2 (67000) | 338 |
| STS-B (57000) | 200 |
| RTE (25000) | 46 |
), ArticleFig(id=1329461190977237374, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=表5, caption=
MPC友好的Transformer转换框架针对不同任务消耗的时间
, figureFileSmall=null, figureFileBig=null, tableContent=
| 任务(数据集大小) | 耗时/min |
|---|
| SST-2 (67000) | 338 |
| STS-B (57000) | 200 |
| RTE (25000) | 46 |
), ArticleFig(id=1329461191052734847, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=EN, label=Table 6, caption=
Performance Comparison Between Our Work and Reference [21]
, figureFileSmall=null, figureFileBig=null, tableContent=
| 方案 | 准确率/% | 速度提升倍数 |
|---|
| 无近似模型 Softmax Attention+GeLU | 91.5 (+0.0) | 1 |
| 2Quad Attention+Quad[21] | 91.8 (+0.3) | 1.78 |
| 2Quad freeDiv Attention+Quad(本文工作) | 91.8 (+0.3) | 2.26 |
), ArticleFig(id=1329461191111455105, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329461181250646298, language=CN, label=表6, caption=
本文工作与文献[21]的性能对比
, figureFileSmall=null, figureFileBig=null, tableContent=
| 方案 | 准确率/% | 速度提升倍数 |
|---|
| 无近似模型 Softmax Attention+GeLU | 91.5 (+0.0) | 1 |
| 2Quad Attention+Quad[21] | 91.8 (+0.3) | 1.78 |
| 2Quad freeDiv Attention+Quad(本文工作) | 91.8 (+0.3) | 2.26 |
)], attaches=null, journal=Journal(id=1324759606947315908, delFlag=0, nameCn=计算机研究与发展, nameEn=Journal of Computer Research and Development, nameHistory1=null, nameHistory2=null, issn=1000-1239, eissn=null, cn=11-1777/TP, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=k2l8zgqwstuxxevFX2qxVA==, journalPrice=null, startedYear=null, abbrevIsoEn=Journal of Computer Research and Development, journalRemark=null, publicationField=null, createdTime=1793776903141, updatedTime=1793850698612, createdBy=18614031015, updatedBy=13701087609, firstLetterCn=J, firstLetterEn=J, subjectCode=Electronic Information, subjectName=null, subjectCodeEn=Electronic Information, subjectNameEn=null, picCn=k2l8zgqwstuxxevFX2qxVA==, picEn=r6k0Ry+RD+c/VXj5QarmDw==, jcr=null, cjcr=null, exts=[JournalExt(id=1325069127710286688, language=CN, name=计算机研究与发展, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1793850698640, updatedTime=1793850698640, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://crad.ict.ac.cn/journalx/authorLogOn.action, submissionEditorUrl=https://crad.ict.ac.cn/journalx/editorLogOn.action, submissionReviewUrl=https://crad.ict.ac.cn/journalx/expertLogOn.action, submissionCeEditorUrl=https://crad.ict.ac.cn/journalx/editorInChiefLogOn.action, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1325069127777395553, language=EN, name=Journal of Computer Research and Development, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1793850698656, updatedTime=1793850698656, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://crad.ict.ac.cn/journalx/authorLogOn.action, submissionEditorUrl=https://crad.ict.ac.cn/journalx/editorLogOn.action, submissionReviewUrl=https://crad.ict.ac.cn/journalx/expertLogOn.action, submissionCeEditorUrl=https://crad.ict.ac.cn/journalx/editorInChiefLogOn.action, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1324759914146529478, websiteList=[Website(id=1325070300139892771, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1324759914146529478, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN, language=CN, createTime=1793850978169, createBy=18614031015, updateTime=1793851040259, updateBy=18614031015, name=计算机研究与发展-中文, tplId=1146099689490845704, title=计算机研究与发展, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1325070893751349360, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=articleTextType, value=kx, createTime=1793851119697, updateTime=1793851119697, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893730377837, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=banner, value=null, createTime=1793851119692, updateTime=1793851119692, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893772320883, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=grayFlag, value=0, createTime=1793851119702, updateTime=1793851119702, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893721989228, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=logo, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/file/pic?fileId=U27tDsy717YF7XSPA+Vwdw==, createTime=1793851119690, updateTime=1793851119690, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893784903797, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=minRunFlag, value=0, createTime=1793851119705, updateTime=1793851119705, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893742960751, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/file/pic, createTime=1793851119695, updateTime=1793851119695, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893780709492, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=silenceFlag, value=0, createTime=1793851119704, updateTime=1793851119704, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893738766446, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1793851119694, updateTime=1793851119694, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893755543665, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=themeColor, value=null, createTime=1793851119698, updateTime=1793851119698, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893763932274, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=themeStyle, value=null, createTime=1793851119700, updateTime=1793851119700, creator=18614031015, updator=18614031015)]), Website(id=1325070300580294698, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1324759914146529478, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN, language=EN, createTime=1793850978274, createBy=18614031015, updateTime=1793851036638, updateBy=18614031015, name=计算机研究与发展-英文, tplId=1146101810881728533, title=Journal of Computer Research and Development, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1325070925288321148, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=articleTextType, value=kx, createTime=1793851127216, updateTime=1793851127216, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925263155321, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=banner, value=null, createTime=1793851127210, updateTime=1793851127210, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925309292671, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=grayFlag, value=0, createTime=1793851127221, updateTime=1793851127221, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925254766712, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=logo, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/file/pic?fileId=U27tDsy717YF7XSPA+Vwdw==, createTime=1793851127208, updateTime=1793851127208, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925326069889, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=minRunFlag, value=0, createTime=1793851127225, updateTime=1793851127225, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925279932539, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/file/pic, createTime=1793851127214, updateTime=1793851127214, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925317681280, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=silenceFlag, value=0, createTime=1793851127223, updateTime=1793851127223, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925271543930, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1793851127212, updateTime=1793851127212, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925292515453, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=themeColor, value=null, createTime=1793851127217, updateTime=1793851127217, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925300904062, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=themeStyle, value=null, createTime=1793851127219, updateTime=1793851127219, creator=18614031015, updator=18614031015)])], journalTitle=计算机研究与发展, weixinUrl=null, journalUrl=https://crad.ict.ac.cn/, iacademicId=null, status=1, seqNo=null, journalTitleEn=Journal of Computer Research and Development, journalPhotoCn=k2l8zgqwstuxxevFX2qxVA==, journalPhotoEn=r6k0Ry+RD+c/VXj5QarmDw==, journalFirstLetter=J, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/10.7544/issn1000-1239.202330966, detailUrlEn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330966, pdfUrlCn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/PDF/10.7544/issn1000-1239.202330966, pdfUrlEn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/PDF/10.7544/issn1000-1239.202330966, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=1, orderTime=1714492800000, fullTextJson=null, articleText=null, reference=null)