Article(id=1327013272512999525, tenantId=1146029695717560320, journalId=1324759914146529478, issueId=1327013054811845282, articleNumber=null, orderNo=null, doi=10.7544/issn1000-1239.202330669, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=research-article, receivedDate=1692547200000, receivedDateStr=2023-08-21, revisedDate=1736352000000, revisedDateStr=2025-01-09, acceptedDate=1737820800000, acceptedDateStr=2025-01-26, onlineDate=1794314218881, onlineDateStr=2026-11-10, pubDate=1751299200000, pubDateStr=2025-07-01, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1794314218881, onlineIssueDateStr=2026-11-10, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1794314218881, creator=13701087609, updateTime=1794314218881, updator=13701087609, issue=Issue{id=1327013054811845282, tenantId=1146029695717560320, journalId=1324759914146529478, year='2025', volume='62', issue='7', pageStart='1595', pageEnd='1832', issueExtLink='null', onlineDate='null', pubDate='1751299200000', pubDateStr='2025-07-01', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1794314166977, creator='13701087609', updateTime=1794376853183, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext={EN=IssueExt(id=1327275980453950013, tenantId=1146029695717560320, journalId=1324759914146529478, issueId=1327013054811845282, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1327275980453950014, tenantId=1146029695717560320, journalId=1324759914146529478, issueId=1327013054811845282, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null, downloadFileDto=null}, startPage=1786, endPage=1796, ext={EN=ArticleExt(id=1327013272752074854, articleId=1327013272512999525, tenantId=1146029695717560320, journalId=1324759914146529478, language=EN, title=Perceptual Image Authentication Hashing Based on Window Self-Attention Feature Fusion, columnId=1327013252946572224, journalTitle=Journal of Computer Research and Development, columnName=Graphics and Image Processing, runingTitle=null, highlight=null, articleAbstract=

With the rapid development of multimedia and network technology, the security of digital image content is becoming more and more prominent. In this paper, we propose a deep perceptual image authentication hashing scheme based on window self-attention feature fusion, which can effectively detect whether the perceptual content of the original image has changed. It can be applied to content authentication, tampering recognition, copy detection, and other similar scenarios. This scheme uses a convolutional neural network architecture that integrates a window self-attention mechanism to build a hashing model that encompasses global and local image features. The scheme chunks the shallow features obtained from the backbone network and extracts the corresponding window features, then calculates the correlation between each intermediate local feature and the global feature to filter out the final local features, and finally inputs the local features and global features into the Hash generation module for fusion and compression to obtain the final image Hash code. In the training process, an integrated loss function based on Hash loss and classification loss is used to constrain the model to improve the robustness and discrimination. The experimental results show that this scheme can achieve superior image content authentication performance compared with existing typical perceptual authentication hashing schemes.

, authors=Yuanding Zhou, Guopeng Gao, Yaodong Fang, Chuan Qin*, authorsList=Yuanding Zhou, Guopeng Gao, Yaodong Fang, Chuan Qin, authorCompany=null, correspAuthors=Chuan Qin, authorNote=

born in 1997. PhD candidate. His main research interests include deep perceptual hashing and multimedia information processing

born in 1998. Master. His main research interest includes perceptual image hashing

born in 1997. Master. His main research interests include perceptual image hashing and image authentication

born in 1980. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include multimedia information security and AI security

, correspAuthorsNote=null, copyrightStatement=Copyright © 2025 Journal of Computer Research and Development. All rights reserved., copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1327013276937990272, articleId=1327013272512999525, tenantId=1146029695717560320, journalId=1324759914146529478, language=CN, title=基于窗口自注意力特征融合的感知图像认证哈希, columnId=1327013253131121602, journalTitle=计算机研究与发展, columnName=图形图像处理, runingTitle=null, highlight=null, articleAbstract=

随着多媒体和互联网技术的快速发展,数字图像内容的安全性问题日益突出. 为此,提出了一种基于窗口自注意力特征融合的深度感知图像认证哈希方案,该方案能有效检测原始图像的感知内容是否发生变化,并可应用于内容认证、复制检测、篡改识别等场合. 该方案以卷积神经网络为基础,利用窗口自注意力构建了一个融合图像全局和局部特征的哈希模型. 模型首先对主干网络获得的浅层特征进行分块并提取相应的窗口特征,然后计算每个局部特征与全局特征之间的相关性来筛选出最终的局部特征,再将这部分特征和全局特征输入到哈希生成模块中进行融合与压缩,得到最终的图像哈希码. 在训练过程中,利用哈希损失和分类损失构造的联合损失函数对模型进行约束,提高感知认证哈希方案的鲁棒性和唯一性. 实验结果表明,与现有典型的感知认证哈希方案相比,所提方案可获得更优的图像内容认证性能.

, authors=周元鼎, 高国鹏, 房耀东, 秦川*, authorsList=周元鼎, 高国鹏, 房耀东, 秦川, authorCompany=null, correspAuthors=秦川, authorNote=

1997年生. 博士研究生. 主要研究方向为深度感知哈希、多媒体信息处理

1998年生. 硕士. 主要研究方向为感知图像哈希

1997年生. 硕士. 主要研究方向为感知图像哈希、图像认证

1980年生. 博士,教授,博士生导师. CCF高级会员. 主要研究方向为多媒体信息安全、AI安全

, correspAuthorsNote=
秦川()
, copyrightStatement=版权所有 © 2025 计算机研究与发展编辑部, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=gG+Ih78LGOFv7xgHMkbBsQ==, magXml=VxpJv2LyANT00r6htA+r2A==, pdfUrl=null, pdf=8rCkn//vUrI35n0NxreKsg==, pdfFileSize=2283291, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=iKWeVPLDE1AIkxpVgvY8ag==, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=KsEdomBpkQguAVBNc6bauA==, mapNumber=null, fund=null)}, authors=[Author(id=1327013277470666885, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=221240081@st.usst.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1327013277550358663, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277470666885, language=EN, stringName=Yuanding Zhou, firstName=Yuanding, middleName=null, lastName=Zhou, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, bio={"content":"

born in 1997. PhD candidate. His main research interests include deep perceptual hashing and multimedia information processing

"}, bioImg=null, bioContent=

born in 1997. PhD candidate. His main research interests include deep perceptual hashing and multimedia information processing

, aboutCorrespAuthor=null), CN=AuthorExt(id=1327013277659410568, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277470666885, language=CN, stringName=周元鼎, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=上海理工大学光电信息与计算机工程学院 上海 200093, bio={"img":"Bj7j5zecaEG1EX7vEYbqHQ==","content":"

1997年生. 博士研究生. 主要研究方向为深度感知哈希、多媒体信息处理

"}, bioImg=Bj7j5zecaEG1EX7vEYbqHQ==, bioContent=

1997年生. 博士研究生. 主要研究方向为深度感知哈希、多媒体信息处理

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1327013277328060545, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, xref=null, ext=[AuthorCompanyExt(id=1327013277340643458, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093), AuthorCompanyExt(id=1327013277349032067, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海理工大学光电信息与计算机工程学院 上海 200093)])]), Author(id=1327013277726519434, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1327013277802016908, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277726519434, language=EN, stringName=Guopeng Gao, firstName=Guopeng, middleName=null, lastName=Gao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, bio={"content":"

born in 1998. Master. His main research interest includes perceptual image hashing

"}, bioImg=null, bioContent=

born in 1998. Master. His main research interest includes perceptual image hashing

, aboutCorrespAuthor=null), CN=AuthorExt(id=1327013277885902989, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277726519434, language=CN, stringName=高国鹏, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=上海理工大学光电信息与计算机工程学院 上海 200093, bio={"img":"caHSlF1z4TjQN/kuK1lg6Q==","content":"

1998年生. 硕士. 主要研究方向为感知图像哈希

"}, bioImg=caHSlF1z4TjQN/kuK1lg6Q==, bioContent=

1998年生. 硕士. 主要研究方向为感知图像哈希

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1327013277328060545, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, xref=null, ext=[AuthorCompanyExt(id=1327013277340643458, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093), AuthorCompanyExt(id=1327013277349032067, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海理工大学光电信息与计算机工程学院 上海 200093)])]), Author(id=1327013277953011855, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1327013279639122065, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277953011855, language=EN, stringName=Yaodong Fang, firstName=Yaodong, middleName=null, lastName=Fang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, bio={"content":"

born in 1997. Master. His main research interests include perceptual image hashing and image authentication

"}, bioImg=null, bioContent=

born in 1997. Master. His main research interests include perceptual image hashing and image authentication

, aboutCorrespAuthor=null), CN=AuthorExt(id=1327013279806894226, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277953011855, language=CN, stringName=房耀东, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=上海理工大学光电信息与计算机工程学院 上海 200093, bio={"img":"dH6MqOqQ7Ra6AwMKBQP5UQ==","content":"

1997年生. 硕士. 主要研究方向为感知图像哈希、图像认证

"}, bioImg=dH6MqOqQ7Ra6AwMKBQP5UQ==, bioContent=

1997年生. 硕士. 主要研究方向为感知图像哈希、图像认证

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1327013277328060545, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, xref=null, ext=[AuthorCompanyExt(id=1327013277340643458, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093), AuthorCompanyExt(id=1327013277349032067, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海理工大学光电信息与计算机工程学院 上海 200093)])]), Author(id=1327013279886586004, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=qin@usst.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1327013279983054998, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013279886586004, language=EN, stringName=Chuan Qin, firstName=Chuan, middleName=null, lastName=Qin, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=*, address=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, bio={"content":"

born in 1980. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include multimedia information security and AI security

"}, bioImg=null, bioContent=

born in 1980. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include multimedia information security and AI security

, aboutCorrespAuthor=null), CN=AuthorExt(id=1327013280062746775, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013279886586004, language=CN, stringName=秦川, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=*, address=上海理工大学光电信息与计算机工程学院 上海 200093, bio={"img":"8HcnicuSFbbNseT0y85Zdw==","content":"

1980年生. 博士,教授,博士生导师. CCF高级会员. 主要研究方向为多媒体信息安全、AI安全

"}, bioImg=8HcnicuSFbbNseT0y85Zdw==, bioContent=

1980年生. 博士,教授,博士生导师. CCF高级会员. 主要研究方向为多媒体信息安全、AI安全

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1327013277328060545, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, xref=null, ext=[AuthorCompanyExt(id=1327013277340643458, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093), AuthorCompanyExt(id=1327013277349032067, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海理工大学光电信息与计算机工程学院 上海 200093)])])], keywords=[Keyword(id=1327013280188575897, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, orderNo=1, keyword=perceptual hashing), Keyword(id=1327013280272461978, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, orderNo=2, keyword=image authentication), Keyword(id=1327013280347959451, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, orderNo=3, keyword=window self-attention), Keyword(id=1327013280457011356, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, orderNo=4, keyword=feature fusion), Keyword(id=1327013280528314525, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, orderNo=5, keyword=robustness), Keyword(id=1327013280595423390, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, orderNo=1, keyword=感知哈希), Keyword(id=1327013280746418335, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, orderNo=2, keyword=图像认证), Keyword(id=1327013280847081632, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, orderNo=3, keyword=窗口自注意力), Keyword(id=1327013280930967713, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, orderNo=4, keyword=特征融合), Keyword(id=1327013281098739874, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, orderNo=5, keyword=鲁棒性)], refs=[Reference(id=1327013285154631868, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=1, rfOrder=0, authorNames=null, journalName=null, refType=null, unstructuredReference=Yan Caiping, Pun Chiman, Yuan Xiaochen. Multi-scale image hashing using adaptive local feature extraction for robust tampering detection[J]. Signal Processing, 2016, 121(C): 1−16, articleTitle=null, refAbstract=null), Reference(id=1327013285314015421, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=2, rfOrder=1, authorNames=null, journalName=null, refType=null, unstructuredReference=Su Qingtang, Liu Decheng, Sun Yehan. A robust adaptive blind color image watermarking for resisting geometric attacks[J]. Information Sciences: An International Journal, 2022, 606: 194−212, articleTitle=null, refAbstract=null), Reference(id=1327013285414678718, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=3, rfOrder=2, authorNames=null, journalName=null, refType=null, unstructuredReference=朱新山,陈砚鸣,董宏辉,等. 基于双域信息融合的鲁棒二值文本图像水印[J]. 计算机学报,2014,37(6):1352−1364, articleTitle=null, refAbstract=null), Reference(id=1327013285544702143, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=3, rfOrder=3, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhu Xinshan, Chen Yanming, Dong Honghui, et al. Robust double domain watermarking for binary document image[J]. Chinese Journal of Computers, 2014, 37(6): 1352−1364 (in Chinese), articleTitle=null, refAbstract=null), Reference(id=1327013285628588224, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=4, rfOrder=4, authorNames=null, journalName=null, refType=null, unstructuredReference=Liao Xin, Li Kaide, Zhu Xinshan, et al. Robust detection of image operator chain with two-stream convolutional neural network[J]. IEEE Journal of Selected Topics in Signal Processing, 2020, 14(5): 955−968, articleTitle=null, refAbstract=null), Reference(id=1327013285720862913, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=5, rfOrder=5, authorNames=null, journalName=null, refType=null, unstructuredReference=彭安杰,康显桂. 基于滤波残差多方向差分的中值滤波取证技术[J]. 计算机学报,2016,39(3):503−515, articleTitle=null, refAbstract=null), Reference(id=1327013285804748994, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=5, rfOrder=6, authorNames=null, journalName=null, refType=null, unstructuredReference=Peng Anjie, Kang Xiangui. Median filtering forensics based on multi-directional difference of filtering residuals[J]. Chinese Journal of Computers, 2016, 39((3): ): 503−515 (in Chinese), articleTitle=null, refAbstract=null), Reference(id=1327013285884440771, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=6, rfOrder=7, authorNames=null, journalName=null, refType=null, unstructuredReference=Shen Qi, Zhao Yan. Perceptual hashing for color image based on color opponent component and quadtree structure[J]. Signal Processing, 2020, 166: 107244, articleTitle=null, refAbstract=null), Reference(id=1327013285964132548, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=7, rfOrder=8, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhang Qiuyu, Han Jitian. A novel color image encryption algorithm based on image hashing, 6D hyperchaotic and DNA coding[J]. Multimedia Tools and Applications, 2021, 80(9): 13841−13864, articleTitle=null, refAbstract=null), Reference(id=1327013286039630021, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=8, rfOrder=9, authorNames=null, journalName=null, refType=null, unstructuredReference=秦川,郭梦琦,李欣然,等. 一种加密域鲁棒图像哈希算法[J]. 软件学报,2023,34(2):868−883, articleTitle=null, refAbstract=null), Reference(id=1327013286182236358, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=8, rfOrder=10, authorNames=null, journalName=null, refType=null, unstructuredReference=Qin Chuan, Guo Mengqi, Li Xinran, et al. Robust image hashing in encrypted domain[J]. Journal of Software, 2023, 34(2): 868−883 (in Chinese), articleTitle=null, refAbstract=null), Reference(id=1327013286350008519, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=9, rfOrder=11, authorNames=null, journalName=null, refType=null, unstructuredReference=Huang Ziqing, Liu Shiguang. Perceptual image hashing with texture and invariant vector distance for copy detection[J]. IEEE Transactions on Multimedia, 2020, 23: 1516−1529, articleTitle=null, refAbstract=null), Reference(id=1327013286610055369, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=10, rfOrder=12, authorNames=null, journalName=null, refType=null, unstructuredReference=Huang Ziqing, Tang Zhenjun, Zhang Xianquan, et al. Perceptual image hashing with locality preserving projection for copy detection[J]. IEEE Transactions on Dependable and Secure Computing, 2023, 20(1): 463−477, articleTitle=null, refAbstract=null), Reference(id=1327013286773633226, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=11, rfOrder=13, authorNames=null, journalName=null, refType=null, unstructuredReference=Du Ling, Ho A T S, Cong Runmin. Perceptual hashing for image authentication: A survey[J]. Signal Processing: Image Communication, 2020, 81: 115713, articleTitle=null, refAbstract=null), Reference(id=1327013286974959820, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=12, rfOrder=14, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Xinran, Qin Chuan, Wang Zichi, et al. Unified performance evaluation method for perceptual image hashing[J]. IEEE Transactions on Information Forensics and Security, 2022, 17: 1404−1419, articleTitle=null, refAbstract=null), Reference(id=1327013288640098509, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=13, rfOrder=15, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Xiaoqing, Yang Jiansheng, Ma Jinwen. Recent developments of content-based image retrieval (CBIR)[J]. Neurocomputing, 2021, 452: 675−689, articleTitle=null, refAbstract=null), Reference(id=1327013288749150414, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=14, rfOrder=16, authorNames=null, journalName=null, refType=null, unstructuredReference=Ouyang Junlin, Liu Yizhi, Shu Huazhong. Robust hashing for image authentication using SIFT feature and quaternion Zernike moments[J]. Multimedia Tools and Applications, 2017, 76(2): 2609−2626, articleTitle=null, refAbstract=null), Reference(id=1327013288900145359, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=15, rfOrder=17, authorNames=null, journalName=null, refType=null, unstructuredReference=Singh S P, Bhatnagar G, Singh A K. A new robust reference image hashing system[J]. IEEE Transactions on Dependable and Secure Computing, 2022, 19(4): 2211−2225, articleTitle=null, refAbstract=null), Reference(id=1327013288984031440, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=16, rfOrder=18, authorNames=null, journalName=null, refType=null, unstructuredReference=Srivastava M, Siddiqui J, Ali M A. Robust image hashing based on statistical features for copy detection[C]//Proc of the IEEE Uttar Pradesh Section Int Conf on Electrical, Computer and Electronics Engineering (UPCON’16). Piscataway, NJ: IEEE, 2016: 490−495, articleTitle=null, refAbstract=null), Reference(id=1327013289093083345, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=17, rfOrder=19, authorNames=null, journalName=null, refType=null, unstructuredReference=Qin Chuan, Chang C C, Tsou P L. Robust image hashing using non-uniform sampling in discrete Fourier domain[J]. Digital Signal Processing, 2013, 23(2): 578−585, articleTitle=null, refAbstract=null), Reference(id=1327013289168580818, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=18, rfOrder=20, authorNames=null, journalName=null, refType=null, unstructuredReference=Abdullahi S M, Wang Hongxia, Li Tao. Fractal coding-based robust and alignment-free fingerprint image hashing[J]. IEEE Transactions on Information Forensics and Security, 2020, 15: 2587−2601, articleTitle=null, refAbstract=null), Reference(id=1327013289269244115, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=19, rfOrder=21, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Yuenan, Wang Dongdong, Tang Linlin. Robust and secure image fingerprinting learned by neural network[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2019, 30(2): 362−375, articleTitle=null, refAbstract=null), Reference(id=1327013289361518804, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=20, rfOrder=22, authorNames=null, journalName=null, refType=null, unstructuredReference=Qin Chuan, Liu Enli, Feng Guorui, et al. Perceptual image hashing for content authentication based on convolutional neural network with multiple constraints[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 31(11): 4523−4537, articleTitle=null, refAbstract=null), Reference(id=1327013289499930837, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=21, rfOrder=23, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhang Han, Goodfellow I, Metaxas D, et al. Self-attention generative adversarial networks [C] //Proc of the 36th Int Conf on Machine Learning. New York: ICML, 2019: 7354−7363, articleTitle=null, refAbstract=null), Reference(id=1327013289596399830, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=22, rfOrder=24, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Zhihui, Wang Shijie, Zhang Pengbo, et al. Weakly supervised fine-grained image classification via correlation-guided discriminative learning [C] //Proc of the 27th ACM Int Conf on Multimedia. New York: ACM, 2019: 1851−1860, articleTitle=null, refAbstract=null), Reference(id=1327013289705451735, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=23, rfOrder=25, authorNames=null, journalName=null, refType=null, unstructuredReference=Cao Bingyi, Araujo A, Sim J. Unifying deep local and global features for image search [C] //Proc of the 16th European Conf on Computer Vision. Berlin: Springer, 2020: 726−743, articleTitle=null, refAbstract=null), Reference(id=1327013289822892248, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=24, rfOrder=26, authorNames=null, journalName=null, refType=null, unstructuredReference=Hjelm R D, Fedorov A, Lavoie-Marchildon S, et al. Learning deep representations by mutual information estimation and maximization [C] //Proc of the 7th Int Conf on Learning Representations. Washington, DC: ICLR, 2019: 9153−9176, articleTitle=null, refAbstract=null), Reference(id=1327013289948721369, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=25, rfOrder=27, authorNames=null, journalName=null, refType=null, unstructuredReference=Lin T Y, Maire M, Belongie S, et al. Microsoft coco: Common objects in context[C]//Proc of the 10th European Conf on Computer Vision. Berlin: Springer, 2014: 740−755, articleTitle=null, refAbstract=null), Reference(id=1327013290049384666, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=26, rfOrder=28, authorNames=null, journalName=null, refType=null, unstructuredReference=Selvaraju R R, Cogswell M, Das A, et al. Grad-CAM: Visual explanations from deep networks via gradient-based localization[C]//Proc of the 15th IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2017: 618−626, articleTitle=null, refAbstract=null), Reference(id=1327013290120687835, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=27, rfOrder=29, authorNames=null, journalName=null, refType=null, unstructuredReference=Douze M, Tolias G, Pizzi E, et al. The 2021 image similarity dataset and challenge [J]. arXiv preprint, arXiv: 2106.09672, 2021, articleTitle=null, refAbstract=null), Reference(id=1327013290229739740, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=28, rfOrder=30, authorNames=null, journalName=null, refType=null, unstructuredReference=Tang Zhenjun, Zhang Xianquan, Li Xianxian, et al. Robust image hashing with ring partition and invariant vector distance[J]. IEEE Transactions on Information Forensics and Security, 2015, 11(1): 200−214, articleTitle=null, refAbstract=null), Reference(id=1327013290296848605, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=29, rfOrder=31, authorNames=null, journalName=null, refType=null, unstructuredReference=Tang Zhenjun, Zhang Xianquan, Huang Liyan, et al. Robust image hashing using ring-based entropies[J]. Signal Processing, 2013, 93(7): 2061−2069, articleTitle=null, refAbstract=null), Reference(id=1327013290368151774, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=30, rfOrder=32, authorNames=null, journalName=null, refType=null, unstructuredReference=Qin Chuan, Chen Xueqin, Luo Xiangyang, et al. Perceptual image hashing via dual-cross pattern encoding and salient structure detection[J]. Information Sciences, 2018, 423: 284−302, articleTitle=null, refAbstract=null)], funds=null, companyList=[AuthorCompany(id=1327013277328060545, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, xref=null, ext=[AuthorCompanyExt(id=1327013277340643458, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093), AuthorCompanyExt(id=1327013277349032067, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海理工大学光电信息与计算机工程学院 上海 200093)])], figs=[ArticleFig(id=1327013281216180387, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Figure 1, caption=Network architecture of our PAH method, figureFileSmall=6Fz+VmQGxxBj3zwFADky5g==, figureFileBig=iKWeVPLDE1AIkxpVgvY8ag==, tableContent=null), ArticleFig(id=1327013281337815204, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=图1, caption=本文PAH方法的网络架构, figureFileSmall=6Fz+VmQGxxBj3zwFADky5g==, figureFileBig=iKWeVPLDE1AIkxpVgvY8ag==, tableContent=null), ArticleFig(id=1327013281576890533, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Figure 2, caption=Illustration of the window self-attention module, figureFileSmall=HtFvhGqgzex39gxEYy6bYA==, figureFileBig=Ln9B4qw6zBTyWH2WySnuKg==, tableContent=null), ArticleFig(id=1327013281660776614, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=图2, caption=窗口自注意力模块示意图, figureFileSmall=HtFvhGqgzex39gxEYy6bYA==, figureFileBig=Ln9B4qw6zBTyWH2WySnuKg==, tableContent=null), ArticleFig(id=1327013281723691175, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Figure 3, caption=ROC curves of the models with different parameter settings, figureFileSmall=IwncyL+LYYLedB/KfXQgFA==, figureFileBig=EAWY2UVzk7UZiF0/n+zG5A==, tableContent=null), ArticleFig(id=1327013281794994344, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=图3, caption=不同参数设置下模型的ROC曲线, figureFileSmall=IwncyL+LYYLedB/KfXQgFA==, figureFileBig=EAWY2UVzk7UZiF0/n+zG5A==, tableContent=null), ArticleFig(id=1327013281853714601, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Figure 4, caption=Characteristic heat maps at different window sizes, figureFileSmall=A8KderTpW/WVE0hY0uEwlg==, figureFileBig=aJgx+N8iaRI7dnOv6CZTpw==, tableContent=null), ArticleFig(id=1327013281920823466, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=图4, caption=不同窗口尺寸下的特征热力图, figureFileSmall=A8KderTpW/WVE0hY0uEwlg==, figureFileBig=aJgx+N8iaRI7dnOv6CZTpw==, tableContent=null), ArticleFig(id=1327013281979543723, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Figure 5, caption=Standard test images in the UCS-SIPI image dataset, figureFileSmall=RtCpnqbZeC13Y8Otb2JmPA==, figureFileBig=2zPDpPHSitLIRh9N8YSPdQ==, tableContent=null), ArticleFig(id=1327013282046652588, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=图5, caption=UCS-SIPI图像数据集中的标准测试图像, figureFileSmall=RtCpnqbZeC13Y8Otb2JmPA==, figureFileBig=2zPDpPHSitLIRh9N8YSPdQ==, tableContent=null), ArticleFig(id=1327013282105372845, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Figure 6, caption=Hash distance curve diagrams of six test images under different content-preserving manipulations, figureFileSmall=gHyZS/ziL+wNMkNioEr1iA==, figureFileBig=yIh0Jp3B7wOgiE9oc+md6g==, tableContent=null), ArticleFig(id=1327013282159898798, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=图6, caption=6张测试图像在不同内容保留操作下的哈希距离曲线图, figureFileSmall=gHyZS/ziL+wNMkNioEr1iA==, figureFileBig=yIh0Jp3B7wOgiE9oc+md6g==, tableContent=null), ArticleFig(id=1327013282218619055, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Figure 7, caption=Comparison of content authentication performance of different PAH schemes, figureFileSmall=6VqVKRu+O5gYAaQpmEQ+CQ==, figureFileBig=RTEuv9VRyyFe8kB7T1akAw==, tableContent=null), ArticleFig(id=1327013282294116528, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=图7, caption=不同PAH方案的内容认证性能比较, figureFileSmall=6VqVKRu+O5gYAaQpmEQ+CQ==, figureFileBig=RTEuv9VRyyFe8kB7T1akAw==, tableContent=null), ArticleFig(id=1327013282357031089, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Figure 8, caption=Content authentication performance under different strategies, figureFileSmall=r/GJzWakcC0yRGBIhsVAxw==, figureFileBig=cIuh2cBkVbvcY3gWibr3/w==, tableContent=null), ArticleFig(id=1327013282419945650, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=图8, caption=不同策略下的内容认证性能, figureFileSmall=r/GJzWakcC0yRGBIhsVAxw==, figureFileBig=cIuh2cBkVbvcY3gWibr3/w==, tableContent=null), ArticleFig(id=1327013284131221683, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Table 1, caption=Image Content-Preserving Manipulations and Its Parameters, figureFileSmall=null, figureFileBig=null, tableContent=
类型操作参数数量
几何操作旋转旋转角度:5°,10°,15°,30°,45°5
翻转方向:水平,垂直,水平+垂直,垂直+水平4
缩放缩放比例:0.2,0.4,0.6,24
增强操作高斯噪声方差:0.01,0.02,0.03,0.04,0.05,0.06,0.07,0.088
JPEG压缩压缩因子:10,20,30,40,50,706
高斯模糊模糊半径:1,2,3,4,5,6,7,8,99
亮度调整亮度因子:0.6,0.7,0.8,0.9,1.1,1.2,1.3,1.48
锐化锐化因子:[0.1, 5]内的随机数1
像素化像素化比例:[0.2, 0.5]内的随机数1
滤波分类:中值滤波,细节滤波,平滑滤波,模式滤波4
色彩空间调整色彩空间:HSV色彩空间、YCbCr色彩空间2
编辑操作边框叠加边框颜色:白色,黑色; 边框宽度:0.01,0.05,0.16
组合操作组合操作1亮度因子:随机;对比度因子:随机1
组合操作2JPEG压缩因子:70;高斯噪声方差:0.007;高斯模糊半径:0.7;旋转角度:5°;亮度因子:0.91
组合操作3JPEG压缩因子:50;高斯噪声方差:0.007;高斯模糊半径:0.7;旋转角度:5°;对比度因子:1.11
组合操作4JPEG压缩因子:70;高斯噪声方差:0.007;高斯模糊半径:0.7;旋转角度:5°;像素化比例:随机1
), ArticleFig(id=1327013284231884980, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=表1, caption=

图像内容保留操作及其参数

, figureFileSmall=null, figureFileBig=null, tableContent=
类型操作参数数量
几何操作旋转旋转角度:5°,10°,15°,30°,45°5
翻转方向:水平,垂直,水平+垂直,垂直+水平4
缩放缩放比例:0.2,0.4,0.6,24
增强操作高斯噪声方差:0.01,0.02,0.03,0.04,0.05,0.06,0.07,0.088
JPEG压缩压缩因子:10,20,30,40,50,706
高斯模糊模糊半径:1,2,3,4,5,6,7,8,99
亮度调整亮度因子:0.6,0.7,0.8,0.9,1.1,1.2,1.3,1.48
锐化锐化因子:[0.1, 5]内的随机数1
像素化像素化比例:[0.2, 0.5]内的随机数1
滤波分类:中值滤波,细节滤波,平滑滤波,模式滤波4
色彩空间调整色彩空间:HSV色彩空间、YCbCr色彩空间2
编辑操作边框叠加边框颜色:白色,黑色; 边框宽度:0.01,0.05,0.16
组合操作组合操作1亮度因子:随机;对比度因子:随机1
组合操作2JPEG压缩因子:70;高斯噪声方差:0.007;高斯模糊半径:0.7;旋转角度:5°;亮度因子:0.91
组合操作3JPEG压缩因子:50;高斯噪声方差:0.007;高斯模糊半径:0.7;旋转角度:5°;对比度因子:1.11
组合操作4JPEG压缩因子:70;高斯噪声方差:0.007;高斯模糊半径:0.7;旋转角度:5°;像素化比例:随机1
), ArticleFig(id=1327013284345131189, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Table 2, caption=Statistics of Hash Distance Between Perceptual Identical Images, figureFileSmall=null, figureFileBig=null, tableContent=
操作最大值最小值均值标准差
旋转2.59230.00010.03620.1168
翻转1.94280.00020.03640.1138
缩放0.459300.00580.0209
高斯模糊1.737500.01440.0552
锐化0.500400.00280.0231
滤波0.082300.00050.0023
像素化0.084600.00140.0056
高斯噪声0.34390.00020.01070.0230
亮度调整3.06080.00020.02730.1038
JPEG压缩3.034300.01060.0930
色彩空间调整0.051500.00080.0022
边框叠加0.27660.00010.00700.0164
组合操作4.06780.00030.05070.2310
), ArticleFig(id=1327013284441600182, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=表2, caption=

感知相似图像之间哈希距离的统计

, figureFileSmall=null, figureFileBig=null, tableContent=
操作最大值最小值均值标准差
旋转2.59230.00010.03620.1168
翻转1.94280.00020.03640.1138
缩放0.459300.00580.0209
高斯模糊1.737500.01440.0552
锐化0.500400.00280.0231
滤波0.082300.00050.0023
像素化0.084600.00140.0056
高斯噪声0.34390.00020.01070.0230
亮度调整3.06080.00020.02730.1038
JPEG压缩3.034300.01060.0930
色彩空间调整0.051500.00080.0022
边框叠加0.27660.00010.00700.0164
组合操作4.06780.00030.05070.2310
), ArticleFig(id=1327013284655509688, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Table 3, caption=Accuracy of Perceptual Identical and Distinct Images under Different Thresholds T, figureFileSmall=null, figureFileBig=null, tableContent=
阈值 TΓsim /%Γdif /%
注:黑体数值表示最优值.
0.795.8098.19
0.896.4197.64
0.997.1497.10
1.097.5196.59
1.198.0096.09
1.298.2095.61
1.398.6195.16
1.499.1094.71
1.599.1094.28
1.699.3193.85
1.799.3193.44
), ArticleFig(id=1327013284781338809, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=表3, caption=

不同阈值T下感知相似和不相似图像的正确率

, figureFileSmall=null, figureFileBig=null, tableContent=
阈值 TΓsim /%Γdif /%
注:黑体数值表示最优值.
0.795.8098.19
0.896.4197.64
0.997.1497.10
1.097.5196.59
1.198.0096.09
1.298.2095.61
1.398.6195.16
1.499.1094.71
1.599.1094.28
1.699.3193.85
1.799.3193.44
), ArticleFig(id=1327013284865224890, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=EN, label=Table 4, caption=Time of Generating Hash Sequence for Different PAH Schemes ms, figureFileSmall=null, figureFileBig=null, tableContent=
方案平均时间
本文方案0.45
RE43.82
RPIVD143.84
DCP181.63
MCCNN0.43
), ArticleFig(id=1327013284957499579, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, language=CN, label=表4, caption=

不同PAH方案生成哈希序列的时间

, figureFileSmall=null, figureFileBig=null, tableContent=
方案平均时间
本文方案0.45
RE43.82
RPIVD143.84
DCP181.63
MCCNN0.43
)], attaches=null, journal=Journal(id=1324759606947315908, delFlag=0, nameCn=计算机研究与发展, nameEn=Journal of Computer Research and Development, nameHistory1=null, nameHistory2=null, issn=1000-1239, eissn=null, cn=11-1777/TP, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=k2l8zgqwstuxxevFX2qxVA==, journalPrice=null, startedYear=null, abbrevIsoEn=Journal of Computer Research and Development, journalRemark=null, publicationField=null, createdTime=1793776903141, updatedTime=1793850698612, createdBy=18614031015, updatedBy=13701087609, firstLetterCn=J, firstLetterEn=J, subjectCode=Electronic Information, subjectName=null, subjectCodeEn=Electronic Information, subjectNameEn=null, picCn=k2l8zgqwstuxxevFX2qxVA==, picEn=r6k0Ry+RD+c/VXj5QarmDw==, jcr=null, cjcr=null, exts=[JournalExt(id=1325069127710286688, language=CN, name=计算机研究与发展, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1793850698640, updatedTime=1793850698640, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://crad.ict.ac.cn/journalx/authorLogOn.action, submissionEditorUrl=https://crad.ict.ac.cn/journalx/editorLogOn.action, submissionReviewUrl=https://crad.ict.ac.cn/journalx/expertLogOn.action, submissionCeEditorUrl=https://crad.ict.ac.cn/journalx/editorInChiefLogOn.action, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1325069127777395553, language=EN, name=Journal of Computer Research and Development, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1793850698656, updatedTime=1793850698656, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://crad.ict.ac.cn/journalx/authorLogOn.action, submissionEditorUrl=https://crad.ict.ac.cn/journalx/editorLogOn.action, submissionReviewUrl=https://crad.ict.ac.cn/journalx/expertLogOn.action, submissionCeEditorUrl=https://crad.ict.ac.cn/journalx/editorInChiefLogOn.action, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1324759914146529478, websiteList=[Website(id=1325070300139892771, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1324759914146529478, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN, language=CN, createTime=1793850978169, createBy=18614031015, updateTime=1793851040259, updateBy=18614031015, name=计算机研究与发展-中文, tplId=1146099689490845704, title=计算机研究与发展, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1325070893751349360, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=articleTextType, value=kx, createTime=1793851119697, updateTime=1793851119697, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893730377837, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=banner, value=null, createTime=1793851119692, updateTime=1793851119692, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893772320883, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=grayFlag, value=0, createTime=1793851119702, updateTime=1793851119702, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893721989228, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=logo, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/file/pic?fileId=U27tDsy717YF7XSPA+Vwdw==, createTime=1793851119690, updateTime=1793851119690, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893784903797, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=minRunFlag, value=0, createTime=1793851119705, updateTime=1793851119705, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893742960751, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/file/pic, createTime=1793851119695, updateTime=1793851119695, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893780709492, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=silenceFlag, value=0, createTime=1793851119704, updateTime=1793851119704, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893738766446, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1793851119694, updateTime=1793851119694, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893755543665, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=themeColor, value=null, createTime=1793851119698, updateTime=1793851119698, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893763932274, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=themeStyle, value=null, createTime=1793851119700, updateTime=1793851119700, creator=18614031015, updator=18614031015)]), Website(id=1325070300580294698, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1324759914146529478, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN, language=EN, createTime=1793850978274, createBy=18614031015, updateTime=1793851036638, updateBy=18614031015, name=计算机研究与发展-英文, tplId=1146101810881728533, title=Journal of Computer Research and Development, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1325070925288321148, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=articleTextType, value=kx, createTime=1793851127216, updateTime=1793851127216, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925263155321, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=banner, value=null, createTime=1793851127210, updateTime=1793851127210, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925309292671, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=grayFlag, value=0, createTime=1793851127221, updateTime=1793851127221, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925254766712, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=logo, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/file/pic?fileId=U27tDsy717YF7XSPA+Vwdw==, createTime=1793851127208, updateTime=1793851127208, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925326069889, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=minRunFlag, value=0, createTime=1793851127225, updateTime=1793851127225, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925279932539, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/file/pic, createTime=1793851127214, updateTime=1793851127214, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925317681280, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=silenceFlag, value=0, createTime=1793851127223, updateTime=1793851127223, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925271543930, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1793851127212, updateTime=1793851127212, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925292515453, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=themeColor, value=null, createTime=1793851127217, updateTime=1793851127217, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925300904062, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=themeStyle, value=null, createTime=1793851127219, updateTime=1793851127219, creator=18614031015, updator=18614031015)])], journalTitle=计算机研究与发展, weixinUrl=null, journalUrl=https://crad.ict.ac.cn/, iacademicId=null, status=1, seqNo=null, journalTitleEn=Journal of Computer Research and Development, journalPhotoCn=k2l8zgqwstuxxevFX2qxVA==, journalPhotoEn=r6k0Ry+RD+c/VXj5QarmDw==, journalFirstLetter=J, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/10.7544/issn1000-1239.202330669, detailUrlEn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202330669, pdfUrlCn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/PDF/10.7544/issn1000-1239.202330669, pdfUrlEn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/PDF/10.7544/issn1000-1239.202330669, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=1, orderTime=1751299200000, fullTextJson=null, articleText=null, reference=null)
收藏切换
基于窗口自注意力特征融合的感知图像认证哈希
周元鼎 , 高国鹏 , 房耀东 , 秦川 *
计算机研究与发展 | 图形图像处理 2025,62(7): 1786-1796
收起
收藏切换
计算机研究与发展 |图形图像处理 2025 , 62 (7) : 1786 -1796
基于窗口自注意力特征融合的感知图像认证哈希
全屏
[Author(id=1327013277470666885, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=221240081@st.usst.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1327013277550358663, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277470666885, language=EN, stringName=Yuanding Zhou, firstName=Yuanding, middleName=null, lastName=Zhou, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, bio={"content":"

born in 1997. PhD candidate. His main research interests include deep perceptual hashing and multimedia information processing

"}, bioImg=null, bioContent=

born in 1997. PhD candidate. His main research interests include deep perceptual hashing and multimedia information processing

, aboutCorrespAuthor=null), CN=AuthorExt(id=1327013277659410568, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277470666885, language=CN, stringName=周元鼎, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=上海理工大学光电信息与计算机工程学院 上海 200093, bio={"img":"Bj7j5zecaEG1EX7vEYbqHQ==","content":"

1997年生. 博士研究生. 主要研究方向为深度感知哈希、多媒体信息处理

"}, bioImg=Bj7j5zecaEG1EX7vEYbqHQ==, bioContent=

1997年生. 博士研究生. 主要研究方向为深度感知哈希、多媒体信息处理

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1327013277328060545, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, xref=null, ext=[AuthorCompanyExt(id=1327013277340643458, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093), AuthorCompanyExt(id=1327013277349032067, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海理工大学光电信息与计算机工程学院 上海 200093)])]), Author(id=1327013277726519434, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1327013277802016908, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277726519434, language=EN, stringName=Guopeng Gao, firstName=Guopeng, middleName=null, lastName=Gao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, bio={"content":"

born in 1998. Master. His main research interest includes perceptual image hashing

"}, bioImg=null, bioContent=

born in 1998. Master. His main research interest includes perceptual image hashing

, aboutCorrespAuthor=null), CN=AuthorExt(id=1327013277885902989, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277726519434, language=CN, stringName=高国鹏, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=上海理工大学光电信息与计算机工程学院 上海 200093, bio={"img":"caHSlF1z4TjQN/kuK1lg6Q==","content":"

1998年生. 硕士. 主要研究方向为感知图像哈希

"}, bioImg=caHSlF1z4TjQN/kuK1lg6Q==, bioContent=

1998年生. 硕士. 主要研究方向为感知图像哈希

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1327013277328060545, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, xref=null, ext=[AuthorCompanyExt(id=1327013277340643458, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093), AuthorCompanyExt(id=1327013277349032067, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海理工大学光电信息与计算机工程学院 上海 200093)])]), Author(id=1327013277953011855, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1327013279639122065, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277953011855, language=EN, stringName=Yaodong Fang, firstName=Yaodong, middleName=null, lastName=Fang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, bio={"content":"

born in 1997. Master. His main research interests include perceptual image hashing and image authentication

"}, bioImg=null, bioContent=

born in 1997. Master. His main research interests include perceptual image hashing and image authentication

, aboutCorrespAuthor=null), CN=AuthorExt(id=1327013279806894226, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013277953011855, language=CN, stringName=房耀东, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=上海理工大学光电信息与计算机工程学院 上海 200093, bio={"img":"dH6MqOqQ7Ra6AwMKBQP5UQ==","content":"

1997年生. 硕士. 主要研究方向为感知图像哈希、图像认证

"}, bioImg=dH6MqOqQ7Ra6AwMKBQP5UQ==, bioContent=

1997年生. 硕士. 主要研究方向为感知图像哈希、图像认证

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1327013277328060545, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, xref=null, ext=[AuthorCompanyExt(id=1327013277340643458, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093), AuthorCompanyExt(id=1327013277349032067, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海理工大学光电信息与计算机工程学院 上海 200093)])]), Author(id=1327013279886586004, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=qin@usst.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1327013279983054998, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013279886586004, language=EN, stringName=Chuan Qin, firstName=Chuan, middleName=null, lastName=Qin, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=*, address=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, bio={"content":"

born in 1980. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include multimedia information security and AI security

"}, bioImg=null, bioContent=

born in 1980. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include multimedia information security and AI security

, aboutCorrespAuthor=null), CN=AuthorExt(id=1327013280062746775, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, authorId=1327013279886586004, language=CN, stringName=秦川, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=*, address=上海理工大学光电信息与计算机工程学院 上海 200093, bio={"img":"8HcnicuSFbbNseT0y85Zdw==","content":"

1980年生. 博士,教授,博士生导师. CCF高级会员. 主要研究方向为多媒体信息安全、AI安全

"}, bioImg=8HcnicuSFbbNseT0y85Zdw==, bioContent=

1980年生. 博士,教授,博士生导师. CCF高级会员. 主要研究方向为多媒体信息安全、AI安全

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1327013277328060545, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, xref=null, ext=[AuthorCompanyExt(id=1327013277340643458, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093), AuthorCompanyExt(id=1327013277349032067, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1327013272512999525, companyId=1327013277328060545, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海理工大学光电信息与计算机工程学院 上海 200093)])])]
周元鼎 , 高国鹏, 房耀东, 秦川*
作者信息
  • 上海理工大学光电信息与计算机工程学院 上海 200093
通讯作者:
秦川()
作者简介:

1997年生. 博士研究生. 主要研究方向为深度感知哈希、多媒体信息处理

1998年生. 硕士. 主要研究方向为感知图像哈希

1997年生. 硕士. 主要研究方向为感知图像哈希、图像认证

1980年生. 博士,教授,博士生导师. CCF高级会员. 主要研究方向为多媒体信息安全、AI安全

Perceptual Image Authentication Hashing Based on Window Self-Attention Feature Fusion
Yuanding Zhou , Guopeng Gao, Yaodong Fang, Chuan Qin*
Affiliations
  • School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093
  • born in 1997. PhD candidate. His main research interests include deep perceptual hashing and multimedia information processing

    born in 1998. Master. His main research interest includes perceptual image hashing

    born in 1997. Master. His main research interests include perceptual image hashing and image authentication

    born in 1980. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include multimedia information security and AI security

出版时间: 2025-07-01 doi: 10.7544/issn1000-1239.202330669
文章导航
收藏切换

随着多媒体和互联网技术的快速发展,数字图像内容的安全性问题日益突出. 为此,提出了一种基于窗口自注意力特征融合的深度感知图像认证哈希方案,该方案能有效检测原始图像的感知内容是否发生变化,并可应用于内容认证、复制检测、篡改识别等场合. 该方案以卷积神经网络为基础,利用窗口自注意力构建了一个融合图像全局和局部特征的哈希模型. 模型首先对主干网络获得的浅层特征进行分块并提取相应的窗口特征,然后计算每个局部特征与全局特征之间的相关性来筛选出最终的局部特征,再将这部分特征和全局特征输入到哈希生成模块中进行融合与压缩,得到最终的图像哈希码. 在训练过程中,利用哈希损失和分类损失构造的联合损失函数对模型进行约束,提高感知认证哈希方案的鲁棒性和唯一性. 实验结果表明,与现有典型的感知认证哈希方案相比,所提方案可获得更优的图像内容认证性能.

感知哈希  /  图像认证  /  窗口自注意力  /  特征融合  /  鲁棒性

With the rapid development of multimedia and network technology, the security of digital image content is becoming more and more prominent. In this paper, we propose a deep perceptual image authentication hashing scheme based on window self-attention feature fusion, which can effectively detect whether the perceptual content of the original image has changed. It can be applied to content authentication, tampering recognition, copy detection, and other similar scenarios. This scheme uses a convolutional neural network architecture that integrates a window self-attention mechanism to build a hashing model that encompasses global and local image features. The scheme chunks the shallow features obtained from the backbone network and extracts the corresponding window features, then calculates the correlation between each intermediate local feature and the global feature to filter out the final local features, and finally inputs the local features and global features into the Hash generation module for fusion and compression to obtain the final image Hash code. In the training process, an integrated loss function based on Hash loss and classification loss is used to constrain the model to improve the robustness and discrimination. The experimental results show that this scheme can achieve superior image content authentication performance compared with existing typical perceptual authentication hashing schemes.

perceptual hashing  /  image authentication  /  window self-attention  /  feature fusion  /  robustness
周元鼎, 高国鹏, 房耀东, 秦川. 基于窗口自注意力特征融合的感知图像认证哈希. 计算机研究与发展, 2025 , 62 (7) : 1786 -1796 . DOI: 10.7544/issn1000-1239.202330669
Yuanding Zhou, Guopeng Gao, Yaodong Fang, Chuan Qin. Perceptual Image Authentication Hashing Based on Window Self-Attention Feature Fusion[J]. Journal of Computer Research and Development, 2025 , 62 (7) : 1786 -1796 . DOI: 10.7544/issn1000-1239.202330669
互联网为内容创作者提供了一个低成本、高效率的平台,使他们能够将创作内容快速传播到各个社交平台. 同时,随着Twitter、Instagram和微博等社交媒体的兴起,用户可以通过这些平台方便快捷地与他人分享数字图像. 然而,随着多媒体技术的快速发展,社交平台上的数字图像数据量不断增加,这大大增加了图像被篡改和伪造的概率. 此外,一些操作简单的图像编辑工具的出现,使得没有专业技能的人也可以轻松地对图像进行修改和编辑. 因此,如何验证数字图像的真实性已经成为一个重要的问题[1]. 近期,研究人员提出了许多基于水印[2-3]和取证[4-5]的图像内容认证方法. 图像水印需要将水印信息事先嵌入到图像中,通过分析提取后的水印信息来实现内容认证,但嵌入操作在一定程度上破坏了图像的质量和完整性. 图像取证虽然无需嵌入信息,但它涉及复杂的计算过程并且认证的准确性也相对较低. 感知认证哈希(perceptual authentication hashing, PAH)作为一种半主动的认证方法,可通过比对图像间的哈希距离来实现认证,近年来引起了研究人员的广泛关注.
需要指出的是, MD5和SHA-1等密码学哈希函数虽然也可以通过将任意长度的数据映射成固定长度的哈希码来实现数据的完整性认证和篡改检测,但由于这些密码学哈希函数对输入数据的变化特别敏感,故不适用于数字图像这种多媒体数据的内容认证. 数字图像作为在互联网上广泛传播的多媒体信息,难免会经历一些图像处理操作(如JPEG压缩、图像增强等),但这些操作并不会改变图像的感知内容. 故对这些处理后的图像,虽然数据表示上有所改变,但要求哈希函数仍应生成和原始图像相同或者相近的哈希值,且不能判断图像被篡改. 所以,对输入敏感的密码学哈希函数显然无法用于图像内容认证的实际场合. 而PAH利用图像的感知内容特征来生成紧凑的哈希码,可以很好地解决传统密码学哈希的这个问题,已被广泛应用于篡改识别[6-7]、图像认证[8]和拷贝检测[9-10]等领域.
PAH侧重于图像内容的认证,该任务中的感知相似图像一般是指原始图像经过内容保留操作得到的图像,其感知内容和原图是相同的. 一个理想的PAH方案需要同时满足2个基本条件[11-12]:感知鲁棒性和唯一性. 感知鲁棒性要求PAH方案对感知相似的2幅图像生成相同或相近的图像哈希码,即该方案能够有效地抵抗图像内容保留操作. 唯一性,也称抗冲突性,要求PAH方案可以区分感知不同的图像,即对于感知不相似的图像生成不同的哈希码. 有些PAH方案还需要考虑密钥依赖性,即在不同密钥的条件下生成显著不同的哈希码.
在PAH研究的早期,许多基于传统图像处理的方案被提出. 这些方案一般包含3个主要步骤:图像预处理、特征提取和哈希生成. 在特征提取步骤中,通常采用人工设计的方式来提取图像特征. 随着深度学习的不断发展,卷积神经网络(convolutional neural network, CNN)作为一种强大的特征提取器被广泛应用于图像处理和计算机视觉领域. 例如,研究人员成功地将CNN应用于语义检索哈希[13],实现了大规模图像检索. 然而,在图像内容认证方面,基于深度学习的PAH研究相对较少,且现有的方案涉及的图像内容保留操作较少,提取的特征也相对单一. 因此,为进一步提高图像内容认证的性能,本文提出一种新的基于CNN的深度PAH方案,其主要贡献有3方面:
1)提出一种基于窗口自注意力的特征融合方案,通过计算图像窗口特征与全局特征之间的相关性,筛选与全局特征相关性最大的若干窗口特征作为局部特征,融合局部特征与全局特征生成哈希码.
2)增加了产生感知相似图像的内容保留操作种类,构建了一个针对PAH的数据集用来训练和测试;同时设计了联合损失函数用来提高模型的鲁棒性和唯一性.
3)本文算法与现有的PAH方案相比,在图像的内容认证方面有更好的性能表现,可有效应用于图像近似复制检测和篡改认证.
现有的感知图像认证哈希方案可以分为2类:基于传统图像处理的方案和基于深度学习的方案. 基于传统图像处理的感知图像认证哈希方案需要通过手动设计的方式来提取图像特征并生成哈希码. 基于深度学习的方案则是通过网络模型和大规模数据集的训练,学习得到图像的感知特征并生成哈希码.
基于传统图像处理的感知图像认证哈希方案,依据特征提取方式可以细分为3类:1)基于特征点的方案. 这类方案通过使用一些具有代表性的图像显著特征点提取器来提取鲁棒特征. Ouyang等人[14]使用四元数Zernike矩和SIFT算法分别提取图像的全局特征和局部特征以生成图像哈希,其中全局特征可以用来进行图像的内容认证,而局部特征可以用来进行图像篡改区域的定位以及篡改操作的识别. Singh等人[15]利用KAZE特征点提取方法来获取图像的局部特征,并利用奇异值分解获取图像的全局特征,将这2个特征进行简单的拼接并通过随机化的方法得到最终的哈希码. 2)基于统计特征的方案. 这类方案利用图像分析中重要的统计特征来进行感知特征的提取. Srivastava等人[16]为了有效捕捉图像的视觉感知内容,使用均值、方差、偏度和峰度这4个统计特征来设计感知哈希方案,该方案对常见的数字图像处理操作(除旋转外)有较好的鲁棒性. 3)基于变换域的方案. 这类方案在变换域中提取图像有效的特征信息. Qin等人[17]利用离散傅里叶变换对预处理后的图像进行鲁棒频率特征的提取,利用非均匀采样的方法从中低频分量中选择更多的采样点,并对采样特征进行增加扰动和量化处理来安全地产生二进制哈希码. Abdullahi等人[18]将傅里叶-梅林变换和分形编码相结合用于生成高效的图像哈希码.
基于深度学习的感知图像认证哈希方案主要是利用深度神经网络模型,从训练集中学习图像的鲁棒表示. Li等人[19]提出一种基于数据驱动的感知图像哈希方案,通过训练降噪自编码器寻找到图像与哈希码之间的最佳映射关系. Qin等人[20]提出一种多约束的深度感知图像哈希模型,使用CNN作为特征提取器,并通过构建相似和不相似的图像及特征图谱间的对称约束来提高模型的认证性能.
近年来,注意力机制已成为捕捉数据特征依赖关系的重要模型组件之一,尤其是自注意力机制,它可以对特征序列中所有位置的向量进行加权平均,来计算每个位置对整体特征的依赖程度. 注意力机制最初多应用于自然语言处理领域,例如机器翻译、文本生成等. 后来在计算机视觉领域中,研究人员开始探索利用注意力机制来获取图像特征间的依赖关系,以提升计算机视觉分析和处理的准确性. 例如,Zhang等人[21]利用自注意力机制获取图像间的依赖关系,从而实现图像合成;Wang等人[22]使用注意力机制来捕获图像局部特征以进行细粒度的图像分类;Cao等人[23]利用注意力模块提取图像的局部特征,并用于将全局特征检索出的图像与查询图像之间的局部特征点进行匹配,以提升检索的准确率.
本文旨在构建一个端到端的深度感知图像认证哈希模型用于图像内容认证. 该模型利用CNN强大的特征学习能力,提取图像的全局特征和局部特征并进行融合,丰富用于生成哈希码的图像表征. 本文提出的PAH网络模型主要包括卷积主干网络、全局特征提取模块、局部特征提取模块和哈希生成模块4个部分. 图1展示了该深度PAH模型的具体架构. 模型的输入为原图、相似图像、不相似图像所构成的三元组. 局部特征提取模块利用窗口自注意力机制对图像进行分块,并提取图像块的特征表示. 哈希生成模块进行特征融合,并通过全连接层压缩特征生成最终的哈希码. 另外,哈希生成模块的输出还用于构建联合损失,指导深度PAH模型训练.
卷积主干网络模块的作用是用来对输入图像进行预处理和初步特征提取,为全局特征和局部特征提取模块提供便利. 该网络包含了8个卷积层和1个最大池化层,其中第1个卷积层采用7×7的卷积核,结合最大池化层对输入图像进行降维,同时增加特征的通道数,以保留有效的特征信息. 例如,对于一个尺寸为224×224×3的图像,经过主干网络的第一个卷积层和池化层处理后,输出维度为56×56×64的图像.
哈希生成模块如图1右下角所示,由聚合器和全连接层组成. 聚合器的作用是将全局特征和局部特征提取模块提取的特征进行拼接;全连接层的作用是对拼接后的特征进行融合和压缩. 哈希生成模块中最后一个全连接层输出深度PAH模型的最终哈希码,其输出长度为l.
如图1所示,对于给定的一张图像,经过卷积层后可得到2个特征图${\boldsymbol{S}} \in {\mathbb{R}^{{H_{\boldsymbol{S}}} \times {W_{\boldsymbol{S}}} \times {C_{\boldsymbol{S}}}}}$和${\boldsymbol{D}} \in {\mathbb{R}^{{H_{\boldsymbol{D}}} \times {W_{\boldsymbol{D}}} \times {C_{\boldsymbol{D}}}}}$,分别代表浅层特征和深层特征,其中H,W,C分别表示特征图的高度、宽度和通道数. 一般来说,深层特征D在空间上的特征尺寸较小,但通道数较多[23],即$ \boldsymbol{\mathit{H}}_{\boldsymbol{D}}\leqslant H_{\boldsymbol{S}} $,$W_{\boldsymbol{D}} \leqslant W_{\boldsymbol{S}} $,$C_{\boldsymbol{D}} \geqslant C_{\boldsymbol{S}} $. 浅层特征S用于提取局部特征,而深层特征D用于生成全局特征.
全局特征提取模块对卷积层提取到的深层特征D进行进一步处理,利用全局平均池化对D中的每个特征图取平均值,将特征变成一个维度为1×1×C的特征向量. 全局平均池化可以大幅度降低网络的参数值,同时防止模型过拟合. 另外,再通过全连接层F对得到的特征进行整合以生成全局特征G:
$ {\boldsymbol{G}}=F\times \left[\frac{1}{{H}_{{\boldsymbol{D}}}{W}_{{\boldsymbol{D}}}}{\displaystyle \sum _{h,w}{{\boldsymbol{d}}}_{h,w}^{(1)}},…,\frac{1}{{H}_{{\boldsymbol{D}}}{W}_{{\boldsymbol{D}}}}{\displaystyle \sum _{h,w}{{\boldsymbol{d}}}_{h,w}^{(k)}}\right]\text{,} $
其中${\boldsymbol{d}}_{h,w}^{(k)} \in {\mathbb{R}^{{C_{\boldsymbol{D}}}}}$表示深层特征D中第k个特征图在(h, w)位置上的特征.
局部特征提取模块包含窗口自注意力模块和局部特征生成模块2部分. 图2以3通道彩色图像作为窗口自注意力模块的输入,展示了窗口分割和自注意力机制的处理流程. 窗口分割对输入的浅层特征S按照预先设置的窗口大小B进行分割,得到相应的窗口特征${\boldsymbol{M}}{ = }({{\boldsymbol{M}}_1}{\text{, }}{{\boldsymbol{M}}_2}{\text{, }}…{\text{, }}{{\boldsymbol{M}}_Q})\in {\mathbb{R}^{Q \times {H_{\boldsymbol{M}}} \times {W_{\boldsymbol{M}}} \times {C_{\boldsymbol{M}}}}}$,其中Q表示窗口的数量,Mi表示第i个窗口特征. 自注意力机制对每个窗口特征Mi使用1×1的卷积进行转换,得到3个相应的特征V1,V2,V3. V1和V2被用于联合生成自注意力特征图${\boldsymbol{E}} \in {\mathbb{R}}^{{H_{\boldsymbol{M}}} \times W_{\boldsymbol{M}}} $:
$ {\boldsymbol{E}}=\sigma ({{\boldsymbol{V}}}_{1}^{\text{T}}{{\boldsymbol{V}}}_{2})\text{,} $
其中$\sigma ( \cdot )$表示Softmax激活函数. V3与E经过聚合和卷积变换后得到窗口自注意力图. 窗口拼接部分将生成的多个窗口自注意力特征图按照窗口分割的顺序进行特征的拼接,并利用映射关系得到包含Q个窗口信息的中间局部特征$ {\mathcal{T}} \in {\mathbb{R}^{N \times Q \times C}}$.
为了选取出最重要的k个窗口特征,$k = \theta \times Q$($\theta $表示中间局部特征筛选比例),利用式(3)计算出全局特征${\boldsymbol{G}} \in {\mathbb{R}^{N \times C}}$与每个中间局部特征${{\mathcal{T}}_i} \in {\mathbb{R}^{N \times C}}$之间的相关性[24],并根据相关性程度排序筛选出相关性最大的k个中间局部特征来生成最终的局部特征.
$ c({\mathcal{{T}}}_{i},{\boldsymbol{G}})=\langle {\mathcal{T}}_{i},{\boldsymbol{G}}\rangle ,i=1,2,…,Q. $
为了提高哈希生成的质量,需要对PAH模型学习到的特征进行进一步的优化. 损失函数在这环节中起到重要的作用,它可以约束模型朝着预先设定的方向进行学习,有效地保证了模型的内容认证性能. 本文方法的损失函数主要由2部分组成,即哈希损失Lhash和分类损失Lcls,两者联合来约束模型的鲁棒性和唯一性,总损失函数如式(4)所示.
$ L={\lambda }_{1}{L}_{{\mathrm{cls}}}+{\lambda }_{2}{L}_{{\mathrm{hash}}}\text{,} $
其中λ1和λ2分别为分类损失和哈希损失的超参数.
本文深度PAH模型的输入是原图、相似图像、不相似图像的三元组图像形式,可以用集合$ O= \{{\boldsymbol{I}},\;{\widehat{\boldsymbol{I}}}_{1} $, $ {\widehat{\boldsymbol{I}}}_{2} $, …, $ {\widehat{\boldsymbol{I}}}_{N} $, $ {\boldsymbol{P}}_{1} $, $ {\boldsymbol{P}}_{2} $, …, $ {\boldsymbol{P}}_{N}\} $表示,其中I表示原始图像,$ \widehat{\boldsymbol{I}} $ 表示与原始图像感知相似的图像,P表示与原始图像感知不相似的图像,N表示感知相似图像和不相似图像的数量,图像输入的总数量为2N+1.哈希损失Lhash的目的是减小原图和其感知相似图像之间的哈希距离,同时扩大原图和其感知不相似图像之间的哈希距离. 哈希码间的距离可以通过均方误差进行衡量,这样原图和其相似及不相似图像之间的距离函数可以表示为
$ {L}_{{\mathrm{sim}}}^{(i)}=\frac{1}{l}{\displaystyle \sum _{k=1}^{l}\left\| {\cal H}{({\boldsymbol{I}})}^{(k)}-{\cal H}{({\widehat{{\boldsymbol{I}}}}_{i})}^{(k)}\right\|_{2}^{2}}\text{,} $
$ {L}_{{\mathrm{dif}}}^{(i)}=\frac{1}{l}{\displaystyle \sum _{k=1}^{l}\left\| {\cal H}{({\boldsymbol{I}})}^{(k)}-{\cal H}{({{\boldsymbol{P}}}_{i})}^{(k)}\right\|_{2}^{2}}\text{,} $
其中${\cal H}(\cdot) $表示本文的深度PAH算法,可以将图像映射到一个固定长度的哈希码;${\widehat{{\boldsymbol{I}}}}_{i} $和${{\boldsymbol{P}}}_{i} $分别表示第i张感知相似和不相似图像;l表示生成的哈希码的长度;${\cal H}({\boldsymbol{I}})^{(k)} $表示哈希码中第k个值. 然而,直接使用均方误差得到的哈希码之间的距离相对较大,如果将其作为损失直接传播到模型中,将会导致模型难以收敛,无法很好地优化. 因此,需要对得到的距离做进一步的归一化处理,以消除大尺度距离对模型的影响. 哈希损失Lhash由相似损失和不相似损失2部分构成,即
$ {L}_{{\mathrm{hash}}}=\frac{1}{N}{\displaystyle \sum _{i=1}^{N}Sigmoid({L}_{{\mathrm{sim}}}^{(i)})}-Sigmoid({L}_{{\mathrm{dif}}}^{(i)})\text{,} $
其中Sigmoid(·)表示归一化函数,它可以将数值归一化到[0.5, 1],即越小的值经过函数Sigmoid(·)之后将越接近0.5,越大的值将越接近1.
哈希损失Lhash主要用于对图像对进行约束,以控制感知相似和不相似图像对之间的哈希距离,但是并没有充分考虑到图像集合O中所有的不相似图像. 为了进一步提高本文提出的PAH模型的性能,我们引入了分类损失来对模型进一步约束. 具体而言,将原图I和其不相似图像P中的每一张图像都视为一个单独的类别,即将集合O中的图像分为N+1个类别,其中原图和其感知相似图像属于同一个类别. 通过对这些图像进行伪标签的设定,构建了分类损失Lcls:
$ {L}_{{\mathrm{cls}}}=\frac{1}{m}{\displaystyle \sum _{i=1}^{m}\left(-{{\boldsymbol{h}}}_{i}^{({y}_{i})}+\mathrm{ln}{\displaystyle\sum_{j=1}^m}\mathrm{exp}({{\boldsymbol{h}}}_{i}^{(j)})\right)}\text{,} $
其中$ {\boldsymbol{h}}_{i}^{\left(j\right)} $表示第i张图像生成的哈希码中的第j个值;yi表示图像真实标签y中的第i个标签值,真实标签由N+1个不同的整数构成;m=2N+1表示每个批次中输入的图像数量.
本文进行了大量的实验来验证本文所提各个算法模块的有效性,所有的实验都是在搭载Windows 10系统、NVIDIA GeForce RTX2080Ti GPU、Inter® Core™ i9-10900X CPU和32 GB内存的台式机上运行的,并且所有的深度感知图像认证哈希模型都是基于Pytorch框架进行开发的.
1)相关指标. 图像哈希码之间的距离可以使用均方误差进行计算,具体公式为:
$ D({{\boldsymbol{h}}}_{1},{{\boldsymbol{h}}}_{2})=\frac{1}{l}{\displaystyle \sum _{k=1}^{l}{\Vert {{\boldsymbol{h}}}_{1}^{(k)}-{{\boldsymbol{h}}}_{2}^{(k)}\Vert }_{2}}\text{,} $
其中$\left\|\cdot\right\|_2 $表示欧几里得范数. 对于每一对图像,如果它们之间的哈希距离不大于给定的阈值T,则可以判定这2张图像为感知相似图像,否则为感知不相似图像. 因此可以使用错误接受率(FAR)和错误拒绝率(FRR)来评估PAH方案的认证性能,具体公式为:
$ \begin{aligned}&FAR(T)=Pr\{D({{\boldsymbol{h}}}_{1},{{\boldsymbol{h}}}_{2})\le T|{{\boldsymbol{I}}}_{1}和{{\boldsymbol{I}}}_{2}感知不相似\}\text{,}\\&FRR(T)=Pr\{D({{\boldsymbol{h}}}_{1},{{\boldsymbol{h}}}_{2}) > T|{{\boldsymbol{I}}}_{1}和{{\boldsymbol{I}}}_{2}感知相似\}\text{,}\end{aligned} $
其中T为阈值. 显然,FAR和FRR的值越小,模型的认证性能就越好. 另外,F1分数常被用来量化PAH模型内容认证的准确性,其值越大表示模型的内容认证性能越好,其计算方式为:
$ F1 = \mathop {\max }\limits_T \left\{ {\frac{{2[1 - FAR(T)] \times [1 - FRR(T)]}}{{[1 - FAR(T)] + [1 - FRR(T)]}}} \right\}. $
2)训练设置. 本文的数据集分成训练集和测试集2部分,其中的图像均是来自COCO数据集[25],且训练集和测试集的图像是没有重复的. 具体地,训练集中的图像分为原图、感知相似图像和感知不相似图像3部分,且感知相似图像和感知不相似图像的数量是一致的,其中感知相似图像是对原图使用表1列出的62个内容保留操作生成的. 这样训练集共包含了187500张图像,其中有1500张原始图像、93000(1500×62)张感知相似图像和93 000张感知不相似图像. 测试集与训练集的结构类似,共包含了62500张图像,其中有500张原始图像、31000(500×62)张感知相似图像和31000张感知不相似图像. 图像在输入到模型时,尺寸会被归一化至128×128×3. 在模型训练中,使用了初始学习率为0.01的SGD优化器对模型的参数进行更新,并采用StepLR机制对优化器的学习率进行动态调整;每经历50个训练轮次,优化器的学习率会被乘以0.1. 模型训练总共进行300个轮次,模型的批量大小设置为125(1+2×62). 分类损失和哈希损失的超参数λ1和λ2分别设置为0.05和1,哈希码的长度l为128.
为了分析本文提出的算法在不同窗口尺寸wz与不同中间局部特征$\mathcal{T} $数量条件下的性能,本节进行了一系列实验. 图3展示了不同窗口尺寸和不同中间局部特征数量下本文深度PAH模型的接收者操作特征(receiver operating characteristic, ROC)曲线.
通过卷积主干网络得到图像的浅层特征S,它的高度和宽度都是4的倍数. 这里我们设置了2种尺寸的窗口大小,即wz=2和wz=4,用于窗口分割模块对S进行分割. 另外,局部特征的数量是按照比例从窗口特征中进行挑选的,本节中设置了2种比例$\theta $进行分析,分别是$\theta $=2/3和$\theta $=3/4. 利用式(9)针对测试集中选取的相对于500张原图的31000个感知相似图像对和31000个感知不相似图像对,即共62000个图像对,计算哈希距离,再设置不同的阈值T通过式(10)计算相应的FAR和FRR值来绘制ROC曲线. ROC曲线图的横坐标为FRR、纵坐标为1−FAR,曲线越靠近左上角表明模型的性能越好. 由图3可以看出在这几种参数设置下模型都可以取得较好的认证性能,相较而言,wz=4和$\theta $=3/4时,模型的性能最好.
Grad-CAM[26]是一种基于梯度的图像可视化技术,它通过对目标图像的梯度进行全局平均池化来获取权重,将权重与对应的特征图相乘并求和来生成热力图,可用于深度学习模型关注于目标图像的哪些区域的可视化. 为了更好地展现不同窗口尺寸wz下模型学习到的不同特征($\theta $=3/4),本文利用Grad-CAM将模型学习到的特征以热力图的形式叠加到原始图像上,如图4所示. 可以看出,当窗口尺寸wz=4时,本文的深度PAH模型可以关注到更多的区域. 需要注意的是,相对于SRH模型主要关注图像中的目标对象信息,PAH模型更加关注于图像的整体信息. 由图4(d)~(f)看出,对于一张类别为花的图像,模型在关注“花”这个主体信息的同时,也关注到了周围背景的内容. 但当窗口尺寸过大时,窗口分割后可能只包含1个到2个窗口特征,故本方案中窗口尺寸设置为4.
理想的PAH方案应该可以有效抵抗内容保留操作对图像哈希码的影响,也就是说PAH方案要求原图和其感知相似图像生成的哈希码之间的距离要尽可能的小,即鲁棒性强. 首先从UCS-SIPI图像数据集中选择了6张尺寸大小为512×512的标准测试图像,如图5所示.
图6展示了测试图像在经过不同内容保留操作后的哈希距离,其中横坐标表示不同内容保留操作的参数名称,纵坐标表示原图与其感知相似图像之间的哈希距离. 由于表1中像素化和锐化操作只有1个参数,故它们的哈希距离并未通过曲线图展示. 从图6中可以观察到,这些感知相似图像之间的哈希距离都小于0.5,且滤波操作、JPEG压缩、高斯噪声、高斯模糊和缩放操作下得到的哈希距离都接近于0,即经过内容保留操作后,这些图像在本文的深度PAH模型下生成的哈希码基本不变.
为了进一步展示本文模型的感知鲁棒性,从实验测试集中选取了相对于500张原始图像的31 000个感知相似图像对. 表2列出了这些相似图像对之间哈希距离的统计值,可以看出,这3类内容保留操作的哈希距离均值都远小于0.05,组合操作下哈希距离的均值也达到了0.050 7,并且标准差也都小于0.3. 值得注意的是,增强操作类别中的大部分内容保留操作对应的哈希距离为0,表明使用这些操作得到的相似图像与原始图像的哈希码是完全一致的. 综合以上2个实验结果,可以说明本文所提出的深度PAH模型具有良好的感知鲁棒性.
唯一性是指PAH方案可以有效区分感知不相似的图像,即对于2张感知不相似的图像,PAH方案需生成完全不同的哈希码,且使得它们之间的距离尽可能的大. 为了验证本文PAH方案的唯一性,本节从DISC21数据集[27]中挑选了1 250张不同场景、不同类别的图像来构建唯一性实验数据集. 该数据集中的图像两两不相似,共包含780625(1250×(1250−1)/2)个感知不相似图像对. 因为感知哈希的唯一性和鲁棒性是2个相互制约的性能指标,所以我们在设置不同阈值T的条件下来联合分析本文PAH方案的唯一性和鲁棒性.
表3列出了不同阈值T下,本文PAH方案对于感知相似图像和感知不相似图像判断的正确率,其中Γsim(Γdif)表示本文方案将实验数据集中的感知相似(感知不相似)图像对正确判断为感知相似(感知不相似)的比例,即Γsim和Γdif分别对应方案的鲁棒性和唯一性. 从表3可以发现,当阈值T=0.9时,Γdif达到97.10%,同时从表2可以发现鲁棒性实验中绝大部分哈希距离都远小于0.9,当表3中T=0.9时,Γsim达到了97.14%. 这表明本文PAH方案可以有效地区分感知不相似图像和感知相似图像,具有较好的唯一性且也是以0.9作为阈值.
为了验证本文所提深度PAH方案的优越性,我们将本文方案与4个典型的PAH方案进行鲁棒性和唯一性2方面的综合比较. 这4个方案分别是RPIVD[28],RE[29],DCP[30],MCCNN[20],其中前3个是基于传统图像处理的PAH方案,最后1个是目前为数不多的基于深度学习的PAH方案. 在实验对比中,将这4个方案调整到最佳的内容认证性能,其中RPIVD,RE,DCP,MCCNN生成的哈希码长度分别为40,64,72,50. 结果如图7所示.
图7展示了这5种PAH方案在包含了31 000对感知相似图像和31 000对感知不相似图像的测试集上的ROC曲线. 由图7可以看出,本文方案的ROC曲线相比于其他4个PAH方案更接近于左上角,表明它具有更好的内容认证性能. 此外,还利用式(11)计算了本文深度PAH方案、RPIVD、RE、DCP、MCCNN的F1分数,分别为0.9971,0.7680,0.8413,0.8537,0.9922. 相比而言,本文方案的F1分数值更接近于1,进一步说明了本文方案内容认证性能的优越性.
理想的PAH方案不仅需要具有出色的内容认证性能,还需要能够在较短的时间内为图像生成相应的图像哈希码,即PAH方案的哈希生成效率. 为了更好地展示本文方案的哈希生成效率,与RE,RPIVD,DCP,MCCNN还进行了哈希生成效率的比对. 我们从实验数据集中选取了150 000张图像来进行测试,通过计算这5个PAH方案生成哈希码的平均时间来比较它们的哈希生成效率. 表4展示了这5个方案哈希生成的平均时间,可以看出3个传统的PAH方案的哈希平均生成时间都在几十至200 ms之间,而本文方案和MCCNN可以在小于0.5 ms的时间内生成图像的哈希码. 这表明,本文方案有着很高的哈希生成效率,可以快速地为海量图像数据生成哈希值并进行内容认证.
本文的深度PAH模型利用了分类损失与局部和全局特征融合这2个策略来优化图像感知哈希的内容认证性能. 为了验证这2种策略的有效性,我们构建了2个PAH模型,即哈希损失模型和全局特征模型,并分别在训练集和测试集上进行训练和测试,这2个模型都是在本文提出的深度PAH模型基础上修改得到的. 其中哈希损失模型是将本文模型在训练时去掉分类损失,只保留基础的哈希损失;全局特征模型是舍弃局部特征与特征融合步骤,只使用全局特征来生成哈希码.
图8展示了本文模型、哈希损失模型和全局特征模型的内容认证性能的ROC曲线,并且它们的F1分数分别为0.9971,0.9963,0.9956. 可以看出,分类损失与局部和全局特征融合这2个策略可以使模型的内容认证性能获得有效的提升.
本文提出了一种基于窗口自注意力机制特征融合的深度感知认证哈希方案. 运用窗口自注意力机制、局部和全局特征融合、联合损失函数对模型进行优化,训练出了一个可以有效抵抗图像内容保留操作的感知哈希模型. 其中窗口自注意力机制用于局部特征的生成,通过将输入的浅层特征按窗口进行分割并计算热力图得到窗口特征,然后利用其与全局特征之间的相关性选取出最终的局部特征;特征融合模块用于将局部特征与全局特征进行融合压缩以便后续生成哈希码;联合损失函数由哈希损失和分类损失构成,用于约束模型的训练,增强鲁棒性和唯一性. 大量的实验结果表明,本文方案的ROC曲线和F1分数优于已有的代表性PAH方案,说明了本文方案具有较好的图像内容认证性能.
目前本文方案可抵抗的内容保留操作都是已知的,对于未知或模型未训练过的内容保留操作的鲁棒性现阶段还不够理想. 然而在实际应用中,图像可能会遭受一些事先未知的操作,如何实现可有效抵抗未知内容保留操作的PAH方案还需进一步深入研究.
作者贡献声明:周元鼎提出了算法思路和实验方案;高国鹏和房耀东负责完成实验并撰写论文;秦川提出指导意见并修改论文.

参考文献 引证文献
排序方式:
1
Yan Caiping, Pun Chiman, Yuan Xiaochen. Multi-scale image hashing using adaptive local feature extraction for robust tampering detection[J]. Signal Processing, 2016, 121(C): 1−16
2
Su Qingtang, Liu Decheng, Sun Yehan. A robust adaptive blind color image watermarking for resisting geometric attacks[J]. Information Sciences: An International Journal, 2022, 606: 194−212
3
朱新山,陈砚鸣,董宏辉,等. 基于双域信息融合的鲁棒二值文本图像水印[J]. 计算机学报,2014,37(6):1352−1364
Zhu Xinshan, Chen Yanming, Dong Honghui, et al. Robust double domain watermarking for binary document image[J]. Chinese Journal of Computers, 2014, 37(6): 1352−1364 (in Chinese)
4
Liao Xin, Li Kaide, Zhu Xinshan, et al. Robust detection of image operator chain with two-stream convolutional neural network[J]. IEEE Journal of Selected Topics in Signal Processing, 2020, 14(5): 955−968
5
彭安杰,康显桂. 基于滤波残差多方向差分的中值滤波取证技术[J]. 计算机学报,2016,39(3):503−515
Peng Anjie, Kang Xiangui. Median filtering forensics based on multi-directional difference of filtering residuals[J]. Chinese Journal of Computers, 2016, 39((3): ): 503−515 (in Chinese)
6
Shen Qi, Zhao Yan. Perceptual hashing for color image based on color opponent component and quadtree structure[J]. Signal Processing, 2020, 166: 107244
7
Zhang Qiuyu, Han Jitian. A novel color image encryption algorithm based on image hashing, 6D hyperchaotic and DNA coding[J]. Multimedia Tools and Applications, 2021, 80(9): 13841−13864
8
秦川,郭梦琦,李欣然,等. 一种加密域鲁棒图像哈希算法[J]. 软件学报,2023,34(2):868−883
Qin Chuan, Guo Mengqi, Li Xinran, et al. Robust image hashing in encrypted domain[J]. Journal of Software, 2023, 34(2): 868−883 (in Chinese)
9
Huang Ziqing, Liu Shiguang. Perceptual image hashing with texture and invariant vector distance for copy detection[J]. IEEE Transactions on Multimedia, 2020, 23: 1516−1529
10
Huang Ziqing, Tang Zhenjun, Zhang Xianquan, et al. Perceptual image hashing with locality preserving projection for copy detection[J]. IEEE Transactions on Dependable and Secure Computing, 2023, 20(1): 463−477
11
Du Ling, Ho A T S, Cong Runmin. Perceptual hashing for image authentication: A survey[J]. Signal Processing: Image Communication, 2020, 81: 115713
12
Li Xinran, Qin Chuan, Wang Zichi, et al. Unified performance evaluation method for perceptual image hashing[J]. IEEE Transactions on Information Forensics and Security, 2022, 17: 1404−1419
13
Li Xiaoqing, Yang Jiansheng, Ma Jinwen. Recent developments of content-based image retrieval (CBIR)[J]. Neurocomputing, 2021, 452: 675−689
14
Ouyang Junlin, Liu Yizhi, Shu Huazhong. Robust hashing for image authentication using SIFT feature and quaternion Zernike moments[J]. Multimedia Tools and Applications, 2017, 76(2): 2609−2626
15
Singh S P, Bhatnagar G, Singh A K. A new robust reference image hashing system[J]. IEEE Transactions on Dependable and Secure Computing, 2022, 19(4): 2211−2225
16
Srivastava M, Siddiqui J, Ali M A. Robust image hashing based on statistical features for copy detection[C]//Proc of the IEEE Uttar Pradesh Section Int Conf on Electrical, Computer and Electronics Engineering (UPCON’16). Piscataway, NJ: IEEE, 2016: 490−495
17
Qin Chuan, Chang C C, Tsou P L. Robust image hashing using non-uniform sampling in discrete Fourier domain[J]. Digital Signal Processing, 2013, 23(2): 578−585
18
Abdullahi S M, Wang Hongxia, Li Tao. Fractal coding-based robust and alignment-free fingerprint image hashing[J]. IEEE Transactions on Information Forensics and Security, 2020, 15: 2587−2601
19
Li Yuenan, Wang Dongdong, Tang Linlin. Robust and secure image fingerprinting learned by neural network[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2019, 30(2): 362−375
20
Qin Chuan, Liu Enli, Feng Guorui, et al. Perceptual image hashing for content authentication based on convolutional neural network with multiple constraints[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 31(11): 4523−4537
21
Zhang Han, Goodfellow I, Metaxas D, et al. Self-attention generative adversarial networks [C] //Proc of the 36th Int Conf on Machine Learning. New York: ICML, 2019: 7354−7363
22
Wang Zhihui, Wang Shijie, Zhang Pengbo, et al. Weakly supervised fine-grained image classification via correlation-guided discriminative learning [C] //Proc of the 27th ACM Int Conf on Multimedia. New York: ACM, 2019: 1851−1860
23
Cao Bingyi, Araujo A, Sim J. Unifying deep local and global features for image search [C] //Proc of the 16th European Conf on Computer Vision. Berlin: Springer, 2020: 726−743
24
Hjelm R D, Fedorov A, Lavoie-Marchildon S, et al. Learning deep representations by mutual information estimation and maximization [C] //Proc of the 7th Int Conf on Learning Representations. Washington, DC: ICLR, 2019: 9153−9176
25
Lin T Y, Maire M, Belongie S, et al. Microsoft coco: Common objects in context[C]//Proc of the 10th European Conf on Computer Vision. Berlin: Springer, 2014: 740−755
26
Selvaraju R R, Cogswell M, Das A, et al. Grad-CAM: Visual explanations from deep networks via gradient-based localization[C]//Proc of the 15th IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2017: 618−626
27
Douze M, Tolias G, Pizzi E, et al. The 2021 image similarity dataset and challenge [J]. arXiv preprint, arXiv: 2106.09672, 2021
28
Tang Zhenjun, Zhang Xianquan, Li Xianxian, et al. Robust image hashing with ring partition and invariant vector distance[J]. IEEE Transactions on Information Forensics and Security, 2015, 11(1): 200−214
29
Tang Zhenjun, Zhang Xianquan, Huang Liyan, et al. Robust image hashing using ring-based entropies[J]. Signal Processing, 2013, 93(7): 2061−2069
30
Qin Chuan, Chen Xueqin, Luo Xiangyang, et al. Perceptual image hashing via dual-cross pattern encoding and salient structure detection[J]. Information Sciences, 2018, 423: 284−302
2025年第62卷第7期
98
43
0
引用本文
BibTeX
文章信息
doi: 10.7544/issn1000-1239.202330669
  • 接收时间:2023-08-21
  • 首发时间:2026-11-10
  • 出版时间:2025-07-01
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2023-08-21
  • 修回日期:2025-01-09
  • 录用日期:2025-01-26
基金
作者信息
    上海理工大学光电信息与计算机工程学院 上海 200093

通讯作者:

秦川()
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/10.7544/issn1000-1239.202330669
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏