Article(id=1149779600760332314, tenantId=1146029695717560320, journalId=1146120084050784272, issueId=1149779599254581563, articleNumber=null, orderNo=null, doi=10.19562/j.chinasae.qcgc.2025.02.002, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1721664000000, receivedDateStr=2024-07-23, revisedDate=1724860800000, revisedDateStr=2024-08-29, acceptedDate=null, acceptedDateStr=null, onlineDate=1752058418693, onlineDateStr=2025-07-09, pubDate=1740412800000, pubDateStr=2025-02-25, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1752058418693, onlineIssueDateStr=2025-07-09, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1752058418693, creator=13701087609, updateTime=1752058418693, updator=13701087609, issue=Issue{id=1149779599254581563, tenantId=1146029695717560320, journalId=1146120084050784272, year='2025', volume='47', issue='2', pageStart='201', pageEnd='390', issueExtLink='null', onlineDate='null', pubDate='null', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=0, createTime=1752058418334, creator=13701087609, updateTime=1753780722751, updator=13701087609, preIssue=null, nextIssue=null, ext={EN=IssueExt(id=1157003467609956875, tenantId=1146029695717560320, journalId=1146120084050784272, issueId=1149779599254581563, language=EN, specialIssueTitle=, coverIllustrator=, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1157003467609956876, tenantId=1146029695717560320, journalId=1146120084050784272, issueId=1149779599254581563, language=CN, specialIssueTitle=, coverIllustrator=, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null}, startPage=211, endPage=221, ext={EN=ArticleExt(id=1149779600928104477, articleId=1149779600760332314, tenantId=1146029695717560320, journalId=1146120084050784272, language=EN, title=Construction Method for Multimodal Rainy Scene Fusion in Autonomous Driving Sample Library, columnId=null, journalTitle=Automotive Engineering, columnName=null, runingTitle=null, highlight=

For the problems of difficult and uncontrollable data acquisition,as well as limited quantity of available rainy day scene samples in the process of unmanned driving perception performance training,a multimodal fusion-based algorithm for constructing rainy day traffic scenes is proposed. Firstly,the rainy day scenes are analyzed and categorized into two models of rain line models and raindrop models for reconstruction. Secondly,a stochastic multisource fusion-based rain line model is proposed,which integrates rain effect from multiple directions and densities. Next,a heterogeneous mapping-based raindrop model is proposed to achieve realistic convex transparency mapping for individual raindrops,coupled with collision prevention design to mitigate cumulative errors of multiple raindrops in the same area. Finally,the two models are integrated to realize reconstruction of rainy day scenes by using various foundational forms. The experimental results show that as rainfall intensity increases,detailed information in the constructed scenes becomes richer initially,with metrics such as entropy and average gradient showing an initial increase followed by a decrease,while image quality continuously decreases,approaching realistic rainy day conditions. With higher rainfall intensity,both interference and detail in the images notably increase,with higher entropy and average gradient,as well as decreased PSNR and SSIM parameters,indicating significant image quality degradation.

, articleAbstract=

For the problems of difficult and uncontrollable data acquisition, as well as limited quantity of available rainy day scene samples in the process of unmanned driving perception performance training, a multimodal fusion-based algorithm for constructing rainy day traffic scenes is proposed. Firstly, the rainy day scenes are analyzed and categorized into two models of rain line models and raindrop models for reconstruction. Secondly, a stochastic multisource fusion-based rain line model is proposed, which integrates rain effect from multiple directions and densities. Next, a heterogeneous mapping-based raindrop model is proposed to achieve realistic convex transparency mapping for individual raindrops, coupled with collision prevention design to mitigate cumulative errors of multiple raindrops in the same area. Finally, the two models are integrated to realize reconstruction of rainy day scenes by using various foundational forms. The experimental results show that as rainfall intensity increases, detailed information in the constructed scenes becomes richer initially, with metrics such as entropy and average gradient showing an initial increase followed by a decrease, while image quality continuously decreases, approaching realistic rainy day conditions. With higher rainfall intensity, both interference and detail in the images notably increase, with higher entropy and average gradient, as well as decreased PSNR and SSIM parameters, indicating significant image quality degradation.

, correspAuthors=He Huang, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=Zhaolong Dong, He Huang, Zhanyi Li, Lan Yang, Huifeng Wang), CN=ArticleExt(id=1149779637829591985, articleId=1149779600760332314, tenantId=1146029695717560320, journalId=1146120084050784272, language=CN, title=自动驾驶样本库中多模态雨天场景融合构建方法*, columnId=null, journalTitle=汽车工程, columnName=null, runingTitle=null, highlight=

针对训练无人驾驶感知性能过程中,现有雨天场景样本数据采集难度大、不可控以及样本库数量较少等问题,提出了一种基于多模态融合的雨天交通场景构建算法。首先,分析雨天场景,将其划分为雨线模型和雨滴模型两种模型进行重构;其次,提出一种基于随机多源融合的雨线模型,由多个方向、多个感知密度融合得出雨线效果;然后,提出了一种基于异构映射的雨滴模型,实现对单个雨滴的凸透效果映射,并结合防碰撞设计,避免多雨滴累加在相同区域造成误差;最后,融合两种模型,并利用多种基础形态实现对雨天场景的重构。实验结果表明,构建的雨天场景随着雨量的增加,部分细节信息变丰富,信息熵、平均梯度等指标先增加后减少,而图像质量则持续降低,接近于实际雨天场景。随着雨量的增加,图像干扰信息和细节都明显增强,信息熵、平均梯度等都有所上升,PSNR、SSIM等参数明显降低,图像质量显著下降。

, articleAbstract=

针对训练无人驾驶感知性能过程中,现有雨天场景样本数据采集难度大、不可控以及样本库数量较少等问题,提出了一种基于多模态融合的雨天交通场景构建算法。首先,分析雨天场景,将其划分为雨线模型和雨滴模型两种模型进行重构;其次,提出一种基于随机多源融合的雨线模型,由多个方向、多个感知密度融合得出雨线效果;然后,提出了一种基于异构映射的雨滴模型,实现对单个雨滴的凸透效果映射,并结合防碰撞设计,避免多雨滴累加在相同区域造成误差;最后,融合两种模型,并利用多种基础形态实现对雨天场景的重构。实验结果表明,构建的雨天场景随着雨量的增加,部分细节信息变丰富,信息熵、平均梯度等指标先增加后减少,而图像质量则持续降低,接近于实际雨天场景。随着雨量的增加,图像干扰信息和细节都明显增强,信息熵、平均梯度等都有所上升,PSNR、SSIM等参数明显降低,图像质量显著下降。

, correspAuthors=黄鹤, authorNote=null, correspAuthorsNote=
黄鹤,教授,博士生导师,E-mail:
, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=oLb+ihQ6Or8PtMNJuVxqQA==, magXml=tbCZGVu2czs89h03DKTSXg==, pdfUrl=null, pdf=PU6NKIRG7VloalClILiT3w==, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=wG+BsXIy+UyomhoNXtkEuQ==, mapNumber=null, authorCompany=null, fund=null, authors=

教授,博士生导师

, authorsList=董兆龙, 黄鹤, 李战一, 杨澜, 王会峰)}, authors=[Author(id=1170299838286537137, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1170299838370423220, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, authorId=1170299838286537137, language=EN, stringName=Zhaolong Dong, firstName=Zhaolong, middleName=null, lastName=Dong, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 School of Electronic and Control Engineering,Chang’an University,Xi’an 710064
2 Key Laboratory of Intelligent Expressway Information Fusion and Control,Xi’an 710064, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1170299838450114997, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, authorId=1170299838286537137, language=CN, stringName=董兆龙, firstName=兆龙, middleName=null, lastName=董, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 长安大学电子与控制工程学院,西安 710064
2 西安市智慧高速公路信息融合与控制重点实验室,西安 710064, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1170299838026490277, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, xref=1, ext=[AuthorCompanyExt(id=1170299838034878886, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838026490277, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 School of Electronic and Control Engineering,Chang’an University,Xi’an 710064), AuthorCompanyExt(id=1170299838043267495, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838026490277, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 长安大学电子与控制工程学院,西安 710064)]), AuthorCompany(id=1170299838114570664, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, xref=2, ext=[AuthorCompanyExt(id=1170299838122959273, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838114570664, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 Key Laboratory of Intelligent Expressway Information Fusion and Control,Xi’an 710064), AuthorCompanyExt(id=1170299838127153578, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838114570664, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 西安市智慧高速公路信息融合与控制重点实验室,西安 710064)])]), Author(id=1170299838513029559, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=huanghe@chd.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1170299838596915642, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, authorId=1170299838513029559, language=EN, stringName=He Huang, firstName=He, middleName=null, lastName=Huang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 School of Electronic and Control Engineering,Chang’an University,Xi’an 710064
2 Key Laboratory of Intelligent Expressway Information Fusion and Control,Xi’an 710064, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1170299838664024507, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, authorId=1170299838513029559, language=CN, stringName=黄鹤, firstName=鹤, middleName=null, lastName=黄, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 长安大学电子与控制工程学院,西安 710064
2 西安市智慧高速公路信息融合与控制重点实验室,西安 710064, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1170299838026490277, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, xref=1, ext=[AuthorCompanyExt(id=1170299838034878886, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838026490277, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 School of Electronic and Control Engineering,Chang’an University,Xi’an 710064), AuthorCompanyExt(id=1170299838043267495, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838026490277, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 长安大学电子与控制工程学院,西安 710064)]), AuthorCompany(id=1170299838114570664, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, xref=2, ext=[AuthorCompanyExt(id=1170299838122959273, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838114570664, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 Key Laboratory of Intelligent Expressway Information Fusion and Control,Xi’an 710064), AuthorCompanyExt(id=1170299838127153578, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838114570664, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 西安市智慧高速公路信息融合与控制重点实验室,西安 710064)])]), Author(id=1170299838785659325, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1170299838865351103, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, authorId=1170299838785659325, language=EN, stringName=Zhanyi Li, firstName=Zhanyi, middleName=null, lastName=Li, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1 School of Electronic and Control Engineering,Chang’an University,Xi’an 710064, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1170299838961820096, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, authorId=1170299838785659325, language=CN, stringName=李战一, firstName=战一, middleName=null, lastName=李, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1 长安大学电子与控制工程学院,西安 710064, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1170299838026490277, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, xref=1, ext=[AuthorCompanyExt(id=1170299838034878886, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838026490277, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 School of Electronic and Control Engineering,Chang’an University,Xi’an 710064), AuthorCompanyExt(id=1170299838043267495, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838026490277, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 长安大学电子与控制工程学院,西安 710064)])]), Author(id=1170299839020540354, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1170299839112815044, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, authorId=1170299839020540354, language=EN, stringName=Lan Yang, firstName=Lan, middleName=null, lastName=Yang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3 School of Information Engineering,Chang’an University,Xi’an 710064, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1170299839184118213, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, authorId=1170299839020540354, language=CN, stringName=杨澜, firstName=澜, middleName=null, lastName=杨, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3 长安大学信息工程学院,西安 710064, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1170299838202651051, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, xref=3, ext=[AuthorCompanyExt(id=1170299838215233965, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838202651051, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 School of Information Engineering,Chang’an University,Xi’an 710064), AuthorCompanyExt(id=1170299838223622574, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838202651051, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 长安大学信息工程学院,西安 710064)])]), Author(id=1170299839280587207, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1170299839351890377, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, authorId=1170299839280587207, language=EN, stringName=Huifeng Wang, firstName=Huifeng, middleName=null, lastName=Wang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2 Key Laboratory of Intelligent Expressway Information Fusion and Control,Xi’an 710064, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1170299839406416330, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, authorId=1170299839280587207, language=CN, stringName=王会峰, firstName=会峰, middleName=null, lastName=王, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2 西安市智慧高速公路信息融合与控制重点实验室,西安 710064, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1170299838114570664, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, xref=2, ext=[AuthorCompanyExt(id=1170299838122959273, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838114570664, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 Key Laboratory of Intelligent Expressway Information Fusion and Control,Xi’an 710064), AuthorCompanyExt(id=1170299838127153578, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838114570664, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 西安市智慧高速公路信息融合与控制重点实验室,西安 710064)])])], keywords=[Keyword(id=1170299839553216971, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, orderNo=1, keyword=rainy scene samples), Keyword(id=1170299839620325836, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, orderNo=2, keyword=rain line model), Keyword(id=1170299839691629005, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, orderNo=3, keyword=raindrop model), Keyword(id=1170299839792292302, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, orderNo=4, keyword=heterogeneous mapping), Keyword(id=1170299839863595471, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, orderNo=1, keyword=雨天场景样本), Keyword(id=1170299839939092944, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, orderNo=2, keyword=雨线模型), Keyword(id=1170299840018784721, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, orderNo=3, keyword=雨滴模型), Keyword(id=1170299840085893586, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, orderNo=4, keyword=异构映射)], refs=[Reference(id=1170299849602769431, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[1], rfOrder=0, authorNames=null, journalName=null, refType=null, unstructuredReference=ZHANG Z,WEI Y Y,ZHANG H J,et al. Data-driven single image deraining:a comprehensive review and new perspectives[J]. Pattern Recognition,2023,143:109740., articleTitle=null, refAbstract=null), Reference(id=1170299849665683992, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[2], rfOrder=1, authorNames=null, journalName=null, refType=null, unstructuredReference=YANG W,TAN R T,FENG J,et al. Deep joint rain detection and removal from a single image[C]. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR),2017:1357-1366., articleTitle=null, refAbstract=null), Reference(id=1170299849778930201, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[3], rfOrder=2, authorNames=null, journalName=null, refType=null, unstructuredReference=ARBELÁEZ P,MAIRE M,FOWLKES C,et al. Contour detection and hierarchical image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(5):898-916., articleTitle=null, refAbstract=null), Reference(id=1170299849833456154, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[4], rfOrder=3, authorNames=null, journalName=null, refType=null, unstructuredReference=ZHANG H,SINDAGI V,PATEL V M. Image deraining using a conditional generative adversarial network[J]. IEEE Transactions on Circuits and Systems for Video Technology,2020,30(11):3943-3956., articleTitle=null, refAbstract=null), Reference(id=1170299850034782747, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[5], rfOrder=4, authorNames=null, journalName=null, refType=null, unstructuredReference=SCHAEFER G,STICH M . UCID:an uncompressed color image database[J]. Storage and Retrieval Methods and Applications for Multimedia,2004,5307:472-480., articleTitle=null, refAbstract=null), Reference(id=1170299850097697308, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[6], rfOrder=5, authorNames=null, journalName=null, refType=null, unstructuredReference=FU X,HUANG J,ZENG D,et al. Removing rain from single images via a deep detail network[C]. 2017 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),2017:3855-3863., articleTitle=null, refAbstract=null), Reference(id=1170299850156417565, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[7], rfOrder=6, authorNames=null, journalName=null, refType=null, unstructuredReference=QUAN R,YU X,LIANG Y,et al. Removing raindrops and rain streaks in one go[C]. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),2021:9143-9152., articleTitle=null, refAbstract=null), Reference(id=1170299850273858078, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[8], rfOrder=7, authorNames=null, journalName=null, refType=null, unstructuredReference=WANG T,YANG X,XU K,et al. Spatial attentive single-image deraining with a high quality real rain dataset[C]. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR),2019:12270-12279., articleTitle=null, refAbstract=null), Reference(id=1170299850345161247, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[9], rfOrder=8, authorNames=null, journalName=null, refType=null, unstructuredReference=LI S Y,ARAUJO I B,REN W Q,et al. Single image deraining:a comprehensive benchmark analysis[C]. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR),2019:3833-3842., articleTitle=null, refAbstract=null), Reference(id=1170299850408075808, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[10], rfOrder=9, authorNames=null, journalName=null, refType=null, unstructuredReference=HAO Z,YOU S,LI Y,et al. Learning from synthetic photorealistic raindrop for single image raindrop removal [C]. 2019 IEEE/CVF International Conference on Computer Vision Workshops(ICCVW),2019:4340-4349., articleTitle=null, refAbstract=null), Reference(id=1170299850470990369, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[11], rfOrder=10, authorNames=null, journalName=null, refType=null, unstructuredReference=WANG H,WU Y,LI M,et al. Survey on rain removal from videos or a single image[J]. Science China Information Sciences,2022,65(1):11101., articleTitle=null, refAbstract=null), Reference(id=1170299850546487842, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[12], rfOrder=11, authorNames=null, journalName=null, refType=null, unstructuredReference=QIAN R,TAN R T,YANG W,et al. Attentive generative adversarial network for raindrop removal from a single image[C]. 2018 IEEE/CVF Conference on Computer Vision and Pattern RecognitionCVPR,2018:2482-2491., articleTitle=null, refAbstract=null), Reference(id=1170299850621985315, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[13], rfOrder=12, authorNames=null, journalName=null, refType=null, unstructuredReference=黄鹤,李战一,胡凯益,等.融合大气光值-图估计的无人机航拍图像去雾[J].哈尔滨工业大学学报,2023,55(5):88-97., articleTitle=null, refAbstract=null), Reference(id=1170299850793951780, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[13], rfOrder=13, authorNames=null, journalName=null, refType=null, unstructuredReference=HUANG H,LI Z Y,HU K Y,et al. UAV aerial image dehazing by fusion of atmospheric light value and graph estimation[J].Journal of Harbin Institute of Technology,2023,55(5):88-97., articleTitle=null, refAbstract=null), Reference(id=1170299850890420773, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[14], rfOrder=14, authorNames=null, journalName=null, refType=null, unstructuredReference=HUANG H,LI Z Y,NIU M B,et al. A sea fog image defogging method based on the improved convex optimization model[J]. Journal of Marine Science and Engineering,2023,11(9):1775., articleTitle=null, refAbstract=null), Reference(id=1170299850978501158, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[15], rfOrder=15, authorNames=null, journalName=null, refType=null, unstructuredReference=CHOI L K,YOU J,BOVIK A C. Referenceless prediction of perceptual fog density and perceptual image defogging [J]. IEEE Transactions on Image Processing,2015,24(11):3888-3901., articleTitle=null, refAbstract=null), Reference(id=1170299851062387239, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[16], rfOrder=16, authorNames=null, journalName=null, refType=null, unstructuredReference=WANG T,YANG X,XU K,et al. Spatial attentive single-image deraining with a high quality real rain dataset [C]. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),2019:12270-12279., articleTitle=null, refAbstract=null), Reference(id=1170299851116913192, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[17], rfOrder=17, authorNames=null, journalName=null, refType=null, unstructuredReference=WANG Z,BOVIK A C,SHEIKH H R,et al. Image quality assessment:from error visibility to structural similarity [J]. IEEE Transactions on Image Processing,2004,13(4):600-612., articleTitle=null, refAbstract=null), Reference(id=1170299851184022057, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[18], rfOrder=18, authorNames=null, journalName=null, refType=null, unstructuredReference=黄鹤,胡凯益,宋京,等.雾霾线求解透射率的二次优化方法[J].西安交通大学学报,2021,55(8):130-138., articleTitle=null, refAbstract=null), Reference(id=1170299851246936618, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[18], rfOrder=19, authorNames=null, journalName=null, refType=null, unstructuredReference=HUANG H,HU K Y,SONG J,et al. Twice optimization method for solving transmittance with haze-lines[J].Journal of Xi'an Jiaotong University,2021,55(8):130-138., articleTitle=null, refAbstract=null)], funds=[Fund(id=1170299849015566867, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, awardId=52472446, language=CN, fundingSource=*国家自然科学基金面上项目(52472446), fundOrder=null, country=null), Fund(id=1170299849153978900, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, awardId=2021YFB2501200, language=CN, fundingSource=国家重点研发计划项目(2021YFB2501200), fundOrder=null, country=null), Fund(id=1170299849263030805, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, awardId=2023001, language=CN, fundingSource=陕西省留学人员科技活动择优资助项目(2023001), fundOrder=null, country=null), Fund(id=1170299849372082710, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, awardId=300102324501, language=CN, fundingSource=中央高校基本科研业务费资助项目(300102324501), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1170299838026490277, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, xref=1, ext=[AuthorCompanyExt(id=1170299838034878886, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838026490277, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 School of Electronic and Control Engineering,Chang’an University,Xi’an 710064), AuthorCompanyExt(id=1170299838043267495, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838026490277, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 长安大学电子与控制工程学院,西安 710064)]), AuthorCompany(id=1170299838114570664, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, xref=2, ext=[AuthorCompanyExt(id=1170299838122959273, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838114570664, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 Key Laboratory of Intelligent Expressway Information Fusion and Control,Xi’an 710064), AuthorCompanyExt(id=1170299838127153578, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838114570664, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 西安市智慧高速公路信息融合与控制重点实验室,西安 710064)]), AuthorCompany(id=1170299838202651051, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, xref=3, ext=[AuthorCompanyExt(id=1170299838215233965, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838202651051, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 School of Information Engineering,Chang’an University,Xi’an 710064), AuthorCompanyExt(id=1170299838223622574, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, companyId=1170299838202651051, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 长安大学信息工程学院,西安 710064)])], figs=[ArticleFig(id=1170299840324968915, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=spAAsW674rnLpBgqty2rAA==, figureFileBig=Y/+JugXxkJvowbussCQGog==, tableContent=null), ArticleFig(id=1170299840392077780, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图1, caption=雨线模型示意图, figureFileSmall=spAAsW674rnLpBgqty2rAA==, figureFileBig=Y/+JugXxkJvowbussCQGog==, tableContent=null), ArticleFig(id=1170299840442409429, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=HBc/rC+6qofMVsno72C/Og==, figureFileBig=QPrVtSYfL16a6MA0NquOzw==, tableContent=null), ArticleFig(id=1170299840555655638, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图2, caption=感知雨线密度及清晰度与场景深度关系示意图, figureFileSmall=HBc/rC+6qofMVsno72C/Og==, figureFileBig=QPrVtSYfL16a6MA0NquOzw==, tableContent=null), ArticleFig(id=1170299840614375895, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=nrRJtNOt1swQRWfszAGl2w==, figureFileBig=YQYhPQfkvz1rrc1btJhUDA==, tableContent=null), ArticleFig(id=1170299840752787928, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图3, caption=雨线滤波器示意图, figureFileSmall=nrRJtNOt1swQRWfszAGl2w==, figureFileBig=YQYhPQfkvz1rrc1btJhUDA==, tableContent=null), ArticleFig(id=1170299840828285401, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=pBz1jcmTiHqSURfYigJrMA==, figureFileBig=Dmxi9SxIkIzmmhGjkLIQ9w==, tableContent=null), ArticleFig(id=1170299840907977178, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图4, caption=不同雨量下融合深度信息对比, figureFileSmall=pBz1jcmTiHqSURfYigJrMA==, figureFileBig=Dmxi9SxIkIzmmhGjkLIQ9w==, tableContent=null), ArticleFig(id=1170299840966697435, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=V9L0AIEIcZWuGo9WS7K9Uw==, figureFileBig=MYnKpMmSGOxq3W1GK9diWA==, tableContent=null), ArticleFig(id=1170299841038000604, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图5, caption=不同密度、不同方向雨线效果图, figureFileSmall=V9L0AIEIcZWuGo9WS7K9Uw==, figureFileBig=MYnKpMmSGOxq3W1GK9diWA==, tableContent=null), ArticleFig(id=1170299841092526557, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=+GFx4pZf9GkM6vBRCkTx5Q==, figureFileBig=0dRNtJnOikRV0pRrbXMzWg==, tableContent=null), ArticleFig(id=1170299841147052510, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图6, caption=雨滴模型示意图, figureFileSmall=+GFx4pZf9GkM6vBRCkTx5Q==, figureFileBig=0dRNtJnOikRV0pRrbXMzWg==, tableContent=null), ArticleFig(id=1170299841205772767, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=HUdcwynmWO2NP2kmVOltjw==, figureFileBig=TBuTr1jGWDzUAMxlglMIaw==, tableContent=null), ArticleFig(id=1170299841260298720, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图7, caption=雨滴效果示意图, figureFileSmall=HUdcwynmWO2NP2kmVOltjw==, figureFileBig=TBuTr1jGWDzUAMxlglMIaw==, tableContent=null), ArticleFig(id=1170299841377739233, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=9KQgd4awzKtGjDdOddxPjA==, figureFileBig=Oh47DhVurpP6TYOozco4HA==, tableContent=null), ArticleFig(id=1170299841444848098, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图8, caption=部分基础雨滴形态, figureFileSmall=9KQgd4awzKtGjDdOddxPjA==, figureFileBig=Oh47DhVurpP6TYOozco4HA==, tableContent=null), ArticleFig(id=1170299841511956963, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=rUg2YgAoIuZRjwjDTR7R0Q==, figureFileBig=4If/mpRpiki6Ybt2YwIp0g==, tableContent=null), ArticleFig(id=1170299841579065828, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图9, caption=防碰撞设计前后对比图, figureFileSmall=rUg2YgAoIuZRjwjDTR7R0Q==, figureFileBig=4If/mpRpiki6Ybt2YwIp0g==, tableContent=null), ArticleFig(id=1170299841675534821, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=x3A9ZeTuy2tsTZS47xikgA==, figureFileBig=2nYb2Y0THXrhrwxtQ8CgGQ==, tableContent=null), ArticleFig(id=1170299841742643686, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图10, caption=雨滴模型邻域影响示意图, figureFileSmall=x3A9ZeTuy2tsTZS47xikgA==, figureFileBig=2nYb2Y0THXrhrwxtQ8CgGQ==, tableContent=null), ArticleFig(id=1170299841843306983, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=4Gwc/xUmCrPB2RSr/sD2uw==, figureFileBig=l65thsGAo58iLSdd4D+uDA==, tableContent=null), ArticleFig(id=1170299841927193064, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图11, caption=邻域影响前后对比, figureFileSmall=4Gwc/xUmCrPB2RSr/sD2uw==, figureFileBig=l65thsGAo58iLSdd4D+uDA==, tableContent=null), ArticleFig(id=1170299842019467753, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=KxmA1Eo3ioM9XTvoFjRmvw==, figureFileBig=5RcqHIdLp4qthb/2N9HhAg==, tableContent=null), ArticleFig(id=1170299842069799402, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图12, caption=多模态融合的雨天场景构建算法流程, figureFileSmall=KxmA1Eo3ioM9XTvoFjRmvw==, figureFileBig=5RcqHIdLp4qthb/2N9HhAg==, tableContent=null), ArticleFig(id=1170299842153685483, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=15a3yq/t/5eG85ttZPANdg==, figureFileBig=6EnKlrUpm8VnhWiJTM57+g==, tableContent=null), ArticleFig(id=1170299842212405740, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图13, caption=第11帧加雨线实验, figureFileSmall=15a3yq/t/5eG85ttZPANdg==, figureFileBig=6EnKlrUpm8VnhWiJTM57+g==, tableContent=null), ArticleFig(id=1170299842271125997, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=3YvPvQ0B+ISUJVwoSTfEhQ==, figureFileBig=IqG+He/aYxPGBFTVNj1PFA==, tableContent=null), ArticleFig(id=1170299842342429166, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图14, caption=第41帧加雨线实验, figureFileSmall=3YvPvQ0B+ISUJVwoSTfEhQ==, figureFileBig=IqG+He/aYxPGBFTVNj1PFA==, tableContent=null), ArticleFig(id=1170299842409538031, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=heqVpgQJVxZQQDhQsrofDA==, figureFileBig=L29pS20RU9vF6DqlVZB3HQ==, tableContent=null), ArticleFig(id=1170299842501812720, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图15, caption=第71帧加雨线实验, figureFileSmall=heqVpgQJVxZQQDhQsrofDA==, figureFileBig=L29pS20RU9vF6DqlVZB3HQ==, tableContent=null), ArticleFig(id=1170299842564727281, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=a83TE2sXXLlD7B59W9kG9g==, figureFileBig=CUVIrYGoeSbFlL5Rgmoj9A==, tableContent=null), ArticleFig(id=1170299842686362098, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图16, caption=第101帧加雨线实验, figureFileSmall=a83TE2sXXLlD7B59W9kG9g==, figureFileBig=CUVIrYGoeSbFlL5Rgmoj9A==, tableContent=null), ArticleFig(id=1170299842799608307, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=gqyiSIvjkIr+acTQWRW/lg==, figureFileBig=Gl5TGnNML+JiP/cRkT/6Mg==, tableContent=null), ArticleFig(id=1170299842917048820, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图17, caption=雨线模型客观指标评价, figureFileSmall=gqyiSIvjkIr+acTQWRW/lg==, figureFileBig=Gl5TGnNML+JiP/cRkT/6Mg==, tableContent=null), ArticleFig(id=1170299843013517813, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=NL9MTDEpQs0IrwmQyv6EWQ==, figureFileBig=tZ4DX7FeGIL6iRu2/vzsbQ==, tableContent=null), ArticleFig(id=1170299844968063478, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图18, caption=第11帧加雨滴实验, figureFileSmall=NL9MTDEpQs0IrwmQyv6EWQ==, figureFileBig=tZ4DX7FeGIL6iRu2/vzsbQ==, tableContent=null), ArticleFig(id=1170299845060338167, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=oe/6uOAtaK3knF79nZqFvQ==, figureFileBig=yfu+O5aGj4xvojkiwqbguA==, tableContent=null), ArticleFig(id=1170299845114864120, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图19, caption=第41帧加雨滴实验, figureFileSmall=oe/6uOAtaK3knF79nZqFvQ==, figureFileBig=yfu+O5aGj4xvojkiwqbguA==, tableContent=null), ArticleFig(id=1170299845173584377, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=XkYH8lIXmfX0D9rDtONlCg==, figureFileBig=5tIRD6v4Z+cEoiP77OGJnA==, tableContent=null), ArticleFig(id=1170299845261664762, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图20, caption=第71帧加雨滴实验, figureFileSmall=XkYH8lIXmfX0D9rDtONlCg==, figureFileBig=5tIRD6v4Z+cEoiP77OGJnA==, tableContent=null), ArticleFig(id=1170299845324579323, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=mEuyKYx160gxcf8H35Nb1Q==, figureFileBig=2SCzadWZ56CZZ2H0xr66nw==, tableContent=null), ArticleFig(id=1170299845383299580, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图21, caption=第101帧加雨滴实验, figureFileSmall=mEuyKYx160gxcf8H35Nb1Q==, figureFileBig=2SCzadWZ56CZZ2H0xr66nw==, tableContent=null), ArticleFig(id=1170299845446214141, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=dH37PSAMaiG82RUaAlqJFw==, figureFileBig=GN/KumR9pnODdfXxBkvFow==, tableContent=null), ArticleFig(id=1170299845500740094, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图22, caption=雨滴模型客观指标评价, figureFileSmall=dH37PSAMaiG82RUaAlqJFw==, figureFileBig=GN/KumR9pnODdfXxBkvFow==, tableContent=null), ArticleFig(id=1170299845584626175, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=/xyIN89FN3BXUGBXhB5tqw==, figureFileBig=JFlCUi9yqaKGJkTW3+i3rg==, tableContent=null), ArticleFig(id=1170299845647540736, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图23, caption= nd=10雨天实验效果, figureFileSmall=/xyIN89FN3BXUGBXhB5tqw==, figureFileBig=JFlCUi9yqaKGJkTW3+i3rg==, tableContent=null), ArticleFig(id=1170299845710455297, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=/59SJd2Kc9iWryhgTnWahQ==, figureFileBig=mzeBoE4CBc85lH+kH0gh8A==, tableContent=null), ArticleFig(id=1170299845777564162, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图24, caption= nd=20雨天实验效果, figureFileSmall=/59SJd2Kc9iWryhgTnWahQ==, figureFileBig=mzeBoE4CBc85lH+kH0gh8A==, tableContent=null), ArticleFig(id=1170299845869838851, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=2bi556ZejU1OdFJfXELxLA==, figureFileBig=wkOFVCpDctGEt0vDJq84Pw==, tableContent=null), ArticleFig(id=1170299845953724932, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图25, caption= nd=30雨天实验效果, figureFileSmall=2bi556ZejU1OdFJfXELxLA==, figureFileBig=wkOFVCpDctGEt0vDJq84Pw==, tableContent=null), ArticleFig(id=1170299846020833797, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=A07BDlmngQ5Ffz5o/5tgnA==, figureFileBig=hPIvTnT7aJWioUy28XdzdQ==, tableContent=null), ArticleFig(id=1170299846092136966, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图26, caption= nd=40雨天实验效果, figureFileSmall=A07BDlmngQ5Ffz5o/5tgnA==, figureFileBig=hPIvTnT7aJWioUy28XdzdQ==, tableContent=null), ArticleFig(id=1170299846171828743, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=yGFuIEDf99KSpWr9UJHm6w==, figureFileBig=AKbVEjMb79AcpGrTsDonCQ==, tableContent=null), ArticleFig(id=1170299846255714824, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图27, caption= nd=50雨天实验效果, figureFileSmall=yGFuIEDf99KSpWr9UJHm6w==, figureFileBig=AKbVEjMb79AcpGrTsDonCQ==, tableContent=null), ArticleFig(id=1170299846322823689, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=N3D7q6LX/9nGGjRDMf7SJA==, figureFileBig=QKtvah8ktKHdR3viGQTDkg==, tableContent=null), ArticleFig(id=1170299846381543946, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=图28, caption=雨天场景客观指标评价, figureFileSmall=N3D7q6LX/9nGGjRDMf7SJA==, figureFileBig=QKtvah8ktKHdR3viGQTDkg==, tableContent=null), ArticleFig(id=1170299846448652811, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
评价指标 原图 δr=5 δr=10 δr=15 δr=20 δr=25
信息熵 14.301 14.697 14.891 14.855 14.606 14.183
平均梯度 7.676 8.998 10.535 11.482 11.638 11.110
FADE 0.611 0.448 0.334 0.317 0.358 0.432
PSNR 30.504 26.369 24.756 24.289 24.202
SSIM 0.797 0.618 0.511 0.449 0.412
模糊系数 0.804 0.662 0.595 0.579 0.601
), ArticleFig(id=1170299846536733196, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=表1, caption=

雨线模型综合客观指标评价

, figureFileSmall=null, figureFileBig=null, tableContent=
评价指标 原图 δr=5 δr=10 δr=15 δr=20 δr=25
信息熵 14.301 14.697 14.891 14.855 14.606 14.183
平均梯度 7.676 8.998 10.535 11.482 11.638 11.110
FADE 0.611 0.448 0.334 0.317 0.358 0.432
PSNR 30.504 26.369 24.756 24.289 24.202
SSIM 0.797 0.618 0.511 0.449 0.412
模糊系数 0.804 0.662 0.595 0.579 0.601
), ArticleFig(id=1170299846612230669, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
评价指标 原图 nd=10 nd=20 nd=30 nd=40 nd=50
信息熵 14.301 14.395 14.441 14.534 14.569 14.589
平均梯度 7.676 7.636 7.549 7.521 7.424 7.413
FADE 0.611 0.608 0.612 0.605 0.611 0.608
PSNR 41.751 39.079 36.857 35.591 35.359
SSIM 0.974 0.952 0.926 0.896 0.890
模糊系数 1.004 1.013 1.024 1.036 1.022
), ArticleFig(id=1170299846670950926, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=表2, caption=

雨滴模型综合客观指标评价

, figureFileSmall=null, figureFileBig=null, tableContent=
评价指标 原图 nd=10 nd=20 nd=30 nd=40 nd=50
信息熵 14.301 14.395 14.441 14.534 14.569 14.589
平均梯度 7.676 7.636 7.549 7.521 7.424 7.413
FADE 0.611 0.608 0.612 0.605 0.611 0.608
PSNR 41.751 39.079 36.857 35.591 35.359
SSIM 0.974 0.952 0.926 0.896 0.890
模糊系数 1.004 1.013 1.024 1.036 1.022
), ArticleFig(id=1170299846733865487, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
评价指标 nd=10 nd=20 nd=30 nd=40 nd=50
信息熵 14.996 14.966 15.092 15.048 15.133
平均梯度 10.756 10.598 10.516 10.527 10.455
FADE 0.374 0.376 0.385 0.385 0.387
PSNR 26.492 26.475 26.383 26.396 26.314
SSIM 0.630 0.611 0.603 0.596 0.586
模糊系数 0.739 0.744 0.751 0.751 0.762
), ArticleFig(id=1170299846800974352, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=表3, caption=

nd变化的客观指标评价

, figureFileSmall=null, figureFileBig=null, tableContent=
评价指标 nd=10 nd=20 nd=30 nd=40 nd=50
信息熵 14.996 14.966 15.092 15.048 15.133
平均梯度 10.756 10.598 10.516 10.527 10.455
FADE 0.374 0.376 0.385 0.385 0.387
PSNR 26.492 26.475 26.383 26.396 26.314
SSIM 0.630 0.611 0.603 0.596 0.586
模糊系数 0.739 0.744 0.751 0.751 0.762
), ArticleFig(id=1170299846884860433, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
评价指标 δr=5 δr=10 δr=15 δr=20
信息熵 15.123 15.199 15.084 14.783
平均梯度 9.384 10.547 11.194 11.157
FADE 0.430 0.353 0.348 0.393
PSNR 30.095 26.368 24.827 24.357
SSIM 0.778 0.629 0.535 0.479
模糊系数 0.876 0.750 0.690 0.681
), ArticleFig(id=1170299846951969298, tenantId=1146029695717560320, journalId=1146120084050784272, articleId=1149779600760332314, language=CN, label=表4, caption=

δr变化的客观指标评价

, figureFileSmall=null, figureFileBig=null, tableContent=
评价指标 δr=5 δr=10 δr=15 δr=20
信息熵 15.123 15.199 15.084 14.783
平均梯度 9.384 10.547 11.194 11.157
FADE 0.430 0.353 0.348 0.393
PSNR 30.095 26.368 24.827 24.357
SSIM 0.778 0.629 0.535 0.479
模糊系数 0.876 0.750 0.690 0.681
)], attaches=null, journal=Journal(id=1146119049450201092, delFlag=0, nameCn=汽车工程, nameEn=Automotive Engineering, nameHistory1=null, nameHistory2=null, issn=1000-680X, eissn=, cn=11-2221/U, coden=null, periodic=0, language=CN, oaType=否, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=QBBRQev7wkMVPuUPGz0mFw==, journalPrice=null, startedYear=null, abbrevIsoEn=Auto Eng, journalRemark=null, publicationField=null, createdTime=null, updatedTime=1755587219741, createdBy=null, updatedBy=15831073675, firstLetterCn=A, firstLetterEn=A, subjectCode=Engineering, subjectName=工程, subjectCodeEn=Engineering, subjectNameEn=null, picCn=QBBRQev7wkMVPuUPGz0mFw==, picEn=p+MsLQKu3DZkDibBsTBu1Q==, jcr=null, cjcr=null, exts=[JournalExt(id=1164580465202643295, language=CN, name=汽车工程, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=null, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=https://www.qichegongcheng.com/CN/1000-680X/home.shtml, createdTime=1755587219763, updatedTime=1755587219763, createdBy=15831073675, updatedBy=15831073675, submissionGuidelinesUrl=https://www.qichegongcheng.com/CN/column/column6.shtml, submissionAuthorUrl=https://journal03.magtechjournal.com/journalx_qcgc/authorLogOn.action, submissionEditorUrl=https://journal03.magtechjournal.com/journalx_qcgc/editorLogOn.action, submissionReviewUrl=https://journal03.magtechjournal.com/journalx_qcgc/expertLogOn.action, submissionCeEditorUrl=https://journal03.magtechjournal.com/journalx_qcgc/editorInChiefLogOn.action, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1164580465248780640, language=EN, name=Automotive Engineering, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=null, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=https://www.qichegongcheng.com/EN/1000-680X/home.shtml, createdTime=1755587219774, updatedTime=1755587219774, createdBy=15831073675, updatedBy=15831073675, submissionGuidelinesUrl=https://www.qichegongcheng.com/EN/column/column6.shtml, submissionAuthorUrl=https://journal03.magtechjournal.com/journalx_qcgc/authorLogOn.action, submissionEditorUrl=https://journal03.magtechjournal.com/journalx_qcgc/editorLogOn.action, submissionReviewUrl=https://journal03.magtechjournal.com/journalx_qcgc/expertLogOn.action, submissionCeEditorUrl=https://journal03.magtechjournal.com/journalx_qcgc/editorInChiefLogOn.action, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1146120084050784272, websiteList=[Website(id=1148243202387206565, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146120084050784272, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/qcygc/CN, language=CN, createTime=1751692112776, createBy=18614031015, updateTime=1753500958911, updateBy=18614031015, name=《汽车工程》中文站点, tplId=1146099689490845704, title=汽车工程, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1148622315115540535, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202387206565, code=articleTextType, value=kx, createTime=1751782500294, updateTime=1751782500294, creator=18614031015, updator=18614031015), WebsiteProps(id=1148622315094569012, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202387206565, code=banner, value=null, createTime=1751782500289, updateTime=1751782500289, creator=18614031015, updator=18614031015), WebsiteProps(id=1148622315081986099, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202387206565, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=+W0ZN6/p6N8AvZxnX71krg==, createTime=1751782500286, updateTime=1751782500286, creator=18614031015, updator=18614031015), WebsiteProps(id=1148622315107151926, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202387206565, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1751782500292, updateTime=1751782500292, creator=18614031015, updator=18614031015), WebsiteProps(id=1148622315102957621, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202387206565, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1751782500291, updateTime=1751782500291, creator=18614031015, updator=18614031015)]), Website(id=1155829970321686531, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146120084050784272, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/qcygc/EN, language=EN, createTime=1753500939211, createBy=18614031015, updateTime=1753500939211, updateBy=18614031015, name=《汽车工程》英文站点, tplId=1146101810881728533, title=Automotive Engineering, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1155830904879702095, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155829970321686531, code=articleTextType, value=kx, createTime=1753501162023, updateTime=1753501162023, creator=18614031015, updator=18614031015), WebsiteProps(id=1155830904858730572, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155829970321686531, code=banner, value=null, createTime=1753501162018, updateTime=1753501162018, creator=18614031015, updator=18614031015), WebsiteProps(id=1155830904837759051, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155829970321686531, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=+W0ZN6/p6N8AvZxnX71krg==, createTime=1753501162013, updateTime=1753501162013, creator=18614031015, updator=18614031015), WebsiteProps(id=1155830904875507790, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155829970321686531, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1753501162022, updateTime=1753501162022, creator=18614031015, updator=18614031015), WebsiteProps(id=1155830904867119181, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155829970321686531, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1753501162020, updateTime=1753501162020, creator=18614031015, updator=18614031015)])], journalTitle=汽车工程, weixinUrl=null, journalUrl=null, iacademicId=null, status=0, seqNo=null, journalTitleEn=Automotive Engineering, journalPhotoCn=QBBRQev7wkMVPuUPGz0mFw==, journalPhotoEn=p+MsLQKu3DZkDibBsTBu1Q==, journalFirstLetter=A, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false), detailUrlCn=https://castjournals.cast.org.cn/joweb/qcygc/CN/10.19562/j.chinasae.qcgc.2025.02.002, detailUrlEn=https://castjournals.cast.org.cn/joweb/qcygc/EN/10.19562/j.chinasae.qcgc.2025.02.002, pdfUrlCn=https://castjournals.cast.org.cn/joweb/qcygc/CN/PDF/10.19562/j.chinasae.qcgc.2025.02.002, pdfUrlEn=https://castjournals.cast.org.cn/joweb/qcygc/EN/PDF/10.19562/j.chinasae.qcgc.2025.02.002, aliStartDate=null, aliEndDate=null, collectionFlag=false, citedCount=null, citedUrl=null, reference=null)
收藏切换
自动驾驶样本库中多模态雨天场景融合构建方法*
收藏切换
PDF下载
董兆龙 1, 2 , 黄鹤 1, 2 , 李战一 1 , 杨澜 3 , 王会峰 2
汽车工程 | 2025,47(2): 211-221
收起
收藏切换
汽车工程 | 2025, 47(2): 211-221
自动驾驶样本库中多模态雨天场景融合构建方法*
全屏
董兆龙1, 2, 黄鹤1, 2 , 李战一1, 杨澜3, 王会峰2
作者信息
  • 1 长安大学电子与控制工程学院,西安 710064
  • 2 西安市智慧高速公路信息融合与控制重点实验室,西安 710064
  • 3 长安大学信息工程学院,西安 710064

通讯作者:

黄鹤,教授,博士生导师,E-mail:
Construction Method for Multimodal Rainy Scene Fusion in Autonomous Driving Sample Library
Zhaolong Dong1, 2, He Huang1, 2 , Zhanyi Li1, Lan Yang3, Huifeng Wang2
Affiliations
  • 1 School of Electronic and Control Engineering,Chang’an University,Xi’an 710064
  • 2 Key Laboratory of Intelligent Expressway Information Fusion and Control,Xi’an 710064
  • 3 School of Information Engineering,Chang’an University,Xi’an 710064
出版时间: 2025-02-25 doi: 10.19562/j.chinasae.qcgc.2025.02.002
文章导航
收藏切换

针对训练无人驾驶感知性能过程中,现有雨天场景样本数据采集难度大、不可控以及样本库数量较少等问题,提出了一种基于多模态融合的雨天交通场景构建算法。首先,分析雨天场景,将其划分为雨线模型和雨滴模型两种模型进行重构;其次,提出一种基于随机多源融合的雨线模型,由多个方向、多个感知密度融合得出雨线效果;然后,提出了一种基于异构映射的雨滴模型,实现对单个雨滴的凸透效果映射,并结合防碰撞设计,避免多雨滴累加在相同区域造成误差;最后,融合两种模型,并利用多种基础形态实现对雨天场景的重构。实验结果表明,构建的雨天场景随着雨量的增加,部分细节信息变丰富,信息熵、平均梯度等指标先增加后减少,而图像质量则持续降低,接近于实际雨天场景。随着雨量的增加,图像干扰信息和细节都明显增强,信息熵、平均梯度等都有所上升,PSNR、SSIM等参数明显降低,图像质量显著下降。

雨天场景样本  /  雨线模型  /  雨滴模型  /  异构映射

For the problems of difficult and uncontrollable data acquisition, as well as limited quantity of available rainy day scene samples in the process of unmanned driving perception performance training, a multimodal fusion-based algorithm for constructing rainy day traffic scenes is proposed. Firstly, the rainy day scenes are analyzed and categorized into two models of rain line models and raindrop models for reconstruction. Secondly, a stochastic multisource fusion-based rain line model is proposed, which integrates rain effect from multiple directions and densities. Next, a heterogeneous mapping-based raindrop model is proposed to achieve realistic convex transparency mapping for individual raindrops, coupled with collision prevention design to mitigate cumulative errors of multiple raindrops in the same area. Finally, the two models are integrated to realize reconstruction of rainy day scenes by using various foundational forms. The experimental results show that as rainfall intensity increases, detailed information in the constructed scenes becomes richer initially, with metrics such as entropy and average gradient showing an initial increase followed by a decrease, while image quality continuously decreases, approaching realistic rainy day conditions. With higher rainfall intensity, both interference and detail in the images notably increase, with higher entropy and average gradient, as well as decreased PSNR and SSIM parameters, indicating significant image quality degradation.

rainy scene samples  /  rain line model  /  raindrop model  /  heterogeneous mapping
董兆龙, 黄鹤, 李战一, 杨澜, 王会峰. 自动驾驶样本库中多模态雨天场景融合构建方法*. 汽车工程, 2025 , 47 (2) : 211 -221 . DOI: 10.19562/j.chinasae.qcgc.2025.02.002
Zhaolong Dong, He Huang, Zhanyi Li, Lan Yang, Huifeng Wang. Construction Method for Multimodal Rainy Scene Fusion in Autonomous Driving Sample Library[J]. Automotive Engineering, 2025 , 47 (2) : 211 -221 . DOI: 10.19562/j.chinasae.qcgc.2025.02.002
雨天视觉感知成为目前自动驾驶技术面临的挑战之一,有效的样本数据则是测试视觉感知性能的关键。雨天数据存在难以采集对照样本、环境变量难以控制等问题。雨天场景根据雨的类型可分为基于雨线的样本库[1]、基于雨滴的样本库[2]及雨滴雨线结合的样本库。现有雨天样本库研究以雨线模型为主。Yang等[2]以BSD[3]数据集为基础,提出Rain100H及Rain100L样本库,其中,Rain100H中公开了1 800组包含3~5层雨线的训练集和100张测试集,Rain100L公开了200组单层雨线的训练集和100张测试集。Zhang等[4]利用PhotoShop工具随机抽取部分BSD和UCID[5]数据集,提出Rain800样本库,其中包含700对含雨线训练集和100张测试集。Fu等[6]提出Rain1400样本库,取自BSD和UCID数据集以及谷歌图片的1 000张图像合成14种不同雨线方向和大小的图像。Quan等[7]提出RainDS样本库,引入雨线数据获取方法,采集250组真实雨滴和雨线图像并合成1 200组雨天图像。Wang等[8]提出SPA-Data样本库,包含大量高分辨率雨天和清晰图像对。Li等[9]提出MPID样本库,根据多任务的需求,涵盖雨滴、雨线、雨雾等多种类型雨天数据。从以上研究现状可得,对雨天图像模拟主要基于BSD数据集等,或采用真实雨天图片,缺乏一种可任意控制雨量大小的雨天图像仿真算法,以对自动驾驶汽车进行标准统一的训练。另外,对于雨滴的研究也多使用人工洒水等物理方法,量化较为困难。因此,本文针对自动驾驶视觉感知测试系统样本库中的雨天场景展开研究,提出一种雨线与雨滴模型结合的多模态融合的雨天场景构建算法,能有效模拟雨滴因重力下坠造成的雨线以及雨滴落到镜头前造成的局部凸透效果,实现由晴朗条件向雨天条件的场景重构,构建高质量的测试样本库。
在雨线模型[10-11]中,雨滴下落受重力影响,会在摄像头采集时呈现出细长条纹,且在画面中所占像素面积较小,原本通过此处的光线也被折射造成无法被采集,取代原本反射光线的是被雨滴本身反射的光线,如图1所示。因此,雨线模型表示为
IR_S=J+SR
式中:IR_S表示雨线作用下的图像;J表示晴天场景下图像;SR表示空气介质中雨线的影响效果。
在真实场景中,雨线受重力等纵向力的作用,运动形态相似。但在风等因素影响下,各雨线间运动方向存在一定差异。同时,不同距离下可观测的雨滴数量明显不同。当前视角内可观测距离越远,画面内雨线数量越多,如图2所示。因此,模型中雨线影响部分SR须进一步细化,由不同方向、不同景深的多个雨线层共同构成雨线模型可改进为
IR_S=J+i=1nSR_i
式中:SR_i表示第i个雨线层;i=1nSR_i表示n个雨线层的累加效果。在雨天场景中,雨线存在于不同景深范围中,呈现的视觉效果也是不同的。在近景区域中,雨线反射的光强度高、衰减少,会呈现清晰白亮雨线密度相对稀疏。在远景区域中,雨线反射的光强度减弱,衰减大,痕迹模糊,且密度相对较大,甚至近似于雾天场景效果。因此,不同层次的雨线受场景深度影响,雨天模型可改进为
IR_S=J+i=1nδj=1nθSij(δri,θj)×e-kd(i)
式中:e -kd i 为第i层雨线场景深度对雨线衰减的影响;k为衰减系数;δri为第i层雨线感知密度;θj为倾斜角度;Sijδriθj)为δriθj对应的雨线层效果。
由于雨线分布随机,本文通过随机噪声模拟雨线分布的位置,设计雨线滤波器并对位置分布图进行滤波,结合深度加权,获得单层雨线层。生成与场景图像对应的随机雨线分布图如下:
Map=Random(m,n,δr)
式中:mn为图像尺寸;δr为雨线感知密度;Map为生成的雨线分布图。在雨线分布图的基础之上,通过设计雨线滤波器,将基础的雨线与分布图融合。其中,雨线滤波器为
S=RainFilter(Rr,Map)
式中:S为雨线层;RainFilter为雨线滤波器,由多层滤波构成,如图3所示;Map为雨线分布图;Rr为滤波雨核,作为基础雨线形态,其大小、方向、速度等因素都会影响成像效果,因此,可描述为式(6)
Rr=gaussfilt(RB(L,θ))
式中:RB为初始雨线形态;L为雨线大小;θ为雨线方向;gaussfilt为高斯滤波器,用于消除雨线与图像融合时的锯齿感。
图2所示的雨天场景中,场景目标与摄像头距离越大,单位区域内可感知的雨线越多,即雨线感知密度越大,可将雨线感知密度建模为
δr=ρd
式中:ρ为感知系数;d为场景深度。
单层雨线可表示为
S(δ,θ)=RainFilter(R(θ),Map(δ))×e-kδρ
随着单层雨线中雨线越多,雨线感知密度越大,其距离越远,成像越模糊,如图4所示。
在真实雨天场景中,各雨线间方向并不相同,而是在一定范围内波动。当雨层中雨线较多时,可看做多方向雨线的累加,因此,最终效果由多个方向、多个感知密度融合而成。雨线层融合方法如下:
SR=i=1nδj=1nθSij(δri,θj)×e-kδiρ
式中:SR为多源融合后的雨线效果;i=1nδj=1nθSij(δri,θj)nδ个方向、nθ个感知密度的累加效果。
不同方向和密度的雨线效果如图5所示。
不同于雨线模型下的雨天场景,雨滴模型[12]下图像受雨滴直接遮挡摄像头的影响,造成局部区域扭曲畸形。由于雨滴形状多样,扭曲区域变化复杂,雨滴模型研究难度较大。对于雨滴模型可以表示为
IR_d=(1-M)J+D
式中:IR_d为雨滴模型作用下的雨天场景图像;M为二值化掩膜图像,表示雨滴影响区域,当M=1时表示该像素位于雨滴影响区域内,当M=0 时表示不在雨滴影响区域内;D为雨滴影响区域图像;J为晴天场景下图像。由式(10)可知,雨滴模型的关键在于对雨滴影响区域D的计算。
雨滴与镜面组合时,形成局部区域的凸透效果,目标结构呈扭曲变换,画面变模糊,如图6所示。靠中心位置受雨滴曲面影响相对小,焦点较远,扭曲影响小,而边缘区域扭曲明显。同时,类似于小孔成像原理,此区域内图像成像呈反转状态。本文对雨滴模型成像过程逐步分析,设计一种异构映射的方法实现对单个雨滴的凸透效果映射,并结合防碰撞设计,避免多雨滴累加在相同区域,造成误差。
由于雨滴形状多变,为方便计算,以圆形为例,如图7(b)所示。首先随机选取任意位置,取一个圆形作为雨滴区域,记为Mi,表示第i个雨滴区域。构建一种映射关系,实现图像的几何变换,即
Di=T(Di)
式中:Di为映射后的雨滴区域图像;T(·)为映射函数;Di为原始雨滴区域图像。T通过计算输入图像xy轴坐标与输出坐标间的映射关系实现几何变换。将输入图像的笛卡尔坐标转为极坐标,即
[r,θ]=[x2+y2,arctanyx]
[x̑,y̑]=[r2cos θ,r2sin θ]
式中:xy分别为图像的横纵坐标;rθ分别为对应极坐标的极径和角度;x̑y̑为映射转换后的坐标。考虑到雨滴区域图像较为模糊,以及镜像问题,对转换后的区域进行镜像转置后再进行均值滤波,实现模糊处理,如图7所示。
真实场景中,雨滴并非圆形状态存在,而是呈现各种不规则形状。因此,在随机生成位置的同时也会以基础形状为基准,随机进行旋转、组合等搭配得到单个雨滴的形状。部分基础形状如图8所示。
为防止两个雨滴出现在相同位置,造成图像映射的累加,在生成雨滴位置时设计防碰撞检测,即
Mc=Mi&Mi-1
式中:Mc为碰撞检测掩膜;Mi为当前第i个雨滴的掩膜图像;Mi-1为之前i-1个雨滴区域的累加;&为图像的与运算。当Mc中存在1时,表示当前雨滴与之前雨滴存在碰撞,放弃当前效果;当Mc为全0掩膜时表示不存在碰撞。
图9所示,在设置碰撞前后的对比图中,可以明显观察到防碰撞设计能够有效防止雨滴效果在某一区域聚集。
雨滴区域不仅包含原本区域的信息,还包含周围区域的信息,如图10所示。受雨滴凸视效果影响,原本不会被采集到的光线被聚集到镜头采集范围内,因此,雨滴效果须考虑周围邻域的影响。
通过扩大雨滴影响区域,可有效获取邻域信息,因此,将雨滴影响区域修改为
Di=IMΩ_i
式中:Di为原始雨滴区域图像;MΩ_i为掩膜图像Mi的邻域。
由于将式(15)代入式(11)后得到的映射图像尺寸较大,还须进行一定的收缩,具体如下:
Di'=Di×rΩ+τi
式中:rΩ为收缩率;τi为补偿系数,补偿由图外光线造成的影响;D'i为收缩后的雨滴映射图像。
含邻域影响效果如图11所示,雨滴明显更为清晰。
综合上述设计,雨滴模型可描述为
IR_d=(1-Mc)J+indDi'
式中indDi'nd个雨滴效果的累加。
将随机多源雨线模型与基于多种形态的雨滴模型结合,可得到多模态雨天模型,具体如下:
IR=(1-M)J+i=1nδj=1nθSij(δi,θj)×e-kδiρ+i=1ndDi'
多模态融合的雨天场景构建流程如图12所示。
对视频数据中部分帧进行加雨线实验,对第11、41、71和101帧加不同雨量的雨线,如图13~图16所示。雨量感知浓度δr分别设为5、10、15、20、25,倾斜角度30°,上下波动10°。随着雨量增加,图像细节逐渐被遮挡。当雨量足够大时,图像变得模糊。
客观评价指标为信息熵[13]、平均梯度[14]、FADE[15]、PSNR[16]、SSIM[17]及模糊系数[18]。对图13~图16进行客观评价,结果如图17所示。图17(a)~图17(c)为对应无参评价指标信息熵、平均梯度和FADE值曲线图。图中不同颜色曲线对应不同帧的加雨线效果评价,依次为:绿色曲线代表第11帧、红色曲线代表第41帧、粉色曲线代表第71帧、蓝色曲线代表第101帧。在初期雨量较小时,雨线效果作为干扰信息,导致信息熵和平均梯度小幅增长,FADE下降,但随着雨量的增加,图像逐渐模糊,信息熵、平均梯度逐渐减少,FADE也不断增加。图17(d)~图17(f)为有参评价指标PSNR、SSIM和模糊系数曲线图。不同于无参评价指标,有参评价指标不存在无用信息干扰,PSNR、SSIM、模糊系数均随雨量增加而降低。雨线累积过多而造成的视觉模糊不同于雾天模糊效果,边缘信息相对丰富,导致模糊系数也不断降低。表1为客观指标评价,将不同关键帧图像的客观指标取均值,得到不同雨量对客观指标的影响。从表1图17可以看出,随着δr变大,模糊系数、PSNR、SSIM逐步减小,信息熵、平均梯度先增大后减小,FADE先减小后增大,说明图像中无用信息增多,图像质量下降,与实际情况相符。因此,本文算法处理后,加雨线图像中信息的损失受控于雨量感知系数,可有效实现不同雨量的加雨效果。
对视频数据中第11、41、71和101帧进行加不同雨量的雨滴实验,结果如图18~图21所示。雨滴数量nd分别设为10、20、30、40、50,雨滴大小设置在[30,80]范围内。随着nd增加,图像中有用信息明显减少,雨滴效果明显。
图18~图21进行客观指标评价,结果如图22所示。图22(a)~图22(c)分别为无参评价指标信息熵、平均梯度和FADE值曲线图。图中不同颜色曲线对应不同帧的加雨滴效果评价,依次为:绿色曲线代表第11帧、红色曲线代表第41帧、粉色曲线代表第71帧、蓝色曲线代表第101帧。雨滴效果并没有引起指标明显变化,由于雨滴由周围邻域信息映射而得,相当于将周围信息整合到较小区域内,因此,信息熵出现小幅增长,但这并非有效信息的增长,平均梯度和FADE也存在小幅变化。图22(d)~图22(f)为有参评价指标PSNR、SSIM和模糊值曲线图。其中PSNR、SSIM逐步降低,说明图像质量明显下降,模糊系数也随雨量增加而小幅增长。结合由表2图22可以看出,随着nd的增大,对应的信息熵、平均梯度、FADE及模糊系数都仅作小幅变化,由于雨滴只影响小范围区域,且区域内包含信息量较多,指标并没有明显降低趋势,但是PSNR和SSIM明显降低,图像质量显著下降,也证明雨滴区域为干扰信息。因此,本文算法处理后,图像质量随雨滴数量而变化,可有效实现不同雨量的加雨滴效果。
根据式(18),进行雨天场景实验。通过雨线和雨滴的交叉实验展示构建效果。图23~图27是对第11帧分别设置雨滴数量为10、20、30、40、50,雨线密度为5、10、15、20的雨天场景效果。
利用客观指标对图23~图27进行评价,结果如图28所示。图28(a)~图28(c)为对应无参评价指标信息熵、平均梯度和FADE值曲线图。图中不同颜色曲线为对应不同雨线感知密度δr,依次为:绿色曲线代表δr=5、红色曲线代表δr=10、蓝色曲线代表δr=15、粉色曲线代表δr=20。图中信息熵、平均梯度和FADE随雨线密度变化相对明显,信息熵、平均梯度随雨线密度先增后减,FADE先减后增,而雨滴数量对无参评价影响较小,信息熵、平均梯度和FADE仅小幅波动。图28(d)~图28(f)为对应有参评价指标PSNR、SSIM和模糊值曲线图。图中含参评价随雨线感知密度变化明显。随着密度增大,PSNR、SSIM和模糊系数均持续下降,图像质量下降明显。雨滴数量增大后含参评价变化较小,但是也呈下降趋势,说明图像质量也在逐步下降。表3为随着nd变化的客观指标评价,表4为随着δr变化的客观指标评价。由表3表4图28可以看出,随着δr的变大,对应的模糊系数、PSNR、SSIM逐步减小,信息熵、平均梯度先增大后减小,FADE先减小后增大,而受nd影响,信息熵、FADE和模糊系数小幅增大,平均梯度、PSNR和SSIM持续降低,图像质量不断下降,与实际情况相符。因此,经本算法处理后,雨天场景图像中信息的损失受控于雨量感知系数和雨滴数量,可有效实现不同雨量的雨天效果。
本文提出了一种基于多模态融合的雨天场景构建方法,包括随机多源雨线生成算法和基于异构映射的雨滴场景构建算法,实现了雨滴模型与雨线模型融合。实验结果表明,随着雨量增加,图像干扰信息和细节明显增强,信息熵和平均梯度有所上升,PSNR和SSIM降低,图像质量显著下降。该方法可以有效地补充雨天数据样本库,应用价值明显。
  • *国家自然科学基金面上项目(52472446)
  • 国家重点研发计划项目(2021YFB2501200)
  • 陕西省留学人员科技活动择优资助项目(2023001)
  • 中央高校基本科研业务费资助项目(300102324501)
参考文献 引证文献
排序方式:
[1]
ZHANG Z,WEI Y Y,ZHANG H J,et al. Data-driven single image deraining:a comprehensive review and new perspectives[J]. Pattern Recognition,2023,143:109740.
[2]
YANG W,TAN R T,FENG J,et al. Deep joint rain detection and removal from a single image[C]. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR),2017:1357-1366.
[3]
ARBELÁEZ P,MAIRE M,FOWLKES C,et al. Contour detection and hierarchical image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(5):898-916.
[4]
ZHANG H,SINDAGI V,PATEL V M. Image deraining using a conditional generative adversarial network[J]. IEEE Transactions on Circuits and Systems for Video Technology,2020,30(11):3943-3956.
[5]
SCHAEFER G,STICH M . UCID:an uncompressed color image database[J]. Storage and Retrieval Methods and Applications for Multimedia,2004,5307:472-480.
[6]
FU X,HUANG J,ZENG D,et al. Removing rain from single images via a deep detail network[C]. 2017 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),2017:3855-3863.
[7]
QUAN R,YU X,LIANG Y,et al. Removing raindrops and rain streaks in one go[C]. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),2021:9143-9152.
[8]
WANG T,YANG X,XU K,et al. Spatial attentive single-image deraining with a high quality real rain dataset[C]. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR),2019:12270-12279.
[9]
LI S Y,ARAUJO I B,REN W Q,et al. Single image deraining:a comprehensive benchmark analysis[C]. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR),2019:3833-3842.
[10]
HAO Z,YOU S,LI Y,et al. Learning from synthetic photorealistic raindrop for single image raindrop removal [C]. 2019 IEEE/CVF International Conference on Computer Vision Workshops(ICCVW),2019:4340-4349.
[11]
WANG H,WU Y,LI M,et al. Survey on rain removal from videos or a single image[J]. Science China Information Sciences,2022,65(1):11101.
[12]
QIAN R,TAN R T,YANG W,et al. Attentive generative adversarial network for raindrop removal from a single image[C]. 2018 IEEE/CVF Conference on Computer Vision and Pattern RecognitionCVPR,2018:2482-2491.
[13]
黄鹤,李战一,胡凯益,等.融合大气光值-图估计的无人机航拍图像去雾[J].哈尔滨工业大学学报,2023,55(5):88-97.
HUANG H,LI Z Y,HU K Y,et al. UAV aerial image dehazing by fusion of atmospheric light value and graph estimation[J].Journal of Harbin Institute of Technology,2023,55(5):88-97.
[14]
HUANG H,LI Z Y,NIU M B,et al. A sea fog image defogging method based on the improved convex optimization model[J]. Journal of Marine Science and Engineering,2023,11(9):1775.
[15]
CHOI L K,YOU J,BOVIK A C. Referenceless prediction of perceptual fog density and perceptual image defogging [J]. IEEE Transactions on Image Processing,2015,24(11):3888-3901.
[16]
WANG T,YANG X,XU K,et al. Spatial attentive single-image deraining with a high quality real rain dataset [C]. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),2019:12270-12279.
[17]
WANG Z,BOVIK A C,SHEIKH H R,et al. Image quality assessment:from error visibility to structural similarity [J]. IEEE Transactions on Image Processing,2004,13(4):600-612.
[18]
黄鹤,胡凯益,宋京,等.雾霾线求解透射率的二次优化方法[J].西安交通大学学报,2021,55(8):130-138.
HUANG H,HU K Y,SONG J,et al. Twice optimization method for solving transmittance with haze-lines[J].Journal of Xi'an Jiaotong University,2021,55(8):130-138.
2025年第47卷第2期
PDF下载
320
126
引用本文
BibTeX
文章信息
doi: 10.19562/j.chinasae.qcgc.2025.02.002
  • 接收时间:2024-07-23
  • 首发时间:2025-07-09
  • 出版时间:2025-02-25
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2024-07-23
  • 修回日期:2024-08-29
基金
*国家自然科学基金面上项目(52472446)
国家重点研发计划项目(2021YFB2501200)
陕西省留学人员科技活动择优资助项目(2023001)
中央高校基本科研业务费资助项目(300102324501)
作者信息
    1 长安大学电子与控制工程学院,西安 710064
    2 西安市智慧高速公路信息融合与控制重点实验室,西安 710064
    3 长安大学信息工程学院,西安 710064

通讯作者:

黄鹤,教授,博士生导师,E-mail:
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/qcygc/CN/10.19562/j.chinasae.qcgc.2025.02.002
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏