Article(id=1190284124809167323, tenantId=1146029695717560320, journalId=1189918454225211397, issueId=1190290597995970659, articleNumber=null, orderNo=null, doi=10.20104/j.cnki.1674-6546.20250039, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=research-article, receivedDate=null, receivedDateStr=null, revisedDate=1741276800000, revisedDateStr=2025-03-07, acceptedDate=null, acceptedDateStr=null, onlineDate=1761715449763, onlineDateStr=2025-10-29, pubDate=1755187200000, pubDateStr=2025-08-15, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1761716993398, onlineIssueDateStr=2025-10-29, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=1761715449763, onlineFirstDateStr=2025-10-29, sourceXml=null, magXml=null, createTime=1761715449763, creator=13701087609, updateTime=1761715449763, updator=13701087609, issue=Issue{id=1190290597995970659, tenantId=1146029695717560320, journalId=1189918454225211397, year='2025', volume='', issue='8', pageStart='1', pageEnd='48', issueExtLink='null', onlineDate='null', pubDate='null', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=1, specialIssue=null, createTime=1761716993092, creator=13701087609, updateTime=1761717119370, updator=13701087609, preIssue=null, nextIssue=null, ext={EN=IssueExt(id=1190291127711404379, tenantId=1146029695717560320, journalId=1189918454225211397, issueId=1190290597995970659, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1190291127711404380, tenantId=1146029695717560320, journalId=1189918454225211397, issueId=1190290597995970659, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null}, startPage=15, endPage=21, ext={EN=ArticleExt(id=1190284124989522399, articleId=1190284124809167323, tenantId=1146029695717560320, journalId=1189918454225211397, language=EN, title=Construction of a Multimodal Perception Dataset for Autonomous Driving in Typical Scenarios, columnId=null, journalTitle=Automotive Engineer, columnName=null, runingTitle=null, highlight=null, articleAbstract=

To address the scarcity of multi-source heterogeneous data and insufficient scenario adaptability in current perception algorithm training and testing of autonomous driving, a typical scenario-based multimodal perception dataset is constructed. It contains 10 specific typical scenario segments, covering multimodal sensor data from LiDAR, cameras, and 4D millimeter-wave radar. The dateset provides annotation information for six categories of targets and offers detailed descriptions of data acquisition device configurations, including sensor parameters, calibration data, and a time synchronization processing scheme. By delivering scenario-specific driving context, the constructed dataset enhances perception accuracy in complex environments, thereby improving the safety and reliability of autonomous driving systems.

, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=Yi Liu, Yao Wang, Shikang Pei, Shuda Wang, Yanbao Qu, Wenjing Bai), CN=ArticleExt(id=1190284318942528082, articleId=1190284124809167323, tenantId=1146029695717560320, journalId=1189918454225211397, language=CN, title=基于自动驾驶典型场景的多模态感知数据集构建*, columnId=1190284124830142945, journalTitle=汽车工程师, columnName=智能车辆环境感知与智能决策技术专刊, runingTitle=null, highlight=null, articleAbstract=

针对当前自动驾驶感知算法训练与测试过程中出现的多源异构数据稀缺、场景适配性不足等问题,构建了基于典型场景的多模态感知数据集,包含10个特定典型场景片段,涵盖激光雷达、摄像头和4D毫米波雷达等多模态传感器数据,提供了6种类别目标物的标注信息,并详细描述了数据采集设备的配置信息,包括传感器参数、标定数据和时间同步处理方案。所构建的数据集可为自动驾驶感知算法提供特定的驾驶场景信息,提升算法在复杂场景下的感知精度,从而提高自动驾驶系统的安全性与可靠性。

, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=unIKnq4kvrHwEacaZaqx3A==, magXml=x4uUJtCa0B4vIvzSlabXLA==, pdfUrl=null, pdf=5wvl+PgkKmQIzWYUJGyAmw==, pdfFileSize=9359228, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=wPP32s3UvVKc0IFgoWkr1A==, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=1zGKFJeJHqRRGZW1wBM5FA==, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=刘艺, 王瑶, 裴世康, 王树达, 屈雁宝, 白文静)}, authors=[Author(id=1194610944367109018, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1194610944450995101, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610944367109018, language=EN, stringName=Yi Liu, firstName=Yi, middleName=null, lastName=Liu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1194610944551658399, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610944367109018, language=CN, stringName=刘艺, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国汽(北京)智能网联汽车研究院有限公司, 北京 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1194610944270640020, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, xref=null, ext=[AuthorCompanyExt(id=1194610944279028629, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176), AuthorCompanyExt(id=1194610944287417238, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国汽(北京)智能网联汽车研究院有限公司, 北京 100176)])]), Author(id=1194610944610378658, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1194610944664904613, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610944610378658, language=EN, stringName=Yao Wang, firstName=Yao, middleName=null, lastName=Wang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1194610944723624871, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610944610378658, language=CN, stringName=王瑶, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国汽(北京)智能网联汽车研究院有限公司, 北京 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1194610944270640020, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, xref=null, ext=[AuthorCompanyExt(id=1194610944279028629, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176), AuthorCompanyExt(id=1194610944287417238, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国汽(北京)智能网联汽车研究院有限公司, 北京 100176)])]), Author(id=1194610944786539433, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1194610944862036908, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610944786539433, language=EN, stringName=Shikang Pei, firstName=Shikang, middleName=null, lastName=Pei, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1194610944929145774, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610944786539433, language=CN, stringName=裴世康, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国汽(北京)智能网联汽车研究院有限公司, 北京 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1194610944270640020, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, xref=null, ext=[AuthorCompanyExt(id=1194610944279028629, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176), AuthorCompanyExt(id=1194610944287417238, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国汽(北京)智能网联汽车研究院有限公司, 北京 100176)])]), Author(id=1194610944992060337, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1194610945075946419, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610944992060337, language=EN, stringName=Shuda Wang, firstName=Shuda, middleName=null, lastName=Wang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1194610945218552757, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610944992060337, language=CN, stringName=王树达, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国汽(北京)智能网联汽车研究院有限公司, 北京 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1194610944270640020, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, xref=null, ext=[AuthorCompanyExt(id=1194610944279028629, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176), AuthorCompanyExt(id=1194610944287417238, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国汽(北京)智能网联汽车研究院有限公司, 北京 100176)])]), Author(id=1194610945281467320, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1194610945377936315, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610945281467320, language=EN, stringName=Yanbao Qu, firstName=Yanbao, middleName=null, lastName=Qu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1194610945445045181, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610945281467320, language=CN, stringName=屈雁宝, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国汽(北京)智能网联汽车研究院有限公司, 北京 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1194610944270640020, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, xref=null, ext=[AuthorCompanyExt(id=1194610944279028629, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176), AuthorCompanyExt(id=1194610944287417238, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国汽(北京)智能网联汽车研究院有限公司, 北京 100176)])]), Author(id=1194610945524736960, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1194610945642177475, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610945524736960, language=EN, stringName=Wenjing Bai, firstName=Wenjing, middleName=null, lastName=Bai, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1194610945726063557, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, authorId=1194610945524736960, language=CN, stringName=白文静, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=国汽(北京)智能网联汽车研究院有限公司, 北京 100176, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1194610944270640020, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, xref=null, ext=[AuthorCompanyExt(id=1194610944279028629, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176), AuthorCompanyExt(id=1194610944287417238, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国汽(北京)智能网联汽车研究院有限公司, 北京 100176)])])], keywords=[Keyword(id=1194610945868669896, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, orderNo=1, keyword=Perception dataset), Keyword(id=1194610945939973066, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, orderNo=2, keyword=Typical scenarios), Keyword(id=1194610946002887628, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, orderNo=3, keyword=Multimodal), Keyword(id=1194610946061607886, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, orderNo=4, keyword=Autonomous driving), Keyword(id=1194610946132911056, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, orderNo=1, keyword=感知数据集), Keyword(id=1194610946246157266, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, orderNo=2, keyword=典型场景), Keyword(id=1194610946304877524, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, orderNo=3, keyword=多模态), Keyword(id=1194610946367792086, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, orderNo=4, keyword=自动驾驶)], refs=[Reference(id=1194610950121694201, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[1], rfOrder=0, authorNames=代振钊, journalName=面向自动驾驶的多模态融合感知技术研究, refType=null, unstructuredReference=代振钊. 面向自动驾驶的多模态融合感知技术研究[D]. 北京: 北方工业大学, 2024., articleTitle=null, refAbstract=null), Reference(id=1194610950192997370, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[1], rfOrder=1, authorNames=DAI Z Z, journalName=Research on Multimodal Fusion Perception Technology for Autonomous Driving, refType=null, unstructuredReference=DAI Z Z. Research on Multimodal Fusion Perception Technology for Autonomous Driving[D]. Beijing: North China University of Technology, 2024., articleTitle=null, refAbstract=null), Reference(id=1194610950264300539, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2024, volume=54, issue=6, pageStart=1283, pageEnd=1318, url=null, language=null, rfNumber=[2], rfOrder=2, authorNames=李弘扬, 李阳, 王晖杰, journalName=中国科学:信息科学, refType=null, unstructuredReference=李弘扬, 李阳, 王晖杰, 等. 自动驾驶开源数据体系:现状与未来[J]. 中国科学:信息科学, 2024, 54(6): 1283-1318., articleTitle=自动驾驶开源数据体系:现状与未来, refAbstract=null), Reference(id=1194610950364963836, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2024, volume=54, issue=6, pageStart=1283, pageEnd=1318, url=null, language=null, rfNumber=[2], rfOrder=3, authorNames=LI H Y, LI Y, WANG H J, journalName=Scientia Sinica (Informationis), refType=null, unstructuredReference=LI H Y, LI Y, WANG H J, et al. Open-Sourced Data Ecosystem in Autonomous Driving: The Present and Future[J]. Scientia Sinica (Informationis), 2024, 54(6): 1283-1318., articleTitle=Open-Sourced Data Ecosystem in Autonomous Driving: The Present and Future, refAbstract=null), Reference(id=1194610950448849917, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2019, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[3], rfOrder=4, authorNames=SUN P, KRETZSCHMAR H, DOTIWALLA X, journalName=2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), refType=null, unstructuredReference=SUN P, KRETZSCHMAR H, DOTIWALLA X, et al. Scalability in Perception for Autonomous Driving:Waymo Open Dataset[C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, WA, USA: IEEE, 2019., articleTitle=Scalability in Perception for Autonomous Driving:Waymo Open Dataset[C], refAbstract=null), Reference(id=1194610950524347390, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2020, volume=null, issue=null, pageStart=11618, pageEnd=11628, url=null, language=null, rfNumber=[4], rfOrder=5, authorNames=CAESAR H, BANKITI V, LANG A H, journalName=2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, refType=null, unstructuredReference=CAESAR H, BANKITI V, LANG A H, et al. nuScenes: A Multimodal Dataset for Autonomous Driving[C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, WA, USA: IEEE, 2020: 11618-11628., articleTitle=nuScenes: A Multimodal Dataset for Autonomous Driving, refAbstract=null), Reference(id=1194610950608233471, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2012, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[5], rfOrder=6, authorNames=GEIGER A, LENZ P, URTASUN R, journalName=2012 IEEE Conference on Computer Vision and Pattern Recognition, refType=null, unstructuredReference=GEIGER A, LENZ P, URTASUN R. Are We Ready for Autonomous Driving? The KITTI Vision Benchmark Suite[C]// 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI, USA: IEEE, 2012., articleTitle=Are We Ready for Autonomous Driving? The KITTI Vision Benchmark Suite, refAbstract=null), Reference(id=1194610950696313856, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2016, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[6], rfOrder=7, authorNames=CORDTS M, OMRAN M, RAMOS S, journalName=2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), refType=null, unstructuredReference=CORDTS M, OMRAN M, RAMOS S, et al. The Cityscapes Dataset for Semantic Urban Scene Understanding[C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, USA: IEEE, 2016., articleTitle=The Cityscapes Dataset for Semantic Urban Scene Understanding, refAbstract=null), Reference(id=1194610950771810304, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2020, volume=42, issue=10, pageStart=2702, pageEnd=2719, url=null, language=null, rfNumber=[7], rfOrder=8, authorNames=HUANG X Y, WANG P, CHENG X J, journalName=IEEE Transactions on Pattern Analysis and Machine Intelligence, refType=null, unstructuredReference=HUANG X Y, WANG P, CHENG X J, et al. The ApolloScape Open Dataset for Autonomous Driving and Its Application[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 42(10): 2702-2719., articleTitle=The ApolloScape Open Dataset for Autonomous Driving and Its Application, refAbstract=null), Reference(id=1194610950855696385, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2023, volume=8, issue=5, pageStart=3312, pageEnd=3323, url=null, language=null, rfNumber=[8], rfOrder=9, authorNames=ZHANG Y X, WANG C, YU R L, journalName=IEEE Transactions on Intelligent Vehicles, refType=null, unstructuredReference=ZHANG Y X, WANG C, YU R L, et al. The AD4CHE Dataset and Its Application in Typical Congestion Scenarios of Traffic Jam Pilot Systems[J]. IEEE Transactions on Intelligent Vehicles, 2023, 8(5): 3312-3323., articleTitle=The AD4CHE Dataset and Its Application in Typical Congestion Scenarios of Traffic Jam Pilot Systems, refAbstract=null), Reference(id=1194610950947971074, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=5, pageStart=31, pageEnd=47, url=null, language=null, rfNumber=[9], rfOrder=10, authorNames=王云鹏, 吴琼, 宋德王, journalName=人工智能, refType=null, unstructuredReference=王云鹏, 吴琼, 宋德王, 等. 自动驾驶数据集及3D目标感知方法综述[J]. 人工智能, 2023(5): 31-47., articleTitle=自动驾驶数据集及3D目标感知方法综述, refAbstract=null), Reference(id=1194610951061217283, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=5, pageStart=31, pageEnd=47, url=null, language=null, rfNumber=[9], rfOrder=11, authorNames=WANG Y P, WU Q, SONG D W, journalName=AI-View, refType=null, unstructuredReference=WANG Y P, WU Q, SONG D W, et al. A Survey on Autonomous Driving Datasets and 3D Object Perception Methods[J]. AI-View, 2023(5): 31-47., articleTitle=A Survey on Autonomous Driving Datasets and 3D Object Perception Methods, refAbstract=null), Reference(id=1194610951149297668, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[10], rfOrder=12, authorNames=自动驾驶标准工作组, journalName=天津: 全国汽车标准化技术委员会, refType=null, unstructuredReference=自动驾驶标准工作组. 智能网联汽车自动驾驶系统测试场景数据采集和分析标准需求研究报告[R]. 天津: 全国汽车标准化技术委员会, 2023., articleTitle=智能网联汽车自动驾驶系统测试场景数据采集和分析标准需求研究报告, refAbstract=null), Reference(id=1194610951220600837, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[10], rfOrder=13, authorNames=Autonomous Driving Standards Working Group, journalName=Tianjin:National Technical Committee of Auto Standardization, refType=null, unstructuredReference=Autonomous Driving Standards Working Group. Research Report on Data Collection and Analysis Standard Requirements for Automated Driving System Test Scenarios of Intelligent and Connected Vehicles[R]. Tianjin:National Technical Committee of Auto Standardization, 2023., articleTitle=Research Report on Data Collection and Analysis Standard Requirements for Automated Driving System Test Scenarios of Intelligent and Connected Vehicles, refAbstract=null)], funds=[Fund(id=1194610949958116344, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, awardId=2022YFB2503401, language=CN, fundingSource=*国家重点研发计划项目(2022YFB2503401), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1194610944270640020, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, xref=null, ext=[AuthorCompanyExt(id=1194610944279028629, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176), AuthorCompanyExt(id=1194610944287417238, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, companyId=1194610944270640020, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=国汽(北京)智能网联汽车研究院有限公司, 北京 100176)])], figs=[ArticleFig(id=1194610946556535769, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=nEm7BsHw0T14Osz5hXh8jg==, figureFileBig=KgaKdcamqB3+L4zmu9s64A==, tableContent=null), ArticleFig(id=1194610946623644635, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=图1, caption=传感器的安装位置示意, figureFileSmall=nEm7BsHw0T14Osz5hXh8jg==, figureFileBig=KgaKdcamqB3+L4zmu9s64A==, tableContent=null), ArticleFig(id=1194610946724307934, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=zG6jZik05FX9yNLrWuoyOQ==, figureFileBig=LXcCYY28Yy08sSxvB7tTvw==, tableContent=null), ArticleFig(id=1194610946799805407, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=图2, caption=200万像素摄像头坐标系标定结果, figureFileSmall=zG6jZik05FX9yNLrWuoyOQ==, figureFileBig=LXcCYY28Yy08sSxvB7tTvw==, tableContent=null), ArticleFig(id=1194610946862719968, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=Fl/+VjtWcWe6IRgiR9QX0w==, figureFileBig=kG9r8vS9pcx08rOhJ0Vm3w==, tableContent=null), ArticleFig(id=1194610946921440225, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=图3, caption=800万像素长焦摄像头坐标系标定结果, figureFileSmall=Fl/+VjtWcWe6IRgiR9QX0w==, figureFileBig=kG9r8vS9pcx08rOhJ0Vm3w==, tableContent=null), ArticleFig(id=1194610948037125090, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=PW/uvBqFY/6M6Pet/4tbbA==, figureFileBig=yuCJS23jBTx3f4kKi2y81Q==, tableContent=null), ArticleFig(id=1194610948116816867, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=图4, caption=800万像素广角摄像头坐标系标定结果, figureFileSmall=PW/uvBqFY/6M6Pet/4tbbA==, figureFileBig=yuCJS23jBTx3f4kKi2y81Q==, tableContent=null), ArticleFig(id=1194610948175537124, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=fU+xx7jF0cICogRcfhIh1w==, figureFileBig=ZCXFWzS0mqPYM5QTnZGYYg==, tableContent=null), ArticleFig(id=1194610948259423205, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=图5, caption=场景片段图像与点云可视化, figureFileSmall=fU+xx7jF0cICogRcfhIh1w==, figureFileBig=ZCXFWzS0mqPYM5QTnZGYYg==, tableContent=null), ArticleFig(id=1194610948368475110, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=0vJwuKlghR34ebdU2kcJGA==, figureFileBig=CsTjSZmfTrpkbunmjcX0bg==, tableContent=null), ArticleFig(id=1194610948460749799, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=图6, caption=联合标注结果可视化, figureFileSmall=0vJwuKlghR34ebdU2kcJGA==, figureFileBig=CsTjSZmfTrpkbunmjcX0bg==, tableContent=null), ArticleFig(id=1194610948532052968, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
传感器类型 安装位置
激光雷达 车顶中心
200万像素摄像头 车顶中心
800万像素摄像头 前风窗玻璃顶端中心
4D毫米波雷达 前保险杠面罩中心
组合惯导 车顶中心
), ArticleFig(id=1194610948632716265, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=表1, caption=

传感器的安装位置

, figureFileSmall=null, figureFileBig=null, tableContent=
传感器类型 安装位置
激光雷达 车顶中心
200万像素摄像头 车顶中心
800万像素摄像头 前风窗玻璃顶端中心
4D毫米波雷达 前保险杠面罩中心
组合惯导 车顶中心
), ArticleFig(id=1194610948691436522, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
传感器类型 坐标系原点 坐标轴方向
激光雷达 雷达几何中心 x轴水平向右,y轴水平向前,z轴竖直向上(右手坐标系)
摄像头 摄像头
光学中心
x轴和y轴分别与图像平面坐标系的x轴和y轴平行,z轴与摄像头光轴平行向前,且与图像平面垂直
4D毫米波雷达 雷达几何中心 x轴水平向前,y轴水平向左,z轴竖直向上(右手坐标系)
), ArticleFig(id=1194610948792099819, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=表2, caption=

传感器坐标系定义

, figureFileSmall=null, figureFileBig=null, tableContent=
传感器类型 坐标系原点 坐标轴方向
激光雷达 雷达几何中心 x轴水平向右,y轴水平向前,z轴竖直向上(右手坐标系)
摄像头 摄像头
光学中心
x轴和y轴分别与图像平面坐标系的x轴和y轴平行,z轴与摄像头光轴平行向前,且与图像平面垂直
4D毫米波雷达 雷达几何中心 x轴水平向前,y轴水平向左,z轴竖直向上(右手坐标系)
), ArticleFig(id=1194610948875985900, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
参数 取值
x轴方向偏移量/m -2.8
y轴方向偏移量/m 0
z轴方向偏移量/m 1.23
x轴旋转角度(Roll)/rad -1.547 849 993 705 755
y轴旋转角度(Pitch)/rad 0
z轴旋转角度(Yaw)/rad 0
), ArticleFig(id=1194610948976649197, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=表3, caption=

4D毫米波雷达坐标系标定结果

, figureFileSmall=null, figureFileBig=null, tableContent=
参数 取值
x轴方向偏移量/m -2.8
y轴方向偏移量/m 0
z轴方向偏移量/m 1.23
x轴旋转角度(Roll)/rad -1.547 849 993 705 755
y轴旋转角度(Pitch)/rad 0
z轴旋转角度(Yaw)/rad 0
), ArticleFig(id=1194610949039563758, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
参数 取值
x轴方向偏移量/m 0
y轴方向偏移量/m 0
z轴方向偏移量/m -0.135
x轴旋转角度(Roll)/rad 0
y轴旋转角度(Pitch)/rad 0
z轴旋转角度(Yaw)/rad 0
), ArticleFig(id=1194610949106672623, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=表4, caption=

RTK组合惯导坐标系标定结果

, figureFileSmall=null, figureFileBig=null, tableContent=
参数 取值
x轴方向偏移量/m 0
y轴方向偏移量/m 0
z轴方向偏移量/m -0.135
x轴旋转角度(Roll)/rad 0
y轴旋转角度(Pitch)/rad 0
z轴旋转角度(Yaw)/rad 0
), ArticleFig(id=1194610949182170096, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
场景
编号
场景名称 场景类型 备注
场景1 scenario_1 切入 前车右侧切入
场景2 scenario_2 自车向右切入后向左切出
场景3 scenario_3 切出 前车向左切出
场景4 scenario_4 自车向左切出
场景5 scenario_5 交通灯起步 对向公交车左转
场景6 scenario_6 跟随公交车起步
场景7 scenario_7 跟车
场景8 scenario_8 目标物复杂 货车、摩托车、自行车等
场景9 scenario_9 特殊场景 立交桥
场景10 scenario_10 桥梁
), ArticleFig(id=1194610949257667569, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=表5, caption=

数据集典型场景片段介绍

, figureFileSmall=null, figureFileBig=null, tableContent=
场景
编号
场景名称 场景类型 备注
场景1 scenario_1 切入 前车右侧切入
场景2 scenario_2 自车向右切入后向左切出
场景3 scenario_3 切出 前车向左切出
场景4 scenario_4 自车向左切出
场景5 scenario_5 交通灯起步 对向公交车左转
场景6 scenario_6 跟随公交车起步
场景7 scenario_7 跟车
场景8 scenario_8 目标物复杂 货车、摩托车、自行车等
场景9 scenario_9 特殊场景 立交桥
场景10 scenario_10 桥梁
), ArticleFig(id=1194610949324776434, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
代号 目标物类型
0 未知
1 行人
1.1 成人
1.2 儿童
2 自行车/摩托车/三轮车/手推车
2.1 自行车
2.1.0 未分类/无法确定有无人骑自行车
2.1.1 无人骑自行车
2.1.2 有人骑自行车
2.2 三轮车
2.2.0 未分类/无法确定有无人骑三轮
2.2.1 无人骑三轮车
2.2.2 有人骑三轮车
2.3 摩托车
2.3.0 未分类/无法确定有无人骑摩托车
2.3.1 无人骑摩托车
2.3.2 有人骑摩托车
2.4 手推车
2.4.0 无法确认有无人手推车
2.4.1 无人手推车
2.4.2 有人手推车
3 小型车辆
3.1 乘用车
4 大型车辆
4.1 客车
4.2 货车
5 静态目标物
5.1 交通锥筒
5.2 交通标牌
), ArticleFig(id=1194610949391885299, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=表6, caption=

4D目标物类型及对应类别代号

, figureFileSmall=null, figureFileBig=null, tableContent=
代号 目标物类型
0 未知
1 行人
1.1 成人
1.2 儿童
2 自行车/摩托车/三轮车/手推车
2.1 自行车
2.1.0 未分类/无法确定有无人骑自行车
2.1.1 无人骑自行车
2.1.2 有人骑自行车
2.2 三轮车
2.2.0 未分类/无法确定有无人骑三轮
2.2.1 无人骑三轮车
2.2.2 有人骑三轮车
2.3 摩托车
2.3.0 未分类/无法确定有无人骑摩托车
2.3.1 无人骑摩托车
2.3.2 有人骑摩托车
2.4 手推车
2.4.0 无法确认有无人手推车
2.4.1 无人手推车
2.4.2 有人手推车
3 小型车辆
3.1 乘用车
4 大型车辆
4.1 客车
4.2 货车
5 静态目标物
5.1 交通锥筒
5.2 交通标牌
), ArticleFig(id=1194610949467382772, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
交通参与者 出现频次
场景1 场景2 场景3 场景4 场景5 场景6 场景7 场景8 场景9 场景10
乘用车 33 106 52 35 44 22 40 37 31 110
货车 7 4 2 4 0 8 8 2 2 1
客车 0 1 0 0 2 1 32 2 0 18
三轮车 0 0 0 0 0 0 2 0 0 3
无人骑摩托车 12 62 0 106 13 0 0 5 0 6
有人骑摩托车 0 4 6 0 10 2 4 3 1 7
无人骑自行车 2 9 15 3 0 0 0 38 0 3
有人骑自行车 1 0 0 0 1 0 0 3 0 0
成人 7 5 1 12 11 4 5 2 0 4
儿童 0 0 0 2 0 0 0 0 0 0
), ArticleFig(id=1194610949555463157, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=表7, caption=

主要交通参与者统计 次

, figureFileSmall=null, figureFileBig=null, tableContent=
交通参与者 出现频次
场景1 场景2 场景3 场景4 场景5 场景6 场景7 场景8 场景9 场景10
乘用车 33 106 52 35 44 22 40 37 31 110
货车 7 4 2 4 0 8 8 2 2 1
客车 0 1 0 0 2 1 32 2 0 18
三轮车 0 0 0 0 0 0 2 0 0 3
无人骑摩托车 12 62 0 106 13 0 0 5 0 6
有人骑摩托车 0 4 6 0 10 2 4 3 1 7
无人骑自行车 2 9 15 3 0 0 0 38 0 3
有人骑自行车 1 0 0 0 1 0 0 3 0 0
成人 7 5 1 12 11 4 5 2 0 4
儿童 0 0 0 2 0 0 0 0 0 0
), ArticleFig(id=1194610949647737846, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
数据集 Waymo nuScenes KITTI Cityscapes ApolloScape 本文数据集
采集地点 美国 波士顿、新加坡 卡尔斯鲁厄 德国及附近国家50个城市 北京、上海、深圳 北京
环境特征 雨、夜间、黄昏等 雨、夜间、黄昏等 白天等 春、夏、秋季良好天气条件 良好、极端天气条件 白天、黄昏
道路特征 城市、高速、住宅区、乡村 城市 住宅区、乡村和高速公路等 城市 高速、城市、校园 城市
传感器
配置
5个摄像头(200万像素)、5个激光雷达 6个摄像头(140万像素)、1个激光雷达(32线)、5个毫米波雷达、GPS 4个摄像头(140万像素,2个灰度和2个彩色)、1个激光雷达(64线)、GPS 2个摄像头(立体双目) 7个900万像素摄像头、1个激光雷达、GPS 3个摄像头(1个200万像素,2个800万像素)、1个激光雷达(128线)、1个4D毫米波雷达、GPS
标注形式 三维边界框、
二维边界框
三维边界框 三维边界框、
二维边界框
语义分割 语义分割 三维边界框、
二维边界框
标注类别 4大类 23类 8类 30余类 26类 6大类19小类
), ArticleFig(id=1194610949756789751, tenantId=1146029695717560320, journalId=1189918454225211397, articleId=1190284124809167323, language=CN, label=表8, caption=

同类数据集对比

, figureFileSmall=null, figureFileBig=null, tableContent=
数据集 Waymo nuScenes KITTI Cityscapes ApolloScape 本文数据集
采集地点 美国 波士顿、新加坡 卡尔斯鲁厄 德国及附近国家50个城市 北京、上海、深圳 北京
环境特征 雨、夜间、黄昏等 雨、夜间、黄昏等 白天等 春、夏、秋季良好天气条件 良好、极端天气条件 白天、黄昏
道路特征 城市、高速、住宅区、乡村 城市 住宅区、乡村和高速公路等 城市 高速、城市、校园 城市
传感器
配置
5个摄像头(200万像素)、5个激光雷达 6个摄像头(140万像素)、1个激光雷达(32线)、5个毫米波雷达、GPS 4个摄像头(140万像素,2个灰度和2个彩色)、1个激光雷达(64线)、GPS 2个摄像头(立体双目) 7个900万像素摄像头、1个激光雷达、GPS 3个摄像头(1个200万像素,2个800万像素)、1个激光雷达(128线)、1个4D毫米波雷达、GPS
标注形式 三维边界框、
二维边界框
三维边界框 三维边界框、
二维边界框
语义分割 语义分割 三维边界框、
二维边界框
标注类别 4大类 23类 8类 30余类 26类 6大类19小类
)], attaches=null, journal=Journal(id=1189918244568731652, delFlag=0, nameCn=汽车工程师, nameEn=Automotive Engineer, nameHistory1=null, nameHistory2=null, issn=1674-6546, eissn=null, cn=22-1432/U, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=+bJsKkKt/pjz9u6EwhnksQ==, journalPrice=null, startedYear=null, abbrevIsoEn=null, journalRemark=null, publicationField=null, createdTime=1761628217121, updatedTime=1761735708780, createdBy=18614031015, updatedBy=13701087609, firstLetterCn=A, firstLetterEn=A, subjectCode=Engineering, subjectName=Engineering, subjectCodeEn=Engineering, subjectNameEn=null, picCn=+bJsKkKt/pjz9u6EwhnksQ==, picEn=O3Sn3tnYYrh/jm6emnnMWA==, jcr=null, cjcr=null, exts=[JournalExt(id=1190369097415233706, language=CN, name=汽车工程师, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1761735708812, updatedTime=1761735708812, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=1, submissionEditorUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=3, submissionReviewUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=2, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1190369097553645739, language=EN, name=Automotive Engineer, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1761735708845, updatedTime=1761735708845, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=1, submissionEditorUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=3, submissionReviewUrl=https://tjqc.cbpt.cnki.net/index.aspx?t=2, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1189918454225211397, websiteList=[Website(id=1189918982430847716, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1189918454225211397, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/qcgcs/CN, language=CN, createTime=1761628393037, createBy=18614031015, updateTime=1761628422913, updateBy=18614031015, name=汽车工程师-中文, tplId=1146099689490845704, title=汽车工程师, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1189919800185917791, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=articleTextType, value=kx, createTime=1761628588005, updateTime=1761628588005, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800164946268, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=banner, value=null, createTime=1761628588000, updateTime=1761628588000, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800211083618, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=grayFlag, value=0, createTime=1761628588011, updateTime=1761628588011, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800156557659, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=logo, value=https://castjournals.cast.org.cn/joweb/qcgcs/CN/file/pic?fileId=yiZ96RYoYcnGnRMuWdmkWA==, createTime=1761628587998, updateTime=1761628587998, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800223666532, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=minRunFlag, value=0, createTime=1761628588014, updateTime=1761628588014, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800181723486, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/qcgcs/CN/file/pic, createTime=1761628588004, updateTime=1761628588004, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800215277923, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=silenceFlag, value=0, createTime=1761628588012, updateTime=1761628588012, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800173334877, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1761628588002, updateTime=1761628588002, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800194306400, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=themeColor, value=null, createTime=1761628588007, updateTime=1761628588007, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919800202695009, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982430847716, code=themeStyle, value=null, createTime=1761628588009, updateTime=1761628588009, creator=18614031015, updator=18614031015)]), Website(id=1189918982527316711, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1189918454225211397, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/qcgcs/EN, language=EN, createTime=1761628393061, createBy=18614031015, updateTime=1761628543075, updateBy=18614031015, name=汽车工程师-英文, tplId=1146101810881728533, title=Automotive Engineer, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1189919837561352952, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=articleTextType, value=kx, createTime=1761628596916, updateTime=1761628596916, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837540381429, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=banner, value=null, createTime=1761628596911, updateTime=1761628596911, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837582324475, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=grayFlag, value=0, createTime=1761628596921, updateTime=1761628596921, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837527798516, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=logo, value=https://castjournals.cast.org.cn/joweb/qcgcs/EN/file/pic?fileId=yiZ96RYoYcnGnRMuWdmkWA==, createTime=1761628596908, updateTime=1761628596908, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837594907389, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=minRunFlag, value=0, createTime=1761628596924, updateTime=1761628596924, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837557158647, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/qcgcs/EN/file/pic, createTime=1761628596915, updateTime=1761628596915, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837586518780, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=silenceFlag, value=0, createTime=1761628596922, updateTime=1761628596922, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837548770038, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1761628596913, updateTime=1761628596913, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837569741561, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=themeColor, value=null, createTime=1761628596918, updateTime=1761628596918, creator=18614031015, updator=18614031015), WebsiteProps(id=1189919837573935866, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189918982527316711, code=themeStyle, value=null, createTime=1761628596919, updateTime=1761628596919, creator=18614031015, updator=18614031015)])], journalTitle=汽车工程师, weixinUrl=null, journalUrl=https://tjqc.cbpt.cnki.net/, iacademicId=null, status=1, seqNo=null, journalTitleEn=Automotive Engineer, journalPhotoCn=+bJsKkKt/pjz9u6EwhnksQ==, journalPhotoEn=O3Sn3tnYYrh/jm6emnnMWA==, journalFirstLetter=A, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false), detailUrlCn=https://castjournals.cast.org.cn/joweb/qcgcs/CN/10.20104/j.cnki.1674-6546.20250039, detailUrlEn=https://castjournals.cast.org.cn/joweb/qcgcs/EN/10.20104/j.cnki.1674-6546.20250039, pdfUrlCn=https://castjournals.cast.org.cn/joweb/qcgcs/CN/PDF/10.20104/j.cnki.1674-6546.20250039, pdfUrlEn=https://castjournals.cast.org.cn/joweb/qcgcs/EN/PDF/10.20104/j.cnki.1674-6546.20250039, aliStartDate=null, aliEndDate=null, collectionFlag=false, citedCount=null, citedUrl=null, reference=null)
收藏切换
基于自动驾驶典型场景的多模态感知数据集构建*
收藏切换
PDF下载
刘艺 , 王瑶 , 裴世康 , 王树达 , 屈雁宝 , 白文静
汽车工程师 | 智能车辆环境感知与智能决策技术专刊 2025,(8): 15-21
收起
收藏切换
汽车工程师 | 智能车辆环境感知与智能决策技术专刊 2025, (8): 15-21
基于自动驾驶典型场景的多模态感知数据集构建*
全屏
刘艺, 王瑶, 裴世康, 王树达, 屈雁宝, 白文静
作者信息
  • 国汽(北京)智能网联汽车研究院有限公司, 北京 100176
Construction of a Multimodal Perception Dataset for Autonomous Driving in Typical Scenarios
Yi Liu, Yao Wang, Shikang Pei, Shuda Wang, Yanbao Qu, Wenjing Bai
Affiliations
  • China Intelligent and Connected Vehicles (Beijing) Research Institute Co., Ltd., Beijing 100176
出版时间: 2025-08-15 doi: 10.20104/j.cnki.1674-6546.20250039
文章导航
收藏切换

针对当前自动驾驶感知算法训练与测试过程中出现的多源异构数据稀缺、场景适配性不足等问题,构建了基于典型场景的多模态感知数据集,包含10个特定典型场景片段,涵盖激光雷达、摄像头和4D毫米波雷达等多模态传感器数据,提供了6种类别目标物的标注信息,并详细描述了数据采集设备的配置信息,包括传感器参数、标定数据和时间同步处理方案。所构建的数据集可为自动驾驶感知算法提供特定的驾驶场景信息,提升算法在复杂场景下的感知精度,从而提高自动驾驶系统的安全性与可靠性。

感知数据集  /  典型场景  /  多模态  /  自动驾驶

To address the scarcity of multi-source heterogeneous data and insufficient scenario adaptability in current perception algorithm training and testing of autonomous driving, a typical scenario-based multimodal perception dataset is constructed. It contains 10 specific typical scenario segments, covering multimodal sensor data from LiDAR, cameras, and 4D millimeter-wave radar. The dateset provides annotation information for six categories of targets and offers detailed descriptions of data acquisition device configurations, including sensor parameters, calibration data, and a time synchronization processing scheme. By delivering scenario-specific driving context, the constructed dataset enhances perception accuracy in complex environments, thereby improving the safety and reliability of autonomous driving systems.

Perception dataset  /  Typical scenarios  /  Multimodal  /  Autonomous driving
刘艺, 王瑶, 裴世康, 王树达, 屈雁宝, 白文静. 基于自动驾驶典型场景的多模态感知数据集构建*. 汽车工程师, 2025 , (8) : 15 -21 . DOI: 10.20104/j.cnki.1674-6546.20250039
Yi Liu, Yao Wang, Shikang Pei, Shuda Wang, Yanbao Qu, Wenjing Bai. Construction of a Multimodal Perception Dataset for Autonomous Driving in Typical Scenarios[J]. Automotive Engineer, 2025 , (8) : 15 -21 . DOI: 10.20104/j.cnki.1674-6546.20250039
随着自动驾驶技术的快速发展和智能交通系统的广泛应用,环境感知能力成为衡量自动驾驶车辆安全性能的核心指标。在复杂多变的交通环境中,感知系统的精准度与鲁棒性直接关系到自动驾驶车辆的安全性与可靠性。由于单一传感器的感知能力存在局限性,多传感器多模态数据融合成为提升自动驾驶感知性能的关键技术[1]。该技术基于摄像头、激光雷达、毫米波雷达以及全球导航卫星系统(Global Navigation Satellite System,GNSS)/惯性测量单元(Inertial Measurement Unit,IMU)等多种传感器的数据特征进行深度融合,为自动驾驶系统提供了更为丰富、全面且精确的环境理解信息,但现有解决方案仍面临复杂场景适应性等重大挑战。
为突破感知算法的研发瓶颈,学术界与产业界已构建了多个具有里程碑意义的多模态数据集[2]。以Waymo开放数据集(Waymo Open Dataset)[3]、nuScenes[4]、KITTI[5]为代表的开放数据集,通过融合激光雷达点云、视觉图像与毫米波雷达数据,构建了涵盖多气候条件、多光照强度和多地域特征的三维场景数据库。而Cityscapes[6]、ApolloScape[7]及中国异构环境自动驾驶数据集(Autonomous Driving Dataset for China’s Heterogeneous Environments,AD4CHE)[8]等数据集则聚焦于高精度语义分割与实例标注,为深度学习算法提供了可靠的训练基准。这些数据集不仅推动了感知算法在常规驾驶场景中的优化与提升,更为特殊场景下的算法鲁棒性研究奠定了基础[9]
基于现有数据集在场景覆盖度与数据模态丰富性方面的持续拓展,本文构建自动驾驶典型场景的多模态感知数据集,提供典型及特殊驾驶场景中的多维度感知信息,包括切入、切出、跟车和特殊场景等。数据集包含来自摄像头图像、激光雷达点云、4D毫米波雷达点云以及控制器局域网(Controller Area Network,CAN)总线数据等多种类型数据源的数据,并通过传感器标定和时间同步方案确保数据间的时空对齐。
数据集的原始数据来源于实车采集。采集车辆搭载了摄像头、激光雷达、4D毫米波雷达、定位设备以及车辆基础传感器数据采集设备等,由数据采集人员在真实道路场景中执行标准化采集流程,同步采集道路环境、车辆行驶状态、交通参与者等信息[10]。具体传感器配置及参数如下:
a. 配置128线激光雷达,最大探测距离为250 m,测量精度为±3 cm,每秒可输出2 304 000个数据点(单回波),水平扫描角度覆盖360°,垂直扫描角度范围为-25°~15°,可提供厘米级的三维环境点云数据。
b. 200万像素摄像头的分辨率为1 920×1 080,水平视场角为60°,垂直视场角为32°,采用F1.8光圈和6 mm焦距。800万像素长焦摄像头的分辨率为3 840×2 160,水平视场角为30°,垂直视场角为16°,采用F1.6光圈和15.3 mm焦距,最大光学畸变为-2.7%。800万像素广角摄像头的分辨率为3 840×2 160,水平视场角为120°,垂直视场角为66°,采用F1.6光圈和4.01 mm焦距,最大光学畸变为-57.9%。
c. 4D毫米波雷达的最大测量距离为300 m,中心频率为76.5 GHz,帧周期为100 ms,水平测角和垂直测角分别覆盖±20°和±10°。
d. 选用集成高精度陀螺仪、加速度计等传感器的组合惯导系统,并接入实时动态差分(Real-Time Kinematic,RTK)定位,可实现厘米级定位精度,能够实时提供车辆的姿态、速度和位置信息。
各传感器的安装位置如表1图1所示。
为确保数据集中各传感器数据的空间对齐,需明确各传感器的坐标系和标定方案。通过精确的标定,可以建立传感器之间的坐标转换关系,确保不同传感器在空间上的数据一致性。
传感器坐标系包括坐标系原点和坐标轴方向等关键信息,激光雷达、摄像头及4D毫米波雷达坐标系定义如表2所示。
多传感器融合的目的是实现汽车周边环境目标的有效识别和定位,由于各传感器成像和测量数据坐标系不同,需要先统一各传感器的测量坐标系,然后在统一的空间坐标系下,通过多传感器坐标转换参数标定,实现场景数据的空间配准。
通过在摄像头和激光雷达视野内提取共同的特征点计算激光雷达到摄像头的外参矩阵,从而将特征点从激光雷达坐标系转换到摄像头坐标系。在此过程中,不仅可以确定摄像头的内参、畸变系数,还能对其外参进行标定,结果如图2~图4所示。其中,摄像头外参矩阵(CameraExtrinsicMat)为4×4的矩阵,内参矩阵(CameraMat)为3×3的矩阵,畸变矩阵(DistCoeff)为1×5的矩阵。
通过激光雷达点云与毫米波雷达数据的对齐,计算出将激光雷达坐标系转换至4D毫米波雷达坐标系的外参矩阵,标定结果如表3所示。
RTK组合惯导与激光雷达安装在同一支架部件上,使二者的相对位置关系固定,RTK组合惯导到激光雷达的坐标系转换标定结果如表4所示。
数据集采用基于GPS协调世界时(UTC)的多传感器时间同步方法,实现多传感器数据间的时间对齐。通过时间同步模块,将秒脉冲信号(1 Pulse Per Second,1PPS)和GPS时间信息输入授时模块,可实现多传感器的时间同步。此外,当顶部激光雷达扫描至摄像头视场的中心位置时,会触发摄像头的曝光过程,所拍摄图像的时间戳即为曝光触发的时间点。这一机制确保了摄像头图像与激光雷达数据在时间维度上的高度一致。同时,激光雷达的时间戳记录了当前激光雷达帧完成一次完整旋转扫描的时刻。
为了保证同步精度,激光雷达和摄像头均以10 Hz的频率进行数据采集。此外,4D毫米波雷达点云数据也按照10 Hz的频率进行抽帧。数据集中激光雷达点云、4D毫米波雷达点云、图像和车辆姿态数据处理后的时间对齐精度为100 ms。这种综合性的时间同步方案有效协调了不同传感器的数据同步采集,确保了多模态数据在时间上的高精度对齐。
数据集包含10个不同的典型场景片段,每个片段持续时间为10 s,均配有图像、激光雷达点云、4D毫米波雷达点云、自车姿态信息、轨迹信息和标注信息。原始数据采集由具备测绘资质的人员和设备完成,涉及的所有敏感信息均已进行脱敏处理,确保数据的合法性和安全性。典型场景片段的设计充分考虑了实际驾驶中的复杂性与多样性,涵盖了切入、切出、跟车等常见驾驶操作,以及交通灯起步、立交桥等特殊场景。表5给出了各典型场景片段的内容,提供了清晰的场景分类与特征概述。同时,图5通过直观的可视化手段,展示了典型场景片段中的图像与点云数据。
数据集采用商业标注软件进行人工标注。采用人工核查的方式对标注结果进行核查,各类标注结果准确率和召回率均高于98%。
数据集中标注对象分为6个类别,分别为未知、行人、自行车/摩托车/三轮车/手推车、小型车辆、大型车辆和静态目标物。每个类别细分为若干子类,以确保对各种目标物类型进行详细分类和精准标注。具体目标物类型及对应类别代号如表6所示。
根据以上分类对点云和图像进行联合标注,结果如图6所示。
对10个典型场景中的主要交通参与者进行统计,结果如表7所示,反映了各类主要交通参与者在不同典型场景中呈现的差异性特征。
对于机动车辆:乘用车作为主导交通元素,在全部场景中均显著出现(总频次486次),尤其是在场景2和场景10中出现的频率最高;货车在场景6和场景7中出现频率较高;三轮车在场景7和场景10中有所出现;客车在场景7和场景10中出现频率较高。
对于非机动车辆:无人骑摩托车在场景4中出现的频率远高于其他场景;有人骑摩托车的分布较为分散,场景5和场景10较多;无人骑自行车在场景8中出现的频率最高;有人骑自行车在场景1和场景5等场景中出现。
对于行人:成人作为主要群体,出现在多个场景中,特别是在场景4和场景5中;儿童仅在场景4中偶有出现。
综上,数据集涵盖了丰富的交通参与者类型,为自动驾驶及相关领域的研究提供了高价值数据资源。
对本文提出的多模态感知数据集从采集地点、环境特征、道路特征、传感器配置、标注形式和类别方面与现有主流同类数据集进行对比,结果如表8所示。本文数据集采用了更高的传感器配置,同时,相对于其他数据集普遍以固定时长为数据片段,首次采用了场景化数据组织方式,筛选典型场景片段进行处理和标注。
本文数据集具有以下特点:
a. 多源异构数据融合:数据集汇聚了多种传感器数据,包含激光雷达点云、图像、4D毫米波雷达点云和组合惯导等多模态传感器数据,各传感器数据通过硬件级时间同步装置实现±5 ms精度对齐,有效解决了多源数据融合的时空错位问题。
b. 高精度数据获取:数据集采用了业界领先的传感器技术,确保了数据的高分辨率和高准确性。
c. 场景化数据组织:数据集覆盖了多种典型场景,包括切入、切出、交通灯起步等复杂的高质量交通场景片段,以便于对特定场景进行检索与应用,每个场景片段提供完整的传感器数据流、精准的时间戳(10 Hz同步采样)及数据描述文件。
d. 结构化数据架构:为了方便使用,数据集组织为结构化格式,每个数据样本包含时间戳、传感器信息、自车姿态信息、轨迹信息及标注信息。
本文数据集专为自动驾驶感知算法研发及测试构建,提供多模态全要素交通场景数据资源,主要应用价值体现在以下方面:
a. 多模态目标检测:融合激光雷达点云、摄像头图像与4D毫米波雷达的三维空间信息,支持车辆、行人、非机动车等多类道路目标的精准识别与分类,多源数据互补特性有效提升复杂光照及远距离场景下的检测鲁棒性。
b. 动态障碍物追踪:基于时间同步的多传感器数据流与目标物连续轨迹标注为实时障碍物运动状态分析提供了时空一致性基础,有助于实现高效的实时障碍物检测和跟踪。
c. 行为意图预测:包含历史运动轨迹的时序标注数据,为深度学习模型提供交通参与者行为模式分析样本,支撑转弯、变道等驾驶行为的预测算法训练与验证。
d. 系统性多场景训练:覆盖切入、切出、交通灯等典型场景,配备多类别目标物精细化标注,可系统评估感知算法在不同环境条件下的检测精度与泛化能力,为算法迭代优化提供多维度的基准测试平台。
本文提出的数据集提供了典型场景下高分辨率的多模态数据,不仅有助于提升感知算法的鲁棒性和准确性,还能加速算法的迭代和优化,满足不同方向算法的应用需求。未来,将致力于数据集的场景多样性扩充,覆盖更多极端与复杂的环境条件,为自动驾驶技术的研发提供更加坚实的数据支撑。
  • *国家重点研发计划项目(2022YFB2503401)
参考文献 引证文献
排序方式:
[1]
代振钊. 面向自动驾驶的多模态融合感知技术研究[D]. 北京: 北方工业大学, 2024.
DAI Z Z. Research on Multimodal Fusion Perception Technology for Autonomous Driving[D]. Beijing: North China University of Technology, 2024.
[2]
李弘扬, 李阳, 王晖杰, 等. 自动驾驶开源数据体系:现状与未来[J]. 中国科学:信息科学, 2024, 54(6): 1283-1318.
LI H Y, LI Y, WANG H J, et al. Open-Sourced Data Ecosystem in Autonomous Driving: The Present and Future[J]. Scientia Sinica (Informationis), 2024, 54(6): 1283-1318.
[3]
SUN P, KRETZSCHMAR H, DOTIWALLA X, et al. Scalability in Perception for Autonomous Driving:Waymo Open Dataset[C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, WA, USA: IEEE, 2019.
[4]
CAESAR H, BANKITI V, LANG A H, et al. nuScenes: A Multimodal Dataset for Autonomous Driving[C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, WA, USA: IEEE, 2020: 11618-11628.
[5]
GEIGER A, LENZ P, URTASUN R. Are We Ready for Autonomous Driving? The KITTI Vision Benchmark Suite[C]// 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence, RI, USA: IEEE, 2012.
[6]
CORDTS M, OMRAN M, RAMOS S, et al. The Cityscapes Dataset for Semantic Urban Scene Understanding[C]// 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, USA: IEEE, 2016.
[7]
HUANG X Y, WANG P, CHENG X J, et al. The ApolloScape Open Dataset for Autonomous Driving and Its Application[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 42(10): 2702-2719.
[8]
ZHANG Y X, WANG C, YU R L, et al. The AD4CHE Dataset and Its Application in Typical Congestion Scenarios of Traffic Jam Pilot Systems[J]. IEEE Transactions on Intelligent Vehicles, 2023, 8(5): 3312-3323.
[9]
王云鹏, 吴琼, 宋德王, 等. 自动驾驶数据集及3D目标感知方法综述[J]. 人工智能, 2023(5): 31-47.
WANG Y P, WU Q, SONG D W, et al. A Survey on Autonomous Driving Datasets and 3D Object Perception Methods[J]. AI-View, 2023(5): 31-47.
[10]
自动驾驶标准工作组. 智能网联汽车自动驾驶系统测试场景数据采集和分析标准需求研究报告[R]. 天津: 全国汽车标准化技术委员会, 2023.
Autonomous Driving Standards Working Group. Research Report on Data Collection and Analysis Standard Requirements for Automated Driving System Test Scenarios of Intelligent and Connected Vehicles[R]. Tianjin:National Technical Committee of Auto Standardization, 2023.
2025年第卷第8期
PDF下载
423
191
引用本文
BibTeX
文章信息
doi: 10.20104/j.cnki.1674-6546.20250039
  • 首发时间:2025-10-29
  • 出版时间:2025-08-15
补充材料
相关文章
文章信息
作者
出版历史
  • 修回日期:2025-03-07
基金
*国家重点研发计划项目(2022YFB2503401)
作者信息
    国汽(北京)智能网联汽车研究院有限公司, 北京 100176
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/qcgcs/CN/10.20104/j.cnki.1674-6546.20250039
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏