Article(id=1204386301475795345, tenantId=1146029695717560320, journalId=1189621681917173762, issueId=1204386298124546351, articleNumber=null, orderNo=null, doi=10.19620/j.cnki.1000-3703.20220911, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=research-article, receivedDate=null, receivedDateStr=null, revisedDate=1662825600000, revisedDateStr=2022-09-11, acceptedDate=null, acceptedDateStr=null, onlineDate=1765077670687, onlineDateStr=2025-12-07, pubDate=1700755200000, pubDateStr=2023-11-24, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1765077670687, onlineIssueDateStr=2025-12-07, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1765077670687, creator=13701087609, updateTime=1765077670687, updator=13701087609, issue=Issue{id=1204386298124546351, tenantId=1146029695717560320, journalId=1189621681917173762, year='2023', volume='', issue='11', pageStart='1', pageEnd='62', issueExtLink='null', onlineDate='null', pubDate='null', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1765077669888, creator=13701087609, updateTime=1765079314030, updator=13701087609, preIssue=null, nextIssue=null, ext={EN=IssueExt(id=1204393194214629961, tenantId=1146029695717560320, journalId=1189621681917173762, issueId=1204386298124546351, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1204393194214629962, tenantId=1146029695717560320, journalId=1189621681917173762, issueId=1204386298124546351, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null}, startPage=27, endPage=33, ext={EN=ArticleExt(id=1204386301719064989, articleId=1204386301475795345, tenantId=1146029695717560320, journalId=1189621681917173762, language=EN, title=Research on Dynamic Vehicle Multi-Object Tracking Method Based on DeepSort, columnId=null, journalTitle=Automobile Technology, columnName=null, runingTitle=null, highlight=null, articleAbstract=

In order to improve the environmental perceive ability and better predict the behaviors of dynamic vehicle targets, a YOLOX model, as the front-end detector, combined with the optimized DeepSort method was proposed to develop the research of dynamic vehicle Multi-Object Tracking. In the process of features matching for dynamic vehicles, the change information of vehicles in the degree of light and shade was extracted to improve the object matching accuracy by adding Haarlike features. Furthermore, based on the application of DeepSort RE-identification network, the improved ResNet13 model was adopted as the backbone network for feature extraction, and SENet was introduced to adjust the feature weight of different channel dimensions. The results show that, compared to the conventional DeepSort method, by using the real on-road video data, the Multi-Object Tracking Accuracy (MOTA) and IDF1 indicator of the proposed algorithm increased by 1.4 percentage points and 7.7 percentage points respectively.

, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=Weikun He, Yuhui Peng, Wei Huang, Yujie Yao, Zehui Chen), CN=ArticleExt(id=1204386304990622201, articleId=1204386301475795345, tenantId=1146029695717560320, journalId=1189621681917173762, language=CN, title=基于DeepSort的动态车辆多目标跟踪方法研究*, columnId=0, journalTitle=汽车技术, columnName=, runingTitle=null, highlight=null, articleAbstract=

为了提高汽车对外界环境信息的感知能力和对动态车辆目标行为的预测能力,采用YOLOX作为前端检测器,结合优化的DeepSort跟踪算法开展动态车辆多目标跟踪方法研究。在车辆特征匹配过程中,提取Haar-like特征对车辆的明暗变化信息进行匹配,提高物体匹配精度;基于DeepSort重识别网络,采用改进的ResNet13作为特征提取的骨干网络,加入SENet调整不同通道维度的特征权重。使用实际道路驾驶采集的视频数据对改进算法与传统算法进行对比,结果表明:相较于传统DeepSort算法,改进算法的多目标跟踪精度(MOTA)提高了1.4百分点,平均数比率(IDF1)提升了7.7百分点。

, correspAuthors=null, authorNote=null, correspAuthorsNote=
彭育辉(1975—),博士,教授,研究方向为汽车智能驾驶、汽车替代燃料等,
, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=sIZUOrwROMVckAQE3GSR7Q==, magXml=7YuoLxne2KvNzr2h1j3Llg==, pdfUrl=null, pdf=jV9hv9WtJkW1nfSnNEBWcw==, pdfFileSize=2293353, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=dFBlu6+YtItcO8evrT265g==, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=fnaGzApGOk/FhKV88TyWxw==, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=何维堃, 彭育辉, 黄炜, 姚宇捷, 陈泽辉)}, authors=[Author(id=1204452625669399074, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1204452625791033902, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, authorId=1204452625669399074, language=EN, stringName=Weikun He, firstName=Weikun, middleName=null, lastName=He, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=Fuzhou University, Fuzhou 350116, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1204452625904280119, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, authorId=1204452625669399074, language=CN, stringName=何维堃, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=福州大学,福州 350116, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1204452625535181325, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, xref=null, ext=[AuthorCompanyExt(id=1204452625543569934, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Fuzhou University, Fuzhou 350116), AuthorCompanyExt(id=1204452625560347156, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=福州大学,福州 350116)])]), Author(id=1204452626030109251, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=pengyuhui@fzu.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1204452626134966861, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, authorId=1204452626030109251, language=EN, stringName=Yuhui Peng, firstName=Yuhui, middleName=null, lastName=Peng, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=Fuzhou University, Fuzhou 350116, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1204452626218852952, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, authorId=1204452626030109251, language=CN, stringName=彭育辉, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=福州大学,福州 350116, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1204452625535181325, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, xref=null, ext=[AuthorCompanyExt(id=1204452625543569934, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Fuzhou University, Fuzhou 350116), AuthorCompanyExt(id=1204452625560347156, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=福州大学,福州 350116)])]), Author(id=1204452626332099169, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1204452626407596650, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, authorId=1204452626332099169, language=EN, stringName=Wei Huang, firstName=Wei, middleName=null, lastName=Huang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=Fuzhou University, Fuzhou 350116, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1204452626546008691, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, authorId=1204452626332099169, language=CN, stringName=黄炜, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=福州大学,福州 350116, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1204452625535181325, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, xref=null, ext=[AuthorCompanyExt(id=1204452625543569934, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Fuzhou University, Fuzhou 350116), AuthorCompanyExt(id=1204452625560347156, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=福州大学,福州 350116)])]), Author(id=1204452626680226434, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1204452626839610004, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, authorId=1204452626680226434, language=EN, stringName=Yujie Yao, firstName=Yujie, middleName=null, lastName=Yao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=Fuzhou University, Fuzhou 350116, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1204452626998993579, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, authorId=1204452626680226434, language=CN, stringName=姚宇捷, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=福州大学,福州 350116, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1204452625535181325, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, xref=null, ext=[AuthorCompanyExt(id=1204452625543569934, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Fuzhou University, Fuzhou 350116), AuthorCompanyExt(id=1204452625560347156, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=福州大学,福州 350116)])]), Author(id=1204452627091268279, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1204452627212903110, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, authorId=1204452627091268279, language=EN, stringName=Zehui Chen, firstName=Zehui, middleName=null, lastName=Chen, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=Fuzhou University, Fuzhou 350116, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1204452627330343637, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, authorId=1204452627091268279, language=CN, stringName=陈泽辉, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=福州大学,福州 350116, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1204452625535181325, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, xref=null, ext=[AuthorCompanyExt(id=1204452625543569934, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Fuzhou University, Fuzhou 350116), AuthorCompanyExt(id=1204452625560347156, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=福州大学,福州 350116)])])], keywords=[Keyword(id=1204452627762356987, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, orderNo=1, keyword=Multi-object tracking), Keyword(id=1204452627883991821, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, orderNo=2, keyword=DeepSort), Keyword(id=1204452628005626650, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, orderNo=3, keyword=Autonomous vehicle), Keyword(id=1204452628102095657, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, orderNo=4, keyword=Haar-like), Keyword(id=1204452628206953271, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, orderNo=5, keyword=SENet), Keyword(id=1204452628307616574, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, orderNo=1, keyword=多目标跟踪), Keyword(id=1204452628420862798, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, orderNo=2, keyword=DeepSort), Keyword(id=1204452628563469151, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, orderNo=3, keyword=自动驾驶), Keyword(id=1204452628706075500, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, orderNo=4, keyword=Haar-like), Keyword(id=1204452628815127419, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, orderNo=5, keyword=SENet)], refs=[Reference(id=1204452632728412504, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2021, volume=43, issue=11, pageStart=1587, pageEnd=1593, url=null, language=null, rfNumber=[1], rfOrder=0, authorNames=陈龙, 朱程铮, 蔡英凤, journalName=汽车工程, refType=null, unstructuredReference=陈龙, 朱程铮, 蔡英凤, 等. 基于自查询的车载多目标跟踪算法研究[J]. 汽车工程, 2021, 43(11): 1587-1593+1610., articleTitle=基于自查询的车载多目标跟踪算法研究, refAbstract=null), Reference(id=1204452632824881507, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2021, volume=43, issue=11, pageStart=1587, pageEnd=1593, url=null, language=null, rfNumber=[1], rfOrder=1, authorNames=CHEN L, ZHU C Z, CAI Y F, journalName=Automotive Engineering, refType=null, unstructuredReference=CHEN L, ZHU C Z, CAI Y F, et al. Research on Vehicle Multi-Target Environment Aware Tracking Algorithm Based on Self-Query[J]. Automotive Engineering, 2021, 43(11): 1587-1593+1610., articleTitle=Research on Vehicle Multi-Target Environment Aware Tracking Algorithm Based on Self-Query, refAbstract=null), Reference(id=1204452632946516334, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=14, issue=15, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[2], rfOrder=2, authorNames=CHEN X, JIA Y, TONG X, journalName=Sustainability, refType=null, unstructuredReference=CHEN X, JIA Y, TONG X, et al. Research on Pedestrian Detection and DeepSort Tracking in front of Intelligent Vehicle Based on Deep Learning[J]. Sustainability, 2022, 14(15)., articleTitle=Research on Pedestrian Detection and DeepSort Tracking in front of Intelligent Vehicle Based on Deep Learning, refAbstract=null), Reference(id=1204452633080734075, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2021, volume=null, issue=null, pageStart=305, pageEnd=309, url=null, language=null, rfNumber=[3], rfOrder=3, authorNames=PERERA I, SENAVIRATHNA S, JAYARATHNE A, journalName=Quebec City, refType=null, unstructuredReference=PERERA I, SENAVIRATHNA S, JAYARATHNE A, et al. Vehicle Tracking Based on An Improved DeepSORT Algorithm and the YOLOv4 Framework[C]// 2021 10th International Conference on Information and Automation for Sustainability (ICIAfS). Quebec City, Canada: IEEE, 2021: 305-309., articleTitle=Vehicle Tracking Based on An Improved DeepSORT Algorithm and the YOLOv4 Framework[C]// 2021 10th International Conference on Information and Automation for Sustainability (ICIAfS), refAbstract=null), Reference(id=1204452633223340427, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2021, volume=129, issue=2, pageStart=465, pageEnd=483, url=null, language=null, rfNumber=[4], rfOrder=4, authorNames=MU L, ZHAO H, LI Y, journalName=Computer Modeling in Engineering & Sciences, refType=null, unstructuredReference=MU L, ZHAO H, LI Y, et al. Traffic Flow Statistics Method Based on Deep Learning and Multi-Feature Fusion[J]. Computer Modeling in Engineering & Sciences, 2021, 129(2): 465-483., articleTitle=Traffic Flow Statistics Method Based on Deep Learning and Multi-Feature Fusion, refAbstract=null), Reference(id=1204452633328198036, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[5], rfOrder=5, authorNames=裴云成, journalName=基于DeepSORT的行人多目标跟踪算法研究与应用, refType=null, unstructuredReference=裴云成. 基于DeepSORT的行人多目标跟踪算法研究与应用[D]. 济南: 齐鲁工业大学, 2022., articleTitle=null, refAbstract=null), Reference(id=1204452633466610078, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[5], rfOrder=6, authorNames=PEI Y C, journalName=Research and Application of Pedestrian Multi-Target Tracking Algorithm Based on DeepSORT, refType=null, unstructuredReference=PEI Y C. Research and Application of Pedestrian Multi-Target Tracking Algorithm Based on DeepSORT[D]. Jinan: Qilu University of Technology, 2022., articleTitle=null, refAbstract=null), Reference(id=1204452633596633516, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2021, volume=55, issue=6, pageStart=1056, pageEnd=1064, url=null, language=null, rfNumber=[6], rfOrder=7, authorNames=金立生, 华强, 郭柏苍, journalName=浙江大学学报(工学版), refType=null, unstructuredReference=金立生, 华强, 郭柏苍, 等. 基于优化DeepSort的前方车辆多目标跟踪[J]. 浙江大学学报(工学版), 2021, 55(6): 1056-1064., articleTitle=基于优化DeepSort的前方车辆多目标跟踪, refAbstract=null), Reference(id=1204452633739239863, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2021, volume=55, issue=6, pageStart=1056, pageEnd=1064, url=null, language=null, rfNumber=[6], rfOrder=8, authorNames=JIN L S, HUA Q, GUO B C, journalName=Journal of Zhejiang University (Engineering Science), refType=null, unstructuredReference=JIN L S, HUA Q, GUO B C, et al. Multi-Target Tracking of Vehicles Based on Optimized DeepSort[J]. Journal of Zhejiang University (Engineering Science), 2021, 55(6): 1056-1064., articleTitle=Multi-Target Tracking of Vehicles Based on Optimized DeepSort, refAbstract=null), Reference(id=1204452633860874691, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=null, issue=null, pageStart=801, pageEnd=806, url=null, language=null, rfNumber=[7], rfOrder=9, authorNames=WU Y, WANG Y, ZHANG D, journalName=Xiamen, refType=null, unstructuredReference=WU Y, WANG Y, ZHANG D, et al. Research on Vehicle Tracking Method Based on UAV Video[C]// 2nd International Conference on Internet of Things and Smart City (IoTSC 2022). Xiamen, China: SPIE, 2022, 12249: 801-806., articleTitle=Research on Vehicle Tracking Method Based on UAV Video[C]// 2nd International Conference on Internet of Things and Smart City (IoTSC 2022), refAbstract=null), Reference(id=1204452633986703820, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=5, issue=3, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[8], rfOrder=10, authorNames=LIU H Y, PEI Y C, BEI Q C, journalName=Applied System Innovation, refType=null, unstructuredReference=LIU H Y, PEI Y C, BEI Q C, et al. Improved DeepSORT Algorithm Based on Multi Feature Fusion[J]. Applied System Innovation, 2022, 5(3)., articleTitle=Improved DeepSORT Algorithm Based on Multi Feature Fusion, refAbstract=null), Reference(id=1204452634045424086, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=1, pageEnd=9, url=null, language=null, rfNumber=[9], rfOrder=11, authorNames=弋英民, 王柯颖, 苑易伟, journalName=小型微型计算机系统, refType=null, unstructuredReference=弋英民, 王柯颖, 苑易伟, 等. 基于扩展卡尔曼滤波的固定翼无人机姿态解算方法[J/OL]. 小型微型计算机系统: 1-9 (2022-08-12)[2022-11-12]. http://kns.cnki.net/kcms/detail/21.1106.TP.20220729.1118.014.html., articleTitle=基于扩展卡尔曼滤波的固定翼无人机姿态解算方法, refAbstract=null), Reference(id=1204452634167058911, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=1, pageEnd=9, url=null, language=null, rfNumber=[9], rfOrder=12, authorNames=GE Y M, WANG K Y, WAN Y W, journalName=Journal of Chinese Computer Systems, refType=null, unstructuredReference=GE Y M, WANG K Y, WAN Y W, et al. Attitude Algorithm Method of Fixed-Wing UAV Based on Extended Kalman Filter[J/OL]. Journal of Chinese Computer Systems: 1-9 (2022-08-12)[2022-11-12]. http://kns.cnki.net/kcms/detail/21.1106.TP.20220729.1118.014.html., articleTitle=Attitude Algorithm Method of Fixed-Wing UAV Based on Extended Kalman Filter, refAbstract=null), Reference(id=1204452634305470955, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2002, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[10], rfOrder=13, authorNames=LIENHART R, MAYDT J, journalName=International Conference on Image Processing. Rochester, NY, refType=null, unstructuredReference=LIENHART R, MAYDT J. An Extended Set of Haar-Like Features for Rapid Object Detection[C]// International Conference on Image Processing. Rochester, NY, USA: IEEE, 2002., articleTitle=An Extended Set of Haar-Like Features for Rapid Object Detection, refAbstract=null), Reference(id=1204452634431300082, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2019, volume=38, issue=2, pageStart=42, pageEnd=45, url=null, language=null, rfNumber=[11], rfOrder=14, authorNames=黎向锋, 赵伟康, 豆心愿, journalName=测控技术, refType=null, unstructuredReference=黎向锋, 赵伟康, 豆心愿, 等. 基于改进AdaBoost+Haar的车辆检测算法[J]. 测控技术, 2019, 38(2): 42-45., articleTitle=基于改进AdaBoost+Haar的车辆检测算法, refAbstract=null), Reference(id=1204452634557129210, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2019, volume=38, issue=2, pageStart=42, pageEnd=45, url=null, language=null, rfNumber=[11], rfOrder=15, authorNames=LI X F, ZHAO K W, DOU X Y, journalName=Measurement & Control Technology, refType=null, unstructuredReference=LI X F, ZHAO K W, DOU X Y, et al. Vehicle Detection Algorithm Based on Improved AdaBoost and Haar[J]. Measurement & Control Technology, 2019, 38(2): 42-45., articleTitle=Vehicle Detection Algorithm Based on Improved AdaBoost and Haar, refAbstract=null), Reference(id=1204452634720707081, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2018, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[12], rfOrder=16, authorNames=储慧芳, journalName=基于深度特征与传统特征融合的行人再识别研究, refType=null, unstructuredReference=储慧芳. 基于深度特征与传统特征融合的行人再识别研究[D]. 合肥: 合肥工业大学, 2018., articleTitle=null, refAbstract=null), Reference(id=1204452634884284946, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2018, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[12], rfOrder=17, authorNames=CHU H F, journalName=Research on Person Re-identification Based on Fusion of Deep Features and Traditional Features, refType=null, unstructuredReference=CHU H F. Research on Person Re-identification Based on Fusion of Deep Features and Traditional Features[D]. Hefei: Hefei University of Technology, 2018., articleTitle=null, refAbstract=null), Reference(id=1204452634976559641, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2021, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[13], rfOrder=18, authorNames=敖为能, journalName=交通场景下基于深度学习的车辆检测方法研究, refType=null, unstructuredReference=敖为能. 交通场景下基于深度学习的车辆检测方法研究[D]. 长沙: 湘潭大学, 2021., articleTitle=null, refAbstract=null), Reference(id=1204452635144331817, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2021, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[13], rfOrder=19, authorNames=AO W N, journalName=Research on Vehicle Detection Method Based on Deep Learning in Traffic Scenarios, refType=null, unstructuredReference=AO W N. Research on Vehicle Detection Method Based on Deep Learning in Traffic Scenarios[D]. Changsha: Xiangtan University, 2021., articleTitle=null, refAbstract=null), Reference(id=1204452635265966637, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[14], rfOrder=20, authorNames=GE Z, LIU S T, WANG F, journalName=null, refType=null, unstructuredReference=GE Z, LIU S T, WANG F, et al. YOLOX:Exceeding YOLO Series in 2021[EB/OL]. (2021-08-06)[2022-11-12]. https://arxiv.org/abs/2107.08430., articleTitle=YOLOX:Exceeding YOLO Series in 2021, refAbstract=null), Reference(id=1204452635383407160, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=58, issue=5, pageStart=271, pageEnd=279, url=null, language=null, rfNumber=[15], rfOrder=21, authorNames=李永上, 马荣贵, 张美月, journalName=计算机工程与应用, refType=null, unstructuredReference=李永上, 马荣贵, 张美月. 改进YOLOv5s+DeepSORT的监控视频车流量统计[J]. 计算机工程与应用, 2022, 58(5): 271-279., articleTitle=改进YOLOv5s+DeepSORT的监控视频车流量统计, refAbstract=null), Reference(id=1204452635513430592, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=58, issue=5, pageStart=271, pageEnd=279, url=null, language=null, rfNumber=[15], rfOrder=22, authorNames=LI Y S, MA R G, ZHANG M Y, journalName=Computer Engineering and Applications, refType=null, unstructuredReference=LI Y S, MA R G, ZHANG M Y. Traffic Monitoring Video Vehicle Volume Statistics Method Based on Improved YOLOv5s+Deep SORT[J]. Computer Engineering and Applications, 2022, 58(5): 271-279., articleTitle=Traffic Monitoring Video Vehicle Volume Statistics Method Based on Improved YOLOv5s+Deep SORT, refAbstract=null), Reference(id=1204452635622482503, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2014, volume=null, issue=null, pageStart=27, pageEnd=null, url=null, language=null, rfNumber=[16], rfOrder=23, authorNames=MONTUFAR G F, PASCANU R, CHO K, journalName=Advances in Neural Information Processing Systems, refType=null, unstructuredReference=MONTUFAR G F, PASCANU R, CHO K, et al. On the Number of Linear Regions of Deep Neural Networks[J]. Advances in Neural Information Processing Systems, 2014, 27., articleTitle=On the Number of Linear Regions of Deep Neural Networks, refAbstract=null), Reference(id=1204452635760894549, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2007, volume=34, issue=5, pageStart=1, pageEnd=41, url=null, language=null, rfNumber=[17], rfOrder=24, authorNames=BENGIO Y, LECUN Y, journalName=Large-Scale Kernel Machines, refType=null, unstructuredReference=BENGIO Y, LECUN Y. Scaling Learning Algorithms Towards AI[J]. Large-Scale Kernel Machines, 2007, 34(5): 1-41., articleTitle=Scaling Learning Algorithms Towards AI, refAbstract=null), Reference(id=1204452635857363546, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=43, issue=5, pageStart=776, pageEnd=782, url=null, language=null, rfNumber=[18], rfOrder=25, authorNames=赵璐璐, 王学营, 张翼, journalName=图学学报, refType=null, unstructuredReference=赵璐璐, 王学营, 张翼, 等. 基于YOLOv5s融合SENet的车辆目标检测技术研究[J]. 图学学报, 2022, 43(5): 776-782., articleTitle=基于YOLOv5s融合SENet的车辆目标检测技术研究, refAbstract=null), Reference(id=1204452635945443936, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=43, issue=5, pageStart=776, pageEnd=782, url=null, language=null, rfNumber=[18], rfOrder=26, authorNames=ZHAO L L, WANG X Y, ZHANG Y, journalName=Journal of Graphics, refType=null, unstructuredReference=ZHAO L L, WANG X Y, ZHANG Y, et al. Vehicle Target Detection Based on YOLOv5s Fusion SENet[J]. Journal of Graphics, 2022, 43(5): 776-782., articleTitle=Vehicle Target Detection Based on YOLOv5s Fusion SENet, refAbstract=null), Reference(id=1204452636100633193, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=null, issue=8, pageStart=32, pageEnd=37, url=null, language=null, rfNumber=[19], rfOrder=27, authorNames=李守彪, 武志斐, journalName=汽车技术, refType=null, unstructuredReference=李守彪, 武志斐. 基于多尺寸分解卷积的车道线检测[J]. 汽车技术, 2022(8): 32-37., articleTitle=基于多尺寸分解卷积的车道线检测, refAbstract=null), Reference(id=1204452636251628148, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2022, volume=null, issue=8, pageStart=32, pageEnd=37, url=null, language=null, rfNumber=[19], rfOrder=28, authorNames=LI S B, WU Z F, journalName=Automobile Technology, refType=null, unstructuredReference=LI S B, WU Z F. Lane Detection Based on Multi-Size Factorized Convolution[J]. Automobile Technology, 2022(8): 32-37., articleTitle=Lane Detection Based on Multi-Size Factorized Convolution, refAbstract=null), Reference(id=1204452636402623101, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2016, volume=null, issue=null, pageStart=869, pageEnd=884, url=null, language=null, rfNumber=[20], rfOrder=29, authorNames=LIU X, LIU W, MEI T, journalName=European Conference on Computer Vision. Amsterdam, refType=null, unstructuredReference=LIU X, LIU W, MEI T, et al. A Deep Learning-Based Approach to Progressive Vehicle Re-Identification for Urban Surveillance[C]// European Conference on Computer Vision. Amsterdam, Netherlands: Springer, Cham, 2016: 869-884., articleTitle=A Deep Learning-Based Approach to Progressive Vehicle Re-Identification for Urban Surveillance, refAbstract=null), Reference(id=1204452636545229445, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, doi=null, pmid=null, pmcid=null, year=2017, volume=20, issue=3, pageStart=645, pageEnd=658, url=null, language=null, rfNumber=[21], rfOrder=30, authorNames=LIU X C, LIU W, MEI T, journalName=IEEE Transactions on Multimedia, refType=null, unstructuredReference=LIU X C, LIU W, MEI T, et al. PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban Surveillance[J]. IEEE Transactions on Multimedia, 2017, 20(3): 645-658., articleTitle=PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban Surveillance, refAbstract=null)], funds=[Fund(id=1204452632418033965, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, awardId=2022H0007, language=CN, fundingSource=* 福建省引导性科技计划项目(2022H0007), fundOrder=null, country=null), Fund(id=1204452632527085884, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, awardId=2021J01559, language=CN, fundingSource=福建省自然科学基金项目(2021J01559), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1204452625535181325, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, xref=null, ext=[AuthorCompanyExt(id=1204452625543569934, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Fuzhou University, Fuzhou 350116), AuthorCompanyExt(id=1204452625560347156, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, companyId=1204452625535181325, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=福州大学,福州 350116)])], figs=[ArticleFig(id=1204452629129700256, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=7m59k21DuMxlYfVkky46aw==, figureFileBig=nSaXhWAgaJEdH7xToyvUZA==, tableContent=null), ArticleFig(id=1204452629247140789, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=图1, caption=特征模块移动方式, figureFileSmall=7m59k21DuMxlYfVkky46aw==, figureFileBig=nSaXhWAgaJEdH7xToyvUZA==, tableContent=null), ArticleFig(id=1204452629410718672, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=9oxcS712qGGeF78/xwFEVg==, figureFileBig=+QXITOvHO0JS/bVRT+gEpg==, tableContent=null), ArticleFig(id=1204452629528159202, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=图2, caption=融合Haar-like的DeepSort目标跟踪算法流程, figureFileSmall=9oxcS712qGGeF78/xwFEVg==, figureFileBig=+QXITOvHO0JS/bVRT+gEpg==, tableContent=null), ArticleFig(id=1204452629679154164, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=GK5K5DyRlH6tz6VAb62Dzg==, figureFileBig=ltxNcwRyvq0qBHXrJiALLQ==, tableContent=null), ArticleFig(id=1204452629846925320, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=图3, caption=SENet结构, figureFileSmall=GK5K5DyRlH6tz6VAb62Dzg==, figureFileBig=ltxNcwRyvq0qBHXrJiALLQ==, tableContent=null), ArticleFig(id=1204452629968560149, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=Q3es59XVP9URMA1RCw+OdA==, figureFileBig=qR9EVekaYjBftWj3kITcIA==, tableContent=null), ArticleFig(id=1204452630098583591, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=图4, caption=残差网络结合SENet结构, figureFileSmall=Q3es59XVP9URMA1RCw+OdA==, figureFileBig=qR9EVekaYjBftWj3kITcIA==, tableContent=null), ArticleFig(id=1204452630236995640, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=pwiXYUDhkJMKudI66WCcVQ==, figureFileBig=5ib7hEpqxKiPrjR4HTqMdA==, tableContent=null), ArticleFig(id=1204452630358630470, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=图5, caption=误差对比, figureFileSmall=pwiXYUDhkJMKudI66WCcVQ==, figureFileBig=5ib7hEpqxKiPrjR4HTqMdA==, tableContent=null), ArticleFig(id=1204452630476071000, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=4RpFl+bvcuzFh5fet2MWZQ==, figureFileBig=n0NrIRxjZejsBdThA5W0Dg==, tableContent=null), ArticleFig(id=1204452630585122919, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=图6, caption=损失对比, figureFileSmall=4RpFl+bvcuzFh5fet2MWZQ==, figureFileBig=n0NrIRxjZejsBdThA5W0Dg==, tableContent=null), ArticleFig(id=1204452630706757750, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=WS0qD0Mll2dWw/JYFFMIgQ==, figureFileBig=8Td6ooQjzCG+TeS8WW8nDg==, tableContent=null), ArticleFig(id=1204452630828392578, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=图7, caption=原始网络的前、后帧变化, figureFileSmall=WS0qD0Mll2dWw/JYFFMIgQ==, figureFileBig=8Td6ooQjzCG+TeS8WW8nDg==, tableContent=null), ArticleFig(id=1204452630996164758, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=EfiXJ2FEAUZvFEykccyD9Q==, figureFileBig=Rd+NyGUCTj95+bzamwciOg==, tableContent=null), ArticleFig(id=1204452631117799590, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=图8, caption=添加Haar-like特征匹配网络的前、后帧变化, figureFileSmall=EfiXJ2FEAUZvFEykccyD9Q==, figureFileBig=Rd+NyGUCTj95+bzamwciOg==, tableContent=null), ArticleFig(id=1204452631231045810, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=yRbev4YI8xDRrv9xxU38xg==, figureFileBig=7y75sIMYX+cb8bPAIIQQXA==, tableContent=null), ArticleFig(id=1204452631398817985, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=图9, caption=原始网络的前、后帧变化, figureFileSmall=yRbev4YI8xDRrv9xxU38xg==, figureFileBig=7y75sIMYX+cb8bPAIIQQXA==, tableContent=null), ArticleFig(id=1204452631512064204, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=CVSeiifX580H0B+A5xPcwQ==, figureFileBig=2pHkRXmVbsGrE1G9P+BrZA==, tableContent=null), ArticleFig(id=1204452631646281954, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=图10, caption=加深网络和加入SENet的前、后帧变化, figureFileSmall=CVSeiifX580H0B+A5xPcwQ==, figureFileBig=2pHkRXmVbsGrE1G9P+BrZA==, tableContent=null), ArticleFig(id=1204452631751139566, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
网络层 输出 网络层 输出
卷积层1 32×96×128 残差层 6×2 128×12×16
卷积层2 32×96×128 残差层 7×2 256×6×8
最大池化层3 32×48×64 残差层 8×2 512×6×8
残差层 4×2 32×48×64 平均池化层 9 512×1×1
残差层 5×2 64×24×32 批处理和L2正则化 512
), ArticleFig(id=1204452631910523132, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=表1, caption=

ResNet13网络结构

, figureFileSmall=null, figureFileBig=null, tableContent=
网络层 输出 网络层 输出
卷积层1 32×96×128 残差层 6×2 128×12×16
卷积层2 32×96×128 残差层 7×2 256×6×8
最大池化层3 32×48×64 残差层 8×2 512×6×8
残差层 4×2 32×48×64 平均池化层 9 512×1×1
残差层 5×2 64×24×32 批处理和L2正则化 512
), ArticleFig(id=1204452632036352266, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
算法 MOTA/% IDF1/% 帧速率/帧·s-1
DeepSort 73.5 72.9 42.3
DeepSort+Haar-like 73.6 78.3 38.0
DeepSort+(均值处理框+更新REID) 74.2 75.6 36.2
改进DeepSort 74.9 80.6 34.4
), ArticleFig(id=1204452632162181397, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1204386301475795345, language=CN, label=表2, caption=

评价结果

, figureFileSmall=null, figureFileBig=null, tableContent=
算法 MOTA/% IDF1/% 帧速率/帧·s-1
DeepSort 73.5 72.9 42.3
DeepSort+Haar-like 73.6 78.3 38.0
DeepSort+(均值处理框+更新REID) 74.2 75.6 36.2
改进DeepSort 74.9 80.6 34.4
)], attaches=null, journal=Journal(id=1149693407745847311, delFlag=0, nameCn=汽车技术, nameEn=Automobile Technology, nameHistory1=null, nameHistory2=null, issn=1000-3703, eissn=null, cn=22-1113/U, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=rYFtDx/CU9+iX8QTM0ckbw==, journalPrice=null, startedYear=null, abbrevIsoEn=null, journalRemark=null, publicationField=null, createdTime=1752037868679, updatedTime=1761735668047, createdBy=18614031015, updatedBy=13701087609, firstLetterCn=A, firstLetterEn=A, subjectCode=Engineering, subjectName=Engineering, subjectCodeEn=Engineering, subjectNameEn=null, picCn=rYFtDx/CU9+iX8QTM0ckbw==, picEn=oFT2NmUwKPUjZ27C1+d9pw==, jcr=null, cjcr=null, exts=[JournalExt(id=1190368926564450443, language=CN, name=汽车技术, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1761735668078, updatedTime=1761735668078, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=1, submissionEditorUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=3, submissionReviewUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=2, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1190368926618976396, language=EN, name=Automobile Technology, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1761735668091, updatedTime=1761735668091, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=1, submissionEditorUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=3, submissionReviewUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=2, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1189621681917173762, websiteList=[Website(id=1189624193747526544, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1189621681917173762, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/qcjs/CN, language=CN, createTime=1761558109939, createBy=18614031015, updateTime=1761558140534, updateBy=18614031015, name=汽车技术-中, tplId=1146099689490845704, title=汽车技术, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1189625424704451180, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=articleTextType, value=kx, createTime=1761558403421, updateTime=1761558403421, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424675091049, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=banner, value=null, createTime=1761558403414, updateTime=1761558403414, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424733811311, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=grayFlag, value=0, createTime=1761558403428, updateTime=1761558403428, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424658313832, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=logo, value=https://castjournals.cast.org.cn/joweb/qcjs/CN/file/pic?fileId=7En9rzX2QCa/1J8NnKt/Fg==, createTime=1761558403410, updateTime=1761558403410, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424746394225, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=minRunFlag, value=0, createTime=1761558403431, updateTime=1761558403431, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424691868267, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/qcjs/CN/file/pic, createTime=1761558403418, updateTime=1761558403418, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424742199920, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=silenceFlag, value=0, createTime=1761558403430, updateTime=1761558403430, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424683479658, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1761558403416, updateTime=1761558403416, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424712839789, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=themeColor, value=null, createTime=1761558403423, updateTime=1761558403423, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424725422702, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=themeStyle, value=null, createTime=1761558403426, updateTime=1761558403426, creator=18614031015, updator=18614031015)]), Website(id=1189624193869161363, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1189621681917173762, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/qcjs/EN, language=EN, createTime=1761558109967, createBy=18614031015, updateTime=1761558340679, updateBy=18614031015, name=汽车技术-英文, tplId=1146101810881728533, title=Automobile Technology, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1189625550722311064, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=articleTextType, value=kx, createTime=1761558433466, updateTime=1761558433466, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550688756629, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=banner, value=null, createTime=1761558433458, updateTime=1761558433458, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550739088283, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=grayFlag, value=0, createTime=1761558433470, updateTime=1761558433470, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550676173716, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=logo, value=https://castjournals.cast.org.cn/joweb/qcjs/EN/file/pic?fileId=7En9rzX2QCa/1J8NnKt/Fg==, createTime=1761558433455, updateTime=1761558433455, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550751671197, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=minRunFlag, value=0, createTime=1761558433473, updateTime=1761558433473, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550713922455, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/qcjs/EN/file/pic, createTime=1761558433464, updateTime=1761558433464, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550743282588, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=silenceFlag, value=0, createTime=1761558433471, updateTime=1761558433471, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550705533846, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1761558433462, updateTime=1761558433462, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550726505369, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=themeColor, value=null, createTime=1761558433467, updateTime=1761558433467, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550734893978, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=themeStyle, value=null, createTime=1761558433469, updateTime=1761558433469, creator=18614031015, updator=18614031015)])], journalTitle=汽车技术, weixinUrl=null, journalUrl=null, iacademicId=null, status=1, seqNo=null, journalTitleEn=Automobile Technology, journalPhotoCn=rYFtDx/CU9+iX8QTM0ckbw==, journalPhotoEn=oFT2NmUwKPUjZ27C1+d9pw==, journalFirstLetter=A, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false), detailUrlCn=https://castjournals.cast.org.cn/joweb/qcjs/CN/10.19620/j.cnki.1000-3703.20220911, detailUrlEn=https://castjournals.cast.org.cn/joweb/qcjs/EN/10.19620/j.cnki.1000-3703.20220911, pdfUrlCn=https://castjournals.cast.org.cn/joweb/qcjs/CN/PDF/10.19620/j.cnki.1000-3703.20220911, pdfUrlEn=https://castjournals.cast.org.cn/joweb/qcjs/EN/PDF/10.19620/j.cnki.1000-3703.20220911, aliStartDate=null, aliEndDate=null, collectionFlag=false, citedCount=null, citedUrl=null, reference=null)
收藏切换
基于DeepSort的动态车辆多目标跟踪方法研究*
收藏切换
PDF下载
何维堃 , 彭育辉 , 黄炜 , 姚宇捷 , 陈泽辉
汽车技术 | 2023,(11): 27-33
收起
收藏切换
汽车技术 | 2023, (11): 27-33
基于DeepSort的动态车辆多目标跟踪方法研究*
全屏
何维堃, 彭育辉 , 黄炜, 姚宇捷, 陈泽辉
作者信息
  • 福州大学,福州 350116

通讯作者:

彭育辉(1975—),博士,教授,研究方向为汽车智能驾驶、汽车替代燃料等,
Research on Dynamic Vehicle Multi-Object Tracking Method Based on DeepSort
Weikun He, Yuhui Peng , Wei Huang, Yujie Yao, Zehui Chen
Affiliations
  • Fuzhou University, Fuzhou 350116
出版时间: 2023-11-24 doi: 10.19620/j.cnki.1000-3703.20220911
文章导航
收藏切换

为了提高汽车对外界环境信息的感知能力和对动态车辆目标行为的预测能力,采用YOLOX作为前端检测器,结合优化的DeepSort跟踪算法开展动态车辆多目标跟踪方法研究。在车辆特征匹配过程中,提取Haar-like特征对车辆的明暗变化信息进行匹配,提高物体匹配精度;基于DeepSort重识别网络,采用改进的ResNet13作为特征提取的骨干网络,加入SENet调整不同通道维度的特征权重。使用实际道路驾驶采集的视频数据对改进算法与传统算法进行对比,结果表明:相较于传统DeepSort算法,改进算法的多目标跟踪精度(MOTA)提高了1.4百分点,平均数比率(IDF1)提升了7.7百分点。

多目标跟踪  /  DeepSort  /  自动驾驶  /  Haar-like  /  SENet

In order to improve the environmental perceive ability and better predict the behaviors of dynamic vehicle targets, a YOLOX model, as the front-end detector, combined with the optimized DeepSort method was proposed to develop the research of dynamic vehicle Multi-Object Tracking. In the process of features matching for dynamic vehicles, the change information of vehicles in the degree of light and shade was extracted to improve the object matching accuracy by adding Haarlike features. Furthermore, based on the application of DeepSort RE-identification network, the improved ResNet13 model was adopted as the backbone network for feature extraction, and SENet was introduced to adjust the feature weight of different channel dimensions. The results show that, compared to the conventional DeepSort method, by using the real on-road video data, the Multi-Object Tracking Accuracy (MOTA) and IDF1 indicator of the proposed algorithm increased by 1.4 percentage points and 7.7 percentage points respectively.

Multi-object tracking  /  DeepSort  /  Autonomous vehicle  /  Haar-like  /  SENet
何维堃, 彭育辉, 黄炜, 姚宇捷, 陈泽辉. 基于DeepSort的动态车辆多目标跟踪方法研究*. 汽车技术, 2023 , (11) : 27 -33 . DOI: 10.19620/j.cnki.1000-3703.20220911
Weikun He, Yuhui Peng, Wei Huang, Yujie Yao, Zehui Chen. Research on Dynamic Vehicle Multi-Object Tracking Method Based on DeepSort[J]. Automobile Technology, 2023 , (11) : 27 -33 . DOI: 10.19620/j.cnki.1000-3703.20220911
面对复杂多变的交通环境,自动驾驶汽车需不断提高对车外环境的感知能力。其中,检测与跟踪道路行驶车辆并预测其运动轨迹是环境感知研究领域的重要课题。
近年来,多目标跟踪识别网络在智能驾驶方面的应用引起了国内外学者的普遍关注[1-2],解决行驶过程中车辆的身份切换问题是本文研究的重点。在基于DeepSort的研究方面,Perera等将DeepSort中的卡尔曼滤波替换为无迹卡尔曼滤波[3];Mu等将卡尔曼滤波替换为拓展卡尔曼滤波[4],使网络能更好地处理应用场景的非线性问题,对目标未来帧进行有效预测,但依然无法保证预测本身的准确性;裴云成将交并比(Intersection Over Union,IOU)匹配更换成广义交并比(Generalized Intersection Over Union,GIOU)[5],使网络能更有效地判断检测框和预测框之间的权重分配,但无法很好地解决特征匹配时出现失配的问题。在DeepSort网络中,重识别网络提取的深度特征用于前、后帧物体的特征匹配,在防止身份切换时能起到很好的作用。金立生等将检测器更换为Gaussian YOLO V3,并用重识别网络的中心损失函数代替交叉熵函数,提高对车辆特征的提取性能与跟踪网络的判断能力[6],但当光照发生变化时,网络无法适应环境的改变,从而导致身份切换;Wu等将重识别网络替换为ShuffleNet V2以适用于计算能力较低的设备[7],但在复杂场景下,无法很好地提取物体的特征;Liu等将原有的重识别网络替换为ResNet50[8],加深了网络深度,并结合特征金字塔网络(Feature Pyramid Networks,FPN)提取物体的多层特征,但复杂的网络结构增加了计算负担。
综上,复杂场景下跟踪检测目标时,跟踪器的准确性及稳定性较差,现有的重识别网络无法有效地对不同场景下的车辆进行特征提取,前、后帧中目标的匹配效果较差。为此,本文采用YOLOX作为检测器,对基于DeepSort研究中重识别网络的特征匹配方法进行改进,添加Haar-like特征反映车辆的光暗变化,对原有的特征匹配机制进行补充,在协调匹配速度的同时加深重识别网络层数并添加SENet注意力机制强化提取车辆外观特征的能力,最后通过实际道路采集的视频数据集对算法的有效性进行验证。
DeepSort是基于匈牙利算法和卡尔曼滤波算法的单假设跟踪方法,引入卡尔曼滤波对轨迹运动状态进行预测,将检测结果经重识别网络提取的特征与轨迹储存的特征共同传入匈牙利算法,进行关联匹配。在匹配过程中,对检测结果框、轨迹预测框的马氏距离及深度特征的余弦距离信息进行整合判断。
余弦距离主要用于衡量检测结果与轨迹的特征向量间的差距。对于物体被遮挡后再出现的情况,网络将轨迹中储存的特征集与物体在重新出现时的特征向量进行计算,得出其最小余弦距离:
d ( 1 ) ( i , j ) = m i n 1 - r j T r k i r k i R i
式中,d(1)(i,j)为第j个检测框内的特征向量与第i个轨迹的特征向量之间的最小余弦距离;rj为第j个检测框内的特征向量; r k i为跟踪器存储的第i个轨迹的特征向量集,其包含第i个轨迹过去成功匹配的k个特征向量;Ri为第i个轨迹的特征向量库。
马氏距离用于衡量上一帧中目标经过卡尔曼滤波预测的位置信息与检测结果的位置信息的差距:
d ( 2 ) ( i , j ) = m i n d j - y j T S i - 1 ( d i - y i )
式中,d(2)(i,j)为第j个检测框和第i个由跟踪器预测的物体框之间的马氏距离;dj为第j个检测框的位置信息;yi为第i个由跟踪器预测的物体框位置信息;Si为第i条轨迹在检测空间的协方差矩阵。
将基于外观特征的余弦距离和基于运动信息的马氏距离进行线性加权获得最终的度量:
c i , j = 1 - λ d ( 1 ) i , j + λ d ( 2 ) i , j
式中,ci,j为最终度量标准;λ为权重系数。
交通场景中的车辆运动轨迹是非线性的,而卡尔曼滤波采用线性状态方程,因此预测能力较弱[9]。通过物体的运动状态预测出的运动信息估计量会存在一定偏差,导致马氏距离关联方法易失效,从而造成身份跳转的现象。在最终度量中设置λ=0,使马氏距离在级联匹配过程中仅为判定值。当2个物体的对象特征一致且两者的马氏距离小于一定阈值,则判定匹配成功。
自动驾驶所涉及的场景多变且复杂,在车辆的多目标跟踪中,车辆之间的相互遮蔽、场景变换、光下的阴影变换都将导致追踪目标失败。本文融合传统特征与深度特征信息,结合各自的优点解决跟踪过程中身份跳转的问题。
传统特征相较于深度特征,在精度方面的表现较差,且泛化能力不足。深度特征的提取受训练集影响较大,训练过程需要大量的场景图像数据,而传统特征的提取作为人工认知驱动的方法,具有解释性,不需要训练,且对算力的要求较低。因此,本文算法以原有的深度特征作为主要匹配依据,融合传统特征Haar-like作为补充匹配。
Haar-like[10]是计算机视觉和图像处理中用于目标检测的特征描述算子。特征模板内有白色和黑色2种矩形,矩形的位置关系不同,影响着所提取的特征信息,如边缘特征、线条特征、中心特征、对角线特征。通过特征模块大小的变换和在图片子窗口的移动得到所需的特征,如图1所示。其中,图片特征提取框为YOLOX输出图片,而非整张图,可明显缩短特征提取的时间。
传统特征中,Haar-like能够表示图像像素值明暗变化信息,能更好地体现车辆行驶状态的特征[11]。在原有的DeepSort中加入Haar-like,将深度神经网络提取的车辆抽象特征与Haar-like信息相融合[12],可有效增强网络对不同场景的适应性。图2所示为融入Haar-like特征的DeepSort网络结构。首先,对检测器输入结果进行深度特征提取和Haar-like特征提取。在匹配过程中,将确认态轨迹中所保留的深度特征与重识别网络提取的深度特征进行匹配,再将未匹配的轨迹和检测物体进行Haar-like特征匹配,最后进行IOU匹配。
车辆目标由于遮挡或未被检测,会出现与之前的目标断开联系且在短时间内重新出现在检测器中的现象。DeepSort利用重识别网络提取车辆外观信息,再将外观信息放入级联匹配。通过计算不同帧物体的外观信息的余弦距离,进行物体的相似度配对,将同一辆车重新建立联系。
车辆作为刚体,在不同视角下所呈现的姿态、大小多变[13]。在自动驾驶过程中,当检测车辆与摄像头的距离发生改变,或检测车辆处于半遮挡及转弯的状态,检测车辆的外观都会发生变化。在原网络中,重识别网络结构简单,无法准确提取行驶过程中实时变化的车辆外观信息,在重识别车辆时具有明显的局限性。
无人驾驶车辆行驶过程中,对象车辆由于距离变化及遮挡的原因,其宽和高在视频中的形变量较大。经过YOLOX[14]检测器识别后,检测器会将车辆的物体框传入追踪网络。重识别网络对车辆特征进行提取的过程中,需要重新调整图像大小。原网络中定义了图片的高为128,宽为64,适用于对行人的特征提取,但无法满足对车辆的特征提取[15]。为避免过大幅度地调整图片的高和宽,导致识别误差,应寻找合适的车辆物体框的高和宽。
本文在自制的道路数据集上进行标注,截取视频中不同场景下(无遮挡、被其他车辆、树木和路障等遮挡)不同车型(挂车、皮卡和轿车等)大小及形态不同的物体框,对识别的物体框的宽和高进行均值处理,求得最优的物体框尺寸为高96、宽128。
在重识别网络中,提取的语义信息随着卷积层数的加深而越来越明显。加深网络层数,会带来更加强大的非线性表达能力和复杂的变换,使提取的信息愈加复杂、抽象[16]。在特征提取网络中,底层网络会提取物体的边缘信息,较深层的网络会提取物体的纹理特征,更深层的网络则会提取目标的形状,能更好地表达车辆的整体信息。原始的重识别网络由6个残差网络组成,最后的特征维度为128。广泛应用于行人的重识别网络由8个残差网络组成,特征维度为512,增加了特征维度使得分类更加细致,但其仍无法进行复杂情况下的车辆特征提取。为了提取车辆更深层次的信息,以满足实际行车中的追踪要求,本文在保证其时效性的同时加深了网络的深度[17],称为ResNet13,网络结构如表1所示。
SENet[18]在通道维度上增加1个注意力机制,并利用损失函数的自我学习,调整不同通道维度的特征权重,增大有效特征通道的权重。根据SENet所提供的各特征通道的重要程度,网络能自主地关注重要的特征通道。其包括挤压、激励和特征重标定3个部分,如图3所示。
挤压是将不同特征通道数(c)的特征图集的全局信息嵌入,聚合成c×1×1的特征描述符。在不同特征通道数的特征图集中加入SENet,将网络中的特征图集聚合成32×1×1、64×1×1、128×1×1、256×1×1、512×1×1的特征描述符。在不同层次上获得每个特征图集的全局描述符:
z c = 1 w × h i = 1 w j = 1 h u c i , j
式中,zc为特征图挤压聚合得到的特征描述;uc为特征图;w为特征图的宽;h为特征图的高。
获取不同深度的特征描述符后,激励通过2个全连接层获取通道间的关系,再经由Sigmoid函数转化为不同网络深度(32、64、128、256、512)下每个通道的权重值:
s = σ W 2 δ W 1 z
式中,s为所有特征图的权重集;σ为Sigmoid函数;δ为线性整流(Rectified Linear Unit,ReLU)函数;W1为第1个全连接层操作;W2为第2个全连接层操作;z为所有特征图挤压聚合所得的特征描述符集。
最后,特征重标定将激励获得的通道权重逐通道加权到不同深度的原始特征图通道上,减小不重要的特征图的权重,提高包含重要分类信息的特征图权重:
X ˜ c = s c u c
式中, X ˜ c为特征图与对应权重相乘得到的特征图;sc为特征图的权重。
ResNet13采用残差块结构[19],将输入的X与由多个卷积级联输出的F(X)相加。残差结构作为小型网络,X为输入的观测值,H(X)为输出的残差网络的预测值,F(X)为观测值与预测值之间的差,即残差。该网络结构有利于保护信息的完整性,且在加深网络层数的同时,能有效解决梯度消失和梯度爆炸的问题。在ResNet13中,随着网络层数的增加,特征图的深度不断扩张。将SENet加入残差网络中,可以对网络中不同深度的特征图进行重构,如图4所示。
试验采用开源的PyTorch 1.6.0深度学习框架,CPU配置为Intel® Aeon® Silver 4108,主频1.80 GHz,显卡为GeForce GTX 1080Ti,内存容量为64 GB,系统为Ubuntu16.04 LTS,包含Python 3.7、CUDA 10.1、CuDNN 7.6.5、OpenCV 4.4.0环境。数据集的采集设备为长虹CXC-X6行车记录仪。
将ResNet13和SENet应用于复杂场景下对车辆特征的提取,以VeRi-776[20-21]数据集训练所得的准确率(Accuracy)和损失(Loss)为基准判断算法的质量。对重识别网络进行数据集的训练时,为保证数据的准确性,3组网络训练采用相同的参数:学习率为0.001,经过20代(epoch),学习率乘以0.1。
准确率是用于对重识别网络训练效果进行度量的主要指标,计算重识别模型正确分类的样本数与总样本数之比,本文利用误差(Error)对准确率进行表达。图5展示了原网络6层残差网络、8层残差网络,以及ResNet13并加入SENet网络预测期间的误差曲线。
误差公式为:
α = 1 - T p + T N T p + T N + F p + F N
式中,α为误差率;TP为真正例数量;TN为真负例数量;FP为假正例数量;FN为假负例数量。
损失函数用于表达实际输出和期望输出之间的差值,使网络更新模型参数,减小误差。图6展示了原网络6层残差网络、8层残差网络,以及ResNet13并加入SENet网络预测期间的损失。
损失公式为:
H ( p , q ) = - i = 1 n p ( x i ) l o g q ( x i )
式中,q(xi)为实际输出的各类别的概率分布;p(xi)为期望输出各类别的分布;n为类别总数;H(p,q)为交叉熵损失。
图5图6中,原始网络的6层残差网络与本文的重识别网络都进行850代的训练对比。在2个网络训练到第80代时,误差和损失都迅速减少,随后下降速度逐渐减缓,直至第200代时趋于平稳。但原始网络在第200代后,训练的模型精度较差,波动较为明显。在经历850代训练后,误差和损失依然不理想,误差为0.55,损失为2.35。本文网络在训练过程中比原始网络更加平稳,误差和损失也更加精确,误差为0.03,损失为0.16。因此,本文网络在车辆外观提取方面,比原始网络具有更好的性能。
分别采用DeepSort的原始版本和本文改进的版本对车辆进行追踪,利用车辆在不同场景(城市、乡村)下的视频集进行试验,验证算法的可行性。本文的试验场景为自制的双车道的来往车辆视频,包括城市和乡镇,具有一定的普遍性。
图7所示为原始网络在数据集中前、后帧的变化情况。由图7可知,身份标签为10的车辆在视频中发生了身份跳转。
图8所示为添加Haar-like特征匹配网络后,试验的前、后帧变化情况。当车辆处于视频的远端角落时,会发生形变及特征不清晰的情况。原始重识别网络提取的深度特征不足以应对复杂的车辆行驶情况,从而发生身份跳转。添加Haar-like特征匹配网络以提取目标车辆的光暗变化,从而实现对原始网络在深度特征匹配之后的补齐。将深度特征无法匹配的车辆进行Haar-like特征再匹配,抑制了身份跳转的发生。
图9所示为原始网络在数据集中前、后帧的变化情况。车辆失去识别后再次出现时,身份标签为3的车辆发生了身份跳转。
图10所示为改进后的ResNet13以及添加了注意力机制网络后,视频前、后帧的变化情况。在相同视频帧下,车辆的身份并没有发生切换;在车辆处于半遮挡状态时,ResNet13可提高网络对车辆的特征提取效果。结果表明:SENet可自动学习到不同通道特征的重要程度,注意力机制提高了目标特征的权重,使网络专注于信息量大的通道特征,减弱不重要信息的通道特征,将ResNet13与SENet相结合可达到更好的匹配结果。
采用多目标跟踪精度(Multiple Object Tracking Accuracy,MOTA)、平均数比率IDF1(Identification F1)和帧速率3个评价指标对跟踪算法进行评估。MOTA衡量了跟踪器在检测物体和保持轨迹时的性能,相比IDF1更专注于检测器的性能。IDF1用于判断跟踪器在视频中长时间地对同一事物进行准确跟踪的能力,着重于计算物体的初始身份号码占其在视频中出现的所有身份号码的比例。帧速率反映了处理速度。对比算法的评价结果,如表2所示。
表2可知,在跟踪网络中加入Haar-like特征且对重识别网络进行改进,可有效提升跟踪网络的效果。
本文针对自动驾驶汽车,面向外界动态车辆多目标跟踪的场景,提出以YOLOX为前端检测器的DeepSort改进算法,利用Haar-like算法提取车辆的光暗变化特征,实现对网络原有匹配机制的补充。此外,通过ResNet13网络对重识别网络进行更换、添加注意力机制,从而提高重识别网络对车辆深度特征的提取能力。采用实际道路驾驶采集的视频数据,对本文算法和传统算法进行对比验证,结果表明:相较于传统DeepSort算法,改进后算法的MOTA提高了1.4百分点,IDF1提升了7.7百分点。
  • * 福建省引导性科技计划项目(2022H0007)
  • 福建省自然科学基金项目(2021J01559)
参考文献 引证文献
排序方式:
[1]
陈龙, 朱程铮, 蔡英凤, 等. 基于自查询的车载多目标跟踪算法研究[J]. 汽车工程, 2021, 43(11): 1587-1593+1610.
CHEN L, ZHU C Z, CAI Y F, et al. Research on Vehicle Multi-Target Environment Aware Tracking Algorithm Based on Self-Query[J]. Automotive Engineering, 2021, 43(11): 1587-1593+1610.
[2]
CHEN X, JIA Y, TONG X, et al. Research on Pedestrian Detection and DeepSort Tracking in front of Intelligent Vehicle Based on Deep Learning[J]. Sustainability, 2022, 14(15).
[3]
PERERA I, SENAVIRATHNA S, JAYARATHNE A, et al. Vehicle Tracking Based on An Improved DeepSORT Algorithm and the YOLOv4 Framework[C]// 2021 10th International Conference on Information and Automation for Sustainability (ICIAfS). Quebec City, Canada: IEEE, 2021: 305-309.
[4]
MU L, ZHAO H, LI Y, et al. Traffic Flow Statistics Method Based on Deep Learning and Multi-Feature Fusion[J]. Computer Modeling in Engineering & Sciences, 2021, 129(2): 465-483.
[5]
裴云成. 基于DeepSORT的行人多目标跟踪算法研究与应用[D]. 济南: 齐鲁工业大学, 2022.
PEI Y C. Research and Application of Pedestrian Multi-Target Tracking Algorithm Based on DeepSORT[D]. Jinan: Qilu University of Technology, 2022.
[6]
金立生, 华强, 郭柏苍, 等. 基于优化DeepSort的前方车辆多目标跟踪[J]. 浙江大学学报(工学版), 2021, 55(6): 1056-1064.
JIN L S, HUA Q, GUO B C, et al. Multi-Target Tracking of Vehicles Based on Optimized DeepSort[J]. Journal of Zhejiang University (Engineering Science), 2021, 55(6): 1056-1064.
[7]
WU Y, WANG Y, ZHANG D, et al. Research on Vehicle Tracking Method Based on UAV Video[C]// 2nd International Conference on Internet of Things and Smart City (IoTSC 2022). Xiamen, China: SPIE, 2022, 12249: 801-806.
[8]
LIU H Y, PEI Y C, BEI Q C, et al. Improved DeepSORT Algorithm Based on Multi Feature Fusion[J]. Applied System Innovation, 2022, 5(3).
[9]
弋英民, 王柯颖, 苑易伟, 等. 基于扩展卡尔曼滤波的固定翼无人机姿态解算方法[J/OL]. 小型微型计算机系统: 1-9 (2022-08-12)[2022-11-12]. http://kns.cnki.net/kcms/detail/21.1106.TP.20220729.1118.014.html.
GE Y M, WANG K Y, WAN Y W, et al. Attitude Algorithm Method of Fixed-Wing UAV Based on Extended Kalman Filter[J/OL]. Journal of Chinese Computer Systems: 1-9 (2022-08-12)[2022-11-12]. http://kns.cnki.net/kcms/detail/21.1106.TP.20220729.1118.014.html.
[10]
LIENHART R, MAYDT J. An Extended Set of Haar-Like Features for Rapid Object Detection[C]// International Conference on Image Processing. Rochester, NY, USA: IEEE, 2002.
[11]
黎向锋, 赵伟康, 豆心愿, 等. 基于改进AdaBoost+Haar的车辆检测算法[J]. 测控技术, 2019, 38(2): 42-45.
LI X F, ZHAO K W, DOU X Y, et al. Vehicle Detection Algorithm Based on Improved AdaBoost and Haar[J]. Measurement & Control Technology, 2019, 38(2): 42-45.
[12]
储慧芳. 基于深度特征与传统特征融合的行人再识别研究[D]. 合肥: 合肥工业大学, 2018.
CHU H F. Research on Person Re-identification Based on Fusion of Deep Features and Traditional Features[D]. Hefei: Hefei University of Technology, 2018.
[13]
敖为能. 交通场景下基于深度学习的车辆检测方法研究[D]. 长沙: 湘潭大学, 2021.
AO W N. Research on Vehicle Detection Method Based on Deep Learning in Traffic Scenarios[D]. Changsha: Xiangtan University, 2021.
[14]
GE Z, LIU S T, WANG F, et al. YOLOX:Exceeding YOLO Series in 2021[EB/OL]. (2021-08-06)[2022-11-12]. https://arxiv.org/abs/2107.08430.
[15]
李永上, 马荣贵, 张美月. 改进YOLOv5s+DeepSORT的监控视频车流量统计[J]. 计算机工程与应用, 2022, 58(5): 271-279.
LI Y S, MA R G, ZHANG M Y. Traffic Monitoring Video Vehicle Volume Statistics Method Based on Improved YOLOv5s+Deep SORT[J]. Computer Engineering and Applications, 2022, 58(5): 271-279.
[16]
MONTUFAR G F, PASCANU R, CHO K, et al. On the Number of Linear Regions of Deep Neural Networks[J]. Advances in Neural Information Processing Systems, 2014, 27.
[17]
BENGIO Y, LECUN Y. Scaling Learning Algorithms Towards AI[J]. Large-Scale Kernel Machines, 2007, 34(5): 1-41.
[18]
赵璐璐, 王学营, 张翼, 等. 基于YOLOv5s融合SENet的车辆目标检测技术研究[J]. 图学学报, 2022, 43(5): 776-782.
ZHAO L L, WANG X Y, ZHANG Y, et al. Vehicle Target Detection Based on YOLOv5s Fusion SENet[J]. Journal of Graphics, 2022, 43(5): 776-782.
[19]
李守彪, 武志斐. 基于多尺寸分解卷积的车道线检测[J]. 汽车技术, 2022(8): 32-37.
LI S B, WU Z F. Lane Detection Based on Multi-Size Factorized Convolution[J]. Automobile Technology, 2022(8): 32-37.
[20]
LIU X, LIU W, MEI T, et al. A Deep Learning-Based Approach to Progressive Vehicle Re-Identification for Urban Surveillance[C]// European Conference on Computer Vision. Amsterdam, Netherlands: Springer, Cham, 2016: 869-884.
[21]
LIU X C, LIU W, MEI T, et al. PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban Surveillance[J]. IEEE Transactions on Multimedia, 2017, 20(3): 645-658.
2023年第卷第11期
PDF下载
269
116
引用本文
BibTeX
文章信息
doi: 10.19620/j.cnki.1000-3703.20220911
  • 首发时间:2025-12-07
  • 出版时间:2023-11-24
补充材料
相关文章
文章信息
作者
出版历史
  • 修回日期:2022-09-11
基金
* 福建省引导性科技计划项目(2022H0007)
福建省自然科学基金项目(2021J01559)
作者信息
    福州大学,福州 350116

通讯作者:

彭育辉(1975—),博士,教授,研究方向为汽车智能驾驶、汽车替代燃料等,
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/qcjs/CN/10.19620/j.cnki.1000-3703.20220911
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏