Article(id=1197492487834087996, tenantId=1146029695717560320, journalId=1189621681917173762, issueId=1197492487066530363, articleNumber=null, orderNo=null, doi=10.19620/j.cnki.1000-3703.20240063, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=null, receivedDateStr=null, revisedDate=1712678400000, revisedDateStr=2024-04-10, acceptedDate=null, acceptedDateStr=null, onlineDate=1763434057434, onlineDateStr=2025-11-18, pubDate=1742745600000, pubDateStr=2025-03-24, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1763434057434, onlineIssueDateStr=2025-11-18, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1763434057434, creator=13701087609, updateTime=1763434057434, updator=13701087609, issue=Issue{id=1197492487066530363, tenantId=1146029695717560320, journalId=1189621681917173762, year='2025', volume='', issue='3', pageStart='1', pageEnd='62', issueExtLink='null', onlineDate='null', pubDate='null', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1763434057251, creator=13701087609, updateTime=1763434367830, updator=13701087609, preIssue=null, nextIssue=null, ext={EN=IssueExt(id=1197493789779603575, tenantId=1146029695717560320, journalId=1189621681917173762, issueId=1197492487066530363, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1197493789779603576, tenantId=1146029695717560320, journalId=1189621681917173762, issueId=1197492487066530363, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null}, startPage=15, endPage=21, ext={EN=ArticleExt(id=1197492488010248769, articleId=1197492487834087996, tenantId=1146029695717560320, journalId=1189621681917173762, language=EN, title=A Study on Fatigue Detection for Sanitation Vehicle Drivers Based on Improved YOLOv8n, columnId=1200009531011985931, journalTitle=Automobile Technology, columnName=Special Topic on Multimodal Information Monitoring and Recognition Technologies for Human Factors in Intelligent Driving, runingTitle=null, highlight=null, articleAbstract=

With regard to the driving environment and safety of sanitation vehicle drivers, this paper proposes a driver fatigue detection method based on an enhanced YOLOv8n algorithm. Specifically, FasterNet is employed to replace the backbone network of the YOLOv8 object detection algorithm, resulting in the design of a lightweight FasterNet-YOLO network model. To preserve critical feature information from the input feature map, Squeeze-and-Excitation (SE) modules are integrated into the backbone network, while Convolutional Block Attention Modules (CBAM) are added to the neck network. Additionally, the Zero-DCE++ algorithm is introduced to enhance the brightness of video streams captured by cameras, addressing the issue of insufficient brightness in the driver’s face that hinders accurate detection. Experimental results demonstrate that the proposed method achieves an average precision of 98% (mAP@0.5) at an intersection over union ratio of 0.5, with an average inference time per frame reduced to 6.95 ms. This approach can effectively monitor the driver’s fatigue state in real-time under varying lighting conditions.

, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=Guang Tong, Bo Zhao, Tingting Sui, Shuxin Liu), CN=ArticleExt(id=1197492804885721114, articleId=1197492487834087996, tenantId=1146029695717560320, journalId=1189621681917173762, language=CN, title=基于改进YOLOv8n的环卫车辆驾驶员疲劳检测方法*, columnId=1200009531179758092, journalTitle=汽车技术, columnName=智能驾驶中人因状态多模态信息监测与识别技术专题, runingTitle=null, highlight=null, articleAbstract=

针对环卫车驾驶员的驾驶环境和驾驶安全,提出了一种基于改进YOLOv8n算法的驾驶员疲劳检测方法。使用FasterNet替换YOLOv8n目标检测算法的主干网络,并设计FasterNet-YOLO的轻量级网络模型;在主干网络和颈部中分别加入压缩和激励(SE)模块与卷积注意力机制(CBAM)模块,保留输入的重要特征信息;引入Zero-DCE++算法对摄像头输入的视频流进行亮度增强,处理因驾驶员面部亮度不足所致模型难以识别问题。试验结果表明:交并比为0.5时的平均类别检测精度(mAP@0.5)达到98%,平均每帧图片推理时间缩短至6.95 ms;该方法在不同光照情况下,均能够实时、准确地检测驾驶员疲劳状态。

, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=NzkgmpoZ0xSz8h9kkz6Pfg==, magXml=qnItwOEQtVMsu+f7Y2JKTg==, pdfUrl=null, pdf=53veU0JeYLB2bCkdcDg4Hw==, pdfFileSize=4002171, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=xFWOOcoRAbnJMV62ETSwJQ==, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=9nBLF8893dIvux9FrgTZ5Q==, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=仝光, 赵博, 随婷婷, 刘书炘)}, authors=[Author(id=1200009540688249290, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200009540776329677, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, authorId=1200009540688249290, language=EN, stringName=Guang Tong, firstName=Guang, middleName=null, lastName=Tong, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=Shanghai Dianji University, Shanghai 201306, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200009540893770193, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, authorId=1200009540688249290, language=CN, stringName=仝光, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=上海电机学院,上海 201306, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200009540558225860, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, xref=null, ext=[AuthorCompanyExt(id=1200009540566614468, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, companyId=1200009540558225860, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Shanghai Dianji University, Shanghai 201306), AuthorCompanyExt(id=1200009540570808773, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, companyId=1200009540558225860, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海电机学院,上海 201306)])]), Author(id=1200009540986044887, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200009541132845533, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, authorId=1200009540986044887, language=EN, stringName=Bo Zhao, firstName=Bo, middleName=null, lastName=Zhao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=Shanghai Dianji University, Shanghai 201306, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200009541300617697, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, authorId=1200009540986044887, language=CN, stringName=赵博, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=上海电机学院,上海 201306, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200009540558225860, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, xref=null, ext=[AuthorCompanyExt(id=1200009540566614468, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, companyId=1200009540558225860, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Shanghai Dianji University, Shanghai 201306), AuthorCompanyExt(id=1200009540570808773, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, companyId=1200009540558225860, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海电机学院,上海 201306)])]), Author(id=1200009541451612645, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200009544534426090, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, authorId=1200009541451612645, language=EN, stringName=Tingting Sui, firstName=Tingting, middleName=null, lastName=Sui, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=Shanghai Dianji University, Shanghai 201306, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200009544626700782, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, authorId=1200009541451612645, language=CN, stringName=随婷婷, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=上海电机学院,上海 201306, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200009540558225860, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, xref=null, ext=[AuthorCompanyExt(id=1200009540566614468, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, companyId=1200009540558225860, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Shanghai Dianji University, Shanghai 201306), AuthorCompanyExt(id=1200009540570808773, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, companyId=1200009540558225860, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海电机学院,上海 201306)])]), Author(id=1200009544685421040, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200009544769307125, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, authorId=1200009544685421040, language=EN, stringName=Shuxin Liu, firstName=Shuxin, middleName=null, lastName=Liu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=Shanghai Dianji University, Shanghai 201306, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200009544886747639, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, authorId=1200009544685421040, language=CN, stringName=刘书炘, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=上海电机学院,上海 201306, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200009540558225860, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, xref=null, ext=[AuthorCompanyExt(id=1200009540566614468, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, companyId=1200009540558225860, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Shanghai Dianji University, Shanghai 201306), AuthorCompanyExt(id=1200009540570808773, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, companyId=1200009540558225860, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海电机学院,上海 201306)])])], keywords=[Keyword(id=1200009545121628669, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, orderNo=1, keyword=Fatigue driving), Keyword(id=1200009545213903360, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, orderNo=2, keyword=Object detection), Keyword(id=1200009545352315395, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, orderNo=3, keyword=FasterNet-YOLO), Keyword(id=1200009545436201478, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, orderNo=4, keyword=Attention Mechanism), Keyword(id=1200009545507504649, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, orderNo=5, keyword=Low-light enhancement), Keyword(id=1200009545603973645, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, orderNo=1, keyword=疲劳驾驶), Keyword(id=1200009545700442641, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, orderNo=2, keyword=目标检测), Keyword(id=1200009545843048981, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, orderNo=3, keyword=FasterNet-YOLO), Keyword(id=1200009545956295195, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, orderNo=4, keyword=注意力机制), Keyword(id=1200009546086318621, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, orderNo=5, keyword=低光增强)], refs=[Reference(id=1200009552558129804, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2022, volume=58, issue=21, pageStart=53, pageEnd=66, url=null, language=null, rfNumber=[1], rfOrder=0, authorNames=张瑞, 朱天军, 邹志亮, journalName=计算机工程与应用, refType=null, unstructuredReference=张瑞, 朱天军, 邹志亮, 等. 驾驶员疲劳驾驶检测方法研究综述[J]. 计算机工程与应用, 2022, 58(21): 53-66., articleTitle=驾驶员疲劳驾驶检测方法研究综述, refAbstract=null), Reference(id=1200009552642015887, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2022, volume=58, issue=21, pageStart=53, pageEnd=66, url=null, language=null, rfNumber=[1], rfOrder=1, authorNames=ZHANG R, ZHU T J, ZOU Z L, journalName=Computer Engineering and Applications, refType=null, unstructuredReference=ZHANG R, ZHU T J, ZOU Z L, et al. Review of Research on Driver Fatigue Driving Detection Methods[J]. Computer Engineering and Applications, 2022, 58(21): 53-66., articleTitle=Review of Research on Driver Fatigue Driving Detection Methods, refAbstract=null), Reference(id=1200009552772039313, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2018, volume=20, issue=6, pageStart=2339, pageEnd=2352, url=null, language=null, rfNumber=[2], rfOrder=2, authorNames=SIKANDER G, ANWAR S, journalName=IEEE Transactions on Intelligent Transportation Systems, refType=null, unstructuredReference=SIKANDER G, ANWAR S. Driver Fatigue Detection Systems: A Review[J]. IEEE Transactions on Intelligent Transportation Systems, 2018, 20(6): 2339-2352., articleTitle=Driver Fatigue Detection Systems: A Review, refAbstract=null), Reference(id=1200009552860119700, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2022, volume=2325, issue=1, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[3], rfOrder=3, authorNames=ROHITH C, IMMANENI T, KUMAR M A, journalName=Journal of Physics: Conference Series, refType=null, unstructuredReference=ROHITH C, IMMANENI T, KUMAR M A, et al. Driver Drowsiness Detection and Monitoring System Using Machine Learning[J]. Journal of Physics: Conference Series, 2022, 2325(1)., articleTitle=Driver Drowsiness Detection and Monitoring System Using Machine Learning, refAbstract=null), Reference(id=1200009552952394390, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2024, volume=43, issue=4, pageStart=115, pageEnd=118, url=null, language=null, rfNumber=[4], rfOrder=4, authorNames=徐敬一, 田瑾, 刘翔, journalName=传感器与微系统, refType=null, unstructuredReference=徐敬一, 田瑾, 刘翔, 等. 基于注意力机制改进的疲劳驾驶检测方法[J]. 传感器与微系统, 2024, 43(4): 115-118., articleTitle=基于注意力机制改进的疲劳驾驶检测方法, refAbstract=null), Reference(id=1200009553023697558, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2024, volume=43, issue=4, pageStart=115, pageEnd=118, url=null, language=null, rfNumber=[4], rfOrder=5, authorNames=XU J Y, TIAN J, LIU X, journalName=Transducer and Microsystem Technologies, refType=null, unstructuredReference=XU J Y, TIAN J, LIU X, et al. Improved Fatigue Driving Detection Method Based on Attention Mechanism[J]. Transducer and Microsystem Technologies, 2024, 43(4): 115-118., articleTitle=Improved Fatigue Driving Detection Method Based on Attention Mechanism, refAbstract=null), Reference(id=1200009553111777943, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2023, volume=36, issue=7, pageStart=3711, pageEnd=3723, url=null, language=null, rfNumber=[5], rfOrder=6, authorNames=QU J X, WEI Z M, HAN Y M, journalName=Neural Computing and Applications, refType=null, unstructuredReference=QU J X, WEI Z M, HAN Y M. An Embedded Device-Oriented Fatigue Driving Detection Method Based on a YOLOv5s[J]. Neural Computing and Applications, 2023, 36(7): 3711-3723., articleTitle=An Embedded Device-Oriented Fatigue Driving Detection Method Based on a YOLOv5s, refAbstract=null), Reference(id=1200009553208246938, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2023, volume=106, issue=11, pageStart=1881, pageEnd=1890, url=null, language=null, rfNumber=[6], rfOrder=7, authorNames=LIU S G, WANG Y J, YU Q G, journalName=IEICE Transactions on Information and Systems, refType=null, unstructuredReference=LIU S G, WANG Y J, YU Q G, et al. A Driver Fatigue Detection Algorithm Based on Dynamic Tracking of Small Facial Targets Using YOLOv7: Regular Section[J]. IEICE Transactions on Information and Systems, 2023, 106(11): 1881-1890., articleTitle=A Driver Fatigue Detection Algorithm Based on Dynamic Tracking of Small Facial Targets Using YOLOv7: Regular Section, refAbstract=null), Reference(id=1200009553292133019, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2023, volume=42, issue=4, pageStart=153, pageEnd=158, url=null, language=null, rfNumber=[7], rfOrder=8, authorNames=张开生, 关凯凯, 李昊晨, journalName=实验室研究与探索, refType=null, unstructuredReference=张开生, 关凯凯, 李昊晨, 等. 基于ResNet-50与Bi-LSTM的驾驶员疲劳检测算法研究[J]. 实验室研究与探索, 2023, 42(4): 153-158., articleTitle=基于ResNet-50与Bi-LSTM的驾驶员疲劳检测算法研究, refAbstract=null), Reference(id=1200009553376019102, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2023, volume=42, issue=4, pageStart=153, pageEnd=158, url=null, language=null, rfNumber=[7], rfOrder=9, authorNames=ZHAGN K S, GUAN K K, LI H C, journalName=Research and Exploration In Laboratory, refType=null, unstructuredReference=ZHAGN K S, GUAN K K, LI H C, et al. Research on Driver Fatigue Detection Algorithm Based on ResNet-50 and Bi-LSTM[J]. Research and Exploration In Laboratory, 2023, 42(4): 153-158., articleTitle=Research on Driver Fatigue Detection Algorithm Based on ResNet-50 and Bi-LSTM, refAbstract=null), Reference(id=1200009553443127969, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2016, volume=null, issue=null, pageStart=779, pageEnd=788, url=null, language=null, rfNumber=[8], rfOrder=10, authorNames=REDMON J, DIVVALA S, GIRSHICK R, journalName=Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), refType=null, unstructuredReference=REDMON J, DIVVALA S, GIRSHICK R, et al. You Only Look Once: Unified, Real-Time Object Detection[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE, 2016: 779-788., articleTitle=You Only Look Once: Unified, Real-Time Object Detection, refAbstract=null), Reference(id=1200009553577345701, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2021, volume=40, issue=2, pageStart=4, pageEnd=7, url=null, language=null, rfNumber=[9], rfOrder=11, authorNames=吴雪, 宋晓茹, 高嵩, journalName=传感器与微系统, refType=null, unstructuredReference=吴雪, 宋晓茹, 高嵩, 等. 基于深度学习的目标检测算法综述[J]. 传感器与微系统, 2021, 40(2): 4-7+18., articleTitle=基于深度学习的目标检测算法综述, refAbstract=null), Reference(id=1200009553673814695, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2021, volume=40, issue=2, pageStart=4, pageEnd=7, url=null, language=null, rfNumber=[9], rfOrder=12, authorNames=WU X, SONG X R, GAO S, journalName=Transducer and Microsystem Technologies, refType=null, unstructuredReference=WU X, SONG X R, GAO S, et al. Review of Target Detection Algorithms Based on Deep Learning[J]. Transducer and Microsystem Technologies, 2021, 40(2): 4-7+18., articleTitle=Review of Target Detection Algorithms Based on Deep Learning, refAbstract=null), Reference(id=1200009553816421032, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2018, volume=null, issue=null, pageStart=7132, pageEnd=7141, url=null, language=null, rfNumber=[10], rfOrder=13, authorNames=HU J, SHEN L, SUN G, journalName=2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), refType=null, unstructuredReference=HU J, SHEN L, SUN G. Squeeze-and-Excitation Networks[C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City: IEEE, 2018: 7132-7141., articleTitle=Squeeze-and-Excitation Networks, refAbstract=null), Reference(id=1200009553933861546, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2018, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[11], rfOrder=14, authorNames=WOO S, PARK J, LEE J Y, journalName=Proceedings of the European Conference on Computer Vision (ECCV). Munich, refType=null, unstructuredReference=WOO S, PARK J, LEE J Y, et al. CBAM: Convolutional Block Attention Module[C]// Proceedings of the European Conference on Computer Vision (ECCV). Munich, Germany: Spriner, 2018., articleTitle=CBAM: Convolutional Block Attention Module, refAbstract=null), Reference(id=1200009554151965357, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/abs/1704.04861, language=null, rfNumber=[12], rfOrder=15, authorNames=HOWARD A G, ZHU M L, CHEN B, journalName=null, refType=null, unstructuredReference=HOWARD A G, ZHU M L, CHEN B, et al. Mobilenets: Efficient Convolutional Neural Networks for Mobile Vision Applications[EB/OL]. ( 2017-04-17) [2024-04-10]. https://arxiv.org/abs/1704.04861., articleTitle=Efficient Convolutional Neural Networks for Mobile Vision Applications, refAbstract=null), Reference(id=1200009554235851439, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2018, volume=null, issue=null, pageStart=6848, pageEnd=6856, url=null, language=null, rfNumber=[13], rfOrder=16, authorNames=ZHANG X Y, ZHOU X Y, LIN M X, journalName=Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, refType=null, unstructuredReference=ZHANG X Y, ZHOU X Y, LIN M X, et al. Shufflenet: An Extremely Efficient Convolutional Neural Network for Mobile Devices[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 6848-6856., articleTitle=Shufflenet: An Extremely Efficient Convolutional Neural Network for Mobile Devices, refAbstract=null), Reference(id=1200009554336514737, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/abs/2109.15099, language=null, rfNumber=[14], rfOrder=17, authorNames=CUI C, GAO T Q, WEI S Y, journalName=2021-09-17, refType=null, unstructuredReference=CUI C, GAO T Q, WEI S Y, et al. PP-LCNet: A Lightweight CPU Convolutional Neural Network[J]. ( 2021-09-17) [2024-04-10]. https://arxiv.org/abs/2109.15099., articleTitle=PP-LCNet: A Lightweight CPU Convolutional Neural Network, refAbstract=null), Reference(id=1200009554462343859, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2017, volume=null, issue=null, pageStart=1800, pageEnd=1807, url=null, language=null, rfNumber=[15], rfOrder=18, authorNames=CHOLLET F, journalName=null, refType=null, unstructuredReference=CHOLLET F. Xception:Deep Learning with Depthwise Separable Convolutions[C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI, USA: IEEE, 2017: 1800-1807., articleTitle=Xception:Deep Learning with Depthwise Separable Convolutions[C], refAbstract=null), Reference(id=1200009554554618549, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=null, pageStart=12021, pageEnd=12031, url=null, language=null, rfNumber=[16], rfOrder=19, authorNames=CHEN J R, KAO S H, HE H, Run, journalName=Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), refType=null, unstructuredReference=CHEN J R, KAO S H, HE H, et al. Run, Don’t Walk: Chasing Higher FLOPS for Faster Neural Networks[C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Vancouver: IEEE, 2023: 12021-12031., articleTitle=Don’t Walk: Chasing Higher FLOPS for Faster Neural Networks, refAbstract=null), Reference(id=1200009554634310327, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2022, volume=44, issue=8, pageStart=4225, pageEnd=4238, url=null, language=null, rfNumber=[17], rfOrder=20, authorNames=LI C Y, GUO C L, LOY C C, journalName=IEEE Transactions on Pattern Analysis and Machine Intelligence, refType=null, unstructuredReference=LI C Y, GUO C L, LOY C C. Learning to Enhance Low-light Image via Zero-reference Deep Curve Estimation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44(8): 4225-4238., articleTitle=Learning to Enhance Low-light Image via Zero-reference Deep Curve Estimation, refAbstract=null), Reference(id=1200009554697224889, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=2014, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[18], rfOrder=21, authorNames=ABTAHI S, OMIDYEGANEH M, SHIRMOHAMMADI S, journalName=Proceedings of the 5th ACM Multimedia Systems Conference, refType=null, unstructuredReference=ABTAHI S, OMIDYEGANEH M, SHIRMOHAMMADI S, et al. YawDD: A Yawning Detection Dataset[C]// Proceedings of the 5th ACM Multimedia Systems Conference. Singapore: Association for Computing Machinery, 2014., articleTitle=YawDD: A Yawning Detection Dataset, refAbstract=null), Reference(id=1200009554764333755, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://rosap.ntl.bts.gov/view/dot/113, language=null, rfNumber=[19], rfOrder=22, authorNames=United States, Federal Motor Carrier Safety Administration, Technology Division, journalName=PERCLOS: A Valid Psychophysiological Measure of Alertness as Assessed by Psychomotor Vigilance, refType=null, unstructuredReference=United States. Federal Motor Carrier Safety Administration. Technology Division. PERCLOS: A Valid Psychophysiological Measure of Alertness as Assessed by Psychomotor Vigilance[EB/OL]. (1998-10-01) [2024-04-10]. https://rosap.ntl.bts.gov/view/dot/113., articleTitle=null, refAbstract=null)], funds=[Fund(id=1200009552268722818, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, awardId=62103256, language=CN, fundingSource=*国家自然科学基金项目(62103256), fundOrder=null, country=null), Fund(id=1200009552356803205, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, awardId=KLCCIIP202203, language=CN, fundingSource=福建省高校重点实验室开放课题基金项目(KLCCIIP202203), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1200009540558225860, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, xref=null, ext=[AuthorCompanyExt(id=1200009540566614468, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, companyId=1200009540558225860, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=Shanghai Dianji University, Shanghai 201306), AuthorCompanyExt(id=1200009540570808773, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, companyId=1200009540558225860, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=上海电机学院,上海 201306)])], figs=[ArticleFig(id=1200009547478827554, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=kJunjWRmsvAxR3iZb8keuw==, figureFileBig=kJAgLEcBBQnmSbb52QkKPQ==, tableContent=null), ArticleFig(id=1200009547575296547, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图1, caption=FasterNet-YOLO网络结构, figureFileSmall=kJunjWRmsvAxR3iZb8keuw==, figureFileBig=kJAgLEcBBQnmSbb52QkKPQ==, tableContent=null), ArticleFig(id=1200009547688542758, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=hVOsb7hyuNZrt03b0hlqDw==, figureFileBig=EBnFW4xgIiJ2T7T+VSgz/w==, tableContent=null), ArticleFig(id=1200009547789206058, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图2, caption=卷积结构, figureFileSmall=hVOsb7hyuNZrt03b0hlqDw==, figureFileBig=EBnFW4xgIiJ2T7T+VSgz/w==, tableContent=null), ArticleFig(id=1200009547902452270, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=nYkhud6PgGNiPmklKSMgMg==, figureFileBig=SXUhWdbl/0gzjobG36l0eg==, tableContent=null), ArticleFig(id=1200009548003115569, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图3, caption=PConv卷积结构, figureFileSmall=nYkhud6PgGNiPmklKSMgMg==, figureFileBig=SXUhWdbl/0gzjobG36l0eg==, tableContent=null), ArticleFig(id=1200009548124750388, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=UxDajRyzjWuNnTombHRlXw==, figureFileBig=u/bPBK+JxE3xmdCg0PYnTQ==, tableContent=null), ArticleFig(id=1200009548284133944, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图4, caption=SE注意力模块, figureFileSmall=UxDajRyzjWuNnTombHRlXw==, figureFileBig=u/bPBK+JxE3xmdCg0PYnTQ==, tableContent=null), ArticleFig(id=1200009548422545979, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=TgI8KP2Atlx2KLQMLAjSzQ==, figureFileBig=FESfAgBdli0eue6oyoj1Gw==, tableContent=null), ArticleFig(id=1200009548502237757, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图5, caption=CBAM注意力模块, figureFileSmall=TgI8KP2Atlx2KLQMLAjSzQ==, figureFileBig=FESfAgBdli0eue6oyoj1Gw==, tableContent=null), ArticleFig(id=1200009548611289665, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=3ClzQtCPvE+s/eqVuEA5zw==, figureFileBig=SkeehOIhW8yyRm8HgW0+sg==, tableContent=null), ArticleFig(id=1200009548737118786, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图6, caption=Zero-DCE++算法框架, figureFileSmall=3ClzQtCPvE+s/eqVuEA5zw==, figureFileBig=SkeehOIhW8yyRm8HgW0+sg==, tableContent=null), ArticleFig(id=1200009548837782086, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=b63ZXen4I6xkhZxq8feSwg==, figureFileBig=JuzD/ZGpNJkWvO0BuSzjvA==, tableContent=null), ArticleFig(id=1200009548934251080, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图7, caption=DCE-net网络结构, figureFileSmall=b63ZXen4I6xkhZxq8feSwg==, figureFileBig=JuzD/ZGpNJkWvO0BuSzjvA==, tableContent=null), ArticleFig(id=1200009549043302986, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=PC6j/kleg1UWUd/vMcoQ1A==, figureFileBig=vlh9pvvV1BXZg29BQGa9LA==, tableContent=null), ArticleFig(id=1200009549185909324, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图8, caption=摄像头安装位置和样本示例, figureFileSmall=PC6j/kleg1UWUd/vMcoQ1A==, figureFileBig=vlh9pvvV1BXZg29BQGa9LA==, tableContent=null), ArticleFig(id=1200009549282378318, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=lZZfmf29hFmWwdLbRETj/w==, figureFileBig=zJdCeXPZTRuDCgKxMXQjvw==, tableContent=null), ArticleFig(id=1200009549357875792, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图9, caption=改进FasterNet-YOLO的训练数据, figureFileSmall=lZZfmf29hFmWwdLbRETj/w==, figureFileBig=zJdCeXPZTRuDCgKxMXQjvw==, tableContent=null), ArticleFig(id=1200009549475316308, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=bE611f63qN3MhLIy6e/6VA==, figureFileBig=9xHoxe4HyumpEgY3Yvusqw==, tableContent=null), ArticleFig(id=1200009549563396695, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图10, caption=Zero-DCE++增光效果对比, figureFileSmall=bE611f63qN3MhLIy6e/6VA==, figureFileBig=9xHoxe4HyumpEgY3Yvusqw==, tableContent=null), ArticleFig(id=1200009549693420123, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=gzJdJoFPrgtIRhO3TFRpLQ==, figureFileBig=RvE5QMjjB+RRBmr3giYL/A==, tableContent=null), ArticleFig(id=1200009549781500510, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=图11, caption=不同光照条件检测效果可视化, figureFileSmall=gzJdJoFPrgtIRhO3TFRpLQ==, figureFileBig=RvE5QMjjB+RRBmr3giYL/A==, tableContent=null), ArticleFig(id=1200009550012187233, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
数据集 正常 闭眼 哈欠 点头
自建数据集 900 700 900 700
YawDD 257 184 284 40
合计 1 157 884 1 184 740
), ArticleFig(id=1200009550121239140, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=表1, caption=

数据集类别分布 张

, figureFileSmall=null, figureFileBig=null, tableContent=
数据集 正常 闭眼 哈欠 点头
自建数据集 900 700 900 700
YawDD 257 184 284 40
合计 1 157 884 1 184 740
), ArticleFig(id=1200009550255456872, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
参数 取值 参数 取值
优化器 Adam 迭代次数/次 200
学习率 0.001 批大小 16
特征图 640×640 耐心(Patience) 200
), ArticleFig(id=1200009550389674604, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=表2, caption=

试验参数配置

, figureFileSmall=null, figureFileBig=null, tableContent=
参数 取值 参数 取值
优化器 Adam 迭代次数/次 200
学习率 0.001 批大小 16
特征图 640×640 耐心(Patience) 200
), ArticleFig(id=1200009550477754991, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
模型 参数量
/×106
FLOPs
/×109
mAP@0.5
/%
处理时间
/ms
SSD 3.941 6.3 96.04 10.20
YOLOv3 tiny 12.134 19.0 98.10 9.40
MobileNet-YOLO 2.098 2.5 97.40 8.00
YOLOv8n 3.012 8.2 98.30 7.80
FasterNet-YOLO
(无注意力)
0.789 1.3 97.60 6.50
FasterNet-YOLO 0.791 1.3 98.00 6.95
), ArticleFig(id=1200009550632944242, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=表3, caption=

各模型性能指标

, figureFileSmall=null, figureFileBig=null, tableContent=
模型 参数量
/×106
FLOPs
/×109
mAP@0.5
/%
处理时间
/ms
SSD 3.941 6.3 96.04 10.20
YOLOv3 tiny 12.134 19.0 98.10 9.40
MobileNet-YOLO 2.098 2.5 97.40 8.00
YOLOv8n 3.012 8.2 98.30 7.80
FasterNet-YOLO
(无注意力)
0.789 1.3 97.60 6.50
FasterNet-YOLO 0.791 1.3 98.00 6.95
), ArticleFig(id=1200009550809105015, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
驾驶状态 标准
正常 检测到驾驶员状态为连续正常
轻度疲劳 哈欠状态计时超过10 s
中度疲劳 哈欠和闭眼同时检出、眨眼超过20次/min
重度疲劳 点头、闭眼超过nPERCLOS阈值
), ArticleFig(id=1200009551945761399, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=表4, caption=

驾驶员驾驶状态评定标准

, figureFileSmall=null, figureFileBig=null, tableContent=
驾驶状态 标准
正常 检测到驾驶员状态为连续正常
轻度疲劳 哈欠状态计时超过10 s
中度疲劳 哈欠和闭眼同时检出、眨眼超过20次/min
重度疲劳 点头、闭眼超过nPERCLOS阈值
), ArticleFig(id=1200009552017064568, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=EN, label=null, caption=null, figureFileSmall=null, figureFileBig=null, tableContent=
光照条件 疲劳状态 识别精度/% 处理时间/ms
白天(光照良好) 正常 98.5 7.1
哈欠 97.5
闭眼瞌睡 97.3
点头 98.0
夜间(光照不足) 正常 96.5 18.0
哈欠 96.1
闭眼瞌睡 95.4
点头 95.6
), ArticleFig(id=1200009552117727869, tenantId=1146029695717560320, journalId=1189621681917173762, articleId=1197492487834087996, language=CN, label=表5, caption=

不同光照条件检测结果

, figureFileSmall=null, figureFileBig=null, tableContent=
光照条件 疲劳状态 识别精度/% 处理时间/ms
白天(光照良好) 正常 98.5 7.1
哈欠 97.5
闭眼瞌睡 97.3
点头 98.0
夜间(光照不足) 正常 96.5 18.0
哈欠 96.1
闭眼瞌睡 95.4
点头 95.6
)], attaches=null, journal=Journal(id=1149693407745847311, delFlag=0, nameCn=汽车技术, nameEn=Automobile Technology, nameHistory1=null, nameHistory2=null, issn=1000-3703, eissn=null, cn=22-1113/U, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=rYFtDx/CU9+iX8QTM0ckbw==, journalPrice=null, startedYear=null, abbrevIsoEn=null, journalRemark=null, publicationField=null, createdTime=1752037868679, updatedTime=1761735668047, createdBy=18614031015, updatedBy=13701087609, firstLetterCn=A, firstLetterEn=A, subjectCode=Engineering, subjectName=Engineering, subjectCodeEn=Engineering, subjectNameEn=null, picCn=rYFtDx/CU9+iX8QTM0ckbw==, picEn=oFT2NmUwKPUjZ27C1+d9pw==, jcr=null, cjcr=null, exts=[JournalExt(id=1190368926564450443, language=CN, name=汽车技术, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1761735668078, updatedTime=1761735668078, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=1, submissionEditorUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=3, submissionReviewUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=2, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1190368926618976396, language=EN, name=Automobile Technology, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1761735668091, updatedTime=1761735668091, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=1, submissionEditorUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=3, submissionReviewUrl=https://qcjs.cbpt.cnki.net/index.aspx?t=2, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1189621681917173762, websiteList=[Website(id=1189624193747526544, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1189621681917173762, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/qcjs/CN, language=CN, createTime=1761558109939, createBy=18614031015, updateTime=1761558140534, updateBy=18614031015, name=汽车技术-中, tplId=1146099689490845704, title=汽车技术, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1189625424704451180, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=articleTextType, value=kx, createTime=1761558403421, updateTime=1761558403421, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424675091049, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=banner, value=null, createTime=1761558403414, updateTime=1761558403414, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424733811311, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=grayFlag, value=0, createTime=1761558403428, updateTime=1761558403428, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424658313832, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=logo, value=https://castjournals.cast.org.cn/joweb/qcjs/CN/file/pic?fileId=7En9rzX2QCa/1J8NnKt/Fg==, createTime=1761558403410, updateTime=1761558403410, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424746394225, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=minRunFlag, value=0, createTime=1761558403431, updateTime=1761558403431, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424691868267, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/qcjs/CN/file/pic, createTime=1761558403418, updateTime=1761558403418, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424742199920, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=silenceFlag, value=0, createTime=1761558403430, updateTime=1761558403430, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424683479658, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1761558403416, updateTime=1761558403416, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424712839789, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=themeColor, value=null, createTime=1761558403423, updateTime=1761558403423, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625424725422702, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193747526544, code=themeStyle, value=null, createTime=1761558403426, updateTime=1761558403426, creator=18614031015, updator=18614031015)]), Website(id=1189624193869161363, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1189621681917173762, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/qcjs/EN, language=EN, createTime=1761558109967, createBy=18614031015, updateTime=1761558340679, updateBy=18614031015, name=汽车技术-英文, tplId=1146101810881728533, title=Automobile Technology, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1189625550722311064, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=articleTextType, value=kx, createTime=1761558433466, updateTime=1761558433466, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550688756629, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=banner, value=null, createTime=1761558433458, updateTime=1761558433458, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550739088283, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=grayFlag, value=0, createTime=1761558433470, updateTime=1761558433470, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550676173716, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=logo, value=https://castjournals.cast.org.cn/joweb/qcjs/EN/file/pic?fileId=7En9rzX2QCa/1J8NnKt/Fg==, createTime=1761558433455, updateTime=1761558433455, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550751671197, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=minRunFlag, value=0, createTime=1761558433473, updateTime=1761558433473, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550713922455, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/qcjs/EN/file/pic, createTime=1761558433464, updateTime=1761558433464, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550743282588, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=silenceFlag, value=0, createTime=1761558433471, updateTime=1761558433471, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550705533846, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1761558433462, updateTime=1761558433462, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550726505369, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=themeColor, value=null, createTime=1761558433467, updateTime=1761558433467, creator=18614031015, updator=18614031015), WebsiteProps(id=1189625550734893978, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1189624193869161363, code=themeStyle, value=null, createTime=1761558433469, updateTime=1761558433469, creator=18614031015, updator=18614031015)])], journalTitle=汽车技术, weixinUrl=null, journalUrl=null, iacademicId=null, status=1, seqNo=null, journalTitleEn=Automobile Technology, journalPhotoCn=rYFtDx/CU9+iX8QTM0ckbw==, journalPhotoEn=oFT2NmUwKPUjZ27C1+d9pw==, journalFirstLetter=A, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false), detailUrlCn=https://castjournals.cast.org.cn/joweb/qcjs/CN/10.19620/j.cnki.1000-3703.20240063, detailUrlEn=https://castjournals.cast.org.cn/joweb/qcjs/EN/10.19620/j.cnki.1000-3703.20240063, pdfUrlCn=https://castjournals.cast.org.cn/joweb/qcjs/CN/PDF/10.19620/j.cnki.1000-3703.20240063, pdfUrlEn=https://castjournals.cast.org.cn/joweb/qcjs/EN/PDF/10.19620/j.cnki.1000-3703.20240063, aliStartDate=null, aliEndDate=null, collectionFlag=false, citedCount=null, citedUrl=null, reference=null)
收藏切换
基于改进YOLOv8n的环卫车辆驾驶员疲劳检测方法*
收藏切换
PDF下载
仝光 , 赵博 , 随婷婷 , 刘书炘
汽车技术 | 智能驾驶中人因状态多模态信息监测与识别技术专题 2025,(3): 15-21
收起
收藏切换
汽车技术 | 智能驾驶中人因状态多模态信息监测与识别技术专题 2025, (3): 15-21
基于改进YOLOv8n的环卫车辆驾驶员疲劳检测方法*
全屏
仝光, 赵博, 随婷婷, 刘书炘
作者信息
  • 上海电机学院,上海 201306
A Study on Fatigue Detection for Sanitation Vehicle Drivers Based on Improved YOLOv8n
Guang Tong, Bo Zhao, Tingting Sui, Shuxin Liu
Affiliations
  • Shanghai Dianji University, Shanghai 201306
出版时间: 2025-03-24 doi: 10.19620/j.cnki.1000-3703.20240063
文章导航
收藏切换

针对环卫车驾驶员的驾驶环境和驾驶安全,提出了一种基于改进YOLOv8n算法的驾驶员疲劳检测方法。使用FasterNet替换YOLOv8n目标检测算法的主干网络,并设计FasterNet-YOLO的轻量级网络模型;在主干网络和颈部中分别加入压缩和激励(SE)模块与卷积注意力机制(CBAM)模块,保留输入的重要特征信息;引入Zero-DCE++算法对摄像头输入的视频流进行亮度增强,处理因驾驶员面部亮度不足所致模型难以识别问题。试验结果表明:交并比为0.5时的平均类别检测精度(mAP@0.5)达到98%,平均每帧图片推理时间缩短至6.95 ms;该方法在不同光照情况下,均能够实时、准确地检测驾驶员疲劳状态。

疲劳驾驶  /  目标检测  /  FasterNet-YOLO  /  注意力机制  /  低光增强

With regard to the driving environment and safety of sanitation vehicle drivers, this paper proposes a driver fatigue detection method based on an enhanced YOLOv8n algorithm. Specifically, FasterNet is employed to replace the backbone network of the YOLOv8 object detection algorithm, resulting in the design of a lightweight FasterNet-YOLO network model. To preserve critical feature information from the input feature map, Squeeze-and-Excitation (SE) modules are integrated into the backbone network, while Convolutional Block Attention Modules (CBAM) are added to the neck network. Additionally, the Zero-DCE++ algorithm is introduced to enhance the brightness of video streams captured by cameras, addressing the issue of insufficient brightness in the driver’s face that hinders accurate detection. Experimental results demonstrate that the proposed method achieves an average precision of 98% (mAP@0.5) at an intersection over union ratio of 0.5, with an average inference time per frame reduced to 6.95 ms. This approach can effectively monitor the driver’s fatigue state in real-time under varying lighting conditions.

Fatigue driving  /  Object detection  /  FasterNet-YOLO  /  Attention Mechanism  /  Low-light enhancement
仝光, 赵博, 随婷婷, 刘书炘. 基于改进YOLOv8n的环卫车辆驾驶员疲劳检测方法*. 汽车技术, 2025 , (3) : 15 -21 . DOI: 10.19620/j.cnki.1000-3703.20240063
Guang Tong, Bo Zhao, Tingting Sui, Shuxin Liu. A Study on Fatigue Detection for Sanitation Vehicle Drivers Based on Improved YOLOv8n[J]. Automobile Technology, 2025 , (3) : 15 -21 . DOI: 10.19620/j.cnki.1000-3703.20240063
环卫车辆驾驶员面对特殊工作环境及多样化作息,极易引发驾驶疲劳,提升交通事故风险。因此,有效的驾驶员疲劳监测系统对于确保驾驶员行车安全至关重要。
驾驶员疲劳检测算法主要基于驾驶车辆信号和驾驶员生理信号,常根据驾驶员面部特征反映其驾驶状态,包括眼睛、嘴巴开闭状态以及驾驶员头部夹角等[1-2]。通过使用计算机视觉检测技术,Rohith等[3]依照眼睛的宽高比、口腔开口比和鼻长比等计算面部特征点,利用支持向量机对驾驶员状态进行分类,但该方法准确性较低且未考虑摄像机对驾驶员面部状态的捕捉效果。徐敬一等[4]提出了一种基于注意力机制和长短期记忆神经网络的疲劳驾驶检测模型,通过对不同特征定位点计算多维特征向量,同时引入注意力机制,使模型更关注检测目标,但对驾驶员疲劳状态检测的准确率较低。
关于提升模型实时性方面,Qu等[5]基于YOLOv5s模型,结合注意力机制提升了人脸检测的准确性,实现了较高的检测准确度,但YOLOv5s模型的参数量和计算量较大,导致检测速度降低。Liu等[6]在YOLOv7模型中引入注意力模块,同时嵌入小目标检测头,增强了模型对眼睛、嘴巴等小型面部目标的特征提取能力,通过简化网络架构实现了高速检测,但该算法在模型训练和运行的参数量和计算量较大,不利于车载嵌入式设备部署运行。张开生等[7]基于ResNet50和Bi-LSTM的时空网络对驾驶员疲劳度进行检测,从空间特征提取出人脸局部的疲劳水平,再输入Bi-LSTM进行时间特征提取。该方法虽然考虑了空间的特征和驾驶员疲劳的连续性,但其检测实时性受到双通道的限制,导致识别精确度较低。
为了保证环卫车辆驾驶员疲劳驾驶状态检测的实时性和准确性,增强在光照较暗时模型检测的鲁棒性,本文通过改进单阶段目标检测YOLOv8n网络,提升模型对驾驶员疲劳状态检测的性能,并引入低光增强技术,实现昏暗环境中对驾驶员面部特征的精确捕捉,最后通过对比试验,证明该方案的有效性。
相较于双阶段目标检测,YOLOv8系列[8]单阶段目标检测算法检测速度更快,网络结构具有轻量级优化空间[9]。本文基于原始YOLOv8n模型,对主干网络和颈部(Neck)网络结构进行轻量化改进,模型的网络结构如图1所示。
首先,将主干网络分为5个层级,在前4个层级中,各层级均存在1个嵌入层或1个合并层,用于空间下采样和通道数量的扩展,原有YOLOv8n的主干网络替换为更为轻量的FasterNet网络;然后,在第5个层级中使用激励和压缩(Squeeze-and-Excitation,SE)注意力机制[10],提取前4层阶段的重要信息,再经过快速空间金字塔池化(Spatial Pyramid Pooling-Faster,SPPF),实现局部特征和全局特征融合;使用简化的特征金字塔网络(Feature Pyramid Network,FPN)对颈部网络进行轻量化,将上、下不同卷积层得到的特征图融合,并引入CBAM注意力机制[11](Convolutional Block Attention Module),提升通道和空间维度的感知与网络的预测能力;最后,由于驾驶员面部疲劳检测的目标较大,所以考虑删除原始目标检测头中小目标检测头,保留2个检测头即可满足检测精度要求。
为了降低模型的参数量和计算量,提高网络的检测速度,MobileNet[12]、ShuffleNet[13]和PP-LCNet[14]等网络使用深度卷积(Depthwise Convolutionv,DWConv)、组卷积[15](Group Convolution,GConv)提取输入特征图的特征,虽然能够降低计算量,但算子经常受到内存访问增加的影响。FasterNet作为快速、轻量级的神经网络[16],其网络结构通过使用部分卷积(Partial Convolution,PConv)提取空间特征,减少了冗余计算和内存访问,从而降低网络参数量和计算量。
假设输入和输出特征图为c×h×w,滤波器为k×k,则DWConv的浮点运算次数(Floating-Point Operations,FLOPs)为h×w×k2×c次,标准卷积为h×w×k2×c2次。为了降低计算量,在DWConv卷积后使用2个点卷积(Pointwise Convolution,PWConv)替代标准卷积,避免信息丢失,两种卷积结构如图2所示。
普通卷积的内存访问量为 h × w × 2 c + k 2 × c 2 h × w × 2 c,DWConv的内存访问量为 h × w × 2 c ' + k 2 × c ' h × w × 2 c '。其中,cc′分别为普通卷积和DWConv的通道数,且c>c′。相较于普通卷积,DWConv虽然能够降低模型的参数量,但内存访问数量大于普通卷积。
传统的DWConv虽然使模型的参数量和计算量有所下降,但网络复杂度却显著增高,计算速度的提升并不明显。为了满足驾驶员疲劳状态检测的实时性,本文引入了PConv卷积结构,如图3所示。PConv的FLOPs为 h × w × k 2 × c p 2次,其中,PConv的通道数 c p = c / 4。因此,PConv的FLOPs仅为传统卷积的1/16,内存访问数量为 h × w × 2 c p + k 2 × c 2 h × w × 2 c p,仅为普通卷积的1/4。
在主干网络中加入SE注意力模块,该模块能够学习主干提取特征通道中的重要信息,过滤无关信息,同时考虑了主干特征通道间的关系,其结构如图4所示。
首先,对输入的特征图进行使用压缩(Squeeze)操作,对每个特征图进行全局池化,压缩空间维度;然后,对Squeeze输出的1×1×c特征图进行激励(Excitation)操作,学习通道间依赖关系,生成各通道的权重,降低网络的计算量,并提升网络的非线性能力;最后,通过缩放(Scale)操作,采用加权平均的方式连接输出的特征图。经过SE模块,模型对目标的特征提取能力提升,同时摒弃不重要的特征。
为了提升颈部网络的特征提取能力,引入CBAM注意力机模块,如图5所示。其中,通道注意力模块有助于保留通道中的重要信息,空间注意力模块对特征图进行池化操作。通过卷积操作将拼接结果降维为1×w×h的特征图权重;最后,将输入特征与该权重进行点积,从而实现空间注意力机制。
由于环卫车驾驶员的工作时间为凌晨和夜间,该时段内驾驶员的面部光线较暗,极易影响模型的检测效果。为此,通过引入低光增强Zero-DCE++(Zero-Reference Deep Curve Estimation)算法[17],对摄像头采集的照明不良的视频流进行亮度实时增强,便于对驾驶员的状态进行监测提醒,算法框架如图6所示。
Zero-DCE++算法无需使用成对的数据集训练,自动将低光图像映射到增强版本的高阶曲线,且自适应曲线的参数仅与输入图像有关。随后,使用DCE-Net(Deep Curve Estimation-Net)对图像进行拟合,结构如图7所示。
图像增强后,将每个像素进行[0,1]归一化,避免图像信息丢失;拟合后曲线呈单调性,保留了相邻像素间差异;在反向传播过程中仍然可微。控制级数和曝光水平,分别将曲线应用于RGB三通道,保留固有的颜色的同时,降低过饱和的风险。该算法的高阶曲线为:
I L E , n x = I L E , n - 1 x + A ( x ) I L E , n - 1 x ( 1 - I L E , n - 1 x )
式中:ILE,nn次迭代的增强图像矩阵,x为像素坐标,n为迭代次数,A(x)为给定图像在[-1,1]间可学习的参数矩阵。
鉴于环卫车辆的驾驶环境复杂多变,本文试验招募了20位志愿者,实车采集数据并构建数据集。为了适应不同的光照条件,还原车内环境,使用一辆压缩式环卫垃圾车,分别在8:00~18:00不同时段、不同光照情况下采集数据,摄像头的位置及数据集样本如图8所示。其中,驾驶状态分别为正常、哈欠、闭眼、点头,各驾驶状态视频的录制时长为10~16 s,选择4类驾驶员状态样本共3 965张图像。
为了增强模型的鲁棒性,使用公共数据集YawDD[18]进行数据扩充。通过将视频数据集按帧裁剪,从公共数据集与自建数据集中随机选择感兴趣的特征图,构成本文使用的数据集。将图像分辨率调整为640像素×640像素,使用Labelimg软件进行数据标注。数据集以6.4∶1.6∶2划分训练集、验证集和测试集,各驾驶状态分布如表1所示。
本文试验使用处理器为英特尔 Core i7-12700KF,主频为3.6 GHz,运行内存32 GB,图像处理器为英伟达 RTX A2000,显存容量为6 GB,深度学习配置环境Python版本为3.8,PyTorch版本为1.13,摄像头为普通高清摄像头,分辨率为1 920×1 080。
为了检测模型性能,将参数量、浮点运算次数、交并比为0.5时的平均类别检测精度(mean Average Precision,mAP)mAP@0.5等作为评价指标。其中,参数量衡量模型复杂度,浮点运算次数反映模型计算复杂度,类别平均精度以各类别的精确度(Precision)P为纵轴,召回率(Recall)R为横轴绘制曲线所围成的面积,相关公式如下:
P = T P T P + F P R = T P T P + F N n A P = 0 1 P r d r n m A P = 1 n i = 1 n n A P , i
式中:TP为模型将正确驾驶状态类别的判断为正样本,FP为模型将错误的驾驶状态类别判断为正样本,FN为模型将错误的驾驶状态类别判断为负样本,nAP为类别精度,nmAP为平均类别精度。
为了验证本文模型(FasterNet-YOLO)的有效性,对比SSD(Single Shot MultiBox Detector)模型(MobileNetv2为主干网络)、YOLOv3-tiny和MobileNetv3-YOLO等模型性能,模型训练超参数配置如表2所示,对比试验结果如表3所示。
表3可知,SSD模型参数量和计算量较大,且模型训练耗时较长;YOLOv3-tiny的训练效果与本文模型持平,但平均每帧图像的识别速度较低;MobileNet-YOLO的参数量虽低于YOLOv8n,但检测精度更低;本文模型在参数量、计算量和平均每帧图像识别速度等方面均有所改善,通过增强模型对空间和通道特征提取能力,检测的精度明显提升,同时,训练耗时大幅度降低。
分析本文模型的损失函数和平均类别精度曲线如图9所示。在训练迭代100次后,训练数据精度趋向稳定并逐渐达到最优。因此,本文提出的疲劳检测算法具有较小的参数量和计算量,并保持了较高的识别精确度,且其检测速度满足车载实时性需要。
由于环卫车辆驾驶员夜间的工作环境照明效果不佳,普通高清摄像头对光线的捕捉能力较弱,导致难以清晰呈现驾驶员面部特征,模型的检测能力受到严重影响。因此,引入Zero-DCE++低光增强算法,对夜间驾驶室照明不良的视频流进行低光照增强处理,结果如图10所示。由于Zero-DCE++为轻量化模型,模型训练仅需20 min,推理增强一张图片仅需2~3 ms,将该增光模型与本文疲劳检测模型结合,模型仍具有良好的实时性。
为了进一步验证模型检测效果,使用眼睑闭合持续时间百分比(Percentage of Eyelid Closure over Pupil for the Longest Blink in a given Observation Period,PERCLOS)[19]评估驾驶员疲劳闭眼程度:
n P E R C L O S = n e n t × 100 %
式中:nent分别为闭眼帧数、检测时段总帧数。
根据研究发现,人眼眨眼的时间范围为0.2~0.4 s,为了保证驾驶员疲劳检测的实时性,同时避免将眨眼误判为困乏,经验证,将检测时段总帧数设置为0.8 s。当nPERCLOS>50%时,表明驾驶员处于非眨眼状态。
按照驾驶员闭眼、正常、哈欠、点头等驾驶特征检测帧数,将驾驶员状态划分为正常、轻度疲劳、中度疲劳和重度疲劳,评定标准如表4所示。
为了验证本文模型结合Zero-DCE++低光增强算法的有效性,招募了4位志愿者(未参与自建数据集)进行模拟驾驶,不同光照条件下,驾驶员前侧采集的4种驾驶状态样本各160个,模型检测结果如表5所示。
表5结果可知,在白天光照良好的环境中,仅使用FasterNet-YOLO模型,模型的平均识别精度达到97.83%,视频流的平均每帧检测时间达到7.1 ms;在夜间驾驶室照明不良的环境中,引入低光增强算法后,模型准确度达到95.9%,平均每帧检测时间达到18 ms,检测效果的可视化如图11所示,模型检测精度和实时性均符合安全驾驶及实时性要求。
本文从环卫车辆的应用场景出发,提出了一种基于轻量级FasterNet-YOLO的驾驶员疲劳检测算法。通过引用注意力机制,提升了模型对驾驶员面部特征提取能力;轻量化主干网络,降低了模型参数量和计算量,提高了模型检测速度;通过结合轻量级Zero-DCE++低光增强算法,实时增强了不良照明条件下模型的检测效果。该方法具有较高的检测准确度和泛化性,可降低车辆硬件配置要求,在工程应用中具有一定的实际意义。
  • *国家自然科学基金项目(62103256)
  • 福建省高校重点实验室开放课题基金项目(KLCCIIP202203)
参考文献 引证文献
排序方式:
[1]
张瑞, 朱天军, 邹志亮, 等. 驾驶员疲劳驾驶检测方法研究综述[J]. 计算机工程与应用, 2022, 58(21): 53-66.
ZHANG R, ZHU T J, ZOU Z L, et al. Review of Research on Driver Fatigue Driving Detection Methods[J]. Computer Engineering and Applications, 2022, 58(21): 53-66.
[2]
SIKANDER G, ANWAR S. Driver Fatigue Detection Systems: A Review[J]. IEEE Transactions on Intelligent Transportation Systems, 2018, 20(6): 2339-2352.
[3]
ROHITH C, IMMANENI T, KUMAR M A, et al. Driver Drowsiness Detection and Monitoring System Using Machine Learning[J]. Journal of Physics: Conference Series, 2022, 2325(1).
[4]
徐敬一, 田瑾, 刘翔, 等. 基于注意力机制改进的疲劳驾驶检测方法[J]. 传感器与微系统, 2024, 43(4): 115-118.
XU J Y, TIAN J, LIU X, et al. Improved Fatigue Driving Detection Method Based on Attention Mechanism[J]. Transducer and Microsystem Technologies, 2024, 43(4): 115-118.
[5]
QU J X, WEI Z M, HAN Y M. An Embedded Device-Oriented Fatigue Driving Detection Method Based on a YOLOv5s[J]. Neural Computing and Applications, 2023, 36(7): 3711-3723.
[6]
LIU S G, WANG Y J, YU Q G, et al. A Driver Fatigue Detection Algorithm Based on Dynamic Tracking of Small Facial Targets Using YOLOv7: Regular Section[J]. IEICE Transactions on Information and Systems, 2023, 106(11): 1881-1890.
[7]
张开生, 关凯凯, 李昊晨, 等. 基于ResNet-50与Bi-LSTM的驾驶员疲劳检测算法研究[J]. 实验室研究与探索, 2023, 42(4): 153-158.
ZHAGN K S, GUAN K K, LI H C, et al. Research on Driver Fatigue Detection Algorithm Based on ResNet-50 and Bi-LSTM[J]. Research and Exploration In Laboratory, 2023, 42(4): 153-158.
[8]
REDMON J, DIVVALA S, GIRSHICK R, et al. You Only Look Once: Unified, Real-Time Object Detection[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE, 2016: 779-788.
[9]
吴雪, 宋晓茹, 高嵩, 等. 基于深度学习的目标检测算法综述[J]. 传感器与微系统, 2021, 40(2): 4-7+18.
WU X, SONG X R, GAO S, et al. Review of Target Detection Algorithms Based on Deep Learning[J]. Transducer and Microsystem Technologies, 2021, 40(2): 4-7+18.
[10]
HU J, SHEN L, SUN G. Squeeze-and-Excitation Networks[C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City: IEEE, 2018: 7132-7141.
[11]
WOO S, PARK J, LEE J Y, et al. CBAM: Convolutional Block Attention Module[C]// Proceedings of the European Conference on Computer Vision (ECCV). Munich, Germany: Spriner, 2018.
[12]
HOWARD A G, ZHU M L, CHEN B, et al. Mobilenets: Efficient Convolutional Neural Networks for Mobile Vision Applications[EB/OL]. ( 2017-04-17) [2024-04-10]. https://arxiv.org/abs/1704.04861. https://arxiv.org/abs/1704.04861
[13]
ZHANG X Y, ZHOU X Y, LIN M X, et al. Shufflenet: An Extremely Efficient Convolutional Neural Network for Mobile Devices[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 6848-6856.
[14]
CUI C, GAO T Q, WEI S Y, et al. PP-LCNet: A Lightweight CPU Convolutional Neural Network[J]. ( 2021-09-17) [2024-04-10]. https://arxiv.org/abs/2109.15099. https://arxiv.org/abs/2109.15099
[15]
CHOLLET F. Xception:Deep Learning with Depthwise Separable Convolutions[C]// 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI, USA: IEEE, 2017: 1800-1807.
[16]
CHEN J R, KAO S H, HE H, et al. Run, Don’t Walk: Chasing Higher FLOPS for Faster Neural Networks[C]// Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Vancouver: IEEE, 2023: 12021-12031.
[17]
LI C Y, GUO C L, LOY C C. Learning to Enhance Low-light Image via Zero-reference Deep Curve Estimation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44(8): 4225-4238.
[18]
ABTAHI S, OMIDYEGANEH M, SHIRMOHAMMADI S, et al. YawDD: A Yawning Detection Dataset[C]// Proceedings of the 5th ACM Multimedia Systems Conference. Singapore: Association for Computing Machinery, 2014.
[19]
United States. Federal Motor Carrier Safety Administration. Technology Division. PERCLOS: A Valid Psychophysiological Measure of Alertness as Assessed by Psychomotor Vigilance[EB/OL]. (1998-10-01) [2024-04-10]. https://rosap.ntl.bts.gov/view/dot/113. https://rosap.ntl.bts.gov/view/dot/113
2025年第卷第3期
PDF下载
266
105
引用本文
BibTeX
文章信息
doi: 10.19620/j.cnki.1000-3703.20240063
  • 首发时间:2025-11-18
  • 出版时间:2025-03-24
补充材料
相关文章
文章信息
作者
出版历史
  • 修回日期:2024-04-10
基金
*国家自然科学基金项目(62103256)
福建省高校重点实验室开放课题基金项目(KLCCIIP202203)
作者信息
    上海电机学院,上海 201306
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/qcjs/CN/10.19620/j.cnki.1000-3703.20240063
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏