Article(id=1282032843652050953, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282032292440805784, articleNumber=null, orderNo=null, doi=10.16265/j.cnki.issn1003-3033.2025.09.1298, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1744300800000, receivedDateStr=2025-04-11, revisedDate=1749916800000, revisedDateStr=2025-06-15, acceptedDate=null, acceptedDateStr=null, onlineDate=1783590048945, onlineDateStr=2026-07-09, pubDate=1758988800000, pubDateStr=2025-09-28, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1783590048945, onlineIssueDateStr=2026-07-09, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1783590048945, creator=13701087609, updateTime=1783590048945, updator=13701087609, issue=Issue{id=1282032292440805784, tenantId=1146029695717560320, journalId=1146031787341344770, year='2025', volume='35', issue='9', pageStart='1', pageEnd='268', issueExtLink='null', onlineDate='null', pubDate='1758988800000', pubDateStr='2025-09-28', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1783589917526, creator='13701087609', updateTime=1783593837820, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext={EN=IssueExt(id=1282048735404344166, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282032292440805784, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1282048735404344167, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282032292440805784, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null, downloadFileDto=null}, startPage=185, endPage=192, ext={EN=ArticleExt(id=1282032848278368266, articleId=1282032843652050953, tenantId=1146029695717560320, journalId=1146031787341344770, language=EN, title=Multimodal large model-based approach for construction safety hazard recognition, columnId=1149733269173878863, journalTitle=China Safety Science Journal, columnName=Safety engineering technology, runingTitle=null, highlight=null, articleAbstract=

In order to enhance the automatic recognition of safety hazards and improve safety management in construction scenarios, a multimodal large-model-based method for construction safety hazard recognition was proposed and its core component—the multimodal safety hazard recognition model, LLaVA(Large Language and Vision Assistant)-CS(Construction Site), was implemented. The system integrated images (construction site photos) with safety operating procedures (worker behavior descriptions), leveraging multimodal learning and deep learning technologies to perform real-time monitoring and analysis of construction sites. To support the system's effective operation, a multimodal dataset covering complex conditions such as varying lighting, occlusions, and multi-person scenarios was constructed, addressing the gaps in existing public datasets. Through prompt tuning of the LLaVA-1.5 model, the LLaVA-CS model effectively integrated visual and textual information, enhancing the accuracy and interpretability of safety hazard recognition. Experimental results show that this method achieves an accuracy of 0.722 2 in multiple real-world construction projects, generating detailed explanatory texts in real time to help managers quickly understand specific safety hazard contexts, thereby improving decision-making in safety management. This study innovatively applies multimodal large models to construction safety management systems, providing real-time, interpretable safety monitoring solutions and offering new technical support and optimization directions for construction safety management.

, authors=Siqi AN1, Anglin CAI2, Zicheng MA2, Baoyan ZHU**, 1, authorsList=Siqi AN, Anglin CAI, Zicheng MA, Baoyan ZHU, authorCompany=null, correspAuthors=Baoyan ZHU, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1282032859733012497, articleId=1282032843652050953, tenantId=1146029695717560320, journalId=1146031787341344770, language=CN, title=集成多模态大模型的施工安全隐患识别, columnId=1149733269727526997, journalTitle=中国安全科学学报, columnName=安全工程技术, runingTitle=null, highlight=null, articleAbstract=

为提升施工场景中安全隐患的自动识别和安全管理水平,构建一个集成多模态大模型的施工安全隐患识别模型,进而构成其核心组件——多模态安全隐患识别模型LLaVA-CS(用于施工场景(Construction Site, CS)下的多模态视觉-文本大语言模型(LLaVA));该系统将图像(施工现场照片)与安全操作规程(工人行为描述)相结合,利用多模态学习和深度学习技术,实时监控和分析施工现场;为支持系统的有效运行,构建一个涵盖不同光照、遮挡和多人场景等复杂条件的多模态数据集,弥补现有公开数据集的空白。结果表明:通过对LLaVA-1.5模型进行提示调优,LLaVA-CS模型能有效融合视觉与文本信息,提升安全隐患识别的精度和可解释性。集成该模型的施工安全隐患识别方法在多个实际施工项目中识别准确率达到0.722 2,能够实时生成详细的解释文本,帮助管理人员快速理解安全隐患的具体情境,增强安全管理的决策支持。将多模态大模型应用于施工安全管理系统,有助于提供实时、可解释的安全监控解决方案。

, authors=安思齐1, 蔡昂林2, 马子程2, 朱宝岩教授**, 1, authorsList=安思齐, 蔡昂林, 马子程, 朱宝岩教授, authorCompany=null, correspAuthors=朱宝岩教授, authorNote=

安思齐(1998—),男,黑龙江大庆人,硕士,主要从事安全管理、安全信用评价等方面的工作。E-mail:

, correspAuthorsNote=
** 朱宝岩(1963—),男,辽宁建昌人,博士,教授,主要从事风险预控、安全行为、安全经济、职业健康管理体系、安全与应急管理等方面的研究。E-mail:
, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=5MaXMeArVxamOr5SX5gmKQ==, magXml=9uFMeDfI9MqawlSBf9R0ew==, pdfUrl=null, pdf=GjCmMwbAuqNqokKVOrEdXQ==, pdfFileSize=8192668, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=J3/0uC81EnjrDjUcpsPszQ==, mapNumber=null, fund=null)}, authors=[Author(id=1282032867542806555, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=ansi.qi@163.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282032868398444573, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032867542806555, language=EN, stringName=Siqi AN, firstName=Siqi, middleName=null, lastName=AN, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1School of Safety Science and Engineering, Liaoning Technical University, Huludao Liaoning 125105, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282032868985647135, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032867542806555, language=CN, stringName=安思齐, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105, bio={"content":"

安思齐(1998—),男,黑龙江大庆人,硕士,主要从事安全管理、安全信用评价等方面的工作。E-mail:

"}, bioImg=null, bioContent=

安思齐(1998—),男,黑龙江大庆人,硕士,主要从事安全管理、安全信用评价等方面的工作。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282032864669708308, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, xref=1, ext=[AuthorCompanyExt(id=1282032864678096917, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032864669708308, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Engineering, Liaoning Technical University, Huludao Liaoning 125105, China), AuthorCompanyExt(id=1282032864694874134, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032864669708308, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105)])]), Author(id=1282032869749010465, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282032871896494116, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032869749010465, language=EN, stringName=Anglin CAI, firstName=Anglin, middleName=null, lastName=CAI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2School of Science, China University of Mining and Technology-Beijing, Beijing 100083, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282032873003790374, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032869749010465, language=CN, stringName=蔡昂林, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2中国矿业大学(北京) 理学院,北京 100083, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282032865504374807, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, xref=2, ext=[AuthorCompanyExt(id=1282032865525346328, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032865504374807, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2School of Science, China University of Mining and Technology-Beijing, Beijing 100083, China), AuthorCompanyExt(id=1282032865550512153, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032865504374807, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2中国矿业大学(北京) 理学院,北京 100083)])]), Author(id=1282032873926537257, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282032874744426539, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032873926537257, language=EN, stringName=Zicheng MA, firstName=Zicheng, middleName=null, lastName=MA, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2School of Science, China University of Mining and Technology-Beijing, Beijing 100083, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282032876023689262, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032873926537257, language=CN, stringName=马子程, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2中国矿业大学(北京) 理学院,北京 100083, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282032865504374807, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, xref=2, ext=[AuthorCompanyExt(id=1282032865525346328, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032865504374807, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2School of Science, China University of Mining and Technology-Beijing, Beijing 100083, China), AuthorCompanyExt(id=1282032865550512153, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032865504374807, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2中国矿业大学(北京) 理学院,北京 100083)])]), Author(id=1282032876816412721, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=361232175@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1282032877642690611, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032876816412721, language=EN, stringName=Baoyan ZHU, firstName=Baoyan, middleName=null, lastName=ZHU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=**, 1, address=1School of Safety Science and Engineering, Liaoning Technical University, Huludao Liaoning 125105, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282032878871621684, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032876816412721, language=CN, stringName=朱宝岩教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=**, 1, address=1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282032864669708308, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, xref=1, ext=[AuthorCompanyExt(id=1282032864678096917, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032864669708308, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Engineering, Liaoning Technical University, Huludao Liaoning 125105, China), AuthorCompanyExt(id=1282032864694874134, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032864669708308, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105)])])], keywords=[Keyword(id=1282032880650006581, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, language=EN, orderNo=1, keyword=multimodal large model), Keyword(id=1282032881803440182, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, language=EN, orderNo=2, keyword=construction safety hazards), Keyword(id=1282032882692632631, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, language=EN, orderNo=3, keyword=complex construction scenarios), Keyword(id=1282032883997061176, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, language=EN, orderNo=4, keyword=accident prevention), Keyword(id=1282032885737697337, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, language=EN, orderNo=5, keyword=tips for tuning), Keyword(id=1282032886568169530, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, language=CN, orderNo=1, keyword=多模态大模型), Keyword(id=1282032887683854395, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, language=CN, orderNo=2, keyword=施工安全隐患), Keyword(id=1282032888300417084, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, language=CN, orderNo=3, keyword=复杂施工场景), Keyword(id=1282032890309488701, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, language=CN, orderNo=4, keyword=安全管理), Keyword(id=1282032891475505214, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, language=CN, orderNo=5, keyword=提示调优)], refs=null, funds=null, companyList=[AuthorCompany(id=1282032864669708308, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, xref=1, ext=[AuthorCompanyExt(id=1282032864678096917, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032864669708308, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Engineering, Liaoning Technical University, Huludao Liaoning 125105, China), AuthorCompanyExt(id=1282032864694874134, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032864669708308, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105)]), AuthorCompany(id=1282032865504374807, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, xref=2, ext=[AuthorCompanyExt(id=1282032865525346328, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032865504374807, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2School of Science, China University of Mining and Technology-Beijing, Beijing 100083, China), AuthorCompanyExt(id=1282032865550512153, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032865504374807, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2中国矿业大学(北京) 理学院,北京 100083)])], figs=null, attaches=null, journal=Journal(id=1123942128916217864, delFlag=0, nameCn=中国安全科学学报, nameEn=China Safety Science Journal, nameHistory1=null, nameHistory2=null, issn=1003-3033, eissn=, cn=11-2865/X, coden=null, periodic=0, language=CN, oaType=0, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=fkqsFM6VKlHC4gCtS5XqTw==, journalPrice=null, startedYear=null, abbrevIsoEn=Chin Saf Sci J, journalRemark=null, publicationField=null, createdTime=null, updatedTime=1784015834644, createdBy=null, updatedBy=13041195026, firstLetterCn=Z, firstLetterEn=Z, subjectCode=Engineering, subjectName=工程, subjectCodeEn=Engineering, subjectNameEn=null, picCn=fkqsFM6VKlHC4gCtS5XqTw==, picEn=SHn9HgqSxtJrOcAxqD++4Q==, jcr=null, cjcr=null, exts=[JournalExt(id=1283818719495308010, language=CN, name=中国安全科学学报, nameHistory1=null, nameHistory2=null, managedBy=中国科学技术协会, sponsoredBy=中国职业安全健康协会, publishedBy=《中国安全科学学报》编辑部, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.cssjj.com.cn/, createdTime=1784015834926, updatedTime=1784015834926, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=http://www.cssjj.com.cn/CN/column/item15.shtml, submissionAuthorUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, option={"copyright":""}), JournalExt(id=1283818719541445355, language=EN, name=China Safety Science Journal, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.cssjj.com.cn/EN/1003-3033/home.shtml, createdTime=1784015834937, updatedTime=1784015834937, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=https://synbioj.cip.com.cn/EN/column/column3.shtml, submissionAuthorUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, option={"copyright":""})], databaseList=null, tenantJournalId=1146031787341344770, websiteList=[Website(id=1148243202345263519, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031787341344770, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN, language=CN, createTime=1751692112766, createBy=18614031015, updateTime=1753502583634, updateBy=18614031015, name=《中国安全科学学报》中文站点, tplId=1146099689490845704, title=中国安全科学学报, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1148618794941046792, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=articleTextType, value=kx, createTime=1751781661020, updateTime=1751781661020, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794911686661, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=banner, value=null, createTime=1751781661012, updateTime=1751781661012, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794894909444, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=tui0IVO9FMwB61HHtX5scg==, createTime=1751781661008, updateTime=1751781661008, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794932658183, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1751781661017, updateTime=1751781661017, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794924269574, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1751781661015, updateTime=1751781661015, creator=18614031015, updator=18614031015)]), Website(id=1155836763751993353, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031787341344770, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN, language=EN, createTime=1753502558893, createBy=18614031015, updateTime=1753524450387, updateBy=18614031015, name=《中国安全科学学报》英文站点, tplId=1146101810881728533, title=China Safety Science Journal, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1155895925743669425, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=articleTextType, value=kx, createTime=1753516664205, updateTime=1753516664205, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925722697902, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=banner, value=null, createTime=1753516664200, updateTime=1753516664200, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925714309293, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=tui0IVO9FMwB61HHtX5scg==, createTime=1753516664198, updateTime=1753516664198, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925735280816, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1753516664203, updateTime=1753516664203, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925731086511, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1753516664202, updateTime=1753516664202, creator=18614031015, updator=18614031015)])], journalTitle=中国安全科学学报, weixinUrl=null, journalUrl=null, iacademicId=null, status=1, seqNo=null, journalTitleEn=China Safety Science Journal, journalPhotoCn=fkqsFM6VKlHC4gCtS5XqTw==, journalPhotoEn=SHn9HgqSxtJrOcAxqD++4Q==, journalFirstLetter=Z, journalRecommend=null, journalNew=null, journalCollection=1, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/10.16265/j.cnki.issn1003-3033.2025.09.1298, detailUrlEn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN/10.16265/j.cnki.issn1003-3033.2025.09.1298, pdfUrlCn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/PDF/10.16265/j.cnki.issn1003-3033.2025.09.1298, pdfUrlEn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN/PDF/10.16265/j.cnki.issn1003-3033.2025.09.1298, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=0, orderTime=1758988800000, fullTextJson=null, articleText=null, reference=null)
收藏切换
集成多模态大模型的施工安全隐患识别
收藏切换
PDF下载
安思齐 1 , 蔡昂林 2 , 马子程 2 , 朱宝岩教授 **, 1
中国安全科学学报 | 安全工程技术 2025,35(9): 185-192
收起
收藏切换
中国安全科学学报 |安全工程技术 2025 , 35 (9) : 185 -192
集成多模态大模型的施工安全隐患识别
全屏
[Author(id=1282032867542806555, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=ansi.qi@163.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282032868398444573, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032867542806555, language=EN, stringName=Siqi AN, firstName=Siqi, middleName=null, lastName=AN, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1School of Safety Science and Engineering, Liaoning Technical University, Huludao Liaoning 125105, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282032868985647135, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032867542806555, language=CN, stringName=安思齐, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105, bio={"content":"

安思齐(1998—),男,黑龙江大庆人,硕士,主要从事安全管理、安全信用评价等方面的工作。E-mail:

"}, bioImg=null, bioContent=

安思齐(1998—),男,黑龙江大庆人,硕士,主要从事安全管理、安全信用评价等方面的工作。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282032864669708308, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, xref=1, ext=[AuthorCompanyExt(id=1282032864678096917, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032864669708308, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Engineering, Liaoning Technical University, Huludao Liaoning 125105, China), AuthorCompanyExt(id=1282032864694874134, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032864669708308, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105)])]), Author(id=1282032869749010465, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282032871896494116, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032869749010465, language=EN, stringName=Anglin CAI, firstName=Anglin, middleName=null, lastName=CAI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2School of Science, China University of Mining and Technology-Beijing, Beijing 100083, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282032873003790374, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032869749010465, language=CN, stringName=蔡昂林, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2中国矿业大学(北京) 理学院,北京 100083, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282032865504374807, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, xref=2, ext=[AuthorCompanyExt(id=1282032865525346328, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032865504374807, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2School of Science, China University of Mining and Technology-Beijing, Beijing 100083, China), AuthorCompanyExt(id=1282032865550512153, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032865504374807, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2中国矿业大学(北京) 理学院,北京 100083)])]), Author(id=1282032873926537257, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282032874744426539, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032873926537257, language=EN, stringName=Zicheng MA, firstName=Zicheng, middleName=null, lastName=MA, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2School of Science, China University of Mining and Technology-Beijing, Beijing 100083, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282032876023689262, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032873926537257, language=CN, stringName=马子程, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2中国矿业大学(北京) 理学院,北京 100083, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282032865504374807, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, xref=2, ext=[AuthorCompanyExt(id=1282032865525346328, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032865504374807, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2School of Science, China University of Mining and Technology-Beijing, Beijing 100083, China), AuthorCompanyExt(id=1282032865550512153, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032865504374807, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2中国矿业大学(北京) 理学院,北京 100083)])]), Author(id=1282032876816412721, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=361232175@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1282032877642690611, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032876816412721, language=EN, stringName=Baoyan ZHU, firstName=Baoyan, middleName=null, lastName=ZHU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=**, 1, address=1School of Safety Science and Engineering, Liaoning Technical University, Huludao Liaoning 125105, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282032878871621684, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, authorId=1282032876816412721, language=CN, stringName=朱宝岩教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=**, 1, address=1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282032864669708308, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, xref=1, ext=[AuthorCompanyExt(id=1282032864678096917, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032864669708308, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Engineering, Liaoning Technical University, Huludao Liaoning 125105, China), AuthorCompanyExt(id=1282032864694874134, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282032843652050953, companyId=1282032864669708308, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105)])])]
安思齐1 , 蔡昂林2, 马子程2, 朱宝岩教授**, 1
作者信息
  • 1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105
  • 2中国矿业大学(北京) 理学院,北京 100083
通讯作者:
** 朱宝岩(1963—),男,辽宁建昌人,博士,教授,主要从事风险预控、安全行为、安全经济、职业健康管理体系、安全与应急管理等方面的研究。E-mail:
作者简介:

安思齐(1998—),男,黑龙江大庆人,硕士,主要从事安全管理、安全信用评价等方面的工作。E-mail:

Multimodal large model-based approach for construction safety hazard recognition
Siqi AN1 , Anglin CAI2, Zicheng MA2, Baoyan ZHU**, 1
Affiliations
  • 1School of Safety Science and Engineering, Liaoning Technical University, Huludao Liaoning 125105, China
  • 2School of Science, China University of Mining and Technology-Beijing, Beijing 100083, China
出版时间: 2025-09-28 doi: 10.16265/j.cnki.issn1003-3033.2025.09.1298
文章导航
收藏切换

为提升施工场景中安全隐患的自动识别和安全管理水平,构建一个集成多模态大模型的施工安全隐患识别模型,进而构成其核心组件——多模态安全隐患识别模型LLaVA-CS(用于施工场景(Construction Site, CS)下的多模态视觉-文本大语言模型(LLaVA));该系统将图像(施工现场照片)与安全操作规程(工人行为描述)相结合,利用多模态学习和深度学习技术,实时监控和分析施工现场;为支持系统的有效运行,构建一个涵盖不同光照、遮挡和多人场景等复杂条件的多模态数据集,弥补现有公开数据集的空白。结果表明:通过对LLaVA-1.5模型进行提示调优,LLaVA-CS模型能有效融合视觉与文本信息,提升安全隐患识别的精度和可解释性。集成该模型的施工安全隐患识别方法在多个实际施工项目中识别准确率达到0.722 2,能够实时生成详细的解释文本,帮助管理人员快速理解安全隐患的具体情境,增强安全管理的决策支持。将多模态大模型应用于施工安全管理系统,有助于提供实时、可解释的安全监控解决方案。

多模态大模型  /  施工安全隐患  /  复杂施工场景  /  安全管理  /  提示调优

In order to enhance the automatic recognition of safety hazards and improve safety management in construction scenarios, a multimodal large-model-based method for construction safety hazard recognition was proposed and its core component—the multimodal safety hazard recognition model, LLaVA(Large Language and Vision Assistant)-CS(Construction Site), was implemented. The system integrated images (construction site photos) with safety operating procedures (worker behavior descriptions), leveraging multimodal learning and deep learning technologies to perform real-time monitoring and analysis of construction sites. To support the system's effective operation, a multimodal dataset covering complex conditions such as varying lighting, occlusions, and multi-person scenarios was constructed, addressing the gaps in existing public datasets. Through prompt tuning of the LLaVA-1.5 model, the LLaVA-CS model effectively integrated visual and textual information, enhancing the accuracy and interpretability of safety hazard recognition. Experimental results show that this method achieves an accuracy of 0.722 2 in multiple real-world construction projects, generating detailed explanatory texts in real time to help managers quickly understand specific safety hazard contexts, thereby improving decision-making in safety management. This study innovatively applies multimodal large models to construction safety management systems, providing real-time, interpretable safety monitoring solutions and offering new technical support and optimization directions for construction safety management.

multimodal large model  /  construction safety hazards  /  complex construction scenarios  /  accident prevention  /  tips for tuning
安思齐, 蔡昂林, 马子程, 朱宝岩教授. 集成多模态大模型的施工安全隐患识别. 中国安全科学学报, 2025 , 35 (9) : 185 -192 . DOI: 10.16265/j.cnki.issn1003-3033.2025.09.1298
Siqi AN, Anglin CAI, Zicheng MA, Baoyan ZHU. Multimodal large model-based approach for construction safety hazard recognition[J]. China Safety Science Journal, 2025 , 35 (9) : 185 -192 . DOI: 10.16265/j.cnki.issn1003-3033.2025.09.1298

参考文献 引证文献
排序方式:
2025年第35卷第9期
PDF下载
78
4
引用本文
BibTeX
文章信息
doi: 10.16265/j.cnki.issn1003-3033.2025.09.1298
  • 接收时间:2025-04-11
  • 首发时间:2026-07-09
  • 出版时间:2025-09-28
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2025-04-11
  • 修回日期:2025-06-15
基金
作者信息
    1辽宁工程技术大学 安全科学与工程学院,辽宁 葫芦岛 125105
    2中国矿业大学(北京) 理学院,北京 100083

通讯作者:

** 朱宝岩(1963—),男,辽宁建昌人,博士,教授,主要从事风险预控、安全行为、安全经济、职业健康管理体系、安全与应急管理等方面的研究。E-mail:
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/10.16265/j.cnki.issn1003-3033.2025.09.1298
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏