Article(id=1282034770670502046, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282034747870253265, articleNumber=null, orderNo=null, doi=10.16265/j.cnki.issn1003-3033.2025.10.1435, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1749484800000, receivedDateStr=2025-06-10, revisedDate=1755014400000, revisedDateStr=2025-08-13, acceptedDate=null, acceptedDateStr=null, onlineDate=1783590508382, onlineDateStr=2026-07-09, pubDate=1761580800000, pubDateStr=2025-10-28, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1783590508382, onlineIssueDateStr=2026-07-09, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1783590508382, creator=13701087609, updateTime=1783590508382, updator=13701087609, issue=Issue{id=1282034747870253265, tenantId=1146029695717560320, journalId=1146031787341344770, year='2025', volume='35', issue='10', pageStart='1', pageEnd='252', issueExtLink='null', onlineDate='null', pubDate='1761580800000', pubDateStr='2025-10-28', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1783590502946, creator='13701087609', updateTime=1783593819616, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext={EN=IssueExt(id=1282048659068006772, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282034747870253265, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1282048659068006773, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282034747870253265, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null, downloadFileDto=null}, startPage=106, endPage=114, ext={EN=ArticleExt(id=1282034770892800159, articleId=1282034770670502046, tenantId=1146029695717560320, journalId=1146031787341344770, language=EN, title=Intelligent question answering model for construction safety hazards based on vision-language multimodality, columnId=1149733269173878863, journalTitle=China Safety Science Journal, columnName=Safety engineering technology, runingTitle=null, highlight=null, articleAbstract=

In order to enhance the intelligent diagnosis level of safety problems in complex construction environments, an intelligent question-answering model for construction safety hazards based on vision-language multimodality was proposed. A dataset of image-text pairs related to construction safety hazards was constructed. A visual encoder was used to complete the visual encoding of safety hazard images, and a language model was employed to encode the question-answering texts about safety hazards. A multimodal feature fusion module was adopted to achieve effective interaction between image and text information. A specific input template for visual question answering adapted to the scenario of construction safety hazards was constructed. The model was fine-tuned based on matrix low-rank decomposition, and multi-round prompts were used to guide the model in generating accurate answers. The results show that compared with existing contrastive models, the intelligent question-answering model for construction safety hazards performs better in automatic evaluation metrics, Generative Pre-trained Transformer(GPT)-4 evaluation, and expert evaluation, with significantly improved fluency and semantic relevance of the generated texts. Ablation experiments further verify the effectiveness of each sub-module, confirming that the synergistic effect of matrix low-rank decomposition fine-tuning and multi-round reasoning is the key for the model to achieve optimal performance, and that reasonably setting the rank parameter of the low-rank matrix can effectively avoid the overfitting problem.

, authors=Zhe WANG1, 2, Haichen HUANG1, 2, Ruiqin LI1, 2, Yongchang WEI3, authorsList=Zhe WANG, Haichen HUANG, Ruiqin LI, Yongchang WEI, authorCompany=null, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1282034771354173602, articleId=1282034770670502046, tenantId=1146029695717560320, journalId=1146031787341344770, language=CN, title=基于视觉语言多模态的建筑施工安全智能问答模型, columnId=1149733269727526997, journalTitle=中国安全科学学报, columnName=安全工程技术, runingTitle=null, highlight=null, articleAbstract=

为提升建筑施工复杂环境下安全问题的智能化诊断水平,提出一种基于视觉语言多模态的建筑施工安全智能问答模型,构建建筑施工安全隐患图文对数据集,采用视觉编码器完成安全隐患图像的视觉编码,利用语言模型实现安全隐患问答文本的编码,通过多模态特征融合模块达成图像与文本信息的有效交互;构建适配建筑施工安全隐患场景视觉问答的特定提示模板,基于矩阵低秩分解对模型微调训练,并通过多轮提示词引导模型生成精确答案。结果表明:相较于现有对比模型,建筑施工安全智能问答模型在自动评估指标、GPT-4评价和专家评价中均表现更优,生成文本的流畅性与语义相关性显著提升;消融试验进一步验证了各子模块的有效性,证实矩阵低秩分解微调和多轮推理的协同作用是模型达成最优性能的关键,且合理设置低秩矩阵的秩参数可有效避免过拟合问题。

, authors=王喆副教授1, 2, 黄海辰1, 2, 李瑞钦1, 2, 魏永长副教授3, authorsList=王喆副教授, 黄海辰, 李瑞钦, 魏永长副教授, authorCompany=null, correspAuthors=null, authorNote=

王喆(1980—),男,湖北武汉人,博士,副教授,博士生导师,主要从事应急决策、人工智能和施工安全等方面的研究。E-mail:

, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=2ZB/NoyPE7fyldWS1EgWsQ==, magXml=Bvf88f93pcZ5RHn87hfW3A==, pdfUrl=null, pdf=3HQMHmS4lFfuE2MVWDCefA==, pdfFileSize=9057090, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=xD5D4whw1QzIDrHBjvTa9A==, mapNumber=null, fund=null)}, authors=[Author(id=1282034771844907181, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=wangzhe@whut.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282034771966542000, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034771844907181, language=EN, stringName=Zhe WANG, firstName=Zhe, middleName=null, lastName=WANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China
2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282034772033650865, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034771844907181, language=CN, stringName=王喆副教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070
2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070, bio={"content":"

王喆(1980—),男,湖北武汉人,博士,副教授,博士生导师,主要从事应急决策、人工智能和施工安全等方面的研究。E-mail:

"}, bioImg=null, bioContent=

王喆(1980—),男,湖北武汉人,博士,副教授,博士生导师,主要从事应急决策、人工智能和施工安全等方面的研究。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282034771542917283, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=1, ext=[AuthorCompanyExt(id=1282034771551305892, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771559694501, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070)]), AuthorCompany(id=1282034771639386278, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=2, ext=[AuthorCompanyExt(id=1282034771651969191, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771660357800, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070)])]), Author(id=1282034772104954035, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282034772193034422, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772104954035, language=EN, stringName=Haichen HUANG, firstName=Haichen, middleName=null, lastName=HUANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China
2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282034772276920503, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772104954035, language=CN, stringName=黄海辰, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070
2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282034771542917283, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=1, ext=[AuthorCompanyExt(id=1282034771551305892, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771559694501, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070)]), AuthorCompany(id=1282034771639386278, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=2, ext=[AuthorCompanyExt(id=1282034771651969191, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771660357800, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070)])]), Author(id=1282034772360806585, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282034772474052796, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772360806585, language=EN, stringName=Ruiqin LI, firstName=Ruiqin, middleName=null, lastName=LI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China
2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282034772545355965, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772360806585, language=CN, stringName=李瑞钦, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070
2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282034771542917283, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=1, ext=[AuthorCompanyExt(id=1282034771551305892, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771559694501, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070)]), AuthorCompany(id=1282034771639386278, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=2, ext=[AuthorCompanyExt(id=1282034771651969191, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771660357800, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070)])]), Author(id=1282034772629242047, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282034772780236993, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772629242047, language=EN, stringName=Yongchang WEI, firstName=Yongchang, middleName=null, lastName=WEI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3College of Business Administration, Zhongnan University of Economics and Law, Wuhan Hubei 430073, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282034772847345858, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772629242047, language=CN, stringName=魏永长副教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3中南财经政法大学 工商管理学院,湖北 武汉 430073, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282034771748438185, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=3, ext=[AuthorCompanyExt(id=1282034771756826794, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771748438185, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3College of Business Administration, Zhongnan University of Economics and Law, Wuhan Hubei 430073, China), AuthorCompanyExt(id=1282034771769409707, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771748438185, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3中南财经政法大学 工商管理学院,湖北 武汉 430073)])])], keywords=[Keyword(id=1282034772943814851, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=EN, orderNo=1, keyword=vision-language), Keyword(id=1282034773023506628, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=EN, orderNo=2, keyword=multimodality), Keyword(id=1282034773111587013, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=EN, orderNo=3, keyword=construction safety), Keyword(id=1282034773191278790, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=EN, orderNo=4, keyword=safety hazard), Keyword(id=1282034773249999047, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=EN, orderNo=5, keyword=intelligent question answering model), Keyword(id=1282034774869000392, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=EN, orderNo=6, keyword=matrix low-rank decomposition), Keyword(id=1282034774948692169, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=CN, orderNo=1, keyword=视觉语言), Keyword(id=1282034775024189642, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=CN, orderNo=2, keyword=多模态), Keyword(id=1282034775091298507, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=CN, orderNo=3, keyword=建筑施工安全), Keyword(id=1282034775166795980, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=CN, orderNo=4, keyword=安全隐患), Keyword(id=1282034775246487757, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=CN, orderNo=5, keyword=智能问答模型), Keyword(id=1282034775321985230, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, language=CN, orderNo=6, keyword=矩阵低秩分解)], refs=null, funds=[Fund(id=1282034775410065615, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, awardId=21YJA630094; 20YJC630154, language=CN, fundingSource=教育部人文社会科学研究青年基金资助(21YJA630094; 20YJC630154), fundOrder=null, country=null), Fund(id=1282034775506534608, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, awardId=104972024DZB0003, language=CN, fundingSource=中央高校基本科研业务费专项资金项目(104972024DZB0003), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1282034771542917283, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=1, ext=[AuthorCompanyExt(id=1282034771551305892, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771559694501, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070)]), AuthorCompany(id=1282034771639386278, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=2, ext=[AuthorCompanyExt(id=1282034771651969191, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771660357800, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070)]), AuthorCompany(id=1282034771748438185, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=3, ext=[AuthorCompanyExt(id=1282034771756826794, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771748438185, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3College of Business Administration, Zhongnan University of Economics and Law, Wuhan Hubei 430073, China), AuthorCompanyExt(id=1282034771769409707, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771748438185, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3中南财经政法大学 工商管理学院,湖北 武汉 430073)])], figs=null, attaches=null, journal=Journal(id=1123942128916217864, delFlag=0, nameCn=中国安全科学学报, nameEn=China Safety Science Journal, nameHistory1=null, nameHistory2=null, issn=1003-3033, eissn=, cn=11-2865/X, coden=null, periodic=0, language=CN, oaType=0, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=fkqsFM6VKlHC4gCtS5XqTw==, journalPrice=null, startedYear=null, abbrevIsoEn=Chin Saf Sci J, journalRemark=null, publicationField=null, createdTime=null, updatedTime=1784015834644, createdBy=null, updatedBy=13041195026, firstLetterCn=Z, firstLetterEn=Z, subjectCode=Engineering, subjectName=工程, subjectCodeEn=Engineering, subjectNameEn=null, picCn=fkqsFM6VKlHC4gCtS5XqTw==, picEn=SHn9HgqSxtJrOcAxqD++4Q==, jcr=null, cjcr=null, exts=[JournalExt(id=1283818719495308010, language=CN, name=中国安全科学学报, nameHistory1=null, nameHistory2=null, managedBy=中国科学技术协会, sponsoredBy=中国职业安全健康协会, publishedBy=《中国安全科学学报》编辑部, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.cssjj.com.cn/, createdTime=1784015834926, updatedTime=1784015834926, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=http://www.cssjj.com.cn/CN/column/item15.shtml, submissionAuthorUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, option={"copyright":""}), JournalExt(id=1283818719541445355, language=EN, name=China Safety Science Journal, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.cssjj.com.cn/EN/1003-3033/home.shtml, createdTime=1784015834937, updatedTime=1784015834937, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=https://synbioj.cip.com.cn/EN/column/column3.shtml, submissionAuthorUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, option={"copyright":""})], databaseList=null, tenantJournalId=1146031787341344770, websiteList=[Website(id=1148243202345263519, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031787341344770, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN, language=CN, createTime=1751692112766, createBy=18614031015, updateTime=1753502583634, updateBy=18614031015, name=《中国安全科学学报》中文站点, tplId=1146099689490845704, title=中国安全科学学报, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1148618794941046792, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=articleTextType, value=kx, createTime=1751781661020, updateTime=1751781661020, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794911686661, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=banner, value=null, createTime=1751781661012, updateTime=1751781661012, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794894909444, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=tui0IVO9FMwB61HHtX5scg==, createTime=1751781661008, updateTime=1751781661008, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794932658183, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1751781661017, updateTime=1751781661017, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794924269574, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1751781661015, updateTime=1751781661015, creator=18614031015, updator=18614031015)]), Website(id=1155836763751993353, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031787341344770, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN, language=EN, createTime=1753502558893, createBy=18614031015, updateTime=1753524450387, updateBy=18614031015, name=《中国安全科学学报》英文站点, tplId=1146101810881728533, title=China Safety Science Journal, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1155895925743669425, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=articleTextType, value=kx, createTime=1753516664205, updateTime=1753516664205, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925722697902, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=banner, value=null, createTime=1753516664200, updateTime=1753516664200, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925714309293, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=tui0IVO9FMwB61HHtX5scg==, createTime=1753516664198, updateTime=1753516664198, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925735280816, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1753516664203, updateTime=1753516664203, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925731086511, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1753516664202, updateTime=1753516664202, creator=18614031015, updator=18614031015)])], journalTitle=中国安全科学学报, weixinUrl=null, journalUrl=null, iacademicId=null, status=1, seqNo=null, journalTitleEn=China Safety Science Journal, journalPhotoCn=fkqsFM6VKlHC4gCtS5XqTw==, journalPhotoEn=SHn9HgqSxtJrOcAxqD++4Q==, journalFirstLetter=Z, journalRecommend=null, journalNew=null, journalCollection=1, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/10.16265/j.cnki.issn1003-3033.2025.10.1435, detailUrlEn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN/10.16265/j.cnki.issn1003-3033.2025.10.1435, pdfUrlCn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/PDF/10.16265/j.cnki.issn1003-3033.2025.10.1435, pdfUrlEn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN/PDF/10.16265/j.cnki.issn1003-3033.2025.10.1435, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=0, orderTime=1761580800000, fullTextJson=null, articleText=null, reference=null)
收藏切换
基于视觉语言多模态的建筑施工安全智能问答模型
收藏切换
PDF下载
王喆副教授 1, 2 , 黄海辰 1, 2 , 李瑞钦 1, 2 , 魏永长副教授 3
中国安全科学学报 | 安全工程技术 2025,35(10): 106-114
收起
收藏切换
中国安全科学学报 |安全工程技术 2025 , 35 (10) : 106 -114
基于视觉语言多模态的建筑施工安全智能问答模型
全屏
[Author(id=1282034771844907181, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=wangzhe@whut.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282034771966542000, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034771844907181, language=EN, stringName=Zhe WANG, firstName=Zhe, middleName=null, lastName=WANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China
2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282034772033650865, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034771844907181, language=CN, stringName=王喆副教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070
2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070, bio={"content":"

王喆(1980—),男,湖北武汉人,博士,副教授,博士生导师,主要从事应急决策、人工智能和施工安全等方面的研究。E-mail:

"}, bioImg=null, bioContent=

王喆(1980—),男,湖北武汉人,博士,副教授,博士生导师,主要从事应急决策、人工智能和施工安全等方面的研究。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282034771542917283, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=1, ext=[AuthorCompanyExt(id=1282034771551305892, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771559694501, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070)]), AuthorCompany(id=1282034771639386278, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=2, ext=[AuthorCompanyExt(id=1282034771651969191, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771660357800, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070)])]), Author(id=1282034772104954035, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282034772193034422, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772104954035, language=EN, stringName=Haichen HUANG, firstName=Haichen, middleName=null, lastName=HUANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China
2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282034772276920503, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772104954035, language=CN, stringName=黄海辰, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070
2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282034771542917283, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=1, ext=[AuthorCompanyExt(id=1282034771551305892, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771559694501, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070)]), AuthorCompany(id=1282034771639386278, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=2, ext=[AuthorCompanyExt(id=1282034771651969191, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771660357800, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070)])]), Author(id=1282034772360806585, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282034772474052796, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772360806585, language=EN, stringName=Ruiqin LI, firstName=Ruiqin, middleName=null, lastName=LI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China
2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282034772545355965, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772360806585, language=CN, stringName=李瑞钦, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070
2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282034771542917283, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=1, ext=[AuthorCompanyExt(id=1282034771551305892, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771559694501, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771542917283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070)]), AuthorCompany(id=1282034771639386278, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=2, ext=[AuthorCompanyExt(id=1282034771651969191, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China), AuthorCompanyExt(id=1282034771660357800, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771639386278, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070)])]), Author(id=1282034772629242047, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282034772780236993, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772629242047, language=EN, stringName=Yongchang WEI, firstName=Yongchang, middleName=null, lastName=WEI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3College of Business Administration, Zhongnan University of Economics and Law, Wuhan Hubei 430073, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282034772847345858, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, authorId=1282034772629242047, language=CN, stringName=魏永长副教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3中南财经政法大学 工商管理学院,湖北 武汉 430073, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282034771748438185, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, xref=3, ext=[AuthorCompanyExt(id=1282034771756826794, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771748438185, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3College of Business Administration, Zhongnan University of Economics and Law, Wuhan Hubei 430073, China), AuthorCompanyExt(id=1282034771769409707, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282034770670502046, companyId=1282034771748438185, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3中南财经政法大学 工商管理学院,湖北 武汉 430073)])])]
王喆副教授1, 2 , 黄海辰1, 2, 李瑞钦1, 2, 魏永长副教授3
作者信息
  • 1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070
  • 2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070
  • 3中南财经政法大学 工商管理学院,湖北 武汉 430073
作者简介:

王喆(1980—),男,湖北武汉人,博士,副教授,博士生导师,主要从事应急决策、人工智能和施工安全等方面的研究。E-mail:

Intelligent question answering model for construction safety hazards based on vision-language multimodality
Zhe WANG1, 2 , Haichen HUANG1, 2, Ruiqin LI1, 2, Yongchang WEI3
Affiliations
  • 1School of Safety Science and Emergency Management, Wuhan University of Technology, Wuhan Hubei 430070, China
  • 2China Emergency Management Research Center, Wuhan University of Technology, Wuhan Hubei 430070, China
  • 3College of Business Administration, Zhongnan University of Economics and Law, Wuhan Hubei 430073, China
出版时间: 2025-10-28 doi: 10.16265/j.cnki.issn1003-3033.2025.10.1435
文章导航
收藏切换

为提升建筑施工复杂环境下安全问题的智能化诊断水平,提出一种基于视觉语言多模态的建筑施工安全智能问答模型,构建建筑施工安全隐患图文对数据集,采用视觉编码器完成安全隐患图像的视觉编码,利用语言模型实现安全隐患问答文本的编码,通过多模态特征融合模块达成图像与文本信息的有效交互;构建适配建筑施工安全隐患场景视觉问答的特定提示模板,基于矩阵低秩分解对模型微调训练,并通过多轮提示词引导模型生成精确答案。结果表明:相较于现有对比模型,建筑施工安全智能问答模型在自动评估指标、GPT-4评价和专家评价中均表现更优,生成文本的流畅性与语义相关性显著提升;消融试验进一步验证了各子模块的有效性,证实矩阵低秩分解微调和多轮推理的协同作用是模型达成最优性能的关键,且合理设置低秩矩阵的秩参数可有效避免过拟合问题。

视觉语言  /  多模态  /  建筑施工安全  /  安全隐患  /  智能问答模型  /  矩阵低秩分解

In order to enhance the intelligent diagnosis level of safety problems in complex construction environments, an intelligent question-answering model for construction safety hazards based on vision-language multimodality was proposed. A dataset of image-text pairs related to construction safety hazards was constructed. A visual encoder was used to complete the visual encoding of safety hazard images, and a language model was employed to encode the question-answering texts about safety hazards. A multimodal feature fusion module was adopted to achieve effective interaction between image and text information. A specific input template for visual question answering adapted to the scenario of construction safety hazards was constructed. The model was fine-tuned based on matrix low-rank decomposition, and multi-round prompts were used to guide the model in generating accurate answers. The results show that compared with existing contrastive models, the intelligent question-answering model for construction safety hazards performs better in automatic evaluation metrics, Generative Pre-trained Transformer(GPT)-4 evaluation, and expert evaluation, with significantly improved fluency and semantic relevance of the generated texts. Ablation experiments further verify the effectiveness of each sub-module, confirming that the synergistic effect of matrix low-rank decomposition fine-tuning and multi-round reasoning is the key for the model to achieve optimal performance, and that reasonably setting the rank parameter of the low-rank matrix can effectively avoid the overfitting problem.

vision-language  /  multimodality  /  construction safety  /  safety hazard  /  intelligent question answering model  /  matrix low-rank decomposition
王喆副教授, 黄海辰, 李瑞钦, 魏永长副教授. 基于视觉语言多模态的建筑施工安全智能问答模型. 中国安全科学学报, 2025 , 35 (10) : 106 -114 . DOI: 10.16265/j.cnki.issn1003-3033.2025.10.1435
Zhe WANG, Haichen HUANG, Ruiqin LI, Yongchang WEI. Intelligent question answering model for construction safety hazards based on vision-language multimodality[J]. China Safety Science Journal, 2025 , 35 (10) : 106 -114 . DOI: 10.16265/j.cnki.issn1003-3033.2025.10.1435
  • 教育部人文社会科学研究青年基金资助(21YJA630094; 20YJC630154)
  • 中央高校基本科研业务费专项资金项目(104972024DZB0003)
参考文献 引证文献
排序方式:
2025年第35卷第10期
PDF下载
61
14
引用本文
BibTeX
文章信息
doi: 10.16265/j.cnki.issn1003-3033.2025.10.1435
  • 接收时间:2025-06-10
  • 首发时间:2026-07-09
  • 出版时间:2025-10-28
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2025-06-10
  • 修回日期:2025-08-13
基金
教育部人文社会科学研究青年基金资助(21YJA630094; 20YJC630154)
中央高校基本科研业务费专项资金项目(104972024DZB0003)
作者信息
    1武汉理工大学 安全科学与应急管理学院,湖北 武汉 430070
    2武汉理工大学 中国应急管理研究中心,湖北 武汉 430070
    3中南财经政法大学 工商管理学院,湖北 武汉 430073
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/10.16265/j.cnki.issn1003-3033.2025.10.1435
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏