Article(id=1329455998747652488, tenantId=1146029695717560320, journalId=1324759914146529478, issueId=1329455965163860100, articleNumber=null, orderNo=null, doi=10.7544/issn1000-1239.202220294, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1649692800000, receivedDateStr=2022-04-12, revisedDate=1686067200000, revisedDateStr=2023-06-07, acceptedDate=null, acceptedDateStr=null, onlineDate=1794896610199, onlineDateStr=2026-11-17, pubDate=1709308800000, pubDateStr=2024-03-02, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1794896610199, onlineIssueDateStr=2026-11-17, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1794896610199, creator=13701087609, updateTime=1794896610199, updator=13701087609, issue=Issue{id=1329455965163860100, tenantId=1146029695717560320, journalId=1324759914146529478, year='2024', volume='61', issue='3', pageStart='539', pageEnd='807', issueExtLink='null', onlineDate='null', pubDate='1709308800000', pubDateStr='2024-03-02', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1794896602192, creator='13701087609', updateTime=1794896602192, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext=null, issueFiles=null, downloadFileDto=null}, startPage=639, endPage=673, ext={EN=ArticleExt(id=1329456000542814601, articleId=1329455998747652488, tenantId=1146029695717560320, journalId=1324759914146529478, language=EN, title=Research Progress of Video Question Answering Technologies, columnId=1325489891789910943, journalTitle=Journal of Computer Research and Development, columnName=Artificial Intelligence, runingTitle=null, highlight=null, articleAbstract=
VideoQA (video question answering), which automatically answers natural language question according to the content of videos, is a relatively new research direction in the field of visual language and has attracted extensive attention in recent years. The solution of videoQA task is of great significance for human-computer interaction, intelligent education, intelligent transportation, scenario analysis, video retrieval, and other fields. VideoQA is a challenging task because it requires a model to understand semantic information of the video and the question to generate the answer. In this work, we analyze the difference between VideoQA and ImageQA (image question answering), and summarize four challenges faced by VideoQA relative to ImageQA. Then, the existing VideoQA models are carefully classified according to the research method around these challenges. Following the classifications, we introduce the generation background and focus on the implementation of models and the relationship between different models. After that, the benchmark datasets commonly used in VideoQA are summarized, the performances of current mainstream algorithms on some datasets are introduced in detail, and the comparison, analysis and summary are carried out. Finally, the future challenges and research trends in this field are discussed, which will provide some ideas for further research in the future.
, authors=Cuizhu Bao
1, 3, Kai Ding
2, Jianfeng Dong
1, 3, Xun Yang
4, Mande Xie
2, *, Xun Wang
1, 3, authorsList=Cuizhu Bao, Kai Ding, Jianfeng Dong, Xun Yang, Mande Xie, Xun Wang, authorCompany=null, correspAuthors=Mande Xie, authorNote=
born in 1995. PhD, lecturer. Member of CCF. Her main research interests include computer vision, intelligent traffic control, and smart city
born in 1995. Master candidate. Student member of CCF. His main research interests include computer vision, and visual question answering, and video question answering
born in 1991. PhD, professor. Member of CCF. His main research interests include multimedia understanding, computer vision, machine learning, and artificial intelligence
born in 1989. PhD, professor. Member of CCF. His main research interests include cross-media analysis and reasoning, structured understanding of multimedia content, and visual media correlation modeling
born in 1977. PhD, professor. Member of CCF. His main research interests include wireless sensor networks, cloud computing, network security, and swarm intelligence perception
born in 1967. PhD, professor. Distinguished member of CCF. His main research interests include visual media big data technology, mobile graphics computing, computer vision, and intelligent information processing and visual analysis
, correspAuthorsNote=null, copyrightStatement=Copyright © 2024 Journal of Computer Research and Development. All rights reserved., copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1329456006263845306, articleId=1329455998747652488, tenantId=1146029695717560320, journalId=1324759914146529478, language=CN, title=视频问答技术研究进展, columnId=1325489892104483745, journalTitle=计算机研究与发展, columnName=人工智能, runingTitle=null, highlight=null, articleAbstract=
视频问答 ( video question answering,VideoQA ) 根据视频内容自动回答自然语言问题,是视觉语言领域较为新兴的一个研究方向, 近年来引起了广泛关注. VideoQA问题的解决对于人机交互、智慧教育、智能交通、场景分析以及视频检索等各个领域都有着重大意义. VideoQA是一项具有挑战性的任务,因为它需要模型同时理解视频与文本内容来生成问题的答案. 首先,分析了VideoQA与图像问答 ( image question answering,ImageQA )的区别,总结了当下VideoQA相对于ImageQA所面临的4个挑战;然后,围绕着这些挑战对目前现有VideoQA模型进行了细致的分类,并重点介绍了模型的实现及不同模型之间的关联;接着详细介绍了在VideoQA中常用的基准数据集及目前主流算法在部分数据集上的性能,并进行了对比与分析;最后,讨论了该领域未来面临的挑战和研究趋势,为未来进一步研究提供一些思路.
, authors=包翠竹
1, 3, 丁凯
2, 董建峰
1, 3, 杨勋
4, 谢满德
2, *, 王勋
1, 3, authorsList=包翠竹, 丁凯, 董建峰, 杨勋, 谢满德, 王勋, authorCompany=null, correspAuthors=谢满德, authorNote=
 |
1990年生. 博士,讲师.CCF会员. 主要研究方向为计算机视觉、智能交通控制、智慧城市 |
 |
1995年生. 硕士研究生.CCF学生会员. 主要研究方向为计算机视觉、视觉问答、视频问答 |
 |
1991年生.博士,教授.CCF会员. 主要研究方向为多媒体理解、计算机视觉、机器学习、人工智能 |
 |
1989年生.博士,教授.CCF会员. 主要研究方向为跨媒体分析与推理、多媒体内容结构化理解、视觉媒体相关性关联建模 |
 |
1977年生.博士. 教授. CCF会员.主要研究方向为无线传感器网络、云计算、网络安全、群智感知 |
 |
1967年生.博士, 教授.CCF杰出会员. 主要研究方向为可视媒体大数据技术、移动图形计算、计算机视觉、智能信息处理与可视分析 |
, correspAuthorsNote=
, copyrightStatement=版权所有 © 2024 计算机研究与发展编辑部, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=GiDZ646dgNn0cmErLutrnA==, magXml=VJfarvny1vTyJaSMHfl/bg==, pdfUrl=null, pdf=n0rxavwL0w6NHgKmwqsVng==, pdfFileSize=7722853, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=CQGQsTiVcaSE+pI6znvTxg==, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=pcZbE782BmD9Pejm6ngk9g==, mapNumber=null, fund=null)}, authors=[Author(id=1329456006930739656, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=baocuizhu@ zjgsu.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329456007064957387, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456006930739656, language=EN, stringName=Cuizhu Bao, firstName=Cuizhu, middleName=null, lastName=Bao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, 3, address=
1School of Computer Science and Technology, Zhejiang Gongshang University, Hangzhou 310018
3Zhejiang E-Commerce Key Lab(Zhejiang Gongshang University), Hangzhou 310018, bio={"content":"
born in 1995. PhD, lecturer. Member of CCF. Her main research interests include computer vision, intelligent traffic control, and smart city
"}, bioImg=null, bioContent=
born in 1995. PhD, lecturer. Member of CCF. Her main research interests include computer vision, intelligent traffic control, and smart city
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329456007165620684, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456006930739656, language=CN, stringName=包翠竹, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, 3, address=
1浙江工商大学计算机科学与技术学院 杭州 310018
3浙江省电子商务与物流信息技术研究重点实验室(浙江工商大学) 杭州 310018, bio={"img":"1i7C/b9tgiW/E5zUFjw2Sg==","content":"
1990年生. 博士,讲师.CCF会员. 主要研究方向为计算机视觉、智能交通控制、智慧城市
"}, bioImg=1i7C/b9tgiW/E5zUFjw2Sg==, bioContent=
1990年生. 博士,讲师.CCF会员. 主要研究方向为计算机视觉、智能交通控制、智慧城市
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329456006553252283, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=1, ext=[AuthorCompanyExt(id=1329456006561640892, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006553252283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1School of Computer Science and Technology, Zhejiang Gongshang University, Hangzhou 310018), AuthorCompanyExt(id=1329456006570029501, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006553252283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1浙江工商大学计算机科学与技术学院 杭州 310018)]), AuthorCompany(id=1329456006762967489, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=3, ext=[AuthorCompanyExt(id=1329456006771356098, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006762967489, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
3Zhejiang E-Commerce Key Lab(Zhejiang Gongshang University), Hangzhou 310018), AuthorCompanyExt(id=1329456006779744707, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006762967489, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
3浙江省电子商务与物流信息技术研究重点实验室(浙江工商大学) 杭州 310018)])]), Author(id=1329456007245312462, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329456007329198544, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456007245312462, language=EN, stringName=Kai Ding, firstName=Kai, middleName=null, lastName=Ding, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
2, address=
2School of Information & Electronic Engineering, Zhejiang Gongshang University, Hangzhou 310018, bio={"content":"
born in 1995. Master candidate. Student member of CCF. His main research interests include computer vision, and visual question answering, and video question answering
"}, bioImg=null, bioContent=
born in 1995. Master candidate. Student member of CCF. His main research interests include computer vision, and visual question answering, and video question answering
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329456007408890321, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456007245312462, language=CN, stringName=丁凯, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
2, address=
2浙江工商大学信息与电子工程学院 杭州 310018, bio={"img":"kdBo7V84l6vE+SbtYRxGKA==","content":"
1995年生. 硕士研究生.CCF学生会员. 主要研究方向为计算机视觉、视觉问答、视频问答
"}, bioImg=kdBo7V84l6vE+SbtYRxGKA==, bioContent=
1995年生. 硕士研究生.CCF学生会员. 主要研究方向为计算机视觉、视觉问答、视频问答
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329456006670692798, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=2, ext=[AuthorCompanyExt(id=1329456006683275711, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006670692798, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2School of Information & Electronic Engineering, Zhejiang Gongshang University, Hangzhou 310018), AuthorCompanyExt(id=1329456006691664320, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006670692798, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2浙江工商大学信息与电子工程学院 杭州 310018)])]), Author(id=1329456007484387795, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329456007614411222, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456007484387795, language=EN, stringName=Jianfeng Dong, firstName=Jianfeng, middleName=null, lastName=Dong, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, 3, address=
1School of Computer Science and Technology, Zhejiang Gongshang University, Hangzhou 310018
3Zhejiang E-Commerce Key Lab(Zhejiang Gongshang University), Hangzhou 310018, bio={"content":"
born in 1991. PhD, professor. Member of CCF. His main research interests include multimedia understanding, computer vision, machine learning, and artificial intelligence
"}, bioImg=null, bioContent=
born in 1991. PhD, professor. Member of CCF. His main research interests include multimedia understanding, computer vision, machine learning, and artificial intelligence
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329456007685714391, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456007484387795, language=CN, stringName=董建峰, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, 3, address=
1浙江工商大学计算机科学与技术学院 杭州 310018
3浙江省电子商务与物流信息技术研究重点实验室(浙江工商大学) 杭州 310018, bio={"img":"QUr/2d7oDAoIvoipfvya6Q==","content":"
1991年生.博士,教授.CCF会员. 主要研究方向为多媒体理解、计算机视觉、机器学习、人工智能
"}, bioImg=QUr/2d7oDAoIvoipfvya6Q==, bioContent=
1991年生.博士,教授.CCF会员. 主要研究方向为多媒体理解、计算机视觉、机器学习、人工智能
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329456006553252283, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=1, ext=[AuthorCompanyExt(id=1329456006561640892, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006553252283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1School of Computer Science and Technology, Zhejiang Gongshang University, Hangzhou 310018), AuthorCompanyExt(id=1329456006570029501, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006553252283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1浙江工商大学计算机科学与技术学院 杭州 310018)]), AuthorCompany(id=1329456006762967489, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=3, ext=[AuthorCompanyExt(id=1329456006771356098, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006762967489, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
3Zhejiang E-Commerce Key Lab(Zhejiang Gongshang University), Hangzhou 310018), AuthorCompanyExt(id=1329456006779744707, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006762967489, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
3浙江省电子商务与物流信息技术研究重点实验室(浙江工商大学) 杭州 310018)])]), Author(id=1329456009304715737, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329456009405379035, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456009304715737, language=EN, stringName=Xun Yang, firstName=Xun, middleName=null, lastName=Yang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
4, address=
4School of Information Science and Technology, University of Science and Technology of China, Hefei 230026, bio={"content":"
born in 1989. PhD, professor. Member of CCF. His main research interests include cross-media analysis and reasoning, structured understanding of multimedia content, and visual media correlation modeling
"}, bioImg=null, bioContent=
born in 1989. PhD, professor. Member of CCF. His main research interests include cross-media analysis and reasoning, structured understanding of multimedia content, and visual media correlation modeling
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329456009497653724, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456009304715737, language=CN, stringName=杨勋, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
4, address=
4中国科学技术大学信息科学技术学院 合肥 230026, bio={"img":"btbyI3+FEIUl9hSCOuWgIA==","content":"
1989年生.博士,教授.CCF会员. 主要研究方向为跨媒体分析与推理、多媒体内容结构化理解、视觉媒体相关性关联建模
"}, bioImg=btbyI3+FEIUl9hSCOuWgIA==, bioContent=
1989年生.博士,教授.CCF会员. 主要研究方向为跨媒体分析与推理、多媒体内容结构化理解、视觉媒体相关性关联建模
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329456006834270660, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=4, ext=[AuthorCompanyExt(id=1329456006842659269, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006834270660, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
4School of Information Science and Technology, University of Science and Technology of China, Hefei 230026), AuthorCompanyExt(id=1329456006851047878, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006834270660, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
4中国科学技术大学信息科学技术学院 合肥 230026)])]), Author(id=1329456009577345502, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=xiemd@zjgsu.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1329456009682203104, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456009577345502, language=EN, stringName=Mande Xie, firstName=Mande, middleName=null, lastName=Xie, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
2, *, address=
2School of Information & Electronic Engineering, Zhejiang Gongshang University, Hangzhou 310018, bio={"content":"
born in 1977. PhD, professor. Member of CCF. His main research interests include wireless sensor networks, cloud computing, network security, and swarm intelligence perception
"}, bioImg=null, bioContent=
born in 1977. PhD, professor. Member of CCF. His main research interests include wireless sensor networks, cloud computing, network security, and swarm intelligence perception
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329456009749311969, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456009577345502, language=CN, stringName=谢满德, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
2, *, address=
2浙江工商大学信息与电子工程学院 杭州 310018, bio={"img":"CjWvrrsag4NSdXXIXx67TA==","content":"
1977年生.博士. 教授. CCF会员.主要研究方向为无线传感器网络、云计算、网络安全、群智感知
"}, bioImg=CjWvrrsag4NSdXXIXx67TA==, bioContent=
1977年生.博士. 教授. CCF会员.主要研究方向为无线传感器网络、云计算、网络安全、群智感知
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329456006670692798, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=2, ext=[AuthorCompanyExt(id=1329456006683275711, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006670692798, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2School of Information & Electronic Engineering, Zhejiang Gongshang University, Hangzhou 310018), AuthorCompanyExt(id=1329456006691664320, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006670692798, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2浙江工商大学信息与电子工程学院 杭州 310018)])]), Author(id=1329456009812226531, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1329456009887724006, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456009812226531, language=EN, stringName=Xun Wang, firstName=Xun, middleName=null, lastName=Wang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, 3, address=
1School of Computer Science and Technology, Zhejiang Gongshang University, Hangzhou 310018
3Zhejiang E-Commerce Key Lab(Zhejiang Gongshang University), Hangzhou 310018, bio={"content":"
born in 1967. PhD, professor. Distinguished member of CCF. His main research interests include visual media big data technology, mobile graphics computing, computer vision, and intelligent information processing and visual analysis
"}, bioImg=null, bioContent=
born in 1967. PhD, professor. Distinguished member of CCF. His main research interests include visual media big data technology, mobile graphics computing, computer vision, and intelligent information processing and visual analysis
, aboutCorrespAuthor=null), CN=AuthorExt(id=1329456009959027175, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, authorId=1329456009812226531, language=CN, stringName=王勋, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=
1, 3, address=
1浙江工商大学计算机科学与技术学院 杭州 310018
3浙江省电子商务与物流信息技术研究重点实验室(浙江工商大学) 杭州 310018, bio={"img":"QGBf9+k/A0FANb+quyWqIQ==","content":"
1967年生.博士, 教授.CCF杰出会员. 主要研究方向为可视媒体大数据技术、移动图形计算、计算机视觉、智能信息处理与可视分析
"}, bioImg=QGBf9+k/A0FANb+quyWqIQ==, bioContent=
1967年生.博士, 教授.CCF杰出会员. 主要研究方向为可视媒体大数据技术、移动图形计算、计算机视觉、智能信息处理与可视分析
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1329456006553252283, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=1, ext=[AuthorCompanyExt(id=1329456006561640892, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006553252283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1School of Computer Science and Technology, Zhejiang Gongshang University, Hangzhou 310018), AuthorCompanyExt(id=1329456006570029501, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006553252283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1浙江工商大学计算机科学与技术学院 杭州 310018)]), AuthorCompany(id=1329456006762967489, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=3, ext=[AuthorCompanyExt(id=1329456006771356098, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006762967489, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
3Zhejiang E-Commerce Key Lab(Zhejiang Gongshang University), Hangzhou 310018), AuthorCompanyExt(id=1329456006779744707, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006762967489, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
3浙江省电子商务与物流信息技术研究重点实验室(浙江工商大学) 杭州 310018)])])], keywords=[Keyword(id=1329456010068079080, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, orderNo=1, keyword=video question answering), Keyword(id=1329456010135187945, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, orderNo=2, keyword=attention), Keyword(id=1329456010198102506, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, orderNo=3, keyword=memory network), Keyword(id=1329456010265211371, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, orderNo=4, keyword=recurrent neural network), Keyword(id=1329456010332320236, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, orderNo=5, keyword=graph network model), Keyword(id=1329456010386846189, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, orderNo=6, keyword=pre-training model), Keyword(id=1329456010449760750, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, orderNo=1, keyword=视频问答), Keyword(id=1329456010512675311, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, orderNo=2, keyword=注意力), Keyword(id=1329456010571395568, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, orderNo=3, keyword=记忆网络), Keyword(id=1329456010646893041, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, orderNo=4, keyword=循环神经网络), Keyword(id=1329456010714001906, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, orderNo=5, keyword=图网络模型), Keyword(id=1329456010797887987, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, orderNo=6, keyword=预训练模型)], refs=[Reference(id=1329456015973659170, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=1, rfOrder=0, authorNames=null, journalName=null, refType=null, unstructuredReference=俞俊,汪亮,余宙. 视觉问答技术研究[J]. 计算机研究与发展,2018,55(9):1946−1958, articleTitle=null, refAbstract=null), Reference(id=1329456016040768035, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=1, rfOrder=1, authorNames=null, journalName=null, refType=null, unstructuredReference=Yu Jun, Wang Liang, Yu Zhou. Research on visual question answering technology[J]. Journal of Computer Research and Development, 2018, 55(9): 1946−1958 (in Chinese), articleTitle=null, refAbstract=null), Reference(id=1329456016112071204, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=2, rfOrder=2, authorNames=null, journalName=null, refType=null, unstructuredReference=Antol S, Agrawal A, Lu Jiasen, et al. VQA: Visual question answering[C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2015: 2425−2433, articleTitle=null, refAbstract=null), Reference(id=1329456016170791461, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=3, rfOrder=3, authorNames=null, journalName=null, refType=null, unstructuredReference=Yang Zichao, He Xiaodong, Gao Jianfeng, et al. Stacked attention networks for image question answering[C]//Proc of the 29th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2016: 21−29, articleTitle=null, refAbstract=null), Reference(id=1329456016246288934, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=4, rfOrder=4, authorNames=null, journalName=null, refType=null, unstructuredReference=Qiao Tingting, Dong Jianfeng, Xu Duanqing. Exploring human-like attention supervision in visual question answering[C]//Proc of the 32nd AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2018: 7300−7307, articleTitle=null, refAbstract=null), Reference(id=1329456016309203495, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=5, rfOrder=5, authorNames=null, journalName=null, refType=null, unstructuredReference=Yu Zhou, Yu Jun, Cui Yuhao, et al. Deep modular co-attention networks for visual question answering[C]//Proc of the 32nd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2019: 6281−6290, articleTitle=null, refAbstract=null), Reference(id=1329456016367923752, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=6, rfOrder=6, authorNames=null, journalName=null, refType=null, unstructuredReference=Luo Haozheng, Qin Ruiyang. Open-ended multi-modal relational reason for video question answering[J]. arXiv preprint, arXiv: 2012. 00822, 2020, articleTitle=null, refAbstract=null), Reference(id=1329456016435032617, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=7, rfOrder=7, authorNames=null, journalName=null, refType=null, unstructuredReference=包希港,周春来,肖克晶,等. 视觉问答研究综述[J]. 软件学报,2021,32(8):2522−2544, articleTitle=null, refAbstract=null), Reference(id=1329456016497947178, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=7, rfOrder=8, authorNames=null, journalName=null, refType=null, unstructuredReference=Bao Xigang, Zhou Chunlai, Xiao Kejing, et al. Review of visual question answering research[J]. Journal of Software, 2021, 32(8): 2522−2544 (in Chinese), articleTitle=null, refAbstract=null), Reference(id=1329456016560861739, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=8, rfOrder=9, authorNames=null, journalName=null, refType=null, unstructuredReference=Patel D, Parikh R, Shastri Y. Recent advances in video question answering: A review of datasets and methods [C]//Proc of the Int Conf on Pattern Recognition. Berlin: Springer, 2021: 339−356, articleTitle=null, refAbstract=null), Reference(id=1329456016619581996, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=9, rfOrder=10, authorNames=null, journalName=null, refType=null, unstructuredReference=Khurana K, Deshpande U. Video question-answering techniques, benchmark datasets and evaluation metrics leveraging video captioning: A comprehensive survey [J]. IEEE Access, 2021, 9: 43799−43823, articleTitle=null, refAbstract=null), Reference(id=1329456018234389038, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=10, rfOrder=11, authorNames=null, journalName=null, refType=null, unstructuredReference=Sun Guanglu, Liang Lili, Li Tianlin, et al. Video question answering: A survey of models and datasets[J]. Mobile Networks and Applications, 2021, 26(5): 1904−1937, articleTitle=null, refAbstract=null), Reference(id=1329456018314080815, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=11, rfOrder=12, authorNames=null, journalName=null, refType=null, unstructuredReference=Mnih V, Heess N, Graves A. Recurrent models of visual attention [C]// Proc of the 27th Int Conf on Neural Information Processing Systems. Cambridge, MA: MIT, 2014: 2204−2212, articleTitle=null, refAbstract=null), Reference(id=1329456018393772592, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=12, rfOrder=13, authorNames=null, journalName=null, refType=null, unstructuredReference=Weston J, Chopra S, Bordes A. Memory networks[J]. arXiv preprint, arXiv: 1410. 3916, 2014, articleTitle=null, refAbstract=null), Reference(id=1329456018477658673, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=13, rfOrder=14, authorNames=null, journalName=null, refType=null, unstructuredReference=Scarselli F, Gori M, Tsoi A C, et al. The graph neural network model[J]. IEEE Transactions on Neural Networks, 2008, 20(1): 61−80, articleTitle=null, refAbstract=null), Reference(id=1329456018553156146, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=14, rfOrder=15, authorNames=null, journalName=null, refType=null, unstructuredReference=Kipf T N, Welling M. Semi-supervised classification with graph convolutional networks[J]. arXiv preprint, arXiv: 1609. 02907, 2016, articleTitle=null, refAbstract=null), Reference(id=1329456018616070707, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=15, rfOrder=16, authorNames=null, journalName=null, refType=null, unstructuredReference=Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need [C]// Proc of the 30th Advances in Neural Information Processing Systems. Cambridge, MA: MIT, 2017: 5998−6008, articleTitle=null, refAbstract=null), Reference(id=1329456018678985268, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=16, rfOrder=17, authorNames=null, journalName=null, refType=null, unstructuredReference=Devlin J, Chang Mingwei, Lee K, et al. BERT: Pre-training of deep bidirectional transformers for language understanding [C]//Proc of the 17th Conf of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg, PA: ACL, 2019: 4171−4186, articleTitle=null, refAbstract=null), Reference(id=1329456018762871349, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=17, rfOrder=18, authorNames=null, journalName=null, refType=null, unstructuredReference=Ren Shaoqing, He Kaiming, Girshick R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 39(6): 1137−1149, articleTitle=null, refAbstract=null), Reference(id=1329456018825785910, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=18, rfOrder=19, authorNames=null, journalName=null, refType=null, unstructuredReference=Deng Jia, Dong Wei, Socher R, et al. ImageNet: A large-scale hierarchical image database [C]//Proc of the 22nd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2009: 248−255, articleTitle=null, refAbstract=null), Reference(id=1329456018897089079, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=19, rfOrder=20, authorNames=null, journalName=null, refType=null, unstructuredReference=Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition[J]. arXiv preprint, arXiv: 1409. 1556, 2014, articleTitle=null, refAbstract=null), Reference(id=1329456018968392248, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=20, rfOrder=21, authorNames=null, journalName=null, refType=null, unstructuredReference=Szegedy C, Liu Wei, Jia Yangqing, et al. Going deeper with convolutions [C]//Proc of the 28th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2015: 1−9, articleTitle=null, refAbstract=null), Reference(id=1329456019048084025, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=21, rfOrder=22, authorNames=null, journalName=null, refType=null, unstructuredReference=He Kaiming, Zhang Xiangyu, Ren Shaoqing, et al. Deep residual learning for image recognition [C]//Proc of the 29th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2016: 770−778, articleTitle=null, refAbstract=null), Reference(id=1329456019115192890, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=22, rfOrder=23, authorNames=null, journalName=null, refType=null, unstructuredReference=Tran D, Bourdev L, Fergus R, et al. Learning spatiotemporal features with 3D convolutional networks [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2015: 4489−4497, articleTitle=null, refAbstract=null), Reference(id=1329456019190690363, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=23, rfOrder=24, authorNames=null, journalName=null, refType=null, unstructuredReference=Carreira J, Zisserman A. Quo vadis, action recognition? A new model and the kinetics dataset [C]//Proc of the 30th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2017: 6299−6308, articleTitle=null, refAbstract=null), Reference(id=1329456019253604924, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=24, rfOrder=25, authorNames=null, journalName=null, refType=null, unstructuredReference=Xie Saining, Sun Chen, Huang Jonathan, et al. Rethinking spatiotemporal feature learning: Speed-accuracy trade-offs in video classification [C]//Proc of the 15th European Conf on Computer Vision. Berlin: Springer, 2018: 305−321, articleTitle=null, refAbstract=null), Reference(id=1329456019337491005, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=25, rfOrder=26, authorNames=null, journalName=null, refType=null, unstructuredReference=Hara K, Kataoka H, Satoh Y. Can spatiotemporal 3D CNNs retrace the history of 2D CNNs and ImageNet? [C]//Proc of the 31st IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2018: 6546−6555, articleTitle=null, refAbstract=null), Reference(id=1329456019404599870, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=26, rfOrder=27, authorNames=null, journalName=null, refType=null, unstructuredReference=Feichtenhofer C, Fan Haoqi, Malik J, et al. SlowFast networks for video recognition [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2019: 6202−6211, articleTitle=null, refAbstract=null), Reference(id=1329456019471708735, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=27, rfOrder=28, authorNames=null, journalName=null, refType=null, unstructuredReference=Le H, Chen N F, Hoi S C H. VGNMN: Video-grounded neural module network to video-grounded language tasks[J]. arXiv preprint, arXiv: 2104. 07921, 2021, articleTitle=null, refAbstract=null), Reference(id=1329456019534623296, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=28, rfOrder=29, authorNames=null, journalName=null, refType=null, unstructuredReference=Shah A, Lin T H, Wu Shijie. Triple attention network architecture for MovieQA[J]. arXiv preprint, arXiv: 2111. 09531, 2021, articleTitle=null, refAbstract=null), Reference(id=1329456019622703681, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=29, rfOrder=30, authorNames=null, journalName=null, refType=null, unstructuredReference=Aytar Y, Vondrick C, Torralba A. SoundNet: Learning sound representations from unlabeled video [C]//Proc of the 29th Advances in Neural Information Processing Systems. Cambridge, MA: MIT, 2016: 892−900, articleTitle=null, refAbstract=null), Reference(id=1329456019702395458, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=30, rfOrder=31, authorNames=null, journalName=null, refType=null, unstructuredReference=Kumar A, Khadkevich M, Fügen C. Knowledge transfer from weakly labeled audio using convolutional neural network for sound events and scenes [C]//Proc of the 44th IEEE Int Conf on Acoustics, Speech and Signal Processing. Piscataway, NJ: IEEE, 2018: 326−330, articleTitle=null, refAbstract=null), Reference(id=1329456019761115715, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=31, rfOrder=32, authorNames=null, journalName=null, refType=null, unstructuredReference=Kim K M, Heo M O, Choi S H, et al. Deepstory: Video story QA by deep embedded memory networks [C]//Proc of the 26th Int Joint Conf on Artificial Intelligence. San Francisco, CA: Morgan Kaufmann, 2017: 2016−2022, articleTitle=null, refAbstract=null), Reference(id=1329456019824030276, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=32, rfOrder=33, authorNames=null, journalName=null, refType=null, unstructuredReference=Na S, Lee S, Kim J, et al. A read-write memory network for movie story understanding [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2017: 677−685, articleTitle=null, refAbstract=null), Reference(id=1329456019878556229, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=33, rfOrder=34, authorNames=null, journalName=null, refType=null, unstructuredReference=Yang Tianhao, Zha Zhengjun, Xie Hongtao, et al. Question-aware tube-switch network for video question answering [C]//Proc of the 27th ACM Int Conf on Multimedia. New York: ACM, 2019: 1184−1192, articleTitle=null, refAbstract=null), Reference(id=1329456019949859398, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=34, rfOrder=35, authorNames=null, journalName=null, refType=null, unstructuredReference=Gao Jiyang, Ge Runzhou, Chen Kan, et al. Motion-appearance co-memory networks for video question answering [C]//Proc of the 31st IEEE CONF on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2018: 6576−6585, articleTitle=null, refAbstract=null), Reference(id=1329456020025356871, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=35, rfOrder=36, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Bo, Xu Youjiang, Han Yahong, et al. Movie question answering: Remembering the textual cues for layered visual contents [C]//Proc of the 32nd AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2018: 7380−7387, articleTitle=null, refAbstract=null), Reference(id=1329456020084077128, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=36, rfOrder=37, authorNames=null, journalName=null, refType=null, unstructuredReference=Castro S, Wang Ruoyao, Huang Pingxuan, et al. FIBER: Fill-in-the-blanks as a challenging video understanding evaluation framework [C]//Proc of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Stroudsburg, PA: ACL, 2022: 2925−2940, articleTitle=null, refAbstract=null), Reference(id=1329456020138603081, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=37, rfOrder=38, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhu Linchao, Yang Yi. Actbert: Learning global-local video-text representations [C]//Proc of the 33rd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2020: 8746−8755, articleTitle=null, refAbstract=null), Reference(id=1329456020201517642, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=38, rfOrder=39, authorNames=null, journalName=null, refType=null, unstructuredReference=Mikolov T, Chen Kai, Corrado G, et al. Efficient estimation of word representations in vector space[J]. arXiv preprint, arXiv: 1301. 3781, 2013, articleTitle=null, refAbstract=null), Reference(id=1329456020268626507, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=39, rfOrder=40, authorNames=null, journalName=null, refType=null, unstructuredReference=Pennington J, Socher R, Manning C D. GloVe: Global vectors for word representation [C]//Proc of the 2014 Conf on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2014: 1532−1543, articleTitle=null, refAbstract=null), Reference(id=1329456020339929676, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=40, rfOrder=41, authorNames=null, journalName=null, refType=null, unstructuredReference=Kiros R, Zhu Yukun, Salakhutdinov R R, et al. Skip-Thought vectors [C]//Proc of the 28th Advances in Neural Information Processing Systems. Cambridge, MA: MIT, 2015: 3294−3302, articleTitle=null, refAbstract=null), Reference(id=1329456020411232845, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=41, rfOrder=42, authorNames=null, journalName=null, refType=null, unstructuredReference=Hochreiter S, Schmidhuber J. Long short-term memory[J]. Neural Computation, 1997, 9(8): 1735−1780, articleTitle=null, refAbstract=null), Reference(id=1329456020482536014, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=42, rfOrder=43, authorNames=null, journalName=null, refType=null, unstructuredReference=Cho K, Van Merriënboer B, Gulcehre C, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation [C]//Proc of the 2014 Conf on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2014: 1724−1734, articleTitle=null, refAbstract=null), Reference(id=1329456020558033487, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=43, rfOrder=44, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhao Zhou, Lin Jinghao, Jiang Xinghua, et al. Video question answering via hierarchical dual-level attention network learning [C]//Proc of the 25th ACM Int Conf on Multimedia. New York: ACM, 2017: 1050−1058, articleTitle=null, refAbstract=null), Reference(id=1329456020625142352, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=44, rfOrder=45, authorNames=null, journalName=null, refType=null, unstructuredReference=Xue Hongyang, Chu Wenqing, Zhao Zhou, et al. A better way to attend: Attention with trees for video question answering[J]. IEEE Transactions on Image Processing, 2018, 27(11): 5563−5574, articleTitle=null, refAbstract=null), Reference(id=1329456020696445521, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=45, rfOrder=46, authorNames=null, journalName=null, refType=null, unstructuredReference=Jang Y, Song Y, Yu Y, et al. TGIF-QA: Toward spatio-temporal reasoning in visual question answering [C]//Proc of the 30th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2017: 2758−2766, articleTitle=null, refAbstract=null), Reference(id=1329456020771942995, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=46, rfOrder=47, authorNames=null, journalName=null, refType=null, unstructuredReference=Falcon A, Lanz O, Serra G. Data augmentation techniques for the video question answering task [C]//Proc of the 16th European Conf on Computer Vision. Berlin: Springer, 2020: 511−525, articleTitle=null, refAbstract=null), Reference(id=1329456020839051860, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=47, rfOrder=48, authorNames=null, journalName=null, refType=null, unstructuredReference=Mazaheri A, Zhang Dong, Shah M. Video fill in the blank using LR/RL LSTMs with spatial-temporal attentions [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2017: 1407−1416, articleTitle=null, refAbstract=null), Reference(id=1329456020914549333, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=48, rfOrder=49, authorNames=null, journalName=null, refType=null, unstructuredReference=Xu Dejing, Zhao Zhou, Xiao Jun, et al. Video question answering via gradually refined attention over appearance and motion [C]//Proc of the 25th ACM Int Conf on Multimedia. New York: ACM, 2017: 1645−1653, articleTitle=null, refAbstract=null), Reference(id=1329456020981658198, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=49, rfOrder=50, authorNames=null, journalName=null, refType=null, unstructuredReference=Chao Guanlin, Rastogi A, Yavuz S, et al. Learning question-guided video representation for multi-turn video question answering [C]//Proc of the 20th Annual SIGDIAL Meeting on Discourse and Dialogue. Stroudsburg, PA: ACL, 2019: 215−225, articleTitle=null, refAbstract=null), Reference(id=1329456021052961367, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=50, rfOrder=51, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhao Zhou, Zhang Zhu, Xiao Shuwen, et al. Open-ended long-form video question answering via adaptive hierarchical reinforced networks [C]//Proc of the 27th Int Joint Conf on Artificial Intelligence. San Francisco, CA: Morgan Kaufmann, 2018: 3683−3689, articleTitle=null, refAbstract=null), Reference(id=1329456022676157016, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=51, rfOrder=52, authorNames=null, journalName=null, refType=null, unstructuredReference=<mixed-citation>Kim J, Ma M, Kim K, et al. Gaining extra supervision via multi-task learning for multi-modal video question answering [C]//Proc of the 2019 Int Joint Conf on Neural Networks. Piscataway, NJ: IEEE, 2019: 1−8</mixed-citation>, articleTitle=null, refAbstract=null), Reference(id=1329456022751654489, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=51, rfOrder=53, authorNames=null, journalName=null, refType=null, unstructuredReference=Kim J,Ma M,Kim K,et al. Gaining extra supervision via multi-task learning for multi-modal video question answering [C]//Proc of the 2019 Int Joint Conf on Neural Networks. Piscataway,NJ:IEEE,2019:1−8, articleTitle=null, refAbstract=null), Reference(id=1329456022822957658, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=52, rfOrder=54, authorNames=null, journalName=null, refType=null, unstructuredReference=Lei Jie, Yu Licheng, Berg T L, et al. TVQA+: Spatio-temporal grounding for video question answering [C]//Proc of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA: ACL, 2020: 8211−8225, articleTitle=null, refAbstract=null), Reference(id=1329456022885872219, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=53, rfOrder=55, authorNames=null, journalName=null, refType=null, unstructuredReference=Gao Difei, Wang Ruiping, Bai Ziyi, et al. Env-QA: A video question answering benchmark for comprehensive understanding of dynamic environments [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2021: 1675−1685, articleTitle=null, refAbstract=null), Reference(id=1329456022961369692, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=54, rfOrder=56, authorNames=null, journalName=null, refType=null, unstructuredReference=Yu Y, Kim J, Kim G. A joint sequence fusion model for video question answering and retrieval [C]//Proc of the 15th European Conf on Computer Vision. Berlin: Springer, 2018: 471−487, articleTitle=null, refAbstract=null), Reference(id=1329456023028478557, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=55, rfOrder=57, authorNames=null, journalName=null, refType=null, unstructuredReference=Ye Yunan, Zhao Zhou, Li Yimeng, et al. Video question answering via attribute-augmented attention network learning [C]//Proc of the 40th Annual Int ACM SIGIR Conf on Research and Development in Information Retrieval. New York: ACM, 2017: 829−832, articleTitle=null, refAbstract=null), Reference(id=1329456023099781726, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=56, rfOrder=58, authorNames=null, journalName=null, refType=null, unstructuredReference=Chowdhury M I H, Nguyen K, Sridharan S, et al. Hierarchical relational attention for video question answering [C]//Proc of the 25th IEEE Int Conf on Image Processing. Piscataway, NJ: IEEE, 2018: 599−603, articleTitle=null, refAbstract=null), Reference(id=1329456023162696287, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=57, rfOrder=59, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhao Zhou, Jiang Xinghua, Cai Deng, et al. Multi-turn video question answering via multi-stream hierarchical attention context network [C]//Proc of the 27th Int Joint Conf on Artificial Intelligence. San Francisco, CA: Morgan Kaufmann, 2018: 3690−3696, articleTitle=null, refAbstract=null), Reference(id=1329456023233999456, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=58, rfOrder=60, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhao Zhou, Yang Qifan, Cai Deng, et al. Video question answering via hierarchical spatio-temporal attention networks [C]//Proc of the 26th Int Joint Conf on Artificial Intelligence. San Francisco, CA: Morgan Kaufmann, 2017: 3518−3524, articleTitle=null, refAbstract=null), Reference(id=1329456023309496929, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=59, rfOrder=61, authorNames=null, journalName=null, refType=null, unstructuredReference=Song Xiaomeng, Shi Yucheng, Chen Xin, et al. Explore multi-step reasoning in video question answering [C]//Proc of the 26th ACM Int Conf on Multimedia. New York: ACM, 2018: 239−247, articleTitle=null, refAbstract=null), Reference(id=1329456023372411490, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=60, rfOrder=62, authorNames=null, journalName=null, refType=null, unstructuredReference=Jiang Jianwen, Chen Ziqiang, Lin Haojie, et al. Divide and conquer: Question-guided spatio-temporal contextual attention for video question answering [C]//Proc of the 34th AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2020: 11101−11108, articleTitle=null, refAbstract=null), Reference(id=1329456023435326051, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=61, rfOrder=63, authorNames=null, journalName=null, refType=null, unstructuredReference=Liang Junwei, Jiang Lu, Cao Liangliang, et al. Focal visual-text attention for visual question answering [C]//Proc of the 31st IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2018: 6135−6143, articleTitle=null, refAbstract=null), Reference(id=1329456023498240612, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=62, rfOrder=64, authorNames=null, journalName=null, refType=null, unstructuredReference=Yu Zhou, Yu Jun, Fan Jianping, et al. Multi-modal factorized bilinear pooling with co-attention learning for visual question answering [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2017: 1821−1830, articleTitle=null, refAbstract=null), Reference(id=1329456023577932389, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=63, rfOrder=65, authorNames=null, journalName=null, refType=null, unstructuredReference=Xue Hongyang, Zhao Zhou, Cai Deng. Unifying the video and question attentions for open-ended video question answering[J]. IEEE Transactions on Image Processing, 2017, 26(12): 5656−5666, articleTitle=null, refAbstract=null), Reference(id=1329456023661818470, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=64, rfOrder=66, authorNames=null, journalName=null, refType=null, unstructuredReference=Chu Wenqing, Xue Hongyang, Zhao Zhou, et al. The forgettable-watcher model for video question answering[J]. Neurocomputing, 2018, 314: 386−393, articleTitle=null, refAbstract=null), Reference(id=1329456023733121639, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=65, rfOrder=67, authorNames=null, journalName=null, refType=null, unstructuredReference=Gao Lianli, Zeng Pengpeng, Song Jingkuan, et al. Structured two-stream attention network for video question answering [C]//Proc of the 33rd AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2019: 6391−6398, articleTitle=null, refAbstract=null), Reference(id=1329456023796036200, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=66, rfOrder=68, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Xiangpeng, Gao Lianli, Wang Xuanhan, et al. Learnable aggregating net with diversity learning for video question answering [C]//Proc of the 27th ACM Int Conf on Multimedia. New York: ACM, 2019: 1166−1174, articleTitle=null, refAbstract=null), Reference(id=1329456023871533673, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=67, rfOrder=69, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Xiangpeng, Song Jingkuan, Gao Lianli, et al. Beyond RNNs: Positional self-attention with co-attention for video question answering [C]//Proc of the 33rd AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2019: 8658−8665, articleTitle=null, refAbstract=null), Reference(id=1329456023930253930, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=68, rfOrder=70, authorNames=null, journalName=null, refType=null, unstructuredReference=Kim K M, Choi S H, Kim J H, et al. Multimodal dual attention memory for video story question answering [C]//Proc of the 15th European Conf on Computer Vision. Berlin: Springer, 2018: 673−688, articleTitle=null, refAbstract=null), Reference(id=1329456023993168491, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=69, rfOrder=71, authorNames=null, journalName=null, refType=null, unstructuredReference=Lei Jie, Yu Licheng, Bansal M, et al. TVQA: Localized, compositional video question answering [C]//Proc of the 2018 Conf on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2018: 1369−1379, articleTitle=null, refAbstract=null), Reference(id=1329456024060277356, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=70, rfOrder=72, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Fangtao, Bai Ting, Cao Chenyu, et al. Relation-aware hierarchical attention framework for video question answering[C]//Proc of the 2021 Int Conf on Multimedia Retrieval. New York: ACM, 2021: 164−172, articleTitle=null, refAbstract=null), Reference(id=1329456024123191917, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=71, rfOrder=73, authorNames=null, journalName=null, refType=null, unstructuredReference=Kim J, Ma M, Pham T, et al. Modality shifting attention network for multi-modal video question answering [C]//Proc of the 33rd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2020: 10106−10115, articleTitle=null, refAbstract=null), Reference(id=1329456024202883694, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=72, rfOrder=74, authorNames=null, journalName=null, refType=null, unstructuredReference=Jin Weike, Zhao Zhou, Gu Mao, et al. Multi-interaction network with object relation for video question answering [C]//Proc of the 27th ACM Int Conf on Multimedia. New York: ACM, 2019: 1193−1201, articleTitle=null, refAbstract=null), Reference(id=1329456024265798255, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=73, rfOrder=75, authorNames=null, journalName=null, refType=null, unstructuredReference=Kim H, Tang Zineng, Bansal M. Dense-caption matching and frame-selection gating for temporal localization in VideoQA [C]//Proc of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA: ACL, 2020: 4812−4822, articleTitle=null, refAbstract=null), Reference(id=1329456024328712816, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=74, rfOrder=76, authorNames=null, journalName=null, refType=null, unstructuredReference=Chadha A, Arora G, Kaloty N. iPerceive: Applying common-sense reasoning to multi-modal dense video captioning and video question answering [C]//Proc of the 2021 IEEE Winter Conf on Applications of Computer Vision. Piscataway, NJ: IEEE, 2021: 1−13, articleTitle=null, refAbstract=null), Reference(id=1329456024395821681, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=75, rfOrder=77, authorNames=null, journalName=null, refType=null, unstructuredReference=Seo M, Kembhavi A, Farhadi A, et al. Bidirectional attention flow for machine comprehension [C/OL]//Proc of the Int Conf on Learning Representations. 2017 [2022-01-10].https://openreview.net/forum? id=HJ0UKP9ge, articleTitle=null, refAbstract=null), Reference(id=1329456024462930546, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=76, rfOrder=78, authorNames=null, journalName=null, refType=null, unstructuredReference=Yu A W, Dohan D, Luong M T, et al. Qanet: Combining local convolution with global self-attention for reading comprehension [C/OL]//Proc of the Int Conf on Learning Representations. 2018 [2022-01-10].https://openreview.net/forum?id=B14TlG-RW, articleTitle=null, refAbstract=null), Reference(id=1329456024521650803, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=77, rfOrder=79, authorNames=null, journalName=null, refType=null, unstructuredReference=Veličković P, Cucurull G, Casanova A, et al. Graph attention networks [C/OL]//Proc of the Int Conf on Learning Representations. 2018 [2022-01-12].https://openreview.net/forum?id=rJXMpikCZ, articleTitle=null, refAbstract=null), Reference(id=1329456024597148276, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=78, rfOrder=80, authorNames=null, journalName=null, refType=null, unstructuredReference=Sukhbaatar S, Weston J, Fergus R. End-to-end memory networks [C]//Proc of the 28th Advances in Neural Information Processing Systems. Cambridge, MA: MIT, 2015: 2440−2448, articleTitle=null, refAbstract=null), Reference(id=1329456024668451445, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=79, rfOrder=81, authorNames=null, journalName=null, refType=null, unstructuredReference=Zeng K H, Chen T H, Chuang C Y, et al. Leveraging video descriptions to learn video question answering [C]//Proc of the 31st AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2017: 4334−4340, articleTitle=null, refAbstract=null), Reference(id=1329456024764920438, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=80, rfOrder=82, authorNames=null, journalName=null, refType=null, unstructuredReference=Tapaswi M, Zhu Yukun, Stiefelhagen R, et al. MovieQA: Understanding stories in movies through question-answering [C]//Proc of the 29th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2016: 4631−4640, articleTitle=null, refAbstract=null), Reference(id=1329456024840417911, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=81, rfOrder=83, authorNames=null, journalName=null, refType=null, unstructuredReference=Cai Jiayin, Yuan Chun, Shi Cheng, et al. Feature augmented memory with global attention network for VideoQA [C]//Proc of the 30th Int Joint Conf on Artificial Intelligence. San Francisco, CA: Morgan Kaufmann, 2021: 998−1004, articleTitle=null, refAbstract=null), Reference(id=1329456024907526776, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=82, rfOrder=84, authorNames=null, journalName=null, refType=null, unstructuredReference=Kumar A, Irsoy O, Ondruska P, et al. Ask me anything: Dynamic memory networks for natural language processing [C]//Proc of the 33rd Int Conf on Machine Learning. New York: ACM, 2016: 1378−1387, articleTitle=null, refAbstract=null), Reference(id=1329456024962052729, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=83, rfOrder=85, authorNames=null, journalName=null, refType=null, unstructuredReference=Xiong Caiming, Merity S, Socher R. Dynamic memory networks for visual and textual question answering [C]//Proc of the 33rd Int Conf on Machine Learning. New York: ACM, 2016: 2397−2406, articleTitle=null, refAbstract=null), Reference(id=1329456025029161594, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=84, rfOrder=86, authorNames=null, journalName=null, refType=null, unstructuredReference=Fan Chenyou, Zhang Xiaofan, Zhang Shu, et al. Heterogeneous memory enhanced multimodal attention model for video question answering [C]//Proc of the 32nd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2019: 1999−2007, articleTitle=null, refAbstract=null), Reference(id=1329456025087881851, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=85, rfOrder=87, authorNames=null, journalName=null, refType=null, unstructuredReference=Kim J, Ma M, Kim K, et al. Progressive attention memory network for movie story question answering [C]//Proc of the 32nd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2019: 8337−8346, articleTitle=null, refAbstract=null), Reference(id=1329456025154990716, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=86, rfOrder=88, authorNames=null, journalName=null, refType=null, unstructuredReference=Yu Ting, Yu Jun, Yu Zhou, et al. Long-term video question answering via multimodal hierarchical memory attentive networks[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2020, 31(3): 931−944, articleTitle=null, refAbstract=null), Reference(id=1329456025264042621, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=87, rfOrder=89, authorNames=null, journalName=null, refType=null, unstructuredReference=Fukui A, Park D H, Yang D, et al. Multimodal compact bilinear pooling for visual question answering and visual grounding [C]//Proc of the 2020 Conf on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2016: 457−468, articleTitle=null, refAbstract=null), Reference(id=1329456025322762878, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=88, rfOrder=90, authorNames=null, journalName=null, refType=null, unstructuredReference=Kim J H, On K W, Lim W, et al. Hadamard product for low-rank bilinear pooling [C/OL]//Proc of the Int Conf on Learning Representations. 2017 [2022-01-20].https://openreview.net/forum?id= r1rhWnZkg, articleTitle=null, refAbstract=null), Reference(id=1329456025381483135, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=89, rfOrder=91, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Zhichun, Lv Qingsong, Lan Xiaohan, et al. Cross-lingual knowledge graph alignment via graph convolutional networks [C]//Proc of the 2018 Conf on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2018: 349−357, articleTitle=null, refAbstract=null), Reference(id=1329456025440203392, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=90, rfOrder=92, authorNames=null, journalName=null, refType=null, unstructuredReference=Fan Wenqi, Ma Yao, Li Qing, et al. Graph neural networks for social recommendation [C]//Proc of the 2019 World Wide Web Conf. New York: ACM, 2019: 417−426, articleTitle=null, refAbstract=null), Reference(id=1329456025511506561, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=91, rfOrder=93, authorNames=null, journalName=null, refType=null, unstructuredReference=Huang Deng, Chen Peihao, Zeng Runhao, et al. Location-aware graph convolutional networks for video question answering [C]//Proc of the 34th AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2020: 11021−11028, articleTitle=null, refAbstract=null), Reference(id=1329456027113730690, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=92, rfOrder=94, authorNames=null, journalName=null, refType=null, unstructuredReference=Jiang Pin, Han Yahong. Reasoning with heterogeneous graph alignment for video question answering [C]//Proc of the 34th AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2020: 11109−11116, articleTitle=null, refAbstract=null), Reference(id=1329456027180839555, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=93, rfOrder=95, authorNames=null, journalName=null, refType=null, unstructuredReference=Seo A, Kang G C, Park J, et al. Attend what you need: Motion-appearance synergistic networks for video question answering [C]//Proc of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th Int Joint Conf on Natural Language Processing (Volume 1: Long Papers). Stroudsburg, PA: ACL, 2021: 6167–6177, articleTitle=null, refAbstract=null), Reference(id=1329456027239559812, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=94, rfOrder=96, authorNames=null, journalName=null, refType=null, unstructuredReference=Park J, Lee J, Sohn K. Bridge to Answer: Structure-aware graph interaction network for video question answering [C]//Proc of the 34th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2021: 15526−15535, articleTitle=null, refAbstract=null), Reference(id=1329456027302474373, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=95, rfOrder=97, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Jianyu, Bao Bingkun, Xu Changsheng. DualVGR: A dual-visual graph reasoning unit for video question answering [J]. IEEE Transactions on Multimedia, 2021, 24: 3369−3380, articleTitle=null, refAbstract=null), Reference(id=1329456027361194630, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=96, rfOrder=98, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Xiao, Zhu Meiqi, Bo Deyu, et al. AM-GCN: Adaptive multi-channel graph convolutional networks [C]//Proc of the 26th ACM SIGKDD Int Conf on Knowledge Discovery & Data Mining. New York: ACM, 2020: 1243−1253, articleTitle=null, refAbstract=null), Reference(id=1329456027432497799, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=97, rfOrder=99, authorNames=null, journalName=null, refType=null, unstructuredReference=Dang L H, Le T M, Le V, et al. Object-centric representation learning for video question answering [C/OL]//Proc of the 2021 Int Joint Conf on Neural Networks. Piscataway, NJ: IEEE, 2021 [2022-01-22].https://arxiv.org/abs/2104.05166, articleTitle=null, refAbstract=null), Reference(id=1329456027499606664, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=98, rfOrder=100, authorNames=null, journalName=null, refType=null, unstructuredReference=Jiang Jingjing, Liu Ziyi, Zheng Nanning, et al. LiVLR: A lightweight visual-linguistic reasoning framework for video question answering [J/OL]. IEEE Transactions on Multimedia, 2022 [2022-02-22].https://github.com/jingjing12110/LiVLR-VideoQA, articleTitle=null, refAbstract=null), Reference(id=1329456027570909833, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=99, rfOrder=101, authorNames=null, journalName=null, refType=null, unstructuredReference=Guo Zhicheng, Zhao Jiaxuan, Jiao Licheng, et al. Multi-scale progressive attention network for video question answering [C]//Proc of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th Int Joint Conf on Natural Language Processing (Volume 2: Short Papers). Stroudsburg, PA: ACL, 2021: 973−978, articleTitle=null, refAbstract=null), Reference(id=1329456027625435786, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=100, rfOrder=102, authorNames=null, journalName=null, refType=null, unstructuredReference=Peng Liang, Yang Shuangji, Bin Yi, et al. Progressive graph attention network for video question answering [C]//Proc of the 29th ACM Int Conf on Multimedia. New York: ACM, 2021: 2871−2879, articleTitle=null, refAbstract=null), Reference(id=1329456027688350347, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=101, rfOrder=103, authorNames=null, journalName=null, refType=null, unstructuredReference=Liu Fei, Liu Jing, Wang Weining, et al. HAIR: Hierarchical visual-semantic relational reasoning for video question answering [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2021: 1698−1707, articleTitle=null, refAbstract=null), Reference(id=1329456027768042124, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=102, rfOrder=104, authorNames=null, journalName=null, refType=null, unstructuredReference=Yang Zekun, Garcia N, Chu Chenhui, et al. Bert representations for video question answering [C]//Proc of the 2020 IEEE Winter Conf on Applications of Computer Vision. Piscataway, NJ: IEEE, 2020: 1556−1565, articleTitle=null, refAbstract=null), Reference(id=1329456027826762381, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=103, rfOrder=105, authorNames=null, journalName=null, refType=null, unstructuredReference=Urooj Khan A, Mazaheri A, da Vitoria Lobo N, et al. MMFT-BERT: Multimodal fusion transformer with BERT encodings for visual question answering [C]//Proc of the 2020 Conf on Empirical Methods in Natural Language Processing(Findings). Stroudsburg, PA: ACL, 2020: 4648−4660, articleTitle=null, refAbstract=null), Reference(id=1329456027893871246, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=104, rfOrder=106, authorNames=null, journalName=null, refType=null, unstructuredReference=Garcia N, Nakashima Y. Knowledge-based video question answering with unsupervised scene descriptions [C]//Proc of the 16th European Conf on Computer Vision. Berlin: Springer, 2020: 581−598, articleTitle=null, refAbstract=null), Reference(id=1329456027948397199, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=105, rfOrder=107, authorNames=null, journalName=null, refType=null, unstructuredReference=Engin D, Schnitzler F, Duong N Q K, et al. On the hidden treasure of dialog in video question answering [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2021: 2064−2073, articleTitle=null, refAbstract=null), Reference(id=1329456028019700368, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=106, rfOrder=108, authorNames=null, journalName=null, refType=null, unstructuredReference=Sadhu A, Chen Kan, Nevatia R. Video question answering with phrases via semantic roles [C]//Proc of the 19th Int Conf of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg, PA: ACL, 2021: 2460−2478, articleTitle=null, refAbstract=null), Reference(id=1329456028082614929, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=107, rfOrder=109, authorNames=null, journalName=null, refType=null, unstructuredReference=Ganesan A, Pal D, Muthuraman K, et al. Video based contextual question answering[J]. arXiv preprint, arXiv: 1804. 07399, 2018, articleTitle=null, refAbstract=null), Reference(id=1329456028149723794, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=108, rfOrder=110, authorNames=null, journalName=null, refType=null, unstructuredReference=Cherian A, Hori C, Marks T K, et al. (2.5+ 1) D spatio-temporal scene graphs for video question answering [C]//Proc of the 36th AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2022: 444−453, articleTitle=null, refAbstract=null), Reference(id=1329456028204249747, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=109, rfOrder=111, authorNames=null, journalName=null, refType=null, unstructuredReference=Peng Min, Wang Chongyang, Gao Yuan, et al. Temporal pyramid transformer with multimodal interaction for video question answering[J]. arXiv preprint, arXiv: 2109. 04735, 2021, articleTitle=null, refAbstract=null), Reference(id=1329456028271358612, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=110, rfOrder=112, authorNames=null, journalName=null, refType=null, unstructuredReference=Tan Hao, Bansal M. Lxmert: Learning cross-modality encoder representations from transformers [C]//Proc of the 2019 Conf on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2019: 5100−5111, articleTitle=null, refAbstract=null), Reference(id=1329456028325884565, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=111, rfOrder=113, authorNames=null, journalName=null, refType=null, unstructuredReference=Sun Chen, Myers A, Vondrick C, et al. Videobert: A joint model for video and language representation learning [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2019: 7464−7473, articleTitle=null, refAbstract=null), Reference(id=1329456028392993430, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=112, rfOrder=114, authorNames=null, journalName=null, refType=null, unstructuredReference=Chen Xinlei, Fang Hao, Lin T Y, et al. Microsoft COCO captions: Data collection and evaluation server[J]. arXiv preprint, arXiv: 1504. 00325, 2015, articleTitle=null, refAbstract=null), Reference(id=1329456028455907991, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=113, rfOrder=115, authorNames=null, journalName=null, refType=null, unstructuredReference=Krishna R, Zhu Yuke, Groth O, et al. Visual Genome: Connecting language and vision using crowdsourced dense image annotations[J]. International Journal of Computer Vision, 2017, 123(1): 32−73, articleTitle=null, refAbstract=null), Reference(id=1329456028514628248, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=114, rfOrder=116, authorNames=null, journalName=null, refType=null, unstructuredReference=Miech A, Zhukov D, Alayrac J B, et al. HowTo100M: Learning a text-video embedding by watching hundred million narrated video clips [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2019: 2630−2640, articleTitle=null, refAbstract=null), Reference(id=1329456028577542809, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=115, rfOrder=117, authorNames=null, journalName=null, refType=null, unstructuredReference=Kim S, Jeong S, Kim E, et al. Self-supervised pre-training and contrastive representation learning for multiple-choice video QA[J]. arXiv preprint, arXiv: 2009. 08043, 2020, articleTitle=null, refAbstract=null), Reference(id=1329456028644651674, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=116, rfOrder=118, authorNames=null, journalName=null, refType=null, unstructuredReference=Yang A, Miech A, Sivic J, et al. Just ask: Learning to answer questions from millions of narrated videos [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2021: 1686−1697, articleTitle=null, refAbstract=null), Reference(id=1329456028707566235, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=117, rfOrder=119, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Linjie, Chen Y C, Cheng Yu, et al. HERO: Hierarchical encoder for video+ language omni-representation pre-training [C]//Proc of the 2020 Conf on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2020: 2046−2065, articleTitle=null, refAbstract=null), Reference(id=1329456028774675100, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=118, rfOrder=120, authorNames=null, journalName=null, refType=null, unstructuredReference=Zellers R, Lu Ximing, Hessel J, et al. MERLOT: Multimodal neural script knowledge models [C]//Proc of the 34th Advances in Neural Information Processing Systems. Cambridge, MA: MIT, 2021: 23634−23651, articleTitle=null, refAbstract=null), Reference(id=1329456028875338397, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=119, rfOrder=121, authorNames=null, journalName=null, refType=null, unstructuredReference=Liu Yinhan, Ott M, Goyal N, et al. RoBERTa: A robustly optimized bert pretraining approach [C/OL]//Proc of the Int Conf on Learning Representations. 2020 [2022-01-25].https://openreview.net/forum?id= SyxS0T4tvS, articleTitle=null, refAbstract=null), Reference(id=1329456028946641566, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=120, rfOrder=122, authorNames=null, journalName=null, refType=null, unstructuredReference=Lei Jie, Li Linjie, Zhou Luowei, et al. Less is more: Clipbert for video-and-language learning via sparse sampling [C]//Proc of the 34th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2021: 7331−7341, articleTitle=null, refAbstract=null), Reference(id=1329456029026333343, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=121, rfOrder=123, authorNames=null, journalName=null, refType=null, unstructuredReference=Yu Weijiang, Zheng Haoteng, Li Mengfei, et al. Learning from Inside: Self-driven siamese sampling and reasoning for video question answering [C]//Proc of the 34th Advances in Neural Information Processing Systems. Cambridge, MA: MIT, 2021: 26462−26474, articleTitle=null, refAbstract=null), Reference(id=1329456029101830816, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=122, rfOrder=124, authorNames=null, journalName=null, refType=null, unstructuredReference=Amrani E, Ben-Ari R, Rotman D, et al. Noise estimation using density estimation for self-supervised multimodal learning [C]//Proc of the 35th AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2021: 6644−6652, articleTitle=null, refAbstract=null), Reference(id=1329456029223465633, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=123, rfOrder=125, authorNames=null, journalName=null, refType=null, unstructuredReference=Luo Jianjie, Li Yehao, Pan Yingwei, et al. CoCo-BERT: Improving video-language pre-training with contrastive cross-modal matching and denoising [C]//Proc of the 29th ACM Int Conf on Multimedia. New York: ACM, 2021: 5600−5608, articleTitle=null, refAbstract=null), Reference(id=1329456029298963106, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=124, rfOrder=126, authorNames=null, journalName=null, refType=null, unstructuredReference=Seo P H, Nagrani A, Schmid C. Look before you speak: Visually contextualized utterances [C]//Proc of the 34th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2021: 16877−16887, articleTitle=null, refAbstract=null), Reference(id=1329456029357683363, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=125, rfOrder=127, authorNames=null, journalName=null, refType=null, unstructuredReference=Lu Jiasen, Batra D, Parikh D, et al. Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks [C]//Proc of the 32nd Advances in Neural Information Processing Systems. Cambridge, MA: MIT, 2019: 13−23, articleTitle=null, refAbstract=null), Reference(id=1329456029412209316, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=126, rfOrder=128, authorNames=null, journalName=null, refType=null, unstructuredReference=Fu T J, Li Linjie, Gan Zhe, et al. VIOLET: End-to-end video-language transformers with masked visual-token modeling[J]. arXiv preprint, arXiv: 2111. 12681, 2021, articleTitle=null, refAbstract=null), Reference(id=1329456029475123877, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=127, rfOrder=129, authorNames=null, journalName=null, refType=null, unstructuredReference=Liu Ze, Ning Jia, Cao Yue, et al. Video swin transformer [C]//Proc of the 35th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2022: 3202−3211, articleTitle=null, refAbstract=null), Reference(id=1329456029630313126, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=128, rfOrder=130, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhou Luowei, Liu Jingjing, Cheng Yu, et al. Cupid: Adaptive curation of pre-training data for video-and-language representation learning[J]. arXiv preprint, arXiv: 2104. 00285, 2021, articleTitle=null, refAbstract=null), Reference(id=1329456029831639719, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=129, rfOrder=131, authorNames=null, journalName=null, refType=null, unstructuredReference=Le T M, Le V, Venkatesh S, et al. Hierarchical conditional relation networks for video question answering [C]//Proc of the 33rd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2020: 9972−9981, articleTitle=null, refAbstract=null), Reference(id=1329456031580664488, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=130, rfOrder=132, authorNames=null, journalName=null, refType=null, unstructuredReference=Dang L H, Le T M, Le V, et al. Hierarchical object-oriented spatio-temporal reasoning for video question answering [C]//Proc of the 30th Int Joint Conf on Artificial Intelligence. San Francisco, CA: Morgan Kaufmann, 2021: 636−642, articleTitle=null, refAbstract=null), Reference(id=1329456031651967657, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=131, rfOrder=133, authorNames=null, journalName=null, refType=null, unstructuredReference=Xiao Junbin, Yao A, Liu Zhiyuan, et al. Video as conditional graph hierarchy for multi-granular question answering [C]//Proc of the 36th AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2022: 2804−2812, articleTitle=null, refAbstract=null), Reference(id=1329456031731659434, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=132, rfOrder=134, authorNames=null, journalName=null, refType=null, unstructuredReference=Yi Kexin, Gan Chuang, Li Yunzhu, et al. CLEVRER: Collision events for video representation and reasoning [C/OL]//Proc of the Int Conf on Learning Representations. 2020 [2022-09-03].https://openreview.net /forum?id=HkxYzANYDB, articleTitle=null, refAbstract=null), Reference(id=1329456031802962603, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=133, rfOrder=135, authorNames=null, journalName=null, refType=null, unstructuredReference=Chen Zhenfang, Mao Jiayuan, Wu Jiajun, et al. Grounding physical concepts of objects and events through dynamic visual reasoning [C/OL]//Proc of the Int Conf on Learning Representations. 2021 [2022-09-03].https://openreview.net/pdf?id=bhCDO_cEGCz, articleTitle=null, refAbstract=null), Reference(id=1329456031874265772, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=134, rfOrder=136, authorNames=null, journalName=null, refType=null, unstructuredReference=Ding Mingyu, Chen Zhenfang, Du Tao, et al. Dynamic visual reasoning by learning differentiable physics models from video and language [C]//Proc of the 34th Advances in Neural Information Processing Systems. Cambridge, MA: MIT, 2021, 34: 887−899, articleTitle=null, refAbstract=null), Reference(id=1329456031949763245, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=135, rfOrder=137, authorNames=null, journalName=null, refType=null, unstructuredReference=Mao Jiayuan, Gan Chuang, Kohli P, et al. The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision [C/OL]//Proc of the Int Conf on Learning Representations. 2019 [2022-09-04].https://research.ibm.com/publications/the-neuro-symbolic-concept-learner-interpreting-scenes-words-and-sentences-from-natural-supervision, articleTitle=null, refAbstract=null), Reference(id=1329456032008483502, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=136, rfOrder=138, authorNames=null, journalName=null, refType=null, unstructuredReference=Xu Li, Huang He, Liu Jun. SUTD-TrafficQA: A question answering benchmark and an efficient network for video reasoning over traffic events [C]//Proc of the 34th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2021: 9878−9888, articleTitle=null, refAbstract=null), Reference(id=1329456032058815151, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=137, rfOrder=139, authorNames=null, journalName=null, refType=null, unstructuredReference=Garcia N, Otani M, Chu Chenhui, et al. KnowIT VQA: Answering knowledge-based questions about videos [C]//Proc of the 34th AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2020: 10826−10834, articleTitle=null, refAbstract=null), Reference(id=1329456032121729712, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=138, rfOrder=140, authorNames=null, journalName=null, refType=null, unstructuredReference=Han Yahong, Wang Bo, Hong Richang, et al. Movie question answering via textual memory and plot graph[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2019, 30(3): 875−887, articleTitle=null, refAbstract=null), Reference(id=1329456032188838577, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=139, rfOrder=141, authorNames=null, journalName=null, refType=null, unstructuredReference=Maharaj T, Ballas N, Rohrbach A, et al. A dataset and exploration of models for understanding video data through fill-in-the-blank question-answering [C]//Proc of the 30th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2017: 6884−6893, articleTitle=null, refAbstract=null), Reference(id=1329456032260141746, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=140, rfOrder=142, authorNames=null, journalName=null, refType=null, unstructuredReference=Mun J, Hongsuck Seo P, Jung I, et al. MarioQA: Answering questions by watching gameplay videos [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2017: 2867−2875, articleTitle=null, refAbstract=null), Reference(id=1329456032327250611, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=141, rfOrder=143, authorNames=null, journalName=null, refType=null, unstructuredReference=Ates T, Atesoglu M S, Yigit C, et al. CRAFT: A benchmark for causal reasoning about forces and interactions [C]//Proc of the 2022 Findings of the Association for Computational Linguistics. Stroudsburg, PA: ACL, 2022: 2602–2627, articleTitle=null, refAbstract=null), Reference(id=1329456032394359476, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=142, rfOrder=144, authorNames=null, journalName=null, refType=null, unstructuredReference=Yu Zhou, Xu Dejing, Yu Jun, et al. Activitynet-QA: A dataset for understanding complex web videos via question answering [C]//Proc of the 33rd AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2019: 9127−9134, articleTitle=null, refAbstract=null), Reference(id=1329456032461468341, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=143, rfOrder=145, authorNames=null, journalName=null, refType=null, unstructuredReference=Torabi A, Tandon N, Sigal L. Learning language-visual embedding for movie understanding with natural-language[J]. arXiv preprint, arXiv: 1609. 08124, 2016, articleTitle=null, refAbstract=null), Reference(id=1329456032549548726, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=144, rfOrder=146, authorNames=null, journalName=null, refType=null, unstructuredReference=Fan Chenyou. EgoVQA-an egocentric video question answering benchmark dataset [C]//Proc of the 2019 IEEE Int Conf on Computer Vision Workshops. Piscataway, NJ: IEEE, 2019: 4359−4366, articleTitle=null, refAbstract=null), Reference(id=1329456032629240503, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=145, rfOrder=147, authorNames=null, journalName=null, refType=null, unstructuredReference=Zadeh A, Chan M, Liang P P, et al. Social-IQ: A question answering benchmark for artificial social intelligence [C]//Proc of the 32nd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2019: 8807−8817, articleTitle=null, refAbstract=null), Reference(id=1329456032742486712, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=146, rfOrder=148, authorNames=null, journalName=null, refType=null, unstructuredReference=Choi S, On K W, Heo Y J, et al. DramaQA: Character-centered video story understanding with hierarchical QA [C]//Proc of the 35th AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI 2021: 1166−1174, articleTitle=null, refAbstract=null), Reference(id=1329456032809595577, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=147, rfOrder=149, authorNames=null, journalName=null, refType=null, unstructuredReference=Castro S, Azab M, Stroud J, et al. LifeQA: A real-life dataset for video question answering [C]//Proc of the 12th Language Resources and Evaluation Conf. Marseille: European Language Resources Association (ELRA), 2020: 4352−4358, articleTitle=null, refAbstract=null), Reference(id=1329456032876704442, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=148, rfOrder=150, authorNames=null, journalName=null, refType=null, unstructuredReference=Colas A, Kim S, Dernoncourt F, et al. Tutorial-VQA: Question answering dataset for tutorial videos [C]//Proc of the 12th Language Resources and Evaluation Conf. Marseille: European Language Resources Association (ELRA), 2020: 5450–5455, articleTitle=null, refAbstract=null), Reference(id=1329456032968979131, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=149, rfOrder=151, authorNames=null, journalName=null, refType=null, unstructuredReference=Xiao Junbin, Shang Xindi, Yao A, et al. NExT-QA: Next phase of question-answering to explaining temporal actions [C]//Proc of the 34th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2021: 9777−9786, articleTitle=null, refAbstract=null), Reference(id=1329456033036087996, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=150, rfOrder=152, authorNames=null, journalName=null, refType=null, unstructuredReference=Grunde-McLaughlin M, Krishna R, Agrawala M. AGQA: A benchmark for compositional spatio-temporal reasoning [C]//Proc of the 34th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2021: 11287−11297, articleTitle=null, refAbstract=null), Reference(id=1329456033094808253, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=151, rfOrder=153, authorNames=null, journalName=null, refType=null, unstructuredReference=Wu Bo, Yu Shoubin, Chen Zhenfang, et al. STAR: A benchmark for situated reasoning in real-world videos [C/OL]//Proc of the 35th Conf on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2). Cambridge, MA: MIT Press, 2021 [2022-01-25].https://openreview.net/forum?id=EfgNF5-ZAjM, articleTitle=null, refAbstract=null), Reference(id=1329456033161917118, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=152, rfOrder=154, authorNames=null, journalName=null, refType=null, unstructuredReference=Jia Baoxiong, Lei Ting, Zhu Songchun, et al. EgoTaskQA: Understanding human tasks in egocentric videos [C/OL]//Proc of the 36th Advances in Neural Information Processing Systems Datasets and Benchmarks Track. Cambridge, MA: MIT, 2022 [2022-01-25].https://openreview.net/forum?id=ttxAvIQA4i_, articleTitle=null, refAbstract=null), Reference(id=1329456033224831679, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=153, rfOrder=155, authorNames=null, journalName=null, refType=null, unstructuredReference=Jasani B, Girdhar R, Ramanan D. Are we asking the right questions in MovieQA? [C]//Proc of the IEEE Int Conf on Computer Vision Workshops. Piscataway, NJ: IEEE, 2019: 1879−1882, articleTitle=null, refAbstract=null), Reference(id=1329456033296134848, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=154, rfOrder=156, authorNames=null, journalName=null, refType=null, unstructuredReference=Rohrbach A, Torabi A, Rohrbach M, et al. Movie description[J]. International Journal of Computer Vision, 2017, 123(1): 94−120, articleTitle=null, refAbstract=null), Reference(id=1329456033367438017, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=155, rfOrder=157, authorNames=null, journalName=null, refType=null, unstructuredReference=Kolve E, Mottaghi R, Han W, et al. AI2-THOR: An interactive 3D environment for visual AI[J]. arXiv preprint, arXiv: 1712. 05474, 2017, articleTitle=null, refAbstract=null), Reference(id=1329456033430352578, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=156, rfOrder=158, authorNames=null, journalName=null, refType=null, unstructuredReference=Li Yuncheng, Song Yale, Cao Liangliang, et al. TGIF: A new dataset and benchmark on animated Gif description [C]//Proc of the 29th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2016: 4641−4650, articleTitle=null, refAbstract=null), Reference(id=1329456033514238659, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=157, rfOrder=159, authorNames=null, journalName=null, refType=null, unstructuredReference=Guadarrama S, Krishnamoorthy N, Malkarnenkar G, et al. YouTube2Text: Recognizing and describing arbitrary activities using semantic hierarchies and zero-shot recognition [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2013: 2712−2719, articleTitle=null, refAbstract=null), Reference(id=1329456033585541828, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=158, rfOrder=160, authorNames=null, journalName=null, refType=null, unstructuredReference=Ji Jingwei, Krishna R, Fei-Fei L, et al. Action genome: Actions as compositions of spatio-temporal scene graphs [C]//Proc of the 33rd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2020: 10236−10247, articleTitle=null, refAbstract=null), Reference(id=1329456033652650693, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=159, rfOrder=161, authorNames=null, journalName=null, refType=null, unstructuredReference=Thomee B, Shamma D A, Friedland G, et al. YFCC-100M: The new data in multimedia research[J]. Communications of the ACM, 2016, 59(2): 64−73, articleTitle=null, refAbstract=null), Reference(id=1329456033715565254, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=160, rfOrder=162, authorNames=null, journalName=null, refType=null, unstructuredReference=Sigurdsson G A, Russakovsky O, Gupta A. What actions are needed for understanding human actions in videos? [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2017: 2137−2146, articleTitle=null, refAbstract=null), Reference(id=1329456033795257031, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=161, rfOrder=163, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Xin, Wu Jiawei, Chen Junkun, et al. VaTeX: A large-scale, high-quality multilingual dataset for video-and-language research [C]//Proc of the IEEE Int Conf on Computer Vision. Piscataway, NJ: IEEE, 2019: 4581−4591, articleTitle=null, refAbstract=null), Reference(id=1329456033870754504, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=162, rfOrder=164, authorNames=null, journalName=null, refType=null, unstructuredReference=Jia Baoxiong, Chen Yixin, Huang Siyuan, et al. LEMMA: A multi-view dataset for learning multi-agent multi-task activities [C]//Proc of the 16th European Conf on Computer Vision. Berlin: Springer, 2020: 767−786, articleTitle=null, refAbstract=null), Reference(id=1329456033933669065, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=163, rfOrder=165, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Xinyu, Liu Yuliang, Shen Chunhua, et al. On the general value of evidence, and bilingual scene-text visual question answering [C]//Proc of the 33rd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2020: 10126−10135, articleTitle=null, refAbstract=null), Reference(id=1329456034000777930, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=164, rfOrder=166, authorNames=null, journalName=null, refType=null, unstructuredReference=Marino K, Chen Xinlei, Parikh D, et al. Krisp: Integrating implicit and symbolic knowledge for open-domain knowledge-based VQA [C]//Proc of the 34th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2021: 14111−14121, articleTitle=null, refAbstract=null), Reference(id=1329456034067886795, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=165, rfOrder=167, authorNames=null, journalName=null, refType=null, unstructuredReference=Zhang Yifeng, Jiang Ming, Zhao Qi. Explicit knowledge incorporation for visual reasoning [C]//Proc of the 34th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2021: 1356−1365, articleTitle=null, refAbstract=null), Reference(id=1329456034130801356, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=166, rfOrder=168, authorNames=null, journalName=null, refType=null, unstructuredReference=Wang Peng, Wu Qi, Shen Chunhua, et al. FVQA: Fact-based visual question answering[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 40(10): 2413−2427, articleTitle=null, refAbstract=null), Reference(id=1329456034210493133, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=167, rfOrder=169, authorNames=null, journalName=null, refType=null, unstructuredReference=Wu Qi, Wang Peng, Shen Chunhua, et al. Ask me anything: Free-form visual question answering based on knowledge from external sources [C]//Proc of the 29th IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2016: 4622−4630, articleTitle=null, refAbstract=null), Reference(id=1329456034281796302, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=168, rfOrder=170, authorNames=null, journalName=null, refType=null, unstructuredReference=Marino K, Rastegari M, Farhadi A, et al. Ok-VQA: A visual question answering benchmark requiring external knowledge [C]//Proc of the 32nd IEEE Conf on Computer Vision and Pattern Recognition. Piscataway, NJ: IEEE, 2019: 3195−3204, articleTitle=null, refAbstract=null), Reference(id=1329456034361488079, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=169, rfOrder=171, authorNames=null, journalName=null, refType=null, unstructuredReference=Shah S, Mishra A, Yadati N, et al. KVQA: Knowledge-aware visual question answering [C]//Proc of the 33rd AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2019: 8876−8884, articleTitle=null, refAbstract=null), Reference(id=1329456035988878034, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=170, rfOrder=172, authorNames=null, journalName=null, refType=null, unstructuredReference=Chen Zhou, Chen Jiaoyan, Geng Yuxia, et al. Zero-shot visual question answering using knowledge graph [C]//Proc of the 20th Int Semantic Web Conf. Berlin: Springer, 2021: 146−162, articleTitle=null, refAbstract=null), Reference(id=1329456036114707155, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=171, rfOrder=173, authorNames=null, journalName=null, refType=null, unstructuredReference=Wu Jialin, Lu Jiasen, Sabharwal A, et al. Multi-modal answer validation for knowledge-based VQA [C]//Proc of the 36th AAAI Conf on Artificial Intelligence. Palo Alto, CA: AAAI, 2022: 2712−2721, articleTitle=null, refAbstract=null), Reference(id=1329456036202787540, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=172, rfOrder=174, authorNames=null, journalName=null, refType=null, unstructuredReference=Wu Qi, Shen Chunhua, Wang Peng, et al. Image captioning and visual question answering based on attributes and external knowledge[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 40(6): 1367−1381, articleTitle=null, refAbstract=null), Reference(id=1329456036282479317, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=173, rfOrder=175, authorNames=null, journalName=null, refType=null, unstructuredReference=Radford A, Kim J W, Hallacy C, et al. Learning transferable visual models from natural language supervision [C]//Proc of the 38th Int Conf on Machine Learning. New York: ACM, 2021: 8748−8763, articleTitle=null, refAbstract=null), Reference(id=1329456036345393878, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=174, rfOrder=176, authorNames=null, journalName=null, refType=null, unstructuredReference=Ju Chen, Han Tengda, Zheng Kunhao, et al. Prompting visual-language models for efficient video understanding [C]//Proc of the 17th European Conf on Computer Vision. Berlin: Springer, 2022: 105−124, articleTitle=null, refAbstract=null)], funds=null, companyList=[AuthorCompany(id=1329456006553252283, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=1, ext=[AuthorCompanyExt(id=1329456006561640892, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006553252283, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1School of Computer Science and Technology, Zhejiang Gongshang University, Hangzhou 310018), AuthorCompanyExt(id=1329456006570029501, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006553252283, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
1浙江工商大学计算机科学与技术学院 杭州 310018)]), AuthorCompany(id=1329456006670692798, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=2, ext=[AuthorCompanyExt(id=1329456006683275711, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006670692798, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2School of Information & Electronic Engineering, Zhejiang Gongshang University, Hangzhou 310018), AuthorCompanyExt(id=1329456006691664320, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006670692798, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
2浙江工商大学信息与电子工程学院 杭州 310018)]), AuthorCompany(id=1329456006762967489, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=3, ext=[AuthorCompanyExt(id=1329456006771356098, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006762967489, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
3Zhejiang E-Commerce Key Lab(Zhejiang Gongshang University), Hangzhou 310018), AuthorCompanyExt(id=1329456006779744707, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006762967489, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
3浙江省电子商务与物流信息技术研究重点实验室(浙江工商大学) 杭州 310018)]), AuthorCompany(id=1329456006834270660, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, xref=4, ext=[AuthorCompanyExt(id=1329456006842659269, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006834270660, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
4School of Information Science and Technology, University of Science and Technology of China, Hefei 230026), AuthorCompanyExt(id=1329456006851047878, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, companyId=1329456006834270660, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=
4中国科学技术大学信息科学技术学院 合肥 230026)])], figs=[ArticleFig(id=1329456010923717108, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 1, caption=
Paper statistics, figureFileSmall=oa0XmF+D59IGFhPNCUIZ9A==, figureFileBig=CQGQsTiVcaSE+pI6znvTxg==, tableContent=null), ArticleFig(id=1329456010999214581, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图1, caption=
论文统计, figureFileSmall=oa0XmF+D59IGFhPNCUIZ9A==, figureFileBig=CQGQsTiVcaSE+pI6znvTxg==, tableContent=null), ArticleFig(id=1329456011208929782, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 2, caption=
The overview of our paper, figureFileSmall=OOPqJJCr9N8Xm4pzUqXKBQ==, figureFileBig=K9oOOSASPeBxrMIuaW/U/Q==, tableContent=null), ArticleFig(id=1329456011297010167, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图2, caption=
本文的概述, figureFileSmall=OOPqJJCr9N8Xm4pzUqXKBQ==, figureFileBig=K9oOOSASPeBxrMIuaW/U/Q==, tableContent=null), ArticleFig(id=1329456011368313336, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 3, caption=
Examples of various types of questions, figureFileSmall=dA9LUC74KD3GWMqNXrHo9Q==, figureFileBig=vsRTwIWqLsEJmXVyUjWG9A==, tableContent=null), ArticleFig(id=1329456011431227897, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图3, caption=
各类型问题示例, figureFileSmall=dA9LUC74KD3GWMqNXrHo9Q==, figureFileBig=vsRTwIWqLsEJmXVyUjWG9A==, tableContent=null), ArticleFig(id=1329456011502531066, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 4, caption=
Comparison of VideoQA and ImageQA models, figureFileSmall=lWID5w7qCXcOTx/mlLaIYg==, figureFileBig=IxuicVtlanBJndcw4xXnIw==, tableContent=null), ArticleFig(id=1329456011552862715, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图4, caption=
VideoQA与ImageQA模型对比, figureFileSmall=lWID5w7qCXcOTx/mlLaIYg==, figureFileBig=IxuicVtlanBJndcw4xXnIw==, tableContent=null), ArticleFig(id=1329456011624165884, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 5, caption=
Overview of the mainstream VideoQA model almanacs, figureFileSmall=BQvu4pPOPg64Gr8OxdDM1A==, figureFileBig=Iq9ZWcG9KV3me3pPig3sWA==, tableContent=null), ArticleFig(id=1329456011695469053, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图5, caption=
主流的VideoQA模型年历表概览, figureFileSmall=BQvu4pPOPg64Gr8OxdDM1A==, figureFileBig=Iq9ZWcG9KV3me3pPig3sWA==, tableContent=null), ArticleFig(id=1329456011758383614, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 6, caption=
VideoQA model processing flow, figureFileSmall=rvsG74uNDcBbLFZXLlc6uQ==, figureFileBig=jH4QrVcZB7A1DJDuuKa6OA==, tableContent=null), ArticleFig(id=1329456011825492479, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图6, caption=
VideoQA模型处理流程, figureFileSmall=rvsG74uNDcBbLFZXLlc6uQ==, figureFileBig=jH4QrVcZB7A1DJDuuKa6OA==, tableContent=null), ArticleFig(id=1329456011884212736, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 7, caption=
Three stages of attention calculation, figureFileSmall=fynuOcpunH0l16q1RHxIfw==, figureFileBig=pUi1AGNQWxITlOY8dlK6iQ==, tableContent=null), ArticleFig(id=1329456011947127297, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图7, caption=
注意力计算的3个阶段, figureFileSmall=fynuOcpunH0l16q1RHxIfw==, figureFileBig=pUi1AGNQWxITlOY8dlK6iQ==, tableContent=null), ArticleFig(id=1329456012005847554, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 8, caption=
Comparison of FVTA and traditional attention[61], figureFileSmall=SQ6rINToQ2tlIeVhESJFxA==, figureFileBig=O82Pzl7WMk8QTmmj9vjAxQ==, tableContent=null), ArticleFig(id=1329456012077150723, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图8, caption=
FVTA和传统注意力的比较[61], figureFileSmall=SQ6rINToQ2tlIeVhESJFxA==, figureFileBig=O82Pzl7WMk8QTmmj9vjAxQ==, tableContent=null), ArticleFig(id=1329456012140065284, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 9, caption=
The structure of PSAC model [67], figureFileSmall=do0GHQhxgkjTDvL2JD7CYQ==, figureFileBig=IEwU3p5bh1JCgH75SXcs4Q==, tableContent=null), ArticleFig(id=1329456012194591237, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图9, caption=
PSAC模型结构[67], figureFileSmall=do0GHQhxgkjTDvL2JD7CYQ==, figureFileBig=IEwU3p5bh1JCgH75SXcs4Q==, tableContent=null), ArticleFig(id=1329456013792621062, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 10, caption=
Key modules of MSAN model[71], figureFileSmall=kvFZmzt0PI8Xdfw0bdS2Tg==, figureFileBig=H/Kv/sguMLUqyCxY1A1qsw==, tableContent=null), ArticleFig(id=1329456013868118535, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图10, caption=
MSAN模型的关键模块[71], figureFileSmall=kvFZmzt0PI8Xdfw0bdS2Tg==, figureFileBig=H/Kv/sguMLUqyCxY1A1qsw==, tableContent=null), ArticleFig(id=1329456013947810312, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 11, caption=
Heterogeneous memory enhanced multimodal attention model[84], figureFileSmall=e1aTfrC2yUbOpwcp7hNtFw==, figureFileBig=ZD4x3xfDQMb2M4ejlQK7Gw==, tableContent=null), ArticleFig(id=1329456014019113481, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图11, caption=
异构记忆增强多模态注意力模型[84], figureFileSmall=e1aTfrC2yUbOpwcp7hNtFw==, figureFileBig=ZD4x3xfDQMb2M4ejlQK7Gw==, tableContent=null), ArticleFig(id=1329456014077833738, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 12, caption=
The graph interaction part of Bridge2Answer method[94], figureFileSmall=P4+IccsSQ52i7LqROSxScQ==, figureFileBig=mBKTVIBf+2/umbnY+dSg6g==, tableContent=null), ArticleFig(id=1329456014144942603, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图12, caption=
Bridge2Answer方法的图交互部分[94], figureFileSmall=P4+IccsSQ52i7LqROSxScQ==, figureFileBig=mBKTVIBf+2/umbnY+dSg6g==, tableContent=null), ArticleFig(id=1329456014203662860, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 13, caption=
MSPAN network structure[99], figureFileSmall=VVhmn+MDghD9p2FuZQFd8g==, figureFileBig=pYwbHHsyFc4W+r+PZCfQDw==, tableContent=null), ArticleFig(id=1329456014258188813, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图13, caption=
MSPAN网络结构[99], figureFileSmall=VVhmn+MDghD9p2FuZQFd8g==, figureFileBig=pYwbHHsyFc4W+r+PZCfQDw==, tableContent=null), ArticleFig(id=1329456014337880590, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 14, caption=
The schematic illustration of (2.5+1)D VideoQA reasoning pipeline[108], figureFileSmall=ed0nwMZ4bXpPjdkJtuFF8w==, figureFileBig=NVd7cTmxtvzMqvbfSBqiGg==, tableContent=null), ArticleFig(id=1329456014400795151, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图14, caption=
(2.5+1)D视频问答推理流程示意图[108], figureFileSmall=ed0nwMZ4bXpPjdkJtuFF8w==, figureFileBig=NVd7cTmxtvzMqvbfSBqiGg==, tableContent=null), ArticleFig(id=1329456014467904016, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 15, caption=
Comparison between popular video-and-language learning paradigm and CLIPBERT[120], figureFileSmall=V/llYiT1bcInn/uqeS7gNA==, figureFileBig=4Rk+/W80RyLh7Er5s8hPEg==, tableContent=null), ArticleFig(id=1329456014539207185, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图15, caption=
流行的视频和语言学习范式和 CLIPBERT之间的比较[120], figureFileSmall=V/llYiT1bcInn/uqeS7gNA==, figureFileBig=4Rk+/W80RyLh7Er5s8hPEg==, tableContent=null), ArticleFig(id=1329456014593733138, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 16, caption=
Some examples of datasets, figureFileSmall=Hu/2iEuWK7CrADnV1GFcMg==, figureFileBig=syo5jfu79V/ru/0B3XwiMA==, tableContent=null), ArticleFig(id=1329456014660842003, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图16, caption=
部分数据集示例, figureFileSmall=Hu/2iEuWK7CrADnV1GFcMg==, figureFileBig=syo5jfu79V/ru/0B3XwiMA==, tableContent=null), ArticleFig(id=1329456014732145172, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Figure 17, caption=
Examples of questions that require visual and common sense knowledge to answer[166], figureFileSmall=0TsQpTUy3rCjanLnSCAhhA==, figureFileBig=UbgWeiH9dtXKc9dDu/7H3A==, tableContent=null), ArticleFig(id=1329456014799254037, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=图17, caption=
需要视觉和常识知识来回答的问题示例[166], figureFileSmall=0TsQpTUy3rCjanLnSCAhhA==, figureFileBig=UbgWeiH9dtXKc9dDu/7H3A==, tableContent=null), ArticleFig(id=1329456014870557206, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Table 1, caption=
Comparison of VideoQA Survey Works
, figureFileSmall=null, figureFileBig=null, tableContent=
| 综述工作 | 数据集 | | 方法 |
|---|
| 最新年份 | 个数 | | 最新年份 | 个数 | 注意力 | 记忆网络 | 图网络 | Transformer/BERT | 预训练 |
|---|
| Patel等人[8] | 2020 | 18 | | 2020 | 26 | √ | √ | × | × | × |
| Khurana等人[9] | 2019 | 11 | | 2020 | 22 | √ | √ | √ | × | × |
| Sun等人[10] | 2019 | 11 | | 2020 | 41 | √ | √ | × | × | × |
| 本文 | 2022 | 30 | | 2022 | 83 | √ | √ | √ | √ | √ |
), ArticleFig(id=1329456014950248983, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=表1, caption=
VideoQA综述工作对比
, figureFileSmall=null, figureFileBig=null, tableContent=
| 综述工作 | 数据集 | | 方法 |
|---|
| 最新年份 | 个数 | | 最新年份 | 个数 | 注意力 | 记忆网络 | 图网络 | Transformer/BERT | 预训练 |
|---|
| Patel等人[8] | 2020 | 18 | | 2020 | 26 | √ | √ | × | × | × |
| Khurana等人[9] | 2019 | 11 | | 2020 | 22 | √ | √ | √ | × | × |
| Sun等人[10] | 2019 | 11 | | 2020 | 41 | √ | √ | × | × | × |
| 本文 | 2022 | 30 | | 2022 | 83 | √ | √ | √ | √ | √ |
), ArticleFig(id=1329456015013163544, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Table 2, caption=
Comparison of Indicators of Each Data Set
, figureFileSmall=null, figureFileBig=null, tableContent=
| 数据集 | 年份 | 数据源 | 视频数 | 片段数 | 平均长度/s | 问答对 | 问答类型 | 问答生成 |
|---|
| MovieQA[80] | 2016 | 电影 | 408 | 6771 | 202 | 14944 | 选择题 | 人工 |
| LSMDC-QA[143] | 2017 | M-VAD/MPII-MD | 202 | 118081 | 200 | 118114 | 选择题 | 人工 |
| MovieFIB[139] | 2017 | LSMDC2016 | 180 | 118507 | 4.1 | 348998 | 填空题 | 自动 |
| YouTube2Text-QA[55] | 2017 | YouTube2Text | 1987 | 1987 | 40 | 99421 | 选择题/开放问题 | 自动 |
| TGIF-QA[45] | 2017 | TGIF | | 71741 | 3 | 165165 | 选择题/开放问题 | 人工/自动 |
| MSRVTT-QA[48] | 2017 | MSRVTT | 7000 | 10000 | 15 | 243000 | 开放问题 | 自动 |
| MSVD-QA[48] | 2017 | MSVD | 1970 | 1970 | 10 | 50505 | 开放问题 | 自动 |
| Video-QA[79] | 2017 | 在线网络视频 | 18100 | 18100 | 90 | 175076 | 开放问题 | 自动 |
| MarioQA[140] | 2017 | 游戏视频 | | | | 187757 | 选择题 | 自动 |
| PororoQA[31] | 2017 | 卡通视频 | 171 | 16066 | | 8913 | 选择题 | 人工 |
| TVQA[69] | 2018 | 电视剧 | 925 | 21793 | 76 | 152545 | 选择题 | 人工 |
| SVQA[59] | 2018 | Unity3D生成 | 12000 | 12000 | | 118680 | 开放问题 | 自动 |
| TVQA+[52] | 2019 | TVQA | 279 | 4198 | 60~90 | 29383 | 选择题 | 人工 |
| KnowIT VQA[137] | 2019 | 电视剧 | 207 | 12087 | 20 | 24000 | 选择题 | 人工 |
| Activitynet-QA[142] | 2019 | ActivityNet | 5800 | 5800 | 180 | 58000 | 开放问题 | 人工 |
| EgoVQA[144] | 2019 | IU Multiview | 16 | 520 | 20~100 | 600 | 选择题/开放问题 | 人工 |
| Social-IQ[145] | 2019 | YouTube | 1250 | 1250 | | 7500 | 选择题 | 人工 |
| DramaQA[146] | 2020 | 电视剧 | 18 | 23928 | 3.6 | 17983 | 选择题 | 人工 |
| LifeQA[147] | 2020 | YouTube | 59 | 275 | 74 | 2326 | 选择题 | 人工 |
| Tutorial-VQA[148] | 2020 | 网络教学视频 | 76 | 408 | | 6195 | 开放问题 | 人工 |
| How2QA[117] | 2020 | HowTo100M/TV | 9035 | 22000 | 60 | 44007 | 选择题 | 人工 |
| Env-QA[53] | 2021 | 模拟器生成 | | 23261 | | 85072 | 选择题 | 自动 |
| CLEVRER[132] | 2021 | 模拟器生成 | 20000 | 20000 | 5 | 300000 | 选择题/开放问题 | 自动 |
| TrafficQA[136] | 2021 | 交通视频 | 10080 | 10080 | | 62535 | 选择题 | 人工 |
| NExT-QA[149] | 2021 | YFCC-100M | 5440 | 5440 | 44 | 52044 | 选择题/开放问题 | 人工 |
| AGQA[150] | 2021 | Action genome | 9601 | 9601 | 30 | 36000000 | 选择题/开放问题 | 自动 |
| STAR[151] | 2021 | Charades | | 22000 | 30 | 60000 | 选择题 | 自动 |
| Fill-in-the-Blank[36] | 2022 | VaTeX | 28000 | 28000 | 10 | 28000 | 填空题 | 人工 |
| CRAFT[141] | 2022 | 模拟器生成 | 9917 | 57524 | 10 | 57524 | 选择题 | 自动 |
| EgoTaskQA[152] | 2022 | LEMMA | 2000 | 2000 | 45 | 40000 | 选择题/开放问题 | 自动 |
), ArticleFig(id=1329456015201907225, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=表2, caption=
各数据集指标对比
, figureFileSmall=null, figureFileBig=null, tableContent=
| 数据集 | 年份 | 数据源 | 视频数 | 片段数 | 平均长度/s | 问答对 | 问答类型 | 问答生成 |
|---|
| MovieQA[80] | 2016 | 电影 | 408 | 6771 | 202 | 14944 | 选择题 | 人工 |
| LSMDC-QA[143] | 2017 | M-VAD/MPII-MD | 202 | 118081 | 200 | 118114 | 选择题 | 人工 |
| MovieFIB[139] | 2017 | LSMDC2016 | 180 | 118507 | 4.1 | 348998 | 填空题 | 自动 |
| YouTube2Text-QA[55] | 2017 | YouTube2Text | 1987 | 1987 | 40 | 99421 | 选择题/开放问题 | 自动 |
| TGIF-QA[45] | 2017 | TGIF | | 71741 | 3 | 165165 | 选择题/开放问题 | 人工/自动 |
| MSRVTT-QA[48] | 2017 | MSRVTT | 7000 | 10000 | 15 | 243000 | 开放问题 | 自动 |
| MSVD-QA[48] | 2017 | MSVD | 1970 | 1970 | 10 | 50505 | 开放问题 | 自动 |
| Video-QA[79] | 2017 | 在线网络视频 | 18100 | 18100 | 90 | 175076 | 开放问题 | 自动 |
| MarioQA[140] | 2017 | 游戏视频 | | | | 187757 | 选择题 | 自动 |
| PororoQA[31] | 2017 | 卡通视频 | 171 | 16066 | | 8913 | 选择题 | 人工 |
| TVQA[69] | 2018 | 电视剧 | 925 | 21793 | 76 | 152545 | 选择题 | 人工 |
| SVQA[59] | 2018 | Unity3D生成 | 12000 | 12000 | | 118680 | 开放问题 | 自动 |
| TVQA+[52] | 2019 | TVQA | 279 | 4198 | 60~90 | 29383 | 选择题 | 人工 |
| KnowIT VQA[137] | 2019 | 电视剧 | 207 | 12087 | 20 | 24000 | 选择题 | 人工 |
| Activitynet-QA[142] | 2019 | ActivityNet | 5800 | 5800 | 180 | 58000 | 开放问题 | 人工 |
| EgoVQA[144] | 2019 | IU Multiview | 16 | 520 | 20~100 | 600 | 选择题/开放问题 | 人工 |
| Social-IQ[145] | 2019 | YouTube | 1250 | 1250 | | 7500 | 选择题 | 人工 |
| DramaQA[146] | 2020 | 电视剧 | 18 | 23928 | 3.6 | 17983 | 选择题 | 人工 |
| LifeQA[147] | 2020 | YouTube | 59 | 275 | 74 | 2326 | 选择题 | 人工 |
| Tutorial-VQA[148] | 2020 | 网络教学视频 | 76 | 408 | | 6195 | 开放问题 | 人工 |
| How2QA[117] | 2020 | HowTo100M/TV | 9035 | 22000 | 60 | 44007 | 选择题 | 人工 |
| Env-QA[53] | 2021 | 模拟器生成 | | 23261 | | 85072 | 选择题 | 自动 |
| CLEVRER[132] | 2021 | 模拟器生成 | 20000 | 20000 | 5 | 300000 | 选择题/开放问题 | 自动 |
| TrafficQA[136] | 2021 | 交通视频 | 10080 | 10080 | | 62535 | 选择题 | 人工 |
| NExT-QA[149] | 2021 | YFCC-100M | 5440 | 5440 | 44 | 52044 | 选择题/开放问题 | 人工 |
| AGQA[150] | 2021 | Action genome | 9601 | 9601 | 30 | 36000000 | 选择题/开放问题 | 自动 |
| STAR[151] | 2021 | Charades | | 22000 | 30 | 60000 | 选择题 | 自动 |
| Fill-in-the-Blank[36] | 2022 | VaTeX | 28000 | 28000 | 10 | 28000 | 填空题 | 人工 |
| CRAFT[141] | 2022 | 模拟器生成 | 9917 | 57524 | 10 | 57524 | 选择题 | 自动 |
| EgoTaskQA[152] | 2022 | LEMMA | 2000 | 2000 | 45 | 40000 | 选择题/开放问题 | 自动 |
), ArticleFig(id=1329456015289987610, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Table 3, caption=
Performance of Mainstream Models on MovieQA %
, figureFileSmall=null, figureFileBig=null, tableContent=
| 模型 | 验证集准确率 | 测试集准确率 |
|---|
| DEMN[31] | 44.7 | 30.0 |
| RWMN[32] | 38.7 | 36.3 |
| FVTA[61] | 41.0 | 37.3 |
| LMN[35] | 42.5 | 39.0 |
| MDAM[68] | | 41.4 |
| PAMN[85] | 43.3 | 42.5 |
| WikiWord Embedding[153] | 50.0 | 47.0 |
), ArticleFig(id=1329456015348707867, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=表3, caption=
主流模型在MovieQA上的性能表现
, figureFileSmall=null, figureFileBig=null, tableContent=
| 模型 | 验证集准确率 | 测试集准确率 |
|---|
| DEMN[31] | 44.7 | 30.0 |
| RWMN[32] | 38.7 | 36.3 |
| FVTA[61] | 41.0 | 37.3 |
| LMN[35] | 42.5 | 39.0 |
| MDAM[68] | | 41.4 |
| PAMN[85] | 43.3 | 42.5 |
| WikiWord Embedding[153] | 50.0 | 47.0 |
), ArticleFig(id=1329456015432593948, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Table 4, caption=
Performance of Mainstream Models on TVQA %
, figureFileSmall=null, figureFileBig=null, tableContent=
| 模型 | 验证集准确率 | 测试集准确率 |
|---|
| 文献[69] | 65.85 | 66.46 |
| PAMN[85] | 66.38 | 66.77 |
| Multi-task[51] | 66.22 | 67.05 |
| STAGE[52] | 70.50 | 70.23 |
| MSAN[71] | 70.79 | 71.13 |
| BERT Rep[102] | 72.35 | 73.06 |
| DCM&FSG[73] | 74.20 | 74.09 |
| iPerceive[74] | 76.97 | 75.15 |
| SP&CRL[115] | 76.23 | 76.15 |
), ArticleFig(id=1329456015512285725, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=表4, caption=
主流模型在TVQA上的性能表现
, figureFileSmall=null, figureFileBig=null, tableContent=
| 模型 | 验证集准确率 | 测试集准确率 |
|---|
| 文献[69] | 65.85 | 66.46 |
| PAMN[85] | 66.38 | 66.77 |
| Multi-task[51] | 66.22 | 67.05 |
| STAGE[52] | 70.50 | 70.23 |
| MSAN[71] | 70.79 | 71.13 |
| BERT Rep[102] | 72.35 | 73.06 |
| DCM&FSG[73] | 74.20 | 74.09 |
| iPerceive[74] | 76.97 | 75.15 |
| SP&CRL[115] | 76.23 | 76.15 |
), ArticleFig(id=1329456015604560414, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Table 5, caption=
Performance of Mainstream Models on TGIF-QA
, figureFileSmall=null, figureFileBig=null, tableContent=
| 模型 | 重复动作 /% | 状态转换 /% | 帧问答 /% | 计数 损失 |
|---|
| ST-VQA[45] | 60.8 | 67.1 | 49.3 | 4.28 |
| Co-Mem[34] | 68.2 | 74.3 | 51.5 | 4.10 |
| PSAC[67] | 70.4 | 76.9 | 55.7 | 4.27 |
| LAD-Net[66] | 69.9 | 78.4 | 57.5 | 4.32 |
| STA[65] | 72.3 | 79.0 | 56.6 | 4.25 |
| Jin等人[72] | 72.7 | 80.9 | 57.1 | 4.17 |
| HME[84] | 73.9 | 77.8 | 53.8 | 4.02 |
| L-GCN[91] | 74.3 | 81.1 | 56.3 | 3.95 |
| HGA[92] | 75.4 | 81.0 | 55.1 | 4.09 |
| HCRN[129] | 75.0 | 81.4 | 55.9 | 3.82 |
| HOSTR[130] | 75.0 | 83.0 | 58.0 | 3.65 |
| FAM[81] | 75.4 | 79.2 | 56.9 | 3.79 |
| QueST[60] | 75.9 | 81.0 | 59.7 | 4.19 |
| Bridge2Answer[94] | 75.9 | 82.6 | 57.5 | 3.71 |
| TPT[109] | 76.6 | 81.6 | 57.8 | 3.63 |
| HAIR[101] | 77.8 | 82.3 | 60.0 | 3.88 |
| MSPAN[99] | 78.4 | 83.3 | 59.7 | 3.57 |
| HQGA[131] | 76.9 | 85.6 | 61.3 | |
| CoCo-BERT[123] | 78.3 | 85.6 | 61.1 | 3.78 |
| SiaSamRea[121] | 79.7 | 85.3 | 60.2 | 3.61 |
| PGAT[100] | 80.6 | 85.7 | 61.1 | 3.96 |
| CLIPBERT[120] | 82.8 | 87.8 | 60.3 | |
| VGNMN[27] | 84.5 | 88.7 | 74.7 | 2.65 |
| VIOLET[126] | 92.5 | 95.7 | 68.9 | |
| MERLOT[118] | 94.0 | 96.2 | 69.5 | |
), ArticleFig(id=1329456015688446495, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=表5, caption=
主流模型在TGIF-QA上的性能表现
, figureFileSmall=null, figureFileBig=null, tableContent=
| 模型 | 重复动作 /% | 状态转换 /% | 帧问答 /% | 计数 损失 |
|---|
| ST-VQA[45] | 60.8 | 67.1 | 49.3 | 4.28 |
| Co-Mem[34] | 68.2 | 74.3 | 51.5 | 4.10 |
| PSAC[67] | 70.4 | 76.9 | 55.7 | 4.27 |
| LAD-Net[66] | 69.9 | 78.4 | 57.5 | 4.32 |
| STA[65] | 72.3 | 79.0 | 56.6 | 4.25 |
| Jin等人[72] | 72.7 | 80.9 | 57.1 | 4.17 |
| HME[84] | 73.9 | 77.8 | 53.8 | 4.02 |
| L-GCN[91] | 74.3 | 81.1 | 56.3 | 3.95 |
| HGA[92] | 75.4 | 81.0 | 55.1 | 4.09 |
| HCRN[129] | 75.0 | 81.4 | 55.9 | 3.82 |
| HOSTR[130] | 75.0 | 83.0 | 58.0 | 3.65 |
| FAM[81] | 75.4 | 79.2 | 56.9 | 3.79 |
| QueST[60] | 75.9 | 81.0 | 59.7 | 4.19 |
| Bridge2Answer[94] | 75.9 | 82.6 | 57.5 | 3.71 |
| TPT[109] | 76.6 | 81.6 | 57.8 | 3.63 |
| HAIR[101] | 77.8 | 82.3 | 60.0 | 3.88 |
| MSPAN[99] | 78.4 | 83.3 | 59.7 | 3.57 |
| HQGA[131] | 76.9 | 85.6 | 61.3 | |
| CoCo-BERT[123] | 78.3 | 85.6 | 61.1 | 3.78 |
| SiaSamRea[121] | 79.7 | 85.3 | 60.2 | 3.61 |
| PGAT[100] | 80.6 | 85.7 | 61.1 | 3.96 |
| CLIPBERT[120] | 82.8 | 87.8 | 60.3 | |
| VGNMN[27] | 84.5 | 88.7 | 74.7 | 2.65 |
| VIOLET[126] | 92.5 | 95.7 | 68.9 | |
| MERLOT[118] | 94.0 | 96.2 | 69.5 | |
), ArticleFig(id=1329456015772332576, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=EN, label=Table 6, caption=
Performance of Mainstream Models on MSRVTT-QA and MSVD-QA %
, figureFileSmall=null, figureFileBig=null, tableContent=
| 模型 | MSRVTT-QA | | MSVD-QA |
|---|
| What | Who | How | When | Where | All | | What | Who | How | When | Where | All |
|---|
| E-VQA[48] | 18.9 | 38.7 | 83.5 | 70.5 | 29.2 | 26.4 | | 9.7 | 42.2 | 83.8 | 72.4 | 53.6 | 23.3 |
| E-SA[48] | 22.0 | 41.6 | 79.6 | 73.1 | 33.2 | 29.3 | | 15.0 | 45.1 | 83.8 | 65.5 | 32.2 | 27.6 |
| E-MN[48] | 23.4 | 41.8 | 83.7 | 70.8 | 27.6 | 30.4 | | 12.9 | 46.5 | 80.3 | 70.7 | 50.0 | 26.7 |
| AMU[48] | 26.2 | 43.0 | 80.2 | 72.5 | 30.0 | 32.5 | | 20.6 | 47.5 | 83.5 | 72.4 | 53.6 | 32.0 |
| HRA[56] | | | | | | 35.1 | | | | | | | 34.4 |
| HME[84] | 26.5 | 43.6 | 82.4 | 76 | 28.6 | 33 | | 22.4 | 50.1 | 73 | 70.7 | 42.9 | 33.7 |
| L-GCN[91] | | | | | | | | | | | | | 34.3 |
| Jin等人[72] | 29.5 | 45.0 | 83.2 | 74.7 | 42.4 | 35.4 | | 24.2 | 49.5 | 83.8 | 74.1 | 53.6 | 35.0 |
| QueST[60] | 27.9 | 45.6 | 83 | 75.7 | 31.6 | 34.6 | | 24.5 | 52.9 | 79.1 | 72.4 | 50 | 36.1 |
| FAM[81] | 26.9 | 43.9 | 82.8 | 70.6 | 31.1 | 33.2 | | 23.1 | 51.6 | 82.2 | 71.4 | 51.9 | 34.5 |
| SSML[122] | | | | | | 35.1 | | | | | | | 35.1 |
| TSN[33] | 27.9 | 46.1 | 84.1 | 77.8 | 37.6 | 35.4 | | 25.0 | 51.3 | 83.8 | 78.4 | 59.1 | 36.7 |
| HGA[92] | 29.2 | 45.7 | 83.5 | 75.2 | 34.0 | 35.5 | | 23.5 | 50.4 | 83.0 | 72.4 | 46.4 | 34.7 |
| MHMAN[86] | 28.7 | 47.1 | 85.1 | 77.1 | 35.2 | 35.6 | | 23.3 | 50.7 | 84.1 | 72.4 | 53.6 | 34.6 |
| HCRN[129] | | | | | | 35.6 | | | | | | | 36.1 |
| ActBERT[37] | 29.4 | 45.6 | 79.8 | 76.7 | 36.4 | 35.5 | | 28.7 | 53.8 | 80.0 | 70.7 | 46.4 | 39.0 |
| HOSTR[130] | | | | | | 35.9 | | | | | | | 39.4 |
| Bridge2Answer[94] | | | | | | 36.9 | | | | | | | 37.2 |
| OCRL+LOGNet[97] | | | | | | 36.0 | | | | | | | 38.2 |
| HAIR[101] | | | | | | 37.5 | | | | | | | 36.9 |
| CLIPBERT[120] | | | | | | 37.4 | | | | | | | |
| PGAT[100] | | | | | | 38.1 | | | | | | | 39.0 |
| TPT[109] | | | | | | 38.5 | | | | | | | 37.7 |
| MSPAN[99] | 31.9 | 47.2 | 83.2 | 77.5 | 38.4 | 37.8 | | 31.0 | 53.8 | 77.0 | 72.1 | 53.6 | 40.3 |
| HQGA[131] | 32.5 | 48.9 | 81.5 | 78.3 | 38.4 | 38.6 | | 30.4 | 57.2 | 76.2 | 75.9 | 32.1 | 41.2 |
| CoMVT[124] | | | | | | 39.5 | | | | | | | 42.6 |
| SiaSamRea[121] | | | | | | 41.6 | | | | | | | 45.5 |
| VQA-T[116] | | | | | | 41.5 | | | | | | | 46.3 |
| VIOLET[126] | | | | | | 43.9 | | | | | | | 47.9 |
| LiVLR[98] | 50.3 | 77.1 | 94.2 | 81.3 | 48.4 | 59.4 | | | | | | | |
), ArticleFig(id=1329456015864607265, tenantId=1146029695717560320, journalId=1324759914146529478, articleId=1329455998747652488, language=CN, label=表6, caption=
主流模型在MSRVTT-QA和MSVD-QA上的性能表现
, figureFileSmall=null, figureFileBig=null, tableContent=
| 模型 | MSRVTT-QA | | MSVD-QA |
|---|
| What | Who | How | When | Where | All | | What | Who | How | When | Where | All |
|---|
| E-VQA[48] | 18.9 | 38.7 | 83.5 | 70.5 | 29.2 | 26.4 | | 9.7 | 42.2 | 83.8 | 72.4 | 53.6 | 23.3 |
| E-SA[48] | 22.0 | 41.6 | 79.6 | 73.1 | 33.2 | 29.3 | | 15.0 | 45.1 | 83.8 | 65.5 | 32.2 | 27.6 |
| E-MN[48] | 23.4 | 41.8 | 83.7 | 70.8 | 27.6 | 30.4 | | 12.9 | 46.5 | 80.3 | 70.7 | 50.0 | 26.7 |
| AMU[48] | 26.2 | 43.0 | 80.2 | 72.5 | 30.0 | 32.5 | | 20.6 | 47.5 | 83.5 | 72.4 | 53.6 | 32.0 |
| HRA[56] | | | | | | 35.1 | | | | | | | 34.4 |
| HME[84] | 26.5 | 43.6 | 82.4 | 76 | 28.6 | 33 | | 22.4 | 50.1 | 73 | 70.7 | 42.9 | 33.7 |
| L-GCN[91] | | | | | | | | | | | | | 34.3 |
| Jin等人[72] | 29.5 | 45.0 | 83.2 | 74.7 | 42.4 | 35.4 | | 24.2 | 49.5 | 83.8 | 74.1 | 53.6 | 35.0 |
| QueST[60] | 27.9 | 45.6 | 83 | 75.7 | 31.6 | 34.6 | | 24.5 | 52.9 | 79.1 | 72.4 | 50 | 36.1 |
| FAM[81] | 26.9 | 43.9 | 82.8 | 70.6 | 31.1 | 33.2 | | 23.1 | 51.6 | 82.2 | 71.4 | 51.9 | 34.5 |
| SSML[122] | | | | | | 35.1 | | | | | | | 35.1 |
| TSN[33] | 27.9 | 46.1 | 84.1 | 77.8 | 37.6 | 35.4 | | 25.0 | 51.3 | 83.8 | 78.4 | 59.1 | 36.7 |
| HGA[92] | 29.2 | 45.7 | 83.5 | 75.2 | 34.0 | 35.5 | | 23.5 | 50.4 | 83.0 | 72.4 | 46.4 | 34.7 |
| MHMAN[86] | 28.7 | 47.1 | 85.1 | 77.1 | 35.2 | 35.6 | | 23.3 | 50.7 | 84.1 | 72.4 | 53.6 | 34.6 |
| HCRN[129] | | | | | | 35.6 | | | | | | | 36.1 |
| ActBERT[37] | 29.4 | 45.6 | 79.8 | 76.7 | 36.4 | 35.5 | | 28.7 | 53.8 | 80.0 | 70.7 | 46.4 | 39.0 |
| HOSTR[130] | | | | | | 35.9 | | | | | | | 39.4 |
| Bridge2Answer[94] | | | | | | 36.9 | | | | | | | 37.2 |
| OCRL+LOGNet[97] | | | | | | 36.0 | | | | | | | 38.2 |
| HAIR[101] | | | | | | 37.5 | | | | | | | 36.9 |
| CLIPBERT[120] | | | | | | 37.4 | | | | | | | |
| PGAT[100] | | | | | | 38.1 | | | | | | | 39.0 |
| TPT[109] | | | | | | 38.5 | | | | | | | 37.7 |
| MSPAN[99] | 31.9 | 47.2 | 83.2 | 77.5 | 38.4 | 37.8 | | 31.0 | 53.8 | 77.0 | 72.1 | 53.6 | 40.3 |
| HQGA[131] | 32.5 | 48.9 | 81.5 | 78.3 | 38.4 | 38.6 | | 30.4 | 57.2 | 76.2 | 75.9 | 32.1 | 41.2 |
| CoMVT[124] | | | | | | 39.5 | | | | | | | 42.6 |
| SiaSamRea[121] | | | | | | 41.6 | | | | | | | 45.5 |
| VQA-T[116] | | | | | | 41.5 | | | | | | | 46.3 |
| VIOLET[126] | | | | | | 43.9 | | | | | | | 47.9 |
| LiVLR[98] | 50.3 | 77.1 | 94.2 | 81.3 | 48.4 | 59.4 | | | | | | | |
)], attaches=null, journal=Journal(id=1324759606947315908, delFlag=0, nameCn=计算机研究与发展, nameEn=Journal of Computer Research and Development, nameHistory1=null, nameHistory2=null, issn=1000-1239, eissn=null, cn=11-1777/TP, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=k2l8zgqwstuxxevFX2qxVA==, journalPrice=null, startedYear=null, abbrevIsoEn=Journal of Computer Research and Development, journalRemark=null, publicationField=null, createdTime=1793776903141, updatedTime=1793850698612, createdBy=18614031015, updatedBy=13701087609, firstLetterCn=J, firstLetterEn=J, subjectCode=Electronic Information, subjectName=null, subjectCodeEn=Electronic Information, subjectNameEn=null, picCn=k2l8zgqwstuxxevFX2qxVA==, picEn=r6k0Ry+RD+c/VXj5QarmDw==, jcr=null, cjcr=null, exts=[JournalExt(id=1325069127710286688, language=CN, name=计算机研究与发展, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1793850698640, updatedTime=1793850698640, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://crad.ict.ac.cn/journalx/authorLogOn.action, submissionEditorUrl=https://crad.ict.ac.cn/journalx/editorLogOn.action, submissionReviewUrl=https://crad.ict.ac.cn/journalx/expertLogOn.action, submissionCeEditorUrl=https://crad.ict.ac.cn/journalx/editorInChiefLogOn.action, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1325069127777395553, language=EN, name=Journal of Computer Research and Development, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1793850698656, updatedTime=1793850698656, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://crad.ict.ac.cn/journalx/authorLogOn.action, submissionEditorUrl=https://crad.ict.ac.cn/journalx/editorLogOn.action, submissionReviewUrl=https://crad.ict.ac.cn/journalx/expertLogOn.action, submissionCeEditorUrl=https://crad.ict.ac.cn/journalx/editorInChiefLogOn.action, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1324759914146529478, websiteList=[Website(id=1325070300139892771, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1324759914146529478, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN, language=CN, createTime=1793850978169, createBy=18614031015, updateTime=1793851040259, updateBy=18614031015, name=计算机研究与发展-中文, tplId=1146099689490845704, title=计算机研究与发展, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1325070893751349360, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=articleTextType, value=kx, createTime=1793851119697, updateTime=1793851119697, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893730377837, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=banner, value=null, createTime=1793851119692, updateTime=1793851119692, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893772320883, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=grayFlag, value=0, createTime=1793851119702, updateTime=1793851119702, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893721989228, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=logo, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/file/pic?fileId=U27tDsy717YF7XSPA+Vwdw==, createTime=1793851119690, updateTime=1793851119690, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893784903797, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=minRunFlag, value=0, createTime=1793851119705, updateTime=1793851119705, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893742960751, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/file/pic, createTime=1793851119695, updateTime=1793851119695, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893780709492, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=silenceFlag, value=0, createTime=1793851119704, updateTime=1793851119704, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893738766446, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1793851119694, updateTime=1793851119694, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893755543665, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=themeColor, value=null, createTime=1793851119698, updateTime=1793851119698, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070893763932274, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300139892771, code=themeStyle, value=null, createTime=1793851119700, updateTime=1793851119700, creator=18614031015, updator=18614031015)]), Website(id=1325070300580294698, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1324759914146529478, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN, language=EN, createTime=1793850978274, createBy=18614031015, updateTime=1793851036638, updateBy=18614031015, name=计算机研究与发展-英文, tplId=1146101810881728533, title=Journal of Computer Research and Development, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1325070925288321148, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=articleTextType, value=kx, createTime=1793851127216, updateTime=1793851127216, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925263155321, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=banner, value=null, createTime=1793851127210, updateTime=1793851127210, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925309292671, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=grayFlag, value=0, createTime=1793851127221, updateTime=1793851127221, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925254766712, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=logo, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/file/pic?fileId=U27tDsy717YF7XSPA+Vwdw==, createTime=1793851127208, updateTime=1793851127208, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925326069889, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=minRunFlag, value=0, createTime=1793851127225, updateTime=1793851127225, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925279932539, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/file/pic, createTime=1793851127214, updateTime=1793851127214, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925317681280, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=silenceFlag, value=0, createTime=1793851127223, updateTime=1793851127223, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925271543930, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1793851127212, updateTime=1793851127212, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925292515453, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=themeColor, value=null, createTime=1793851127217, updateTime=1793851127217, creator=18614031015, updator=18614031015), WebsiteProps(id=1325070925300904062, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1325070300580294698, code=themeStyle, value=null, createTime=1793851127219, updateTime=1793851127219, creator=18614031015, updator=18614031015)])], journalTitle=计算机研究与发展, weixinUrl=null, journalUrl=https://crad.ict.ac.cn/, iacademicId=null, status=1, seqNo=null, journalTitleEn=Journal of Computer Research and Development, journalPhotoCn=k2l8zgqwstuxxevFX2qxVA==, journalPhotoEn=r6k0Ry+RD+c/VXj5QarmDw==, journalFirstLetter=J, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/10.7544/issn1000-1239.202220294, detailUrlEn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202220294, pdfUrlCn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/CN/PDF/10.7544/issn1000-1239.202220294, pdfUrlEn=https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/PDF/10.7544/issn1000-1239.202220294, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=1, orderTime=1709308800000, fullTextJson=null, articleText=null, reference=null)