收藏切换
Research Progress of Video Question Answering Technologies
收藏切换
Cuizhu Bao1, 3, Kai Ding2, Jianfeng Dong1, 3, Xun Yang4, Mande Xie2, *, Xun Wang1, 3
Journal of Computer Research and Development | 2024, 61(3) : 639 - 673
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(3): 639-673
• Artificial Intelligence •
Research Progress of Video Question Answering Technologies
Full
Cuizhu Bao1, 3, Kai Ding2, Jianfeng Dong1, 3, Xun Yang4, Mande Xie2, *, Xun Wang1, 3
Affiliations
  • 1School of Computer Science and Technology, Zhejiang Gongshang University, Hangzhou 310018
  • 2School of Information & Electronic Engineering, Zhejiang Gongshang University, Hangzhou 310018
  • 3Zhejiang E-Commerce Key Lab(Zhejiang Gongshang University), Hangzhou 310018
  • 4School of Information Science and Technology, University of Science and Technology of China, Hefei 230026
  • born in 1995. PhD, lecturer. Member of CCF. Her main research interests include computer vision, intelligent traffic control, and smart city

    born in 1995. Master candidate. Student member of CCF. His main research interests include computer vision, and visual question answering, and video question answering

    born in 1991. PhD, professor. Member of CCF. His main research interests include multimedia understanding, computer vision, machine learning, and artificial intelligence

    born in 1989. PhD, professor. Member of CCF. His main research interests include cross-media analysis and reasoning, structured understanding of multimedia content, and visual media correlation modeling

    born in 1977. PhD, professor. Member of CCF. His main research interests include wireless sensor networks, cloud computing, network security, and swarm intelligence perception

    born in 1967. PhD, professor. Distinguished member of CCF. His main research interests include visual media big data technology, mobile graphics computing, computer vision, and intelligent information processing and visual analysis

About Author:

born in 1995. PhD, lecturer. Member of CCF. Her main research interests include computer vision, intelligent traffic control, and smart city

born in 1995. Master candidate. Student member of CCF. His main research interests include computer vision, and visual question answering, and video question answering

born in 1991. PhD, professor. Member of CCF. His main research interests include multimedia understanding, computer vision, machine learning, and artificial intelligence

born in 1989. PhD, professor. Member of CCF. His main research interests include cross-media analysis and reasoning, structured understanding of multimedia content, and visual media correlation modeling

born in 1977. PhD, professor. Member of CCF. His main research interests include wireless sensor networks, cloud computing, network security, and swarm intelligence perception

born in 1967. PhD, professor. Distinguished member of CCF. His main research interests include visual media big data technology, mobile graphics computing, computer vision, and intelligent information processing and visual analysis

Published: 2024-03-02 doi: 10.7544/issn1000-1239.202220294
Outline
收藏切换

VideoQA (video question answering), which automatically answers natural language question according to the content of videos, is a relatively new research direction in the field of visual language and has attracted extensive attention in recent years. The solution of videoQA task is of great significance for human-computer interaction, intelligent education, intelligent transportation, scenario analysis, video retrieval, and other fields. VideoQA is a challenging task because it requires a model to understand semantic information of the video and the question to generate the answer. In this work, we analyze the difference between VideoQA and ImageQA (image question answering), and summarize four challenges faced by VideoQA relative to ImageQA. Then, the existing VideoQA models are carefully classified according to the research method around these challenges. Following the classifications, we introduce the generation background and focus on the implementation of models and the relationship between different models. After that, the benchmark datasets commonly used in VideoQA are summarized, the performances of current mainstream algorithms on some datasets are introduced in detail, and the comparison, analysis and summary are carried out. Finally, the future challenges and research trends in this field are discussed, which will provide some ideas for further research in the future.

video question answering  /  attention  /  memory network  /  recurrent neural network  /  graph network model  /  pre-training model
包翠竹, 丁凯, 董建峰, 杨勋, 谢满德, 王勋. 视频问答技术研究进展. 计算机研究与发展, 2024 , 61 (3) : 639 -673 . DOI: 10.7544/issn1000-1239.202220294
Cuizhu Bao, Kai Ding, Jianfeng Dong, Xun Yang, Mande Xie, Xun Wang. Research Progress of Video Question Answering Technologies[J]. Journal of Computer Research and Development, 2024 , 61 (3) : 639 -673 . DOI: 10.7544/issn1000-1239.202220294
Year 2024 volume 61 Issue 3
90
41
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202220294
  • Receive Date:2022-04-12
  • Online Date:2026-11-17
  • Published:2024-03-02
Article Data
Affiliations
History
  • Received:2022-04-12
  • Revised:2023-06-07
Affiliations
    1School of Computer Science and Technology, Zhejiang Gongshang University, Hangzhou 310018
    2School of Information & Electronic Engineering, Zhejiang Gongshang University, Hangzhou 310018
    3Zhejiang E-Commerce Key Lab(Zhejiang Gongshang University), Hangzhou 310018
    4School of Information Science and Technology, University of Science and Technology of China, Hefei 230026
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202220294
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT