收藏切换
Open World Object Recognition and Detection Systems: Landscapes, Challenges and Prospects
收藏切换
Hui Nie, Ruiping Wang*, Xilin Chen
Journal of Computer Research and Development | 2024, 61(9) : 2128 - 2141
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(9): 2128-2141
• Research Highlights •
Open World Object Recognition and Detection Systems: Landscapes, Challenges and Prospects
Full
Hui Nie, Ruiping Wang*, Xilin Chen
Affiliations
  • Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190
  • University of Chinese Academy of Sciences, Beijing 100049
  • born in 1996. PhD candidate. His main research interests include open world object detection and computer vision

    born in 1981. PhD, professor, PhD supervisor. His main research interests include computer vision, pattern recognition, and machine learning

    born in 1965. PhD, professor, PhD supervisor. His main research interests include computer vision, pattern recognition, image processing, and multimodal interfaces

About Author:

born in 1996. PhD candidate. His main research interests include open world object detection and computer vision

born in 1981. PhD, professor, PhD supervisor. His main research interests include computer vision, pattern recognition, and machine learning

born in 1965. PhD, professor, PhD supervisor. His main research interests include computer vision, pattern recognition, image processing, and multimodal interfaces

Published: 2024-09-01 doi: 10.7544/issn1000-1239.202440054
Outline
收藏切换

We explore the transition from closed environments to open world environments and its impact on visual perception (focusing on object recognition and detection) and the field of deep learning. In open world environments, software systems need to adapt to constantly changing conditions and demands, presenting new challenges for deep learning methods. In particular, open world visual perception requires systems to understand and process environments and objects not seen during the training phase, which exceeds the capabilities of traditional closed systems. We first discuss the dynamic and adaptive system requirements brought about by technological advances, highlighting the advantages of open systems over closed systems. Then we delve into the definition of the open world and existing work, covering five dimensions of openness: open set learning, zero-shot learning, few-shot learning, long-tail learning, and incremental learning. In terms of open world recognition, we analyze the core challenges of each dimension and provide quantified evaluation metrics for each task dataset. For open world object detection, we discuss additional challenges compared with recognition, such as occlusion, scale, posture, symbiotic relationships, background interference, etc., and emphasize the importance of simulation environments in constructing open world object detection datasets. Finally, we underscore the new perspectives and opportunities that the concept of the open world brings to deep learning, acting as a catalyst for technological advancement and deeper understanding of the realistic environment challenges, offering a reference for future research.

open world  /  visual perception  /  object detection  /  object recognition  /  evaluation metrics  /  simulation environment
聂晖, 王瑞平, 陈熙霖. 开放世界物体识别与检测系统:现状、挑战与展望. 计算机研究与发展, 2024 , 61 (9) : 2128 -2141 . DOI: 10.7544/issn1000-1239.202440054
Hui Nie, Ruiping Wang, Xilin Chen. Open World Object Recognition and Detection Systems: Landscapes, Challenges and Prospects[J]. Journal of Computer Research and Development, 2024 , 61 (9) : 2128 -2141 . DOI: 10.7544/issn1000-1239.202440054
Year 2024 volume 61 Issue 9
71
35
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202440054
  • Receive Date:2024-01-29
  • Online Date:2026-11-17
  • Published:2024-09-01
Article Data
Affiliations
History
  • Received:2024-01-29
  • Revised:2024-06-06
Affiliations
    Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190
    University of Chinese Academy of Sciences, Beijing 100049
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202440054
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT