收藏切换
A survey of unmanned aerial vehicle vision-language navigation from the perspective of embodied intelligence
收藏切换
Zhouyi Zheng1, 2, Chenrui Guo3, 4, Chun Shan1, 2, Lei Zhang1, 2, *, Wei Wei1, 2
Journal of Image and Graphics | 2026, 31(9) : 3198 - 3226
Less
收藏切换
Journal of Image and Graphics | 2026, 31(9): 3198-3226
• The intelligent empowerment of large models in the aviation field •
A survey of unmanned aerial vehicle vision-language navigation from the perspective of embodied intelligence
Full
Zhouyi Zheng1, 2, Chenrui Guo3, 4, Chun Shan1, 2, Lei Zhang1, 2, *, Wei Wei1, 2
Affiliations
  • 1 School of Computer Science,Northwestern Polytechnical University,Xi’an 710129,China
  • 2 National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology,Northwestern Polytechnical University,Xi’an 710129,China
  • 3 State Key Laboratory of Aerospace Intelligent Control Technology,Beijing 100854,China
  • 4 Beijing Aerospace Automatic Control Institute,Beijing 100854,China
Published: 2026-09-16 doi: 10.11834/jig.260203
Outline
收藏切换

Unmanned aerial vehicle (UAV) vision-language navigation stands as a core research direction of aerial embodied intelligence,which combines computer vision (CV),natural language processing,robot control,and unmanned system technology. This system endows UAVs with the ability to understand human natural language instructions and perform autonomous navigation,path planning and task execution in unstructured,GPS-denied and dynamically changing three-dimensional environments. Unlike traditional UAV navigation methods that rely on satellite positioning,inertial navigation or manual waypoint setting,UAV vision-language navigation establishes a direct mapping from high-level semantic instructions to low-level continuous flight actions. This enables UAVs to complete complex tasks,such as target search,obstacle avoidance,long-distance cruising,and scene reasoning only through visual observation and language understanding. This technology effectively breaks the limitations of traditional navigation in semantic interaction and environmental adaptability. At the same time,it has theoretical value and engineering application prospects in low-altitude economies,urban security,emergency rescue,industrial inspection,and precision agriculture. In recent years,with the rapid development of multimodal large models,Transformer architectures and embodied artificial intelligence (AI),UAV vision-language navigation has gradually evolved from early modular pipelines to end-to-end learning frameworks,and then to highly interpretable reasoning systems driven by large language models (LLMs) and vision-language models. However,compared with ground robot vision-language navigation,UAV vision-language navigation still faces many unique challenges caused by aerial movement characteristics. First,UAVs move with six degrees of freedom,and frequent changes in height,pitch,yaw,and roll lead to unstable visual input,large differences in object scales and serious geometric distortion,which in turn increases the difficulty of cross-modal alignment between vision and language. Second,three-dimensional spatial topology is more complex,and spatial prepositions,such as “above”,“between”,“along”,and “across” require stronger geometric reasoning and spatial awareness,which cannot be satisfied by two-dimensional image matching alone. Third,long-range navigation tasks bring certain problems,such as massive visual information,cumulative positioning errors,and semantic forgetting,which put forward higher requirements for efficient memory mechanism and environmental representation. Fourth,the discrete semantic decision space is difficult to match with the continuous physical control spaces of UAVs,resulting in a large gap between simulation training and real-world deployment. With the goal of solving the abovementioned problems,this paper systematically summarizes the research progress of UAV vision-language navigation from the perspective of embodied intelligence. First,three types of simulation platforms are reviewed: general robot simulation platforms,simulation platforms based on real scene reconstruction,and large-scale virtual simulation platforms built by game engines. These platforms provide safe,low-cost,and high-efficiency test environments for algorithm verification,data generation,and model training,as well as effectively narrow the domain gap between simulation and reality. Then,mainstream datasets are compared and analyzed from the dimensions of scene scale,instruction complexity,action space definition,and environmental authenticity. The development of datasets reflects the trend of UAV vision-language navigation moving from indoor structured scenes to outdoor large-scale urban scenes,from short and simple to long sequential reasoning instructions,and from discrete actions to continuous six-degree-of-freedom control. Next,the core technical framework is divided into four modules: perception representation,reasoning paradigm,memory storage and embodied control. The perception representation focuses on visual feature extraction,geometric alignment,multimodal fusion,and world model construction. The reasoning paradigm mainly includes cross-modal attention mechanism,transformer-based pretraining,and large-model-driven chain-of-thought reasoning. The memory storage evolves from implicit temporal memory to explicit semantic maps and topological graphs. Furthermore,the embodied control develops from modular trajectory planning to end-to-end vision-language-action generation with safety constraints. In terms of practical applications,UAV vision-language navigation has been widely explored in urban infrastructure inspection,disaster emergency search and rescue,intelligent logistics distribution,and precision agricultural monitoring. This can reduce manual participation,improve operation efficiency,and enhance safety under high-risk,high-complexity and high-efficiency-demanding conditions. However,key bottlenecks continue to restrict large-scale deployment,such as simulation-to-real transfer,generalization in unseen environments,real-time performance of onboard computing,safety and stability in dynamic environments,and collaborative navigation of multiple UAVs. Finally,this paper discusses the prospects and future development trends of UAV vision-language navigation,including stronger world model and predictive reasoning,better generalization and robustness based on multimodal large models,safer and more reliable physical control,more efficient human-machine interaction and collaborative intelligence,as well as deeper integration with low-altitude digital economy and unmanned system ecology. Overall,this review aims to provide a complete and clear technical route for researchers in the fields of embodied intelligence,computer vision,natural language processing,and UAV systems; promote the breakthrough of key technologies; and accelerate the practical and industrialization process of UAV vision-language navigation.

unmanned aerial vehicle (UAV)  /  vision-language navigation  /  embodied intelligence  /  cross-modal alignment  /  large model
郑周一, 郭宸瑞, 单淳, 张磊, 魏巍. 具身智能视角下无人机视觉语言导航研究进展. 中国图象图形学报, 2026 , 31 (9) : 3198 -3226 . DOI: 10.11834/jig.260203
Zhouyi Zheng, Chenrui Guo, Chun Shan, Lei Zhang, Wei Wei. A survey of unmanned aerial vehicle vision-language navigation from the perspective of embodied intelligence[J]. Journal of Image and Graphics, 2026 , 31 (9) : 3198 -3226 . DOI: 10.11834/jig.260203
  • National Natural Science Foundation of China(62372379,62472359)
Year 2026 volume 31 Issue 9
17
8
Cite this Article
BibTeX
Article Info
doi: 10.11834/jig.260203
  • Receive Date:2026-04-16
  • Online Date:2026-10-30
  • Published:2026-09-16
Article Data
Affiliations
History
  • Received:2026-04-16
  • Revised:2026-06-14
Funding
National Natural Science Foundation of China(62372379,62472359)
Affiliations
    1 School of Computer Science,Northwestern Polytechnical University,Xi’an 710129,China
    2 National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology,Northwestern Polytechnical University,Xi’an 710129,China
    3 State Key Laboratory of Aerospace Intelligent Control Technology,Beijing 100854,China
    4 Beijing Aerospace Automatic Control Institute,Beijing 100854,China
References
Share
https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/10.11834/jig.260203
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT