Article(id=1322960864705393559, tenantId=1146029695717560320, journalId=1249024232475115590, issueId=1322960856543273127, articleNumber=null, orderNo=null, doi=10.11834/jig.250550, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1762272000000, receivedDateStr=2025-11-05, revisedDate=1769616000000, revisedDateStr=2026-01-29, acceptedDate=null, acceptedDateStr=null, onlineDate=1793348049569, onlineDateStr=2026-10-30, pubDate=1786809600000, pubDateStr=2026-08-16, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1793348049569, onlineIssueDateStr=2026-10-30, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1793348049569, creator=13701087609, updateTime=1793348049569, updator=13701087609, issue=Issue{id=1322960856543273127, tenantId=1146029695717560320, journalId=1249024232475115590, year='2026', volume='31', issue='8', pageStart='2687', pageEnd='3074', issueExtLink='null', onlineDate='null', pubDate='1786809600000', pubDateStr='2026-08-16', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1793348047624, creator='13701087609', updateTime=1793348605344, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext={EN=IssueExt(id=1322963195874378645, tenantId=1146029695717560320, journalId=1249024232475115590, issueId=1322960856543273127, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1322963195874378646, tenantId=1146029695717560320, journalId=1249024232475115590, issueId=1322960856543273127, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null, downloadFileDto=null}, startPage=2705, endPage=2730, ext={EN=ArticleExt(id=1322960864906720152, articleId=1322960864705393559, tenantId=1146029695717560320, journalId=1249024232475115590, language=EN, title=Embodied intelligence model evaluation: from perception to execution, columnId=1322960859068244136, journalTitle=Journal of Image and Graphics, columnName=Embodied Intelligence and Humanoid Robotics Frontiers, runingTitle=null, highlight=null, articleAbstract=

Embodied intelligence refers to agents that sense,reason,act,and learn through a tight “body-environment-task” feedback loop. It is widely regarded as the most promising route to general-purpose artificial intelligence (AI). Paradoxically,although model parameters,training data,and compute budgets have grown by four orders of magnitude in only five years,the evaluation ecosystem remains fragmented and largely irreproducible. The same functional capability (e.g.,“pick-and-place”) is formalized as object-detection mean average precision in one paper,as 3D intersection over union in a second,as task success rate in a third,and as human preference score in a fourth,with absolute gaps that exceed 10%—15% among “state-of-the-art” results. Environments,random seeds,physics parameters,sensor noise models,and success criteria are rarely open-sourced,and thus,the community cannot tell whether an apparent improvement originates from algorithmic innovation,data scale,evaluation cherry picking,or simple benchmark over-fitting. This uncertainty has become a critical bottleneck for scientific progress and industrial adoption. To address the gap,we conduct a systematic survey of 100+ papers published in IEEE/CVF Conference on Computer Vision and Pattern Recognition,IEEE International Conference on Robotics and Automation,Conference on Neural Information Processing Systems,Robotics: Science and Systems,International Conference on Learning Representations,International Journal of Robotic Research,and Journal of Machine Learning Research between 2020 and 2025. Then,we present the first holistic analysis of embodied AI evaluation. We organize the landscape into a three-tier pyramid: static datasets,simulation benchmarks,and real-robot trials. Each tier trades off cost,controllability,and ecological validity. Across all tiers,we decompose evaluation space into four tightly coupled stages: perception,cognition,decision,and execution. Then,we identify fine-grained capability dimensions along with 20+ quantitative metrics. For every dimension,we analyze the following: 1) the underlying methodological assumptions,2) the boundary conditions under which the metric is valid,3) the intrinsic limitations (e.g.,sim-to-real physics mismatch,dataset bias,human-label variance),and 4) the cost-credibility curve that determines when a researcher should ascend from static to simulation,and finally to the real world.All evaluations in this study are based on a theoretical “perception-cognition-decision-execution loop” framework. In embodied AI,perception is the process by which an agent converts raw,asynchronous,and often noisy signals from heterogeneous physical sensors,such as RGB-D cameras,LiDAR,tactile skins,joint encoders,force/torque,and inertial measurement unit units,into a registered,time-aligned digital twin that supplies metric 3D geometry and semantic labels. Cognition is then built on this torrent to distill structured,memory-enabled,and generalizable world models that encode object affordances,physical common sense,and relational and causal links,grounding free-form human language into the resulting latent space. Decision-making combines these world models with an explicit task goal and searches across symbolic,kinematic,and dynamic levels to output a coherent,risk-aware,and resource-efficient plan that is expressed as a hierarchy of subgoals,trajectories,and low-level set points. Finally,execution transforms this plan into real-world mechanical energy through high-rate feedback controllers that track desired motions or forces while compensating for actuator nonlinearities,shock,thermal limits,and human safety constraints,closing the perception-cognition-decision-execution loop that defines embodied AI. In contrast with humans,whose perception-cognition-decision-execution loop is seamlessly integrated,currently available embodied agents suffer structural flaws in every stage. Consequently,evaluation must decouple the four blocks and score accuracy,error,and latency separately to pinpoint bottlenecks. Static tests,i.e.,“written exams”,run on a GPU with a few megabytes of images or point clouds in minutes,but erase dynamics and physics. Simulation,i.e.,the “job interview”,adds interactive physics in tens of seconds but still drifts away from reality. Real robot trials,i.e.,“practical tests”,cost thousands,take days to deploy and minutes per run,but expose every sensing drift,prediction error,or control delay,offering the ultimate ground truth before field deployment. Therefore,by integrating the three-tier pyramid of static test-simulation-real robot evaluation into the closed perception-cognition-decision-execution loop,this work delivers the first systematic quantification of coverage,cost,and accuracy trade-offs across more than 100 embodied AI benchmarks,establishing a reproducible,traceable,and extensible evaluation baseline that not only exposes the exact stage at which state-of-the-art systems fail,but also provides a principled road map for allocating research budgets,standardizing protocols,and certifying safety before real-world deployment,marking a pivotal transition from empirical competition to scientific measurement,and accelerating the field’s development toward trustworthy,deployable,and general-purpose embodied intelligence. The detailed static-dynamic-real embodied intelligence evaluation can be accessed at https://opencompass.org.cn/embodied-intelligence.

, authors=Chunyi Li1, 2, Jianbo Zhang1, 2, Jiahao Xiao1, 2, Bowen Yan1, 3, Shengyu Guo1, 4, Tongrui Ye1, 5, Weisi Lin6, Guangtao Zhai1, 2, *, authorsList=Chunyi Li, Jianbo Zhang, Jiahao Xiao, Bowen Yan, Shengyu Guo, Tongrui Ye, Weisi Lin, Guangtao Zhai, authorCompany=null, correspAuthors=Guangtao Zhai, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1322960870090879901, articleId=1322960864705393559, tenantId=1146029695717560320, journalId=1249024232475115590, language=CN, title=具身智能模型评测:从感知到执行, columnId=1322960859248599210, journalTitle=中国图象图形学报, columnName=具身智能与人形机器人前沿, runingTitle=null, highlight=null, articleAbstract=

具身智能通过“身体—环境—任务”闭环交互,被视为迈向通用人工智能的核心路径。然而,与模型参数和训练数据的高速扩张形成鲜明对照,其评测体系仍处于“任务碎片化、指标多元化、平台封闭化”的自发状态,造成同一功能在不同研究中的性能差异超过10%,却无法判定来源是算法创新、数据扩充还是评测偏差,严重阻碍了技术迭代与产业落地。本文围绕“从感知到执行”的完整链路,对2020—2025年间发表于CVPR(IEEE/CVF Conference on Computer Vision and Pattern Recognition)、ICRA(IEEE International Conference on Robotics and Automation)、NeurIPS(Conference on Neural Information Processing Systems)等顶级会议与 Nature、IJRR(International Journal of Robotic Research)、JMLR(Journal of Machine Learning Research)等期刊的百余篇文献进行系统梳理,首次提出“静态数据集—仿真平台—真实机器人”三级金字塔式评测范式,并从感知、认知、决策、执行4个环节拆解出20余项核心能力维度与量化指标,分别从方法学假设、适用边界、固有局限和成本—可信度曲线4个角度进行横向对比。本文进一步汇总了46套主流基在数据规模、任务类型、评估指标、开源程度和安全伦理考量等维度的差异。基于此,提出“能力导向、协议统一、三级协同”的未来框架:1)在任务层,由“功能对标”转向“能力对标”,建立可分解、可溯源、可加权的多维误差体系;2)在协议层,制定统一的场景描述、接口规范与指标定义,实现跨平台、跨任务、跨模型的可比性;3)在系统层,构建可远程接入、7 × 24 h运行的共享机器人集群,形成“仿真预训练—真机微调—在线更新”的闭环追踪,降低重复建设成本,打通从实验室到场景落地的“最后一公里”。最后讨论了安全伦理、文化偏见和能效评估等新维度如何纳入量化框架,并给出标准化路线图的短、中、长期目标。本文工作为具身智能从“技术涌现”走向“科学共识”提供了可操作的评测基础设施与参考范式,具体的静态—仿真—真机榜单展示在:https://opencompass.org.cn/embodied-intelligence。

, authors=李春一1, 2, 张建博1, 2, 肖嘉豪1, 2, 闫博闻1, 3, 郭晟毓1, 4, 叶桐瑞1, 5, 林维斯6, 翟广涛1, 2, *, authorsList=李春一, 张建博, 肖嘉豪, 闫博闻, 郭晟毓, 叶桐瑞, 林维斯, 翟广涛, authorCompany=null, correspAuthors=翟广涛, authorNote=

李春一,男,博士研究生,主要研究方向为面向具身智能的多媒体信号处理。E-mail:

张建博,男,助理研究员,主要研究方向为具身智能大小脑协作、SLAM导航。E-mail:

肖嘉豪,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

闫博闻,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

郭晟毓,男,硕士研究生,主要研究方向为具身智能与世界模型。E-mail:

叶桐瑞,男,硕士研究生,主要研究方向为具身智能心理学评测。E-mail:

林维斯,男,教授,主要研究方向为图像处理、感知建模、多媒体信号处理和计算机视觉。E-mail:

翟广涛,通信作者,男,教授,主要研究方向为图像处理、感知建模、大模型与具身智能评测。E-mail:

, correspAuthorsNote=
翟广涛,通信作者,男,教授,主要研究方向为图像处理、感知建模、大模型与具身智能评测。E-mail:
, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=2JnP+r5rrfZY9LYqeLmCwg==, magXml=WDFRIS05h0Q8whTK3l8bFg==, pdfUrl=null, pdf=F9hJHeAABaPXLkCdj92igg==, pdfFileSize=1441548, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=R/Vypy3oOwNxRDL3pDE9DA==, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=GiAILuUe4wx4xbXCk+V1gQ==, mapNumber=null, fund=null)}, authors=[Author(id=1322960873005921201, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=lichunyi@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960873488266164, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960873005921201, language=EN, stringName=Chunyi Li, firstName=Chunyi, middleName=null, lastName=Li, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960873546986421, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960873005921201, language=CN, stringName=李春一, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 上海人工智能实验室评测专项组,上海;200032
2 上海交通大学信息与电子工程学院,上海 200240, bio={"content":"

李春一,男,博士研究生,主要研究方向为面向具身智能的多媒体信号处理。E-mail:

"}, bioImg=null, bioContent=

李春一,男,博士研究生,主要研究方向为面向具身智能的多媒体信号处理。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870548059041, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=2, ext=[AuthorCompanyExt(id=1322960870560641954, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China), AuthorCompanyExt(id=1322960870573224867, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 上海交通大学信息与电子工程学院,上海 200240)])]), Author(id=1322960873949639607, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=zhangjianbo@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960874415207354, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960873949639607, language=EN, stringName=Jianbo Zhang, firstName=Jianbo, middleName=null, lastName=Zhang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960874721391547, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960873949639607, language=CN, stringName=张建博, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 上海人工智能实验室评测专项组,上海;200032
2 上海交通大学信息与电子工程学院,上海 200240, bio={"content":"

张建博,男,助理研究员,主要研究方向为具身智能大小脑协作、SLAM导航。E-mail:

"}, bioImg=null, bioContent=

张建博,男,助理研究员,主要研究方向为具身智能大小脑协作、SLAM导航。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870548059041, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=2, ext=[AuthorCompanyExt(id=1322960870560641954, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China), AuthorCompanyExt(id=1322960870573224867, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 上海交通大学信息与电子工程学院,上海 200240)])]), Author(id=1322960875098878909, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=xiaojiahao@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960876810154944, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960875098878909, language=EN, stringName=Jiahao Xiao, firstName=Jiahao, middleName=null, lastName=Xiao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960876902429633, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960875098878909, language=CN, stringName=肖嘉豪, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 上海人工智能实验室评测专项组,上海;200032
2 上海交通大学信息与电子工程学院,上海 200240, bio={"content":"

肖嘉豪,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

"}, bioImg=null, bioContent=

肖嘉豪,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870548059041, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=2, ext=[AuthorCompanyExt(id=1322960870560641954, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China), AuthorCompanyExt(id=1322960870573224867, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 上海交通大学信息与电子工程学院,上海 200240)])]), Author(id=1322960877040841667, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=yanbowen@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960877208613830, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877040841667, language=EN, stringName=Bowen Yan, firstName=Bowen, middleName=null, lastName=Yan, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 3, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
3 Institute of Data and Information,Tsinghua Shenzhen International Graduate School,Shenzhen 518055,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960877485437895, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877040841667, language=CN, stringName=闫博闻, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 3, address=1 上海人工智能实验室评测专项组,上海;200032
3 清华大学深圳国际研究生院数据与信息研究院,深圳 518055, bio={"content":"

闫博闻,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

"}, bioImg=null, bioContent=

闫博闻,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870644528036, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=3, ext=[AuthorCompanyExt(id=1322960870652916645, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870644528036, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 Institute of Data and Information,Tsinghua Shenzhen International Graduate School,Shenzhen 518055,China), AuthorCompanyExt(id=1322960870661305254, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870644528036, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 清华大学深圳国际研究生院数据与信息研究院,深圳 518055)])]), Author(id=1322960877632238537, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=guoshengyu@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960877758067660, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877632238537, language=EN, stringName=Shengyu Guo, firstName=Shengyu, middleName=null, lastName=Guo, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 4, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
4 Yuanpei College,Peking University,Beijing 100871,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960877825176525, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877632238537, language=CN, stringName=郭晟毓, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 4, address=1 上海人工智能实验室评测专项组,上海;200032
4 北京大学元培学院,北京 100871, bio={"content":"

郭晟毓,男,硕士研究生,主要研究方向为具身智能与世界模型。E-mail:

"}, bioImg=null, bioContent=

郭晟毓,男,硕士研究生,主要研究方向为具身智能与世界模型。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960872326443943, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=4, ext=[AuthorCompanyExt(id=1322960872339026856, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872326443943, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4 Yuanpei College,Peking University,Beijing 100871,China), AuthorCompanyExt(id=1322960872355804073, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872326443943, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4 北京大学元培学院,北京 100871)])]), Author(id=1322960877900673999, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=yetongrui@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960877988754386, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877900673999, language=EN, stringName=Tongrui Ye, firstName=Tongrui, middleName=null, lastName=Ye, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 5, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
5 Department of Psychology,Tongji University,Shanghai 200292,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960878072640467, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877900673999, language=CN, stringName=叶桐瑞, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 5, address=1 上海人工智能实验室评测专项组,上海;200032
5 同济大学应用心理学系,上海 200292, bio={"content":"

叶桐瑞,男,硕士研究生,主要研究方向为具身智能心理学评测。E-mail:

"}, bioImg=null, bioContent=

叶桐瑞,男,硕士研究生,主要研究方向为具身智能心理学评测。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960872620045226, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=5, ext=[AuthorCompanyExt(id=1322960872632628139, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872620045226, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5 Department of Psychology,Tongji University,Shanghai 200292,China), AuthorCompanyExt(id=1322960872649405356, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872620045226, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5 同济大学应用心理学系,上海 200292)])]), Author(id=1322960878156526549, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=6, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=wslin@ntu.edu.sg, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960878232024023, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960878156526549, language=EN, stringName=Weisi Lin, firstName=Weisi, middleName=null, lastName=Lin, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=6, address=6 College of Computing and Data Science,Nanyang Technological University,Singapore 639798,Singapore, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960878299132888, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960878156526549, language=CN, stringName=林维斯, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=6, address=6 南洋理工大学计算机与数据科学学院,新加坡 639798,新加坡, bio={"content":"

林维斯,男,教授,主要研究方向为图像处理、感知建模、多媒体信号处理和计算机视觉。E-mail:

"}, bioImg=null, bioContent=

林维斯,男,教授,主要研究方向为图像处理、感知建模、多媒体信号处理和计算机视觉。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960872750068653, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=6, ext=[AuthorCompanyExt(id=1322960872758457262, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872750068653, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=6 College of Computing and Data Science,Nanyang Technological University,Singapore 639798,Singapore), AuthorCompanyExt(id=1322960872766845871, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872750068653, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=6 南洋理工大学计算机与数据科学学院,新加坡 639798,新加坡)])]), Author(id=1322960878370436058, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=7, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=zhaiguangtao@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1322960878462710749, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960878370436058, language=EN, stringName=Guangtao Zhai, firstName=Guangtao, middleName=null, lastName=Zhai, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, *, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960878525625310, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960878370436058, language=CN, stringName=翟广涛, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, *, address=1 上海人工智能实验室评测专项组,上海;200032
2 上海交通大学信息与电子工程学院,上海 200240, bio={"content":"

翟广涛,通信作者,男,教授,主要研究方向为图像处理、感知建模、大模型与具身智能评测。E-mail:

"}, bioImg=null, bioContent=

翟广涛,通信作者,男,教授,主要研究方向为图像处理、感知建模、大模型与具身智能评测。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870548059041, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=2, ext=[AuthorCompanyExt(id=1322960870560641954, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China), AuthorCompanyExt(id=1322960870573224867, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 上海交通大学信息与电子工程学院,上海 200240)])])], keywords=[Keyword(id=1322960878617899999, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, orderNo=1, keyword=embodied intelligence), Keyword(id=1322960878680814560, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, orderNo=2, keyword=benchmark evaluation), Keyword(id=1322960878739534817, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, orderNo=3, keyword=perception-cognition-decision-execution), Keyword(id=1322960878810837986, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, orderNo=4, keyword=simulation), Keyword(id=1322960878877946851, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, orderNo=5, keyword=real-world validation), Keyword(id=1322960878957638628, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, orderNo=6, keyword=sim2real consistency), Keyword(id=1322960879028941797, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, orderNo=1, keyword=具身智能), Keyword(id=1322960879083467750, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, orderNo=2, keyword=评测体系), Keyword(id=1322960879175742439, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, orderNo=3, keyword=感知—认知—决策—执行), Keyword(id=1322960879255434216, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, orderNo=4, keyword=仿真平台), Keyword(id=1322960879335125993, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, orderNo=5, keyword=真机测试), Keyword(id=1322960879414817770, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, orderNo=6, keyword=仿真—现实一致性)], refs=[Reference(id=1322960883089027074, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2503.20020.pdf, language=null, rfNumber=null, rfOrder=0, authorNames=Abeyruwan S, Ainslie J, Alayrac J B, Arenas M G, Armstrong T, Balakrishna A, journalName=null, refType=null, unstructuredReference=Abeyruwan S,Ainslie J,Alayrac J B,Arenas M G,Armstrong T,Balakrishna A,et al. 2025. Gemini robotics: bringing AI into the physical world [EB/OL]. [2025-11-05]., articleTitle=Gemini robotics: bringing AI into the physical world, refAbstract=null), Reference(id=1322960883156135939, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=1, issue=1, pageStart=null, pageEnd=100008, url=null, language=null, rfNumber=null, rfOrder=1, authorNames=An Z L, Yu X Q, Wang C, Zhang J L, Li Y, Song C H, journalName=The Innovation Informatics, refType=null, unstructuredReference=An Z L,Yu X Q,Wang C,Zhang J L,Li Y and Song C H. 2025. Embodied intelligence: recent advances and future perspectives. The Innovation Informatics,1(1): #100008 [DOI: 10.59717/j.xinn-inform.2025.100008], articleTitle=Embodied intelligence: recent advances and future perspectives, refAbstract=null), Reference(id=1322960883223244804, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2003, volume=149, issue=1, pageStart=91, pageEnd=130, url=null, language=null, rfNumber=null, rfOrder=2, authorNames=Anderson M L, journalName=Artificial Intelligence, refType=null, unstructuredReference=Anderson M L. 2003. Embodied cognition: a field guide. Artificial Intelligence,149(1): 91-130 [DOI: 10.1016/S0004-3702(03)00054-7], articleTitle=Embodied cognition: a field guide, refAbstract=null), Reference(id=1322960883281965061, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2022, volume=null, issue=null, pageStart=19107, pageEnd=19117, url=null, language=null, rfNumber=null, rfOrder=3, authorNames=Azuma D, Miyanishi T, Kurita S, Kawanabe M, journalName=null, refType=null, unstructuredReference=Azuma D,Miyanishi T,Kurita S and Kawanabe M. 2022. Scan Q A: 3D question answering for spatial scene understanding//Proceedings of 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Orleans,USA: IEEE: 19107-19117, articleTitle=Scan Q A: 3D question answering for spatial scene understanding, refAbstract=null), Reference(id=1322960883349073926, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2503.15558.pdf, language=null, rfNumber=null, rfOrder=4, authorNames=Azzolini A, Bai J J, Brandon H, Cao J X, Chattopadhyay P, Chen H Y, journalName=null, refType=null, unstructuredReference=Azzolini A,Bai J J,Brandon H,Cao J X,Chattopadhyay P,Chen H Y,et al. 2025. Cosmos-Reason1: from physical common sense to embodied reasoning [EB/OL]. [2025-11-05]., articleTitle=Cosmos-Reason1: from physical common sense to embodied reasoning, refAbstract=null), Reference(id=1322960883424571399, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=11288, pageEnd=11309, url=null, language=null, rfNumber=null, rfOrder=5, authorNames=Ballout M, Wilfred O, Yaghoubi S, Abdelmoneim N M, Mayer J, Bruni E, journalName=Findings of the Association for Computational Linguistics: EMNLP 2025, refType=null, unstructuredReference=Ballout M,Wilfred O,Yaghoubi S,Abdelmoneim N M,Mayer J and Bruni E. 2025. Can you SPLICE it together? A human curated benchmark for probing visual reasoning in VLMs//Findings of the Association for Computational Linguistics: EMNLP 2025. Suzhou,China: Association for Computational Linguistics: 11288-11309 [DOI: 10.18653/v1/2025.findings-emnlp.604], articleTitle=Can you SPLICE it together? A human curated benchmark for probing visual reasoning in VLMs, refAbstract=null), Reference(id=1322960883504263176, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=6, authorNames=Belkhale S, Ding T L, Xiao T, Sermanet P, Vuong Q, Tompson J, journalName=Robotics: Science and Systems XX, refType=null, unstructuredReference=Belkhale S,Ding T L,Xiao T,Sermanet P,Vuong Q,Tompson J,et al. 2024. RT-H: action hierarchies using language//Robotics: Science and Systems XX. Delft,the Netherlands: [s.n.], articleTitle=RT-H: action hierarchies using language, refAbstract=null), Reference(id=1322960883579760649, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=7, authorNames=Brohan A, Brown N, Carbajal J, Chebotar Y, Dabis J, Finn C, journalName=Robotics: Science and Systems XIX, refType=null, unstructuredReference=Brohan A,Brown N,Carbajal J,Chebotar Y,Dabis J,Finn C,et al. 2023. RT-1: robotics transformer for real-world control at scale//Robotics: Science and Systems XIX. Daegu,Korea(South): [s.n.], articleTitle=RT-1: robotics transformer for real-world control at scale, refAbstract=null), Reference(id=1322960883672035338, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2509.17321.pdf, language=null, rfNumber=null, rfOrder=8, authorNames=Budzianowski P, Wiśnios E, Tyrolski M, Góral G, Kulakov I, Petrenko V, journalName=null, refType=null, unstructuredReference=Budzianowski P,Wiśnios E,Tyrolski M,Góral G,Kulakov I,Petrenko V,et al. 2025. OpenGVL-benchmarking visual temporal progress for data curation [EB/OL]. [2025-11-05]., articleTitle=OpenGVL-benchmarking visual temporal progress for data curation, refAbstract=null), Reference(id=1322960883751727115, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2509.22737.pdf, language=null, rfNumber=null, rfOrder=9, authorNames=Cai J, Yang K N, Fu L, Ding J M, Li J L, Sun H M, journalName=null, refType=null, unstructuredReference=Cai J,Yang K N,Fu L,Ding J M,Li J L,Sun H M,et al. 2025. CompareBench: a benchmark for visual comparison reasoning in vision-language models [EB/OL]. [2025-11-05]., articleTitle=CompareBench: a benchmark for visual comparison reasoning in vision-language models, refAbstract=null), Reference(id=1322960883814641676, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2017, volume=null, issue=null, pageStart=667, pageEnd=676, url=null, language=null, rfNumber=null, rfOrder=10, authorNames=Chang A, Dai A, Funkhouser T, Halber M, Niessner M, Savva M, journalName=null, refType=null, unstructuredReference=Chang A,Dai A,Funkhouser T,Halber M,Niessner M,Savva M,et al. 2017. Matterport3D: learning from RGB-D data in indoor environments//Proceedings of 2017 International Conference on 3D Vision (3DV). Qingdao,China: IEEE: 667-676 [DOI: 10.1109/3DV.2017.00081], articleTitle=Matterport3D: learning from RGB-D data in indoor environments, refAbstract=null), Reference(id=1322960883881750541, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2020, volume=null, issue=null, pageStart=202, pageEnd=221, url=null, language=null, rfNumber=null, rfOrder=11, authorNames=Chen D Z, Chang A X, Nießner M, journalName=null, refType=null, unstructuredReference=Chen D Z,Chang A X and Nießner M. 2020. ScanRefer: 3D object localization in RGB-D scans using natural language//Proceedings of the 16th European Conference on Computer Vision — ECCV 2020. Glasgow,UK: Springer: 202-221 [DOI: 10.1007/978-3-030-58565-5_13], articleTitle=ScanRefer: 3D object localization in RGB-D scans using natural language, refAbstract=null), Reference(id=1322960883948859406, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2021, volume=null, issue=null, pageStart=3192, pageEnd=3202, url=null, language=null, rfNumber=null, rfOrder=12, authorNames=Chen D Z, Gholami A, Nießner M and Chang A X, journalName=null, refType=null, unstructuredReference=Chen D Z,Gholami A,Nießner M and Chang A X. 2021. Scan2Cap: context-aware dense captioning in RGB-D scans//Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Nashville,USA: IEEE: 3192-3202 [DOI: 10.1109/CVPR46437.2021.00321], articleTitle=Scan2Cap: context-aware dense captioning in RGB-D scans, refAbstract=null), Reference(id=1322960884020162575, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025a, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2509.25885.pdf, language=null, rfNumber=null, rfOrder=13, authorNames=Chen R L, Sun Y Q, Wang J H, Lyu M Y, Zhang Q, Zeng Y, journalName=null, refType=null, unstructuredReference=Chen R L,Sun Y Q,Wang J H,Lyu M Y,Zhang Q and Zeng Y. 2025a. SafeMind: benchmarking and mitigating safety risks in embodied LLM agents [EB/OL]. [2025-11-05]., articleTitle=SafeMind: benchmarking and mitigating safety risks in embodied LLM agents, refAbstract=null), Reference(id=1322960884091465744, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025b, volume=0, issue=null, pageStart=2, pageEnd=null, url=https://arxiv.org/pdf/2506.18088.pdf, language=null, rfNumber=null, rfOrder=14, authorNames=Chen T X, Chen Z X, Chen B J, Cai Z J, Liu Y B, Li Z X, journalName=null, refType=null, unstructuredReference=Chen T X,Chen Z X,Chen B J,Cai Z J,Liu Y B,Li Z X,et al. 2025b. RoboTwin 2.0: a scalable data generator and benchmark with strong domain randomization for robust bimanual robotic manipulation [EB/OL]. [2025-11-05]., articleTitle=RoboTwin, refAbstract=null), Reference(id=1322960885676912657, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025c, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2505.20148.pdf, language=null, rfNumber=null, rfOrder=15, authorNames=Chen Z, Gholami A, Nießner M and Chang A X, journalName=null, refType=null, unstructuredReference=Chen Z,Gholami A,Nießner M and Chang A X. 2025c. MineAnyBuild: benchmarking spatial planning for open-world ai agents[EB/OL].[2025-11-05]., articleTitle=MineAnyBuild: benchmarking spatial planning for open-world ai agents, refAbstract=null), Reference(id=1322960885769187346, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2508.08706.pdf, language=null, rfNumber=null, rfOrder=16, authorNames=Cheng Z X, Zhang Y Q, Zhang W K, Li H Y, Wang K Y, Song L, journalName=null, refType=null, unstructuredReference=Cheng Z X,Zhang Y Q,Zhang W K,Li H Y,Wang K Y,Song L,et al. 2025. OmniVTLA: vision-tactile-language-action model with semantic-aligned tactile sensing [EB/OL]. [2025-11-05]., articleTitle=OmniVTLA: vision-tactile-language-action model with semantic-aligned tactile sensing, refAbstract=null), Reference(id=1322960885848879123, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2409.14277.pdf, language=null, rfNumber=null, rfOrder=17, authorNames=Chia Y K, Sun Q, Bing L D, Poria S, journalName=null, refType=null, unstructuredReference=Chia Y K,Sun Q,Bing L D and Poria S. 2024. Can-Do! A dataset and neuro-symbolic grounded framework for embodied planning with large multimodal models [EB/OL]. [2025-11-05]., articleTitle=Can-Do! A dataset and neuro-symbolic grounded framework for embodied planning with large multimodal models, refAbstract=null), Reference(id=1322960885903405076, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2505.03233.pdf, language=null, rfNumber=null, rfOrder=18, authorNames=Deng S L, Yan M, Wei S L, Ma H X, Yang Y X, Chen J Y, journalName=null, refType=null, unstructuredReference=Deng S L,Yan M,Wei S L,Ma H X,Yang Y X,Chen J Y,et al. 2025. GraspVLA: a grasping foundation model pre-trained on billion-scale synthetic action data [EB/OL]. [2025-11-05]., articleTitle=GraspVLA: a grasping foundation model pre-trained on billion-scale synthetic action data, refAbstract=null), Reference(id=1322960885966319637, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=7147, pageEnd=7153, url=null, language=null, rfNumber=null, rfOrder=19, authorNames=Du Y W, Feng S Y, Cort C G, Vela P A, journalName=null, refType=null, unstructuredReference=Du Y W,Feng S Y,Cort C G and Vela P A. 2025. Task-driven SLAM benchmarking for robot navigation//Proceedings of 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Hangzhou,China: IEEE: 7147-7153 [DOI: 10.1109/IROS60139.2025.11246415], articleTitle=Task-driven SLAM benchmarking for robot navigation, refAbstract=null), Reference(id=1322960886033428502, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2022, volume=6, issue=2, pageStart=230, pageEnd=244, url=null, language=null, rfNumber=null, rfOrder=20, authorNames=Duan J F, Yu S, Tan H L, Zhu H Y, Tan C, journalName=IEEE Transactions on Emerging Topics in Computational Intelligence, refType=null, unstructuredReference=Duan J F,Yu S,Tan H L,Zhu H Y and Tan C. 2022. A survey of embodied AI: from simulators to research tasks. IEEE Transactions on Emerging Topics in Computational Intelligence,6(2): 230-244 [DOI: 10.1109/TETCI.2022.3141105], articleTitle=A survey of embodied AI: from simulators to research tasks, refAbstract=null), Reference(id=1322960886092148759, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=653, pageEnd=660, url=null, language=null, rfNumber=null, rfOrder=21, authorNames=Fang H S, Fang H J, Tang Z Y, Liu J R, Wang C X, Wang J B, journalName=null, refType=null, unstructuredReference=Fang H S,Fang H J,Tang Z Y,Liu J R,Wang C X,Wang J B,et al. 2024. RH20T: a comprehensive robotic dataset for learning diverse skills in one-shot//Proceedings of 2024 IEEE International Conference on Robotics and Automation (ICRA). Yokohama,Japan: IEEE: 653-660 [DOI: 10.1109/ICRA57147.2024.10611615], articleTitle=RH20T: a comprehensive robotic dataset for learning diverse skills in one-shot, refAbstract=null), Reference(id=1322960886159257624, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://action-net.org/, language=null, rfNumber=null, rfOrder=22, authorNames=Fourier ActionNet Team and Mu Y, journalName=null, refType=null, unstructuredReference=Fourier ActionNet Team and Mu Y. 2025. ActionNet: a dataset for dexterous bimanual manipulation [EB/OL]. [2025-11-05]., articleTitle=ActionNet: a dataset for dexterous bimanual manipulation, refAbstract=null), Reference(id=1322960886217977881, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2509.23690.pdf, language=null, rfNumber=null, rfOrder=23, authorNames=Gao S Y, Yao J S, Wen H Y, Guo Y H, Liu Z M, Huang H Y, journalName=null, refType=null, unstructuredReference=Gao S Y,Yao J S,Wen H Y,Guo Y H,Liu Z M and Huang H Y. 2025. HomeSafeBench: a benchmark for embodied vision-language models in free-exploration home safety inspection[EB/OL]. [2025-11-05]., articleTitle=HomeSafeBench: a benchmark for embodied vision-language models in free-exploration home safety inspection, refAbstract=null), Reference(id=1322960886285086746, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2012, volume=null, issue=null, pageStart=3354, pageEnd=3361, url=null, language=null, rfNumber=null, rfOrder=24, authorNames=Geiger A, Lenz P, Urtasun R, journalName=null, refType=null, unstructuredReference=Geiger A,Lenz P and Urtasun R. 2012. Are we ready for autonomous driving? The KITTI vision benchmark suite//Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence,USA: IEEE: 3354-3361 [DOI: 10.1109/CVPR.2012.6248074], articleTitle=Are we ready for autonomous driving? The KITTI vision benchmark suite, refAbstract=null), Reference(id=1322960886348001307, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2504.18904.pdf, language=null, rfNumber=null, rfOrder=25, authorNames=Geng H R, Wang F S, Wei S L, Li Y Y, Wang B J, An B S, journalName=null, refType=null, unstructuredReference=Geng H R,Wang F S,Wei S L,Li Y Y,Wang B J,An B S,et al. 2025. RoboVerse: towards a unified platform,dataset and benchmark for scalable and generalizable robot learning [EB/OL]. [2025-11-05]., articleTitle=RoboVerse: towards a unified platform,dataset and benchmark for scalable and generalizable robot learning, refAbstract=null), Reference(id=1322960886406721564, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2510.07869.pdf, language=null, rfNumber=null, rfOrder=26, authorNames=Gu J W, Wu Z H, Si P X, Qiu S, Feng Y K, Sun L Y, journalName=null, refType=null, unstructuredReference=Gu J W,Wu Z H,Si P X,Qiu S,Feng Y K,Sun L Y,et al. 2025. USIM and U0: a vision-language-action dataset and model for general underwater robots [EB/OL]. [2025-11-05]., articleTitle=USIM and U0: a vision-language-action dataset and model for general underwater robots, refAbstract=null), Reference(id=1322960886469636125, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=27, authorNames=Gu J Y, Kirmani S, Wohlhart P, Lu Y, Gonzalez Arenas M, Rao K, journalName=null, refType=null, unstructuredReference=Gu J Y,Kirmani S,Wohlhart P,Lu Y,Gonzalez Arenas M,Rao K,et al. 2024. RT-Trajectory: robotic task generalization via hindsight trajectory sketches//Proceedings of the 12th International Conference on Learning Representations. Vienna,Austria: OpenReview.net, articleTitle=RT-Trajectory: robotic task generalization via hindsight trajectory sketches, refAbstract=null), Reference(id=1322960886532550686, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=null, pageStart=2, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=28, authorNames=Gu J Y, Xiang F B, Li X L, Ling Z, Liu X Q, Mu T Z, journalName=ManiSkill, refType=null, unstructuredReference=Gu J Y,Xiang F B,Li X L,Ling Z,Liu X Q,Mu T Z,et al. 2023. ManiSkill2: a unified benchmark for generalizable manipulation skills//Proceedings of the 11th International Conference on Learning Representations. Kigali,Rwanda: OpenReview.net, articleTitle=a unified benchmark for generalizable manipulation skills, refAbstract=null), Reference(id=1322960886595465247, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2505.18229.pdf, language=null, rfNumber=null, rfOrder=29, authorNames=Guo M N, Wu M W, He J R, Li S X, Li H F, Tao C, journalName=null, refType=null, unstructuredReference=Guo M N,Wu M W,He J R,Li S X,Li H F and Tao C. 2025. BEDI: a comprehensive benchmark for evaluating embodied agents on UAVs[EB/OL]. [2025-11-05]., articleTitle=BEDI: a comprehensive benchmark for evaluating embodied agents on UAVs, refAbstract=null), Reference(id=1322960886654185504, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2506.06677.pdf, language=null, rfNumber=null, rfOrder=30, authorNames=Han S H, Qiu B X, Liao Y, Huang S Y, Gao C, Yan S C, journalName=null, refType=null, unstructuredReference=Han S H,Qiu B X,Liao Y,Huang S Y,Gao C,Yan S C,et al. 2025. RoboCerebra: a large-scale benchmark for long-horizon robotic manipulation evaluation [EB/OL]. [2025-11-05]., articleTitle=RoboCerebra: a large-scale benchmark for long-horizon robotic manipulation evaluation, refAbstract=null), Reference(id=1322960886712905761, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2504.14650.pdf, language=null, rfNumber=null, rfOrder=31, authorNames=Huang Y T, Ding L L, Tang Z P, Wang T F, Lin X R, Zhang W Y, journalName=null, refType=null, unstructuredReference=Huang Y T,Ding L L,Tang Z P,Wang T F,Lin X R,Zhang W Y,et al. 2025. A framework for benchmarking and aligning task-planning safety in LLM-based embodied agents [EB/OL]. [2025-11-05]., articleTitle=A framework for benchmarking and aligning task-planning safety in LLM-based embodied agents, refAbstract=null), Reference(id=1322960886780014626, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://internrobotics.shlab.org.cn/opendataset.html, language=null, rfNumber=null, rfOrder=32, authorNames=Intern Robotics Team, journalName=null, refType=null, unstructuredReference=Intern Robotics Team. 2025. InternData: a large-scale multimodal synthetic and real hybrid dataset for embodied intelligence[EB/OL]. [2025-11-05]., articleTitle=InternData: a large-scale multimodal synthetic and real hybrid dataset for embodied intelligence, refAbstract=null), Reference(id=1322960886842929187, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2020, volume=5, issue=2, pageStart=3019, pageEnd=3026, url=null, language=null, rfNumber=null, rfOrder=33, authorNames=James S, Ma Z C, Arrojo D R, Davison A J, journalName=IEEE Robotics and Automation Letters, refType=null, unstructuredReference=James S,Ma Z C,Arrojo D R and Davison A J. 2020. RLBench: the robot learning benchmark and learning environment. IEEE Robotics and Automation Letters,5(2): 3019-3026, articleTitle=RLBench: the robot learning benchmark and learning environment, refAbstract=null), Reference(id=1322960886914232356, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2503.11117.pdf, language=null, rfNumber=null, rfOrder=34, authorNames=Jiang K X, Liu Y, Chen W X, Luo J Z, Chen Z L, Pan L, journalName=null, refType=null, unstructuredReference=Jiang K X,Liu Y,Chen W X,Luo J Z,Chen Z L,Pan L,et al. 2025. Beyond the destination: a novel benchmark for exploration-aware embodied question answering [EB/OL]. [2025-11-05]., articleTitle=Beyond the destination: a novel benchmark for exploration-aware embodied question answering, refAbstract=null), Reference(id=1322960886981341221, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=1996, volume=4, issue=1, pageStart=237, pageEnd=285, url=null, language=null, rfNumber=null, rfOrder=35, authorNames=Kaelbling L P, Littman M L, Moore A W, journalName=Journal of Artificial Intelligence Research, refType=null, unstructuredReference=Kaelbling L P,Littman M L and Moore A W. 1996. Reinforcement learning: a survey. Journal of Artificial Intelligence Research,4(1): 237-285, articleTitle=Reinforcement learning: a survey, refAbstract=null), Reference(id=1322960887044255782, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=null, pageStart=11257, pageEnd=11264, url=null, language=null, rfNumber=null, rfOrder=36, authorNames=Kästner L, Carstens R, Zeng H J, Kmiecik J, Bhuiyan T, Khorsandhi N, journalName=null, refType=null, unstructuredReference=Kästner L,Carstens R,Zeng H J,Kmiecik J,Bhuiyan T,Khorsandhi N,et al. 2023. Arena-Rosnav 2.0: a development and benchmarking platform for robot navigation in highly dynamic environments//Proceedings of 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Detroit,USA: IEEE: 11257-11264 [DOI: 10.1109/IROS55552.2023.10342152], articleTitle=Arena-Rosnav 2.0: a development and benchmarking platform for robot navigation in highly dynamic environments, refAbstract=null), Reference(id=1322960887107170343, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=16373, pageEnd=16383, url=null, language=null, rfNumber=null, rfOrder=37, authorNames=Khanna M, Ramrakhya R, Chhablani G, Yenamandra S, Gervet T, Chang M, journalName=null, refType=null, unstructuredReference=Khanna M,Ramrakhya R,Chhablani G,Yenamandra S,Gervet T,Chang M,et al. 2024. GOAT-Bench: a benchmark for multi-modal lifelong navigation//Proceedings of 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle,USA: IEEE: 16373-16383 [DOI: 10.1109/CVPR52733.2024.01549], articleTitle=GOAT-Bench: a benchmark for multi-modal lifelong navigation, refAbstract=null), Reference(id=1322960887182667816, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=38, authorNames=Khazatsky A, Pertsch K, Nair S, Balakrishna A, Dasari S, Karamcheti S, journalName=Robotics: Science and Systems XX, refType=null, unstructuredReference=Khazatsky A,Pertsch K,Nair S,Balakrishna A,Dasari S,Karamcheti S,et al. 2024. DROID: a large-scale in-the-wild robot manipulation dataset//Robotics: Science and Systems XX. Delft,the Netherlands: [s.n.], articleTitle=DROID: a large-scale in-the-wild robot manipulation dataset, refAbstract=null), Reference(id=1322960887262359593, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2017, volume=40, issue=null, pageStart=null, pageEnd=253, url=null, language=null, rfNumber=null, rfOrder=39, authorNames=Lake B M, Ullman T D, Tenenbaum J B, Gershman S J, journalName=Behavioral and Brain Sciences, refType=null, unstructuredReference=Lake B M,Ullman T D,Tenenbaum J B and Gershman S J. 2017. Building machines that learn and think like people. Behavioral and Brain Sciences,40: #253 [DOI: 10.1017/S0140525X16001837], articleTitle=Building machines that learn and think like people, refAbstract=null), Reference(id=1322960887329468458, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2015, volume=521, issue=7553, pageStart=436, pageEnd=444, url=null, language=null, rfNumber=null, rfOrder=40, authorNames=LeCun Y, Bengio Y, Hinton G, journalName=Nature, refType=null, unstructuredReference=LeCun Y,Bengio Y and Hinton G. 2015. Deep learning. Nature,521(7553): 436-444 [DOI: 10.1038/nature14539], articleTitle=Deep learning, refAbstract=null), Reference(id=1322960887413354539, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=5912, pageEnd=5922, url=null, language=null, rfNumber=null, rfOrder=41, authorNames=Lee J, Miyanishi T, Kurita S, Sakamoto K, Azuma D, Matsuo Y, journalName=CityNav: a large-scale dataset for real-world aerial navigation/, refType=null, unstructuredReference=Lee J,Miyanishi T,Kurita S,Sakamoto K,Azuma D,Matsuo Y,et al. 2025. CityNav: a large-scale dataset for real-world aerial navigation//Proceedings of 2025 IEEE/CVF International Conference on Computer Vision. 5912-5922, articleTitle=2025, refAbstract=null), Reference(id=1322960887480463404, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025a, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2505.16815.pdf, language=null, rfNumber=null, rfOrder=42, authorNames=Li C Y, Xiao J H, Zhang J B, Wen F R, Zhang Z C, Tian Y, journalName=null, refType=null, unstructuredReference=Li C Y,Xiao J H,Zhang J B,Wen F R,Zhang Z C,Tian Y,et al. 2025a. Image quality assessment for embodied AI [EB/OL]. [2025-11-05]., articleTitle=Image quality assessment for embodied AI, refAbstract=null), Reference(id=1322960887564349485, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025b, volume=19, issue=7, pageStart=1349, pageEnd=1361, url=null, language=null, rfNumber=null, rfOrder=43, authorNames=Li C Y, Zhang J B, Zhang Z C, Wu H N, Tian Y, Sun W, journalName=IEEE Journal of Selected Topics in Signal Processing, refType=null, unstructuredReference=Li C Y,Zhang J B,Zhang Z C,Wu H N,Tian Y,Sun W,et al. 2025b. R-Bench: are your large multimodal model robust to real-world corruptions? IEEE Journal of Selected Topics in Signal Processing,19(7): 1349-1361 [DOI: 10.1109/JSTSP.2025.3558652], articleTitle=R-Bench: are your large multimodal model robust to real-world corruptions?, refAbstract=null), Reference(id=1322960887648235566, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025c, volume=null, issue=null, pageStart=3705, pageEnd=3728, url=null, language=null, rfNumber=null, rfOrder=44, authorNames=Li X, Hsu K, Gu J, Pertsch K, Mees O, Walke H R, journalName=null, refType=null, unstructuredReference=Li X,Hsu K,Gu J,Pertsch K,Mees O,Walke H R,et al. 2025c. Evaluating real-world robot manipulation policies in simulation//Proceedings of the 8th Conference on Robot Learning. Munich,Germany: PMLR: 3705-3728, articleTitle=Evaluating real-world robot manipulation policies in simulation, refAbstract=null), Reference(id=1322960887723733039, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2508.10399.pdf, language=null, rfNumber=null, rfOrder=45, authorNames=Liang W L, Zhou R, Ma Y, Zhang B, Li S L, Liao Y J, journalName=null, refType=null, unstructuredReference=Liang W L,Zhou R,Ma Y,Zhang B,Li S L,Liao Y J,et al. 2025. Large model empowered embodied AI: a survey on decision-making and embodied learning [EB/OL]. [2025-11-05]., articleTitle=Large model empowered embodied AI: a survey on decision-making and embodied learning, refAbstract=null), Reference(id=1322960887795036208, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=null, pageStart=#1939, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=46, authorNames=Liu B, Zhu Y F, Gao C K, Feng Y H, Liu Q, Zhu Y K, journalName=null, refType=null, unstructuredReference=Liu B,Zhu Y F,Gao C K,Feng Y H,Liu Q,Zhu Y K,et al. 2023. LIBERO: benchmarking knowledge transfer for lifelong robot learning//Proceedings of the 37th International Conference on Neural Information Processing Systems. New Orleans,USA: Curran Associates Inc.: #1939, articleTitle=LIBERO: benchmarking knowledge transfer for lifelong robot learning, refAbstract=null), Reference(id=1322960887862145073, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025a, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2509.22356.pdf, language=null, rfNumber=null, rfOrder=47, authorNames=Liu E G, Liang S Y, Lu L M, Zeng X Y, Cao X C, Liu A S, journalName=null, refType=null, unstructuredReference=Liu E G,Liang S Y,Lu L M,Zeng X Y,Cao X C,Liu A S,et al. 2025a. RoboView-Bias: benchmarking visual bias in embodied agents for robotic manipulation [EB/OL]. [2025-11-05]., articleTitle=RoboView-Bias: benchmarking visual bias in embodied agents for robotic manipulation, refAbstract=null), Reference(id=1322960887937642546, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025b, volume=null, issue=null, pageStart=10607, pageEnd=10615, url=null, language=null, rfNumber=null, rfOrder=48, authorNames=Liu H R, Wan W K, Yu X Q, Li M H, Zhang J Z, Zhao B, journalName=null, refType=null, unstructuredReference=Liu H R,Wan W K,Yu X Q,Li M H,Zhang J Z,Zhao B,et al. 2025b. Na Vid-4D: unleashing spatial intelligence in egocentric RGB-D videos for vision-and-language navigation//Proceedings of 2025 IEEE International Conference on Robotics and Automation. Atlanta,USA: IEEE: 10607-10615 [DOI: 10.1109/ICRA55743.2025.11128467], articleTitle=Na Vid-4D: unleashing spatial intelligence in egocentric RGB-D videos for vision-and-language navigation, refAbstract=null), Reference(id=1322960888013140019, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025c, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2510.00405.pdf, language=null, rfNumber=null, rfOrder=49, authorNames=Liu J Y, Zhou J M, Ye K, Lin K Y, Wang A, Liang J W, journalName=null, refType=null, unstructuredReference=Liu J Y,Zhou J M,Ye K,Lin K Y,Wang A and Liang J W. 2025c. EgoTraj-Bench: towards robust trajectory prediction under ego-view noisy observations [EB/OL]. [2025-11-05]., articleTitle=EgoTraj-Bench: towards robust trajectory prediction under ego-view noisy observations, refAbstract=null), Reference(id=1322960888084443188, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2506.16402.pdf, language=null, rfNumber=null, rfOrder=50, authorNames=Lu X Y, Chen Z, Hu X H, Zhou Y J, Zhang W C, Liu D R, journalName=null, refType=null, unstructuredReference=Lu X Y,Chen Z,Hu X H,Zhou Y J,Zhang W C,Liu D R,et al. 2025. IS-Bench: evaluating interactive safety of VLM-driven embodied agents in daily household tasks [EB/OL]. [2025-11-05]., articleTitle=IS-Bench: evaluating interactive safety of VLM-driven embodied agents in daily household tasks, refAbstract=null), Reference(id=1322960888155746357, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=44, issue=4, pageStart=592, pageEnd=606, url=null, language=null, rfNumber=null, rfOrder=51, authorNames=Luo J L, Xu C, Liu F C, Tan L M, Lin Z P, Wu J, journalName=The International Journal of Robotics Research, refType=null, unstructuredReference=Luo J L,Xu C,Liu F C,Tan L M,Lin Z P,Wu J,et al. 2025. FMB: a functional manipulation benchmark for generalizable robotic learning. The International Journal of Robotics Research,44(4): 592-606 [DOI: 10.1177/02783649241276017], articleTitle=FMB: a functional manipulation benchmark for generalizable robotic learning, refAbstract=null), Reference(id=1322960888222855222, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2506.08708.pdf, language=null, rfNumber=null, rfOrder=52, authorNames=Ma L, Wen J J, Lin M, Xu R T, Liang X W, Lin B Q, journalName=null, refType=null, unstructuredReference=Ma L,Wen J J,Lin M,Xu R T,Liang X W,Lin B Q,et al. 2025. PhyBlock: a progressive benchmark for physical understanding and planning via 3D block assembly [EB/OL]. [2025-11-05]., articleTitle=PhyBlock: a progressive benchmark for physical understanding and planning via 3D block assembly, refAbstract=null), Reference(id=1322960888298352695, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=null, pageStart=3, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=53, authorNames=Ma X J, Yong S L, Zheng Z L, Li Q, Liang Y T, Zhu S C, journalName=SQA, refType=null, unstructuredReference=Ma X J,Yong S L,Zheng Z L,Li Q,Liang Y T,Zhu S C,et al. 2023. SQA3D: situated question answering in 3D scenes//Proceedings of the 11th International Conference on Learning Representations. Kigali,Rwanda: OpenReview.net, articleTitle=: situated question answering in 3D scenes, refAbstract=null), Reference(id=1322960888369655864, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=1289, pageEnd=1313, url=null, language=null, rfNumber=null, rfOrder=54, authorNames=Maji A, Kumar R, Ghosh A, Anushka, Shah N, Borah A, journalName=null, refType=null, unstructuredReference=Maji A,Kumar R,Ghosh A,Anushka,Shah N,Borah A,et al. 2025. DRISHTIKON: a multimodal multilingual benchmark for testing language models’ understanding on Indian culture//Proceedings of 2025 Conference on Empirical Methods in Natural Language Processing. Suzhou,China: Association for Computational Linguistics: 1289-1313 [DOI: 10.18653/v1/2025.emnlp-main.68], articleTitle=DRISHTIKON: a multimodal multilingual benchmark for testing language models’ understanding on Indian culture, refAbstract=null), Reference(id=1322960888445153337, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=16488, pageEnd=16498, url=null, language=null, rfNumber=null, rfOrder=55, authorNames=Majumdar A, Ajay A, Zhang X H, Putta P, Yenamandra S, Henaff M, journalName=null, refType=null, unstructuredReference=Majumdar A,Ajay A,Zhang X H,Putta P,Yenamandra S,Henaff M,et al. 2024. OpenEQA: embodied question answering in the era of foundation models//Proceedings of 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle,USA: IEEE: 16488-16498 [DOI: 10.1109/CVPR52733.2024.01560], articleTitle=OpenEQA: embodied question answering in the era of foundation models, refAbstract=null), Reference(id=1322960888516456506, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2021, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=56, authorNames=Makoviychuk V, Wawrzyniak L, Guo Y R, Lu M, Storey K, Macklin, M, journalName=Curran Associates Inc, refType=null, unstructuredReference=Makoviychuk V,Wawrzyniak L,Guo Y R,Lu M,Storey K,Macklin,M,et al. 2021. Isaac Gym: high performance GPU-based physics simulation for robot learning//Proceedings of the 35th International Conference on Neural Information Processing Systems. [s.l.]: Curran Associates Inc., articleTitle=Isaac Gym: high performance GPU-based physics simulation for robot learning, refAbstract=null), Reference(id=1322960890202566715, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2022, volume=7, issue=3, pageStart=7327, pageEnd=7334, url=null, language=null, rfNumber=null, rfOrder=57, authorNames=Mees O, Hermann L, Rosete-Beas E, Burgard W, journalName=IEEE Robotics and Automation Letters, refType=null, unstructuredReference=Mees O,Hermann L,Rosete-Beas E and Burgard W. 2022. CALVIN: a benchmark for language-conditioned policy learning for long-horizon robot manipulation tasks. IEEE Robotics and Automation Letters,7(3): 7327-7334 [DOI: 10.1109/LRA.2022.3180108], articleTitle=CALVIN: a benchmark for language-conditioned policy learning for long-horizon robot manipulation tasks, refAbstract=null), Reference(id=1322960890286452796, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=17521, pageEnd=17541, url=null, language=null, rfNumber=null, rfOrder=58, authorNames=Men T Y, Jin Z R, Cao P F, Chen Y B, Liu K, Zhao J, journalName=Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), refType=null, unstructuredReference=Men T Y,Jin Z R,Cao P F,Chen Y B,Liu K and Zhao J. 2025. Agent-RewardBench: towards a unified benchmark for reward modeling across perception,planning,and safety in real-world multimodal agents//Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Vienna,Austria: Association for Computational Linguistics: 17521-17541 [DOI: 10.18653/v1/2025.acl-long.857], articleTitle=Agent-RewardBench: towards a unified benchmark for reward modeling across perception,planning,and safety in real-world multimodal agents, refAbstract=null), Reference(id=1322960890370338877, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=1, issue=12, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=59, authorNames=Meng Q F, Zhang Y R, Zhang H W, Hu X Y, Luo Y H, journalName=Journal of Image and Graphics, refType=null, unstructuredReference=Meng Q F,Zhang Y R,Zhang H W,Hu X Y and Luo Y H. 2025. Research on virtual embodied interaction technology for VR physics experiments. Journal of Image and Graphics,1-12, articleTitle=Research on virtual embodied interaction technology for VR physics experiments, refAbstract=null), Reference(id=1322960890437447742, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=1, pageEnd=12, url=null, language=null, rfNumber=null, rfOrder=60, authorNames=孟启帆, 张怡冉, 张鸿文, 胡晓雁, 骆岩红, journalName=中国图象图形学报, refType=null, unstructuredReference=孟启帆,张怡冉,张鸿文,胡晓雁,骆岩红. 2025. 面向VR物理实验的虚拟具身交互技术研究. 中国图象图形学报,1-12 [DOI: 10.11834/jig.250425], articleTitle=面向VR物理实验的虚拟具身交互技术研究, refAbstract=null), Reference(id=1322960890500362303, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2509.21922.pdf, language=null, rfNumber=null, rfOrder=61, authorNames=Mirjalili V, Giahi R, Kollipara S, Kekuda A, Yao K H, Zhao K, journalName=null, refType=null, unstructuredReference=Mirjalili V,Giahi R,Kollipara S,Kekuda A,Yao K H,Zhao K,et al. 2025. Spatial reasoning in foundation models: benchmarking object-centric spatial understanding [EB/OL]. [2025-11-05]., articleTitle=Spatial reasoning in foundation models: benchmarking object-centric spatial understanding, refAbstract=null), Reference(id=1322960890563276864, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2406.02523.pdf, language=null, rfNumber=null, rfOrder=62, authorNames=Nasiriany S, Maddukuri A, Zhang L C, Parikh A, Lo A, Joshi A, journalName=null, refType=null, unstructuredReference=Nasiriany S,Maddukuri A,Zhang L C,Parikh A,Lo A,Joshi A,et al. 2024. RoboCasa: large-scale simulation of everyday tasks for generalist robots [EB/OL]. [2025-11-05]., articleTitle=RoboCasa: large-scale simulation of everyday tasks for generalist robots, refAbstract=null), Reference(id=1322960890638774337, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2509.15273.pdf, language=null, rfNumber=null, rfOrder=63, authorNames=Ni F, Zhang M, Li P Y, Yuan Y F, Zhang L F, Liu Y C, journalName=null, refType=null, unstructuredReference=Ni F,Zhang M,Li P Y,Yuan Y F,Zhang L F,Liu Y C,et al. 2025. Embodied arena: a comprehensive,unified,and evolving evaluation platform for embodied AI [EB/OL]. [2025-11-05]., articleTitle=Embodied arena: a comprehensive,unified,and evolving evaluation platform for embodied AI, refAbstract=null), Reference(id=1322960890714271810, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2404.12916.pdf, language=null, rfNumber=null, rfOrder=64, authorNames=Ni Z Y, Ye R, Wei Y X, Xiang Z, Wang Y F, Chen S H, journalName=null, refType=null, unstructuredReference=Ni Z Y,Ye R,Wei Y X,Xiang Z,Wang Y F and Chen S H. 2024. Physical backdoor attack can jeopardize driving with vision-large-language models [EB/OL]. [2025-11-05]., articleTitle=Physical backdoor attack can jeopardize driving with vision-large-language models, refAbstract=null), Reference(id=1322960890793963587, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2310.08864.pdf, language=null, rfNumber=null, rfOrder=65, authorNames=O’Neill A, Rehman A, Gupta A, Maddukuri A, Gupta A, Padalkar A, journalName=null, refType=null, unstructuredReference=O’Neill A,Rehman A,Gupta A,Maddukuri A,Gupta A,Padalkar A,et al. 2023. Open X-embodiment: robotic learning datasets and RT-X models [EB/OL]. [2025-11-05]., articleTitle=Open X-embodiment: robotic learning datasets and RT-X models, refAbstract=null), Reference(id=1322960890856878148, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=6892, pageEnd=6903, url=null, language=null, rfNumber=null, rfOrder=66, authorNames=O’Neill A, Rehman A, Maddukuri A, Gupta A, Padalkar A, Lee A, journalName=Open X-embodiment: robotic learning datasets and RT-X models: open X-embodiment collaboration0//Proceedings of 2024 IEEE International Conference on Robotics and Automation, refType=null, unstructuredReference=O’Neill A,Rehman A,Maddukuri A,Gupta A,Padalkar A,Lee A,et al. 2024. Open X-embodiment: robotic learning datasets and RT-X models: open X-embodiment collaboration0//Proceedings of 2024 IEEE International Conference on Robotics and Automation. Yokohama,Japan: IEEE: 6892-6903 [DOI: 10.1109/ICRA57147.2024.10611477], articleTitle=null, refAbstract=null), Reference(id=1322960890928181317, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2006, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=67, authorNames=Pfeifer R, Bongard J, journalName=null, refType=null, unstructuredReference=Pfeifer R and Bongard J. 2006. How the Body Shapes the Way We Think: A New View of Intelligence. Cambridge,USA: The MIT Press, articleTitle=How the Body Shapes the Way We Think: A New View of Intelligence. Cambridge,USA: The MIT Press, refAbstract=null), Reference(id=1322960891007873094, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2506.17221.pdf, language=null, rfNumber=null, rfOrder=68, authorNames=Qi Z Y, Zhang Z X, Yu Y Z, Wang J Q, Zhao H S, journalName=null, refType=null, unstructuredReference=Qi Z Y,Zhang Z X,Yu Y Z,Wang J Q and Zhao H S. 2025. VLN-R1: vision-language navigation via reinforcement fine-tuning [EB/OL]. [2025-11-05]., articleTitle=VLN-R1: vision-language navigation via reinforcement fine-tuning, refAbstract=null), Reference(id=1322960891087564871, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=11948, pageEnd=11956, url=null, language=null, rfNumber=null, rfOrder=69, authorNames=Robey A, Ravichandran Z, Kumar V, Hassani H, Pappas G J, journalName=null, refType=null, unstructuredReference=Robey A,Ravichandran Z,Kumar V,Hassani H and Pappas G J. 2025. Jailbreaking LLM-controlled robots//Proceedings of 2025 IEEE International Conference on Robotics and Automation (ICRA). Atlanta,USA: IEEE: 11948-11956 [DOI: 10.1109/ICRA55743.2025.11128119], articleTitle=Jailbreaking LLM-controlled robots, refAbstract=null), Reference(id=1322960891171450952, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=645, pageEnd=652, url=null, language=null, rfNumber=null, rfOrder=70, authorNames=Sermanet P, Ding T L, Zhao J, Xia F, Dwibedi D, Gopalakrishnan K, journalName=null, refType=null, unstructuredReference=Sermanet P,Ding T L,Zhao J,Xia F,Dwibedi D,Gopalakrishnan K,et al. 2024. RoboVQA: multimodal long-horizon reasoning for robotics//Proceedings of 2024 IEEE International Conference on Robotics and Automation (ICRA). Yokohama,Japan: IEEE: 645-652 [DOI: 10.1109/ICRA57147.2024.10610216], articleTitle=RoboVQA: multimodal long-horizon reasoning for robotics, refAbstract=null), Reference(id=1322960891246948425, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=3, issue=null, pageStart=null, pageEnd=9150042, url=null, language=null, rfNumber=null, rfOrder=71, authorNames=Sun F C, Chen R F, Ji T Y, Luo Y, Zhou H D, Liu H P, journalName=CAAI Artificial Intelligence Research, refType=null, unstructuredReference=Sun F C,Chen R F,Ji T Y,Luo Y,Zhou H D and Liu H P. 2024. A comprehensive survey on embodied intelligence: advancements,challenges,and future perspectives. CAAI Artificial Intelligence Research,3: #9150042 [DOI: 10.26599/AIR.2024.9150042], articleTitle=A comprehensive survey on embodied intelligence: advancements,challenges,and future perspectives, refAbstract=null), Reference(id=1322960891322445898, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2410.00425.pdf, language=null, rfNumber=null, rfOrder=72, authorNames=Tao S, Xiang F B, Shukla A, Qin Y Z, Hinrichsen X, Yuan X D, journalName=null, refType=null, unstructuredReference=Tao S,Xiang F B,Shukla A,Qin Y Z,Hinrichsen X,Yuan X D,et al. 2024. ManiSkill3: GPU parallelized robotics simulation and rendering for generalizable embodied AI [EB/OL]. [2025-11-05]., articleTitle=ManiSkill3: GPU parallelized robotics simulation and rendering for generalizable embodied AI, refAbstract=null), Reference(id=1322960891389554763, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2011, volume=null, issue=null, pageStart=1521, pageEnd=1528, url=null, language=null, rfNumber=null, rfOrder=73, authorNames=Torralba A, Efros A A, journalName=Proceedings of the CVPR 2011, refType=null, unstructuredReference=Torralba A and Efros A A. 2011. Unbiased look at dataset bias//Proceedings of the CVPR 2011. Colorado Springs,USA: IEEE: 1521-1528 [DOI: 10.1109/CVPR.2011.5995347], articleTitle=Unbiased look at dataset bias, refAbstract=null), Reference(id=1322960891477635148, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2015, volume=null, issue=null, pageStart=1137, pageEnd=1143, url=null, language=null, rfNumber=null, rfOrder=74, authorNames=Ushani A K, Carlevaris-Bianco N, Cunningham A G, Galceran E, Eustice R M, journalName=null, refType=null, unstructuredReference=Ushani A K,Carlevaris-Bianco N,Cunningham A G,Galceran E and Eustice R M. 2015. Continuous-time estimation for dynamic obstacle tracking//Proceedings of 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Hamburg,Germany: IEEE: 1137-1143 [DOI: 10.1109/IROS.2015.7353513], articleTitle=Continuous-time estimation for dynamic obstacle tracking, refAbstract=null), Reference(id=1322960891544744013, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024a, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2407.10943.pdf, language=null, rfNumber=null, rfOrder=75, authorNames=Wang H Q, Chen J H, Huang W S, Ben Q W, Wang T, Mi B Y, journalName=null, refType=null, unstructuredReference=Wang H Q,Chen J H,Huang W S,Ben Q W,Wang T,Mi B Y,et al. 2024a. GRUtopia: dream general robots in a city at scale [EB/OL]. [2025-11-05]., articleTitle=GRUtopia: dream general robots in a city at scale, refAbstract=null), Reference(id=1322960891624435790, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024b, volume=null, issue=null, pageStart=#3952, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=76, authorNames=Wang L R, Chen X L, Zhao J L, He K M, journalName=null, refType=null, unstructuredReference=Wang L R,Chen X L,Zhao J L and He K M. 2024b. Scaling proprioceptive-visual learning with heterogeneous pre-trained transformers//Proceedings of the 38th International Conference on Neural Information Processing Systems. Vancouver,Canada: Curran Associates Inc.: #3952, articleTitle=Scaling proprioceptive-visual learning with heterogeneous pre-trained transformers, refAbstract=null), Reference(id=1322960891687350351, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=1615, pageEnd=1638, url=null, language=null, rfNumber=null, rfOrder=77, authorNames=Wang Z J, Zhou Z H, Song J Y, Huang Y H, Shu Z, Ma L, journalName=(FSE), refType=null, unstructuredReference=Wang Z J,Zhou Z H,Song J Y,Huang Y H,Shu Z and Ma L. 2025. VLATest: testing and evaluating vision-language-action models for robotic manipulation. Proceedings of the ACM on Software Engineering,2(FSE): 1615-1638 [DOI: 10.1145/3729343], articleTitle=VLATest: testing and evaluating vision-language-action models for robotic manipulation. Proceedings of the ACM on Software Engineering,2, refAbstract=null), Reference(id=1322960891762847824, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2412.13877.pdf, language=null, rfNumber=null, rfOrder=78, authorNames=Wu K, Hou C K, Liu J M, Che Z P, Ju X Z, Yang Z Q, journalName=null, refType=null, unstructuredReference=Wu K,Hou C K,Liu J M,Che Z P,Ju X Z,Yang Z Q,et al. 2024. RoboMIND: benchmark on multi-embodiment intelligence normative data for robot manipulation [EB/OL]. [2025-11-05]., articleTitle=RoboMIND: benchmark on multi-embodiment intelligence normative data for robot manipulation, refAbstract=null), Reference(id=1322960891838345297, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2505.14404.pdf, language=null, rfNumber=null, rfOrder=79, authorNames=Wu X C, Liu J X, Huang D L, Wang Y F, Shi Y Y, Chen K D, journalName=null, refType=null, unstructuredReference=Wu X C,Liu J X,Huang D L,Wang Y F,Shi Y Y,Chen K D,et al. 2025. ViC-bench: benchmarking visual-interleaved chain-of-thought capability in MLLMs with free-style intermediate state representations [EB/OL]. [2025-11-05]., articleTitle=ViC-bench: benchmarking visual-interleaved chain-of-thought capability in MLLMs with free-style intermediate state representations, refAbstract=null), Reference(id=1322960891909648466, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025a, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2508.06553.pdf, language=null, rfNumber=null, rfOrder=80, authorNames=Xiao J H, Yan B W, Zhang J B, Wang J, Li C Y, Cheng Z X, journalName=null, refType=null, unstructuredReference=Xiao J H,Yan B W,Zhang J B,Wang J,Li C Y,Cheng Z X,et al. 2025a. Data assessment for embodied intelligence [EB/OL]. [2025-11-05]., articleTitle=Data assessment for embodied intelligence, refAbstract=null), Reference(id=1322960891985145939, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025b, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2508.06553.pdf, language=null, rfNumber=null, rfOrder=81, authorNames=Xiao J H, Zhang J B, Yan B W, Guo S Y, Ye T R, Zhang K W, journalName=null, refType=null, unstructuredReference=Xiao J H,Zhang J B,Yan B W,Guo S Y,Ye T R,Zhang K W,et al. 2025b. Static and plugged: make embodied evaluation simple[EB/OL]. [2025-11-05]., articleTitle=Static and plugged: make embodied evaluation simple, refAbstract=null), Reference(id=1322960892052254804, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2502.11426.pdf, language=null, rfNumber=null, rfOrder=82, authorNames=Xu T, Pan C, Rao M B, Datar A, Pokhrel A, Lu Y, journalName=null, refType=null, unstructuredReference=Xu T,Pan C,Rao M B,Datar A,Pokhrel A,Lu Y,et al,2025. Verti-bench: a general and scalable off-road mobility benchmark for vertically challenging terrain [EB/OL]. [2025-11-05]., articleTitle=Verti-bench: a general and scalable off-road mobility benchmark for vertically challenging terrain, refAbstract=null), Reference(id=1322960892123557973, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2509.25794.pdf, language=null, rfNumber=null, rfOrder=83, authorNames=Xue H, Ge Y, Zeng Y, Li Z, Liu M Y, Chen Y, journalName=null, refType=null, unstructuredReference=Xue H,Ge Y,Zeng Y,Li Z,Liu M Y,Chen Y,et al. 2025. Point-it-out: benchmarking embodied reasoning for vision language models in multi-stage visual grounding [EB/OL]. [2025-11-05]., articleTitle=Point-it-out: benchmarking embodied reasoning for vision language models in multi-stage visual grounding, refAbstract=null), Reference(id=1322960892186472534, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2412.07215.pdf, language=null, rfNumber=null, rfOrder=84, authorNames=Yan F, Liu F F, Zheng L M, Zhong Y F, Huang Y Y, Guan Z C, journalName=null, refType=null, unstructuredReference=Yan F,Liu F F,Zheng L M,Zhong Y F,Huang Y Y,Guan Z C,et al. 2024. RoboTron-Mani: all-in-one multimodal large model for robotic manipulation [EB/OL]. [2025-11-05]., articleTitle=RoboTron-Mani: all-in-one multimodal large model for robotic manipulation, refAbstract=null), Reference(id=1322960892266164311, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2412.14171.pdf, language=null, rfNumber=null, rfOrder=85, authorNames=Yang J, Yang S, Gupta A W, Han R, Fei-Fei L, Xie S, journalName=null, refType=null, unstructuredReference=Yang J,Yang S,Gupta A W,Han R,Fei-Fei L and Xie S. 2025. Thinking in space: how multimodal large language models see,remember,and recall spaces [EB/OL]. [2025-11-05]., articleTitle=Thinking in space: how multimodal large language models see,remember,and recall spaces, refAbstract=null), Reference(id=1322960892358439000, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2412.13178.pdf, language=null, rfNumber=null, rfOrder=86, authorNames=Yin S, Pang X H, Ding Y Z, Chen M L, Bi Y T, Xiong Y C, journalName=null, refType=null, unstructuredReference=Yin S,Pang X H,Ding Y Z,Chen M L,Bi Y T,Xiong Y C,et al. 2024. SafeAgentBench: a benchmark for safe task planning of embodied LLM agents [EB/OL]. [2025-11-05]., articleTitle=SafeAgentBench: a benchmark for safe task planning of embodied LLM agents, refAbstract=null), Reference(id=1322960892433936473, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2506.14697.pdf, language=null, rfNumber=null, rfOrder=87, authorNames=Ying Z H, Wang L, Xiao Y S, Wang J K, Ma Y Q, Guo J Y, journalName=null, refType=null, unstructuredReference=Ying Z H,Wang L,Xiao Y S,Wang J K,Ma Y Q,Guo J Y,et al. 2025. AGENTSAFE: benchmarking the safety of embodied agents on hazardous instructions [EB/OL]. [2025-11-05]., articleTitle=AGENTSAFE: benchmarking the safety of embodied agents on hazardous instructions, refAbstract=null), Reference(id=1322960892501045338, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2019, volume=null, issue=null, pageStart=1094, pageEnd=1100, url=null, language=null, rfNumber=null, rfOrder=88, authorNames=Yu T H, Quillen D, He Z P, Julian R, Hausman K, Finn C, journalName=null, refType=null, unstructuredReference=Yu T H,Quillen D,He Z P,Julian R,Hausman K,Finn C,et al. 2019. Meta-world: a benchmark and evaluation for multi-task and meta reinforcement learning//Proceedings of the 3rd Annual Conference on Robot Learning. Osaka,Japan: PMLR: 1094-1100, articleTitle=Meta-world: a benchmark and evaluation for multi-task and meta reinforcement learning, refAbstract=null), Reference(id=1322960892563959899, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2505.08548.pdf, language=null, rfNumber=null, rfOrder=89, authorNames=Yuan Y F, Cui H Q, Chen Y B, Dong Z B, Ni F, Kou L X, journalName=null, refType=null, unstructuredReference=Yuan Y F,Cui H Q,Chen Y B,Dong Z B,Ni F,Kou L X,et al. 2025. From seeing to doing: bridging reasoning and decision for robotic manipulation [EB/OL]. [2025-11-05]., articleTitle=From seeing to doing: bridging reasoning and decision for robotic manipulation, refAbstract=null), Reference(id=1322960892626874460, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024d, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2407.20242.pdf, language=null, rfNumber=null, rfOrder=90, authorNames=Zhang H, Zhu C, Wang X, Zhou Z, Hu S and Zhang L Y, journalName=null, refType=null, unstructuredReference=Zhang H,Zhu C,Wang X,Zhou Z,Hu S and Zhang L Y,2024d. BadRobot: jailbreaking LLM-based embodied AI in the physical world [EB/OL]. [2025-11-05]., articleTitle=BadRobot: jailbreaking LLM-based embodied AI in the physical world, refAbstract=null), Reference(id=1322960892702371933, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024a, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2412.18774.pdf, language=null, rfNumber=null, rfOrder=91, authorNames=Zhang J B, Li C Y, Hao J, Jia J, Duan H Y, Zheng G Q, journalName=null, refType=null, unstructuredReference=Zhang J B,Li C Y,Hao J,Jia J,Duan H Y,Zheng G Q,et al. 2024a. Embodied image quality assessment for robotic intelligence[EB/OL]. [2025-11-05]., articleTitle=Embodied image quality assessment for robotic intelligence, refAbstract=null), Reference(id=1322960892769480798, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024b, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2412.06224.pdf, language=null, rfNumber=null, rfOrder=92, authorNames=Zhang J Z, Wang K Y, Wang S A, Li M H, Liu H R, Wei S L, journalName=null, refType=null, unstructuredReference=Zhang J Z,Wang K Y,Wang S A,Li M H,Liu H R,Wei S L,et al. 2024b. Uni-NaVid: a video-based vision-language-action model for unifying embodied navigation tasks [EB/OL]. [2025-11-05]., articleTitle=Uni-NaVid: a video-based vision-language-action model for unifying embodied navigation tasks, refAbstract=null), Reference(id=1322960892844978271, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024c, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=null, rfOrder=93, authorNames=Zhang J Z, Wang K Y, Xu R T, Zhou G Z, Hong Y C, Fang X M, journalName=Robotics: Science and Systems XX, refType=null, unstructuredReference=Zhang J Z,Wang K Y,Xu R T,Zhou G Z,Hong Y C,Fang X M,et al. 2024c. NaVid: video-based VLM plans the next step for vision-and-language navigation//Robotics: Science and Systems XX. Delft,the Netherlands: [s.n.], articleTitle=NaVid: video-based VLM plans the next step for vision-and-language navigation, refAbstract=null), Reference(id=1322960892933058656, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025a, volume=null, issue=null, pageStart=21566, pageEnd=21573, url=null, language=null, rfNumber=null, rfOrder=94, authorNames=Zhang L F, Wang Y N, Gu H J, Hamidizadeh A, Zhang Z G, Liu Y C, journalName=null, refType=null, unstructuredReference=Zhang L F,Wang Y N,Gu H J,Hamidizadeh A,Zhang Z G,Liu Y C,et al. 2025a. ET-plan-bench: embodied task-level planning benchmark towards spatial-temporal cognition with foundation models//Proceedings of 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Hangzhou,China: IEEE: 21566-21573 [DOI: 10.1109/IROS60139.2025.11246658], articleTitle=ET-plan-bench: embodied task-level planning benchmark towards spatial-temporal cognition with foundation models, refAbstract=null), Reference(id=1322960893000167521, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025b, volume=null, issue=null, pageStart=11142, pageEnd=11152, url=null, language=null, rfNumber=null, rfOrder=95, authorNames=Zhang S D, Xu Z, Liu P J, Yu X P, Li Y, Gao Q H, journalName=null, refType=null, unstructuredReference=Zhang S D,Xu Z,Liu P J,Yu X P,Li Y,Gao Q H,et al. 2025b. VLABench: a large-scale benchmark for language-conditioned robotics manipulation with long-horizon reasoning tasks//Proceedings of 2025 IEEE/CVF International Conference on Computer Vision. [s.l.]: [s.n.]: 11142-11152, articleTitle=VLABench: a large-scale benchmark for language-conditioned robotics manipulation with long-horizon reasoning tasks, refAbstract=null), Reference(id=1322960894640140386, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025c, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2503.11089.pdf, language=null, rfNumber=null, rfOrder=96, authorNames=Zhang Y, Zhang Q, Ju X Z, Liu Z Y, Mao J L, Sun J K, journalName=null, refType=null, unstructuredReference=Zhang Y,Zhang Q,Ju X Z,Liu Z Y,Mao J L,Sun J K,et al. 2025c. EmbodiedVSR: dynamic scene graph-guided chain-of-thought reasoning for visual spatial tasks [EB/OL]. [2025-11-05]., articleTitle=EmbodiedVSR: dynamic scene graph-guided chain-of-thought reasoning for visual spatial tasks, refAbstract=null), Reference(id=1322960894719832163, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2026, volume=91, issue=null, pageStart=null, pageEnd=103255, url=null, language=null, rfNumber=null, rfOrder=97, authorNames=Zhang Z C, Wang J Y, Guo Y J, Wen F R, Chen Z J, Wang H Q, journalName=Displays, refType=null, unstructuredReference=Zhang Z C,Wang J Y,Guo Y J,Wen F R,Chen Z J,Wang H Q,et al. 2026. AIBench: towards trustworthy evaluation under the 45°law. Displays,91: #103255 [DOI: 10.1016/j.displa.2025.103255], articleTitle=AIBench: towards trustworthy evaluation under the 45°law, refAbstract=null), Reference(id=1322960894795329636, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025d, volume=68, issue=12, pageStart=null, pageEnd=221301, url=null, language=null, rfNumber=null, rfOrder=98, authorNames=Zheng Z C, Wang J Y, Wen F R, Guo Y J, Zhao X Y, Fang X Y, journalName=Science China Information Sciences, refType=null, unstructuredReference=Zheng Z C,Wang J Y,Wen F R,Guo Y J,Zhao X Y,Fang X Y,et al. 2025d. Large multimodal models evaluation: a survey. Science China Information Sciences,68(12): #221301 [DOI: 10.1007/s11432-025-4676-4], articleTitle=Large multimodal models evaluation: a survey, refAbstract=null), Reference(id=1322960894866632805, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2407.06951.pdf, language=null, rfNumber=null, rfOrder=99, authorNames=Zheng L M, Yan F, Liu F F, Feng C J, Kang Z L, Ma L, journalName=null, refType=null, unstructuredReference=Zheng L M,Yan F,Liu F F,Feng C J,Kang Z L and Ma L. 2024. RoboCAS: a benchmark for robotic manipulation in complex object arrangement scenarios [EB/OL]. [2025-11-05]., articleTitle=RoboCAS: a benchmark for robotic manipulation in complex object arrangement scenarios, refAbstract=null), Reference(id=1322960894937935974, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2505.12084.pdf, language=null, rfNumber=null, rfOrder=100, authorNames=Zhong N H, Caro S, Iskandar A, Ramesh M, Smith S L, journalName=null, refType=null, unstructuredReference=Zhong N H,Caro S,Iskandar A,Ramesh M and Smith S L. 2025. Bench-NPIN: benchmarking non-prehensile interactive navigation[EB/OL]. [2025-11-05]., articleTitle=Bench-NPIN: benchmarking non-prehensile interactive navigation, refAbstract=null), Reference(id=1322960895005044839, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025a, volume=null, issue=null, pageStart=6940, pageEnd=6949, url=null, language=null, rfNumber=null, rfOrder=101, authorNames=Zhou W J, Tao M L, Zhao C Y, Guo H Y, Dong H H, Tang M, journalName=null, refType=null, unstructuredReference=Zhou W J,Tao M L,Zhao C Y,Guo H Y,Dong H H,Tang M,et al. 2025a. PhysVLM: enabling visual language models to understand robotic physical reachability//Proceedings of 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville,USA: 6940-6949 [DOI: 10.1109/CVPR52734.2025.00651], articleTitle=PhysVLM: enabling visual language models to understand robotic physical reachability, refAbstract=null), Reference(id=1322960895093125224, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2025b, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2503.24278.pdf, language=null, rfNumber=null, rfOrder=102, authorNames=Zhou Z Y, Atreya P, Tan Y L, Pertsch K, Levine S, journalName=null, refType=null, unstructuredReference=Zhou Z Y,Atreya P,Tan Y L,Pertsch K and Levine S. 2025b. AutoEval: autonomous evaluation of generalist robot manipulation policies in the real world [EB/OL]. [2025-11-05]., articleTitle=AutoEval: autonomous evaluation of generalist robot manipulation policies in the real world, refAbstract=null), Reference(id=1322960895151845481, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2024, volume=null, issue=null, pageStart=null, pageEnd=null, url=https://arxiv.org/pdf/2408.04449.pdf, language=null, rfNumber=null, rfOrder=103, authorNames=Zhu Z H, Wu B Z, Zhang Z Y, Han L, Liu Q S, Wu B Y, journalName=null, refType=null, unstructuredReference=Zhu Z H,Wu B Z,Zhang Z Y,Han L,Liu Q S and Wu B Y. 2024. EARBench: towards evaluating physical risk awareness for task planning of foundation model-based embodied AI agents [EB/OL]. [2025-11-05]., articleTitle=EARBench: towards evaluating physical risk awareness for task planning of foundation model-based embodied AI agents, refAbstract=null), Reference(id=1322960895218954346, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=null, pageStart=2165, pageEnd=2183, url=null, language=null, rfNumber=null, rfOrder=104, authorNames=Zitkovich B, Yu T H, Xu S C, Xu P, Xiao T, Xia F, journalName=null, refType=null, unstructuredReference=Zitkovich B,Yu T H,Xu S C,Xu P,Xiao T,Xia F,et al. 2023. RT-2: vision-language-action models transfer web knowledge to robotic control//Proceedings of 2023 Conference on Robot Learning. Atlanta,USA: PMLR: 2165-2183, articleTitle=RT-2: vision-language-action models transfer web knowledge to robotic control, refAbstract=null)], funds=[Fund(id=1322960882950615040, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, awardId=null, language=EN, fundingSource=National Natural Science Foundation of China(62225112,625B2118);Singapore MoE Foundation(MOE-T2EP20123-0006), fundOrder=null, country=null), Fund(id=1322960883005140993, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, awardId=null, language=CN, fundingSource=国家自然科学基金项目(62225112,625B2118);新加坡教育部基金项目(MOE-T2EP20123-0006), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870548059041, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=2, ext=[AuthorCompanyExt(id=1322960870560641954, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China), AuthorCompanyExt(id=1322960870573224867, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 上海交通大学信息与电子工程学院,上海 200240)]), AuthorCompany(id=1322960870644528036, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=3, ext=[AuthorCompanyExt(id=1322960870652916645, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870644528036, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 Institute of Data and Information,Tsinghua Shenzhen International Graduate School,Shenzhen 518055,China), AuthorCompanyExt(id=1322960870661305254, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870644528036, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 清华大学深圳国际研究生院数据与信息研究院,深圳 518055)]), AuthorCompany(id=1322960872326443943, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=4, ext=[AuthorCompanyExt(id=1322960872339026856, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872326443943, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4 Yuanpei College,Peking University,Beijing 100871,China), AuthorCompanyExt(id=1322960872355804073, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872326443943, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4 北京大学元培学院,北京 100871)]), AuthorCompany(id=1322960872620045226, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=5, ext=[AuthorCompanyExt(id=1322960872632628139, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872620045226, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5 Department of Psychology,Tongji University,Shanghai 200292,China), AuthorCompanyExt(id=1322960872649405356, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872620045226, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5 同济大学应用心理学系,上海 200292)]), AuthorCompany(id=1322960872750068653, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=6, ext=[AuthorCompanyExt(id=1322960872758457262, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872750068653, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=6 College of Computing and Data Science,Nanyang Technological University,Singapore 639798,Singapore), AuthorCompanyExt(id=1322960872766845871, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872750068653, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=6 南洋理工大学计算机与数据科学学院,新加坡 639798,新加坡)])], figs=[ArticleFig(id=1322960879800693739, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, label=Fig.1, caption=Perception-cognition-decision-execution loop for intelligence systems, figureFileSmall=1ryRKUlPwOfuJtH5zVAqIw==, figureFileBig=R/Vypy3oOwNxRDL3pDE9DA==, tableContent=null), ArticleFig(id=1322960881407112174, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, label=图1, caption=智能系统的感知—认知—决策—执行闭环, figureFileSmall=1ryRKUlPwOfuJtH5zVAqIw==, figureFileBig=R/Vypy3oOwNxRDL3pDE9DA==, tableContent=null), ArticleFig(id=1322960881600050159, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, label=Fig.2, caption=Scatter plot of Octo VLA model performance on 50 task samples, figureFileSmall=Y9LBvB+KdYMwjwB5DgiESQ==, figureFileBig=Ymz/hYXt9QrZTN6xtwK4pw==, tableContent=null), ArticleFig(id=1322960881675547632, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, label=图2, caption=Octo 模型在50个任务样本上的性能散点图, figureFileSmall=Y9LBvB+KdYMwjwB5DgiESQ==, figureFileBig=Ymz/hYXt9QrZTN6xtwK4pw==, tableContent=null), ArticleFig(id=1322960881742656497, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, label=Table 1, caption=Ability evaluation dimensions for human and embodied intelligence, figureFileSmall=null, figureFileBig=null, tableContent=
步骤人类智能具身智能
感知角膜—晶状体—虹膜联合,微扫视清除视觉暂留固定镜头 + 模数转换,帧间延迟导致多重失真
认知大脑可塑性突触调整权重,抑制无关区域VLM固定感受野与位置编码,需额外注意力模块
决策小脑前馈—反馈混合模型,毫秒级校正运动误差VLA/VLN纯价值输出,靠外部补偿延迟,受时隙限制
执行脊髓—肌肉—肌腱可变刚度机构,提供变阻抗机制电机—减速器—连杆高刚度链,依赖阻抗控制算法
), ArticleFig(id=1322960881809765362, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, label=表1, caption=

人类智能与具身智能的能力评测维度

, figureFileSmall=null, figureFileBig=null, tableContent=
步骤人类智能具身智能
感知角膜—晶状体—虹膜联合,微扫视清除视觉暂留固定镜头 + 模数转换,帧间延迟导致多重失真
认知大脑可塑性突触调整权重,抑制无关区域VLM固定感受野与位置编码,需额外注意力模块
决策小脑前馈—反馈混合模型,毫秒级校正运动误差VLA/VLN纯价值输出,靠外部补偿延迟,受时隙限制
执行脊髓—肌肉—肌腱可变刚度机构,提供变阻抗机制电机—减速器—连杆高刚度链,依赖阻抗控制算法
), ArticleFig(id=1322960881897845747, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, label=Table 2, caption=Three evaluation paradigms for embodied intelligence, figureFileSmall=null, figureFileBig=null, tableContent=
资源开销静态评测仿真评测真机评测
硬件费用¥ 0¥ 1 000~10 000¥ 100 000+
数据规模≤ 100 MB1~5 GBOn-site
安装时间分钟级日级—周级周级—月级
推理时间0.1 s10 s60 s
可信度低中高
), ArticleFig(id=1322960881964954612, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, label=表2, caption=

具身智能评测的3种范式

, figureFileSmall=null, figureFileBig=null, tableContent=
资源开销静态评测仿真评测真机评测
硬件费用¥ 0¥ 1 000~10 000¥ 100 000+
数据规模≤ 100 MB1~5 GBOn-site
安装时间分钟级日级—周级周级—月级
推理时间0.1 s10 s60 s
可信度低中高
), ArticleFig(id=1322960882040452085, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, label=Table 3, caption=Static evaluation for embodied intelligence in the perception-cognition-decision-execution loop, figureFileSmall=null, figureFileBig=null, tableContent=
评测集感知认知决策执行数据规模核心任务主要指标对象年份
Scan2Cap√√--51 583个描述3D扫描场景描述IoU, CiDEr, BLEU, METEOR, ROUGEVLM2021
ScanQA√√--41 000个问题3D问题解答Acc, BLEU, CIDEr ROUGE,GPTVLM2022
ScanRefer√√--51 583个描述3D空间定位IoUVLM2023
Multi3DRefer√√--61 900个描述3D 下的多物体定位Recall@K, Acc, mIoU, F1-scoreVLM2023
SQA3D√√--20.4 k 文本描述, 33.4 k 问题3D场景理解与推理AccVLM2023
OpenEQA√√--1 600+ 问题, 180+ 环境开放词汇 EQA 数据集Acc, GPTVLM2024
RoboVQA√√√-829 502 视频文本对长中期任务高阶推理AccVLM2024
VSI-Bench√√√-5 000+ 问答对视频数据集Acc, MRAVLM2024
Can-Do√√√-400 多模态样本多样化复杂场景下具身规划任务AccVLM2024
Embodied Arena√√√√22个BenchmarkQA/导航/任务plan综合指标VLM, VLN2024
StaticEmbodiedBench√√√√

1 000条QA,

100条具身数据

机器臂操作Acc, L2VLM, VLA2025
Embodied-IQA√√√√36.9 k 条失真图像面向机器的图像质量Acc, BLEU, ROUGE, CIDErVLM, VLA2025
ERQA√√--400道多选题对物理交互至关重要的高级推理技能AccVLM2025
UniEQA√√√√5 378问题对理解和生成的整体基准Uniscore, GPTVLM2025
VABench√--√300 个人工标注问题空间可操作性,轨迹,定位boxPoint Acc, MAE, RMSE, GPTVLM, VLA2025
PhyBlock√√√2 600个任务QA数据集Acc,PRVLM2025
MineAnyBuild√√√4 000个任务Minecraft建筑方案GPTVLM2025
OmniVTLA√--√40个机器人操作私有的真实机器臂操数据集MSEVLA2025
VLATest√--√18 604 离线测评数据静态测试场景离线测评MSEVLA2025
OpenX-Embodiment√--√1 M + 示例大规模机器臂操作数据MSEVLA2025
GraspVLA√--√10亿帧机器人抓取数据抓取任务,提供了离线测试脚本MSEVLA2025
USIM√--√1 852 条轨迹水下机器臂操作任务MSEVLA2025
Droid√--√76 K示例大规模机器臂操作数据MSEVLA2025
), ArticleFig(id=1322960882120143862, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, label=表3, caption=

具身智能静态评测在感知—认知—决策—执行闭环中的应用

, figureFileSmall=null, figureFileBig=null, tableContent=
评测集感知认知决策执行数据规模核心任务主要指标对象年份
Scan2Cap√√--51 583个描述3D扫描场景描述IoU, CiDEr, BLEU, METEOR, ROUGEVLM2021
ScanQA√√--41 000个问题3D问题解答Acc, BLEU, CIDEr ROUGE,GPTVLM2022
ScanRefer√√--51 583个描述3D空间定位IoUVLM2023
Multi3DRefer√√--61 900个描述3D 下的多物体定位Recall@K, Acc, mIoU, F1-scoreVLM2023
SQA3D√√--20.4 k 文本描述, 33.4 k 问题3D场景理解与推理AccVLM2023
OpenEQA√√--1 600+ 问题, 180+ 环境开放词汇 EQA 数据集Acc, GPTVLM2024
RoboVQA√√√-829 502 视频文本对长中期任务高阶推理AccVLM2024
VSI-Bench√√√-5 000+ 问答对视频数据集Acc, MRAVLM2024
Can-Do√√√-400 多模态样本多样化复杂场景下具身规划任务AccVLM2024
Embodied Arena√√√√22个BenchmarkQA/导航/任务plan综合指标VLM, VLN2024
StaticEmbodiedBench√√√√

1 000条QA,

100条具身数据

机器臂操作Acc, L2VLM, VLA2025
Embodied-IQA√√√√36.9 k 条失真图像面向机器的图像质量Acc, BLEU, ROUGE, CIDErVLM, VLA2025
ERQA√√--400道多选题对物理交互至关重要的高级推理技能AccVLM2025
UniEQA√√√√5 378问题对理解和生成的整体基准Uniscore, GPTVLM2025
VABench√--√300 个人工标注问题空间可操作性,轨迹,定位boxPoint Acc, MAE, RMSE, GPTVLM, VLA2025
PhyBlock√√√2 600个任务QA数据集Acc,PRVLM2025
MineAnyBuild√√√4 000个任务Minecraft建筑方案GPTVLM2025
OmniVTLA√--√40个机器人操作私有的真实机器臂操数据集MSEVLA2025
VLATest√--√18 604 离线测评数据静态测试场景离线测评MSEVLA2025
OpenX-Embodiment√--√1 M + 示例大规模机器臂操作数据MSEVLA2025
GraspVLA√--√10亿帧机器人抓取数据抓取任务,提供了离线测试脚本MSEVLA2025
USIM√--√1 852 条轨迹水下机器臂操作任务MSEVLA2025
Droid√--√76 K示例大规模机器臂操作数据MSEVLA2025
), ArticleFig(id=1322960882195641335, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, label=Table 4, caption=Simulation evaluation for embodied intelligence in the perception-cognition-decision-execution loop, figureFileSmall=null, figureFileBig=null, tableContent=
评测集感知认知决策执行数据规模核心任务主要指标对象年份
RLBench√-√√100个任务无限演示视觉引导机器人操作SRVLA2020
Meta-World--√√50个任务多任务与元强化学习机器人操作SRVLA2020
Isaac Gym--√√仿真平台GPU并行机器人仿真SRVLA,VLN2021
Arena-Rosnav 2.0√√√√仿真平台动态环境中的机器人导航SR, Collision, Time,Path LengthVLN2023
LIBERO√√√√130个任务语言条件下的终身机器人操作SRVLA2023
ET-Plan-Bench-√√√11 838个实例低层导航、物体操作与高层任务规划SR, Sequence LengthVLM,VLN2024
ManiSkill3√-√√数百万演示帧机器人操作、移动操作与灵巧操作SRVLA2024
GRUtopia√√√√>100 000个交互场景社交导航、物体导航与移动操作SRVLA,VLN2024

GRUtopia

(Loco-Navigation)

√√√√300个episodes物体定位与移动导航SR, Path LengthVLN2024

GRUtopia

(Loco-Manipulation)

√√√√300个episodes移动操作SR, Path LengthVLA2024
RoboCasa√√√√100个任务>10万条轨迹厨房场景日常操作与复合任务SRVLA2024
), ArticleFig(id=1322960882275333112, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, label=表4, caption=

具身智能仿真评测在感知—认知—决策—执行闭环中的应用

, figureFileSmall=null, figureFileBig=null, tableContent=
评测集感知认知决策执行数据规模核心任务主要指标对象年份
RLBench√-√√100个任务无限演示视觉引导机器人操作SRVLA2020
Meta-World--√√50个任务多任务与元强化学习机器人操作SRVLA2020
Isaac Gym--√√仿真平台GPU并行机器人仿真SRVLA,VLN2021
Arena-Rosnav 2.0√√√√仿真平台动态环境中的机器人导航SR, Collision, Time,Path LengthVLN2023
LIBERO√√√√130个任务语言条件下的终身机器人操作SRVLA2023
ET-Plan-Bench-√√√11 838个实例低层导航、物体操作与高层任务规划SR, Sequence LengthVLM,VLN2024
ManiSkill3√-√√数百万演示帧机器人操作、移动操作与灵巧操作SRVLA2024
GRUtopia√√√√>100 000个交互场景社交导航、物体导航与移动操作SRVLA,VLN2024

GRUtopia

(Loco-Navigation)

√√√√300个episodes物体定位与移动导航SR, Path LengthVLN2024

GRUtopia

(Loco-Manipulation)

√√√√300个episodes移动操作SR, Path LengthVLA2024
RoboCasa√√√√100个任务>10万条轨迹厨房场景日常操作与复合任务SRVLA2024
), ArticleFig(id=1322960882346636281, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, label=null, caption=Simulation evaluation for embodied intelligence in the perception-cognition-decision-execution loop, figureFileSmall=null, figureFileBig=null, tableContent=
评测集感知认知决策执行数据规模核心任务主要指标对象年份
GOAT-Bench√√√√181个场景68万条episode多模态开放词汇终身导航SR, SPLVLN2024
BEDI√√√√虚拟+真实混合评测无人机感知、控制、工具使用与规划SRVLM,VLN2025
POINT-IT-OUT√√√->600条人工标注指称定位、任务驱动指向与轨迹预测Normalized IoUVLM2025
Cosmos-Reason1√√√-1 026个视频1 216个问题物理常识、任务判断与下一动作预测AccVLM2025

ERQA

(Gemini Robotics)

√√√-400个问题具身推理视觉问答AccVLM2025
ViC-Bench√√√-2 751个样本迷宫、拼图、长程规划与复杂计数Acc, Recall, LegalityVLM2025
EgoTraj-Bench√√--36 947对轨迹第一视角行人未来轨迹预测minADE@K,minFDE@KVLN2025
RoboView-Bias√-√√2 127个任务实例机器人操作视觉偏差评测SR, Interaction EffectVLA2025
RoboTwin 2.0 Benchmark√√√√>100 000条轨迹双臂机器人操作与泛化SRVLA2025
OpenGVL√√--50条轨迹/数据集时序任务进度预测Value-Order Correlation(VOC)VLM2025
RoboVerse√-√√510 500条轨迹统一机器人操作、导航与策略学习SRVLA2025
TaskSLAM-Bench√-√√3个仿真场景2条真实路径任务驱动SLAM与航点导航Accuracy, Precision,CompletenessVLN2025
HomeSafeBench√√√√12 900条数据自由探索式家庭安全隐患检测Precision, Recall, F1VLM,VLN2025
Verti-Bench--√√100个环境1 000个导航任务垂直复杂地形越野导航SR, Traversal Time,Roll, PitchVLN2025
Bench-PUSH√√√√4类仿真任务非抓取式交互导航与推物操作Task Efficiency Score, Task Success ScoreVLM2025
EXPRESS-Bench√√√√

777条探索轨迹

2 044个问答-轨迹对

主动探索式具身问答EACVLM2025
Agent-RewardBench√√√-1 136个样本多模态智能体奖励建模AccVLM2025
SPLICE√√--3 381个视频11 423个事件片段视频事件片段排序与多维推理Binary Acc, Hamming AccVLM2025
), ArticleFig(id=1322960882430522362, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, label=续表4, caption=

具身智能仿真评测在感知—认知—决策—执行闭环中的应用

, figureFileSmall=null, figureFileBig=null, tableContent=
评测集感知认知决策执行数据规模核心任务主要指标对象年份
GOAT-Bench√√√√181个场景68万条episode多模态开放词汇终身导航SR, SPLVLN2024
BEDI√√√√虚拟+真实混合评测无人机感知、控制、工具使用与规划SRVLM,VLN2025
POINT-IT-OUT√√√->600条人工标注指称定位、任务驱动指向与轨迹预测Normalized IoUVLM2025
Cosmos-Reason1√√√-1 026个视频1 216个问题物理常识、任务判断与下一动作预测AccVLM2025

ERQA

(Gemini Robotics)

√√√-400个问题具身推理视觉问答AccVLM2025
ViC-Bench√√√-2 751个样本迷宫、拼图、长程规划与复杂计数Acc, Recall, LegalityVLM2025
EgoTraj-Bench√√--36 947对轨迹第一视角行人未来轨迹预测minADE@K,minFDE@KVLN2025
RoboView-Bias√-√√2 127个任务实例机器人操作视觉偏差评测SR, Interaction EffectVLA2025
RoboTwin 2.0 Benchmark√√√√>100 000条轨迹双臂机器人操作与泛化SRVLA2025
OpenGVL√√--50条轨迹/数据集时序任务进度预测Value-Order Correlation(VOC)VLM2025
RoboVerse√-√√510 500条轨迹统一机器人操作、导航与策略学习SRVLA2025
TaskSLAM-Bench√-√√3个仿真场景2条真实路径任务驱动SLAM与航点导航Accuracy, Precision,CompletenessVLN2025
HomeSafeBench√√√√12 900条数据自由探索式家庭安全隐患检测Precision, Recall, F1VLM,VLN2025
Verti-Bench--√√100个环境1 000个导航任务垂直复杂地形越野导航SR, Traversal Time,Roll, PitchVLN2025
Bench-PUSH√√√√4类仿真任务非抓取式交互导航与推物操作Task Efficiency Score, Task Success ScoreVLM2025
EXPRESS-Bench√√√√

777条探索轨迹

2 044个问答-轨迹对

主动探索式具身问答EACVLM2025
Agent-RewardBench√√√-1 136个样本多模态智能体奖励建模AccVLM2025
SPLICE√√--3 381个视频11 423个事件片段视频事件片段排序与多维推理Binary Acc, Hamming AccVLM2025
), ArticleFig(id=1322960882506019835, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, label=Table 5, caption=Real-world evaluation for embodied intelligence in the perception-cognition-decision-execution loop, figureFileSmall=null, figureFileBig=null, tableContent=
评测集感知认知决策执行数据规模核心任务主要指标对象年份
KITTI-odometry√---22条自动驾驶序列39.2 km路程视觉—激光里程计轨迹误差ATE,RPE汽车2012
NCLT√---15 个月采集、27 条跨季节长时视觉 + 激光雷达序列长期地点识别、SLAM 回环检测召回率、ATE地面移动巡检机器人2015
MatterPort3D√-√-90 个室内场景 RGB-D 扫描场景室内环境导航SPL室内移动机器人2017
RLBench√-√√100 个任务桌面操作/强化学习/模仿学习SR, 步数StepFranka2020
Meta-World√--√50种任务多任务元学习SRSawyer2020
CALVIN√-√√1 000条真机轨迹语言长程操作SRFranka2022
RT-1 Benchmark√-√√13万条演示语言操作任务SREveryday-Robot2022
Open X-Embodiment√-√√22种不同机器人 + 527 种技能 + 超百万条演示轨迹跨本体操作SR多机异构2023
RH20T√--√11万条机器人序列 + 140个任务机器人长程操作SRFlexiv机械臂 + 大华-95机械爪2023
ManiSkill2√--√20个任务,400万个演示帧桌面操作/模仿学习/强化学习SR, AccFranka,ROKAE xMate3Pro2023
RT-2 Benchmark√√√√13万交互轨迹 + 互联网数据语言操作任务SREveryday-Robot2023
RoboMIND√√√√10.7万机械臂轨迹 + 479个任务 + 96种不同物体生活服务SRFranka, 天工人形,Magic,AgileX,UR5e2024
RoboCasa√-√√120种任务 + 10万条动作家务操作SRFranka机械臂 + Omron移动底盘2024
RoboData√√√√7万条操作轨迹多模态操作SRFranka2024
HPT√--√27个异构机器人的遥操作轨迹 + 20万条网络数据跨本体迁移SR多臂异构数据训练 + Franka测试2024
RoboCAS√-√√复杂布局7 500次操作杂乱场景操作SRFranka2024
SimplerEnv√-√√sim2real 1 500动作序列sim2real对齐测试sim2real SR差异Google Robot,WidowX2024
BEDI-UAV√√√√154幅图像 + 2 740个问题测试感知;30幅图像 + 357个问题测试决策无人机感知 + 决策 + 动作Comp, Acc, Step无人机2025
eSpatial-Benchmark√√--262条颜色 + 316条质量 + 213条相对位置 + 214条尺寸空间关系推理Acc, SR天工人形机器人 + Robotiq 机械手2025
Fourier ActionNet√--√3 万条真机演示人形灵巧双手SRFourier全尺寸人形机器人2025
), ArticleFig(id=1322960882585711612, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, label=表5, caption=

具身智能真机评测在感知—认知—决策—执行闭环中的应用

, figureFileSmall=null, figureFileBig=null, tableContent=
评测集感知认知决策执行数据规模核心任务主要指标对象年份
KITTI-odometry√---22条自动驾驶序列39.2 km路程视觉—激光里程计轨迹误差ATE,RPE汽车2012
NCLT√---15 个月采集、27 条跨季节长时视觉 + 激光雷达序列长期地点识别、SLAM 回环检测召回率、ATE地面移动巡检机器人2015
MatterPort3D√-√-90 个室内场景 RGB-D 扫描场景室内环境导航SPL室内移动机器人2017
RLBench√-√√100 个任务桌面操作/强化学习/模仿学习SR, 步数StepFranka2020
Meta-World√--√50种任务多任务元学习SRSawyer2020
CALVIN√-√√1 000条真机轨迹语言长程操作SRFranka2022
RT-1 Benchmark√-√√13万条演示语言操作任务SREveryday-Robot2022
Open X-Embodiment√-√√22种不同机器人 + 527 种技能 + 超百万条演示轨迹跨本体操作SR多机异构2023
RH20T√--√11万条机器人序列 + 140个任务机器人长程操作SRFlexiv机械臂 + 大华-95机械爪2023
ManiSkill2√--√20个任务,400万个演示帧桌面操作/模仿学习/强化学习SR, AccFranka,ROKAE xMate3Pro2023
RT-2 Benchmark√√√√13万交互轨迹 + 互联网数据语言操作任务SREveryday-Robot2023
RoboMIND√√√√10.7万机械臂轨迹 + 479个任务 + 96种不同物体生活服务SRFranka, 天工人形,Magic,AgileX,UR5e2024
RoboCasa√-√√120种任务 + 10万条动作家务操作SRFranka机械臂 + Omron移动底盘2024
RoboData√√√√7万条操作轨迹多模态操作SRFranka2024
HPT√--√27个异构机器人的遥操作轨迹 + 20万条网络数据跨本体迁移SR多臂异构数据训练 + Franka测试2024
RoboCAS√-√√复杂布局7 500次操作杂乱场景操作SRFranka2024
SimplerEnv√-√√sim2real 1 500动作序列sim2real对齐测试sim2real SR差异Google Robot,WidowX2024
BEDI-UAV√√√√154幅图像 + 2 740个问题测试感知;30幅图像 + 357个问题测试决策无人机感知 + 决策 + 动作Comp, Acc, Step无人机2025
eSpatial-Benchmark√√--262条颜色 + 316条质量 + 213条相对位置 + 214条尺寸空间关系推理Acc, SR天工人形机器人 + Robotiq 机械手2025
Fourier ActionNet√--√3 万条真机演示人形灵巧双手SRFourier全尺寸人形机器人2025
), ArticleFig(id=1322960882657014781, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, label=Table 5, caption=Real-world evaluation for embodied intelligence in the perception-cognition-decision-execution loop, figureFileSmall=null, figureFileBig=null, tableContent=
评测集感知认知决策执行数据规模核心任务主要指标对象年份
EQA-phys√√--200个样本和1 000个真机问答物理可达性问答LLM-scoreUR3和XArm6机器人2025
VLABench√√√√100个任务 + 2 000 个物体长时推理操作SR, AccFranka2025
RoboCerebra√√√√400小时轨迹的长程任务长时序操作Acc, SRFranka2025
FMB√--√225 00条操作轨迹抓取放置通用操作SRFranka2025
AutoEval√√√√100小时的动作序列自主评估策略SRWidowX2025
R-Bench√√√-采集 7 类共 33 种真实图像失真样本、2970 组问答样本多模态模型抗图像失真鲁棒性评测、位姿估计SR轮式移动机器人AgileX Mini2025
EDA√---1.5 万条具身智能采集数据具身原始数据集质量评估、数据可学习性筛查数据多样性熵、可学习度评分UR5机械臂2025
CityNav√√--32637 条语言导航目标描述、配套无人机实测轨迹城市户外场景语言引导无人机导航ATE、SR、SPL无人机2025
RoboTwin 2.0 Benchmark√-√√>100 000条轨迹,731 个标注物体资产库双手机器人操作SR多机异构机械臂2025
StaticEmbodiedBench√√√√1 000条QA,100条具身数据机器臂操作AccUR5机械臂2025
), ArticleFig(id=1322960882719929342, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, label=表5, caption=

具身智能真机评测在感知—认知—决策—执行闭环中的应用

, figureFileSmall=null, figureFileBig=null, tableContent=
评测集感知认知决策执行数据规模核心任务主要指标对象年份
EQA-phys√√--200个样本和1 000个真机问答物理可达性问答LLM-scoreUR3和XArm6机器人2025
VLABench√√√√100个任务 + 2 000 个物体长时推理操作SR, AccFranka2025
RoboCerebra√√√√400小时轨迹的长程任务长时序操作Acc, SRFranka2025
FMB√--√225 00条操作轨迹抓取放置通用操作SRFranka2025
AutoEval√√√√100小时的动作序列自主评估策略SRWidowX2025
R-Bench√√√-采集 7 类共 33 种真实图像失真样本、2970 组问答样本多模态模型抗图像失真鲁棒性评测、位姿估计SR轮式移动机器人AgileX Mini2025
EDA√---1.5 万条具身智能采集数据具身原始数据集质量评估、数据可学习性筛查数据多样性熵、可学习度评分UR5机械臂2025
CityNav√√--32637 条语言导航目标描述、配套无人机实测轨迹城市户外场景语言引导无人机导航ATE、SR、SPL无人机2025
RoboTwin 2.0 Benchmark√-√√>100 000条轨迹,731 个标注物体资产库双手机器人操作SR多机异构机械臂2025
StaticEmbodiedBench√√√√1 000条QA,100条具身数据机器臂操作AccUR5机械臂2025
), ArticleFig(id=1322960882791232511, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=EN, label=Table 6, caption=The S2D correlation factor between static and real-world embodied evaluation, figureFileSmall=null, figureFileBig=null, tableContent=
任务类型位置误差旋转误差夹爪开合
拾取0.7960.3331.000
放置0.4710.3430.750
按压0.4760.8251.000
拉0.6840.7140.889
推0.7300.4031.000
), ArticleFig(id=1322960882854147072, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, language=CN, label=表6, caption=

不同基础任务类型在位置、旋转和夹爪开合3个维度的静态评分与真实执行评分之间的S2D系数

, figureFileSmall=null, figureFileBig=null, tableContent=
任务类型位置误差旋转误差夹爪开合
拾取0.7960.3331.000
放置0.4710.3430.750
按压0.4760.8251.000
拉0.6840.7140.889
推0.7300.4031.000
)], attaches=null, journal=Journal(id=1249023527618129992, delFlag=0, nameCn=中国图象图形学报, nameEn=Journal of Image and Graphics, nameHistory1=null, nameHistory2=null, issn=1006-8961, eissn=null, cn=11-3758, coden=CODEN ZTTXFZ, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=uirXtX858YS3zEpFXZttJA==, journalPrice=null, startedYear=null, abbrevIsoEn=Journal of Image and Graphics, journalRemark=null, publicationField=null, createdTime=1775720014721, updatedTime=1788951488513, createdBy=18614031015, updatedBy=13041195026, firstLetterCn=Z, firstLetterEn=Z, subjectCode=Electronic Information, subjectName=null, subjectCodeEn=Electronic Information, subjectNameEn=null, picCn=uirXtX858YS3zEpFXZttJA==, picEn=bud7qaxfvWHeFsbyBTAiKQ==, jcr=null, cjcr=null, exts=[JournalExt(id=1304520351199814396, language=CN, name=中国图象图形学报, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1788951488542, updatedTime=1788951488542, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=, submissionAuthorUrl=https://journal.ids.fzyun.cn/auth/realms/journal/protocol/openid-connect/auth?client_id=journal-cjig-author&redirect_uri=https%3A%2F%2Fcjig.portal.founderss.cn%2Foauth%2Fcallback&response_type=code&scope=phone+openid+email+profile&state=e6369def-2842-41d8, submissionEditorUrl=https://journal.ids.fzyun.cn/auth/realms/journal/protocol/openid-connect/auth?client_id=journal-cjig-editor&redirect_uri=https%3A%2F%2Fcjigeditor.portal.founderss.cn%2Foauth%2Fcallback&response_type=code&scope=phone+openid+email+profile&state=9ccec05b-6bd, submissionReviewUrl=https://journal.ids.fzyun.cn/auth/realms/journal/protocol/openid-connect/auth?client_id=journal-cjig-author&redirect_uri=https%3A%2F%2Fcjig.portal.founderss.cn%2Foauth%2Fcallback&response_type=code&scope=phone+openid+email+profile&state=1e8a31c8-5434-4f78, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1304520351250146045, language=EN, name=Journal of Image and Graphics, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1788951488554, updatedTime=1788951488554, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=, submissionAuthorUrl=https://journal.ids.fzyun.cn/auth/realms/journal/protocol/openid-connect/auth?client_id=journal-cjig-author&redirect_uri=https%3A%2F%2Fcjig.portal.founderss.cn%2Foauth%2Fcallback&response_type=code&scope=phone+openid+email+profile&state=e6369def-2842-41d8, submissionEditorUrl=https://journal.ids.fzyun.cn/auth/realms/journal/protocol/openid-connect/auth?client_id=journal-cjig-editor&redirect_uri=https%3A%2F%2Fcjigeditor.portal.founderss.cn%2Foauth%2Fcallback&response_type=code&scope=phone+openid+email+profile&state=9ccec05b-6bd, submissionReviewUrl=https://journal.ids.fzyun.cn/auth/realms/journal/protocol/openid-connect/auth?client_id=journal-cjig-author&redirect_uri=https%3A%2F%2Fcjig.portal.founderss.cn%2Foauth%2Fcallback&response_type=code&scope=phone+openid+email+profile&state=1e8a31c8-5434-4f78, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1249024232475115590, websiteList=[Website(id=1249025782459334881, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1249024232475115590, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgtxtxxb/CN, language=CN, createTime=1775720552315, createBy=18614031015, updateTime=1775720586268, updateBy=18614031015, name=中国图象图形学报-中文, tplId=1146099689490845704, title=中国图象图形学报, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1249026166254928133, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782459334881, code=articleTextType, value=kx, createTime=1775720643819, updateTime=1775720643819, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026166221373698, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782459334881, code=banner, value=null, createTime=1775720643811, updateTime=1775720643811, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026166271705352, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782459334881, code=grayFlag, value=0, createTime=1775720643823, updateTime=1775720643823, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026166212985089, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782459334881, code=logo, value=https://castjournals.cast.org.cn/joweb/zgtxtxxb/CN/file/pic?fileId=TDRjKTHfgAnvFKZaDA70wA==, createTime=1775720643809, updateTime=1775720643809, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026166288482570, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782459334881, code=minRunFlag, value=0, createTime=1775720643827, updateTime=1775720643827, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026166246539524, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782459334881, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/zgtxtxxb/CN/file/pic, createTime=1775720643817, updateTime=1775720643817, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026166280093961, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782459334881, code=silenceFlag, value=0, createTime=1775720643825, updateTime=1775720643825, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026166233956611, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782459334881, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1775720643814, updateTime=1775720643814, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026166259122438, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782459334881, code=themeColor, value=null, createTime=1775720643820, updateTime=1775720643820, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026166267511047, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782459334881, code=themeStyle, value=null, createTime=1775720643822, updateTime=1775720643822, creator=18614031015, updator=18614031015)]), Website(id=1249025782681633001, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1249024232475115590, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN, language=EN, createTime=1775720552368, createBy=18614031015, updateTime=1775720607118, updateBy=18614031015, name=中国图象图形学报-英文, tplId=1146101810881728533, title=Journal of Image and Graphics, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1249026195371786511, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782681633001, code=articleTextType, value=kx, createTime=1775720650761, updateTime=1775720650761, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026195355009292, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782681633001, code=banner, value=null, createTime=1775720650757, updateTime=1775720650757, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026195392758034, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782681633001, code=grayFlag, value=0, createTime=1775720650766, updateTime=1775720650766, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026195342426379, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782681633001, code=logo, value=https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/file/pic?fileId=TDRjKTHfgAnvFKZaDA70wA==, createTime=1775720650754, updateTime=1775720650754, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026195409535252, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782681633001, code=minRunFlag, value=0, createTime=1775720650770, updateTime=1775720650770, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026195367592206, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782681633001, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/file/pic, createTime=1775720650760, updateTime=1775720650760, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026195401146643, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782681633001, code=silenceFlag, value=0, createTime=1775720650768, updateTime=1775720650768, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026195359203597, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782681633001, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1775720650758, updateTime=1775720650758, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026195380175120, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782681633001, code=themeColor, value=null, createTime=1775720650763, updateTime=1775720650763, creator=18614031015, updator=18614031015), WebsiteProps(id=1249026195388563729, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1249025782681633001, code=themeStyle, value=null, createTime=1775720650765, updateTime=1775720650765, creator=18614031015, updator=18614031015)])], journalTitle=中国图象图形学报, weixinUrl=null, journalUrl=https://www.cjig.cn/, iacademicId=null, status=1, seqNo=null, journalTitleEn=Journal of Image and Graphics, journalPhotoCn=uirXtX858YS3zEpFXZttJA==, journalPhotoEn=bud7qaxfvWHeFsbyBTAiKQ==, journalFirstLetter=Z, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/zgtxtxxb/CN/10.11834/jig.250550, detailUrlEn=https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/10.11834/jig.250550, pdfUrlCn=https://castjournals.cast.org.cn/joweb/zgtxtxxb/CN/PDF/10.11834/jig.250550, pdfUrlEn=https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/PDF/10.11834/jig.250550, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=1, orderTime=1786809600000, fullTextJson=null, articleText=null, reference=null)
收藏切换
具身智能模型评测:从感知到执行
收藏切换
PDF下载
李春一 1, 2 , 张建博 1, 2 , 肖嘉豪 1, 2 , 闫博闻 1, 3 , 郭晟毓 1, 4 , 叶桐瑞 1, 5 , 林维斯 6 , 翟广涛 1, 2, *
中国图象图形学报 | 具身智能与人形机器人前沿 2026,31(8): 2705-2730
收起
收藏切换
中国图象图形学报 |具身智能与人形机器人前沿 2026 , 31 (8) : 2705 -2730
具身智能模型评测:从感知到执行
全屏
[Author(id=1322960873005921201, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=lichunyi@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960873488266164, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960873005921201, language=EN, stringName=Chunyi Li, firstName=Chunyi, middleName=null, lastName=Li, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960873546986421, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960873005921201, language=CN, stringName=李春一, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 上海人工智能实验室评测专项组,上海;200032
2 上海交通大学信息与电子工程学院,上海 200240, bio={"content":"

李春一,男,博士研究生,主要研究方向为面向具身智能的多媒体信号处理。E-mail:

"}, bioImg=null, bioContent=

李春一,男,博士研究生,主要研究方向为面向具身智能的多媒体信号处理。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870548059041, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=2, ext=[AuthorCompanyExt(id=1322960870560641954, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China), AuthorCompanyExt(id=1322960870573224867, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 上海交通大学信息与电子工程学院,上海 200240)])]), Author(id=1322960873949639607, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=zhangjianbo@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960874415207354, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960873949639607, language=EN, stringName=Jianbo Zhang, firstName=Jianbo, middleName=null, lastName=Zhang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960874721391547, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960873949639607, language=CN, stringName=张建博, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 上海人工智能实验室评测专项组,上海;200032
2 上海交通大学信息与电子工程学院,上海 200240, bio={"content":"

张建博,男,助理研究员,主要研究方向为具身智能大小脑协作、SLAM导航。E-mail:

"}, bioImg=null, bioContent=

张建博,男,助理研究员,主要研究方向为具身智能大小脑协作、SLAM导航。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870548059041, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=2, ext=[AuthorCompanyExt(id=1322960870560641954, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China), AuthorCompanyExt(id=1322960870573224867, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 上海交通大学信息与电子工程学院,上海 200240)])]), Author(id=1322960875098878909, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=xiaojiahao@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960876810154944, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960875098878909, language=EN, stringName=Jiahao Xiao, firstName=Jiahao, middleName=null, lastName=Xiao, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960876902429633, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960875098878909, language=CN, stringName=肖嘉豪, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 上海人工智能实验室评测专项组,上海;200032
2 上海交通大学信息与电子工程学院,上海 200240, bio={"content":"

肖嘉豪,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

"}, bioImg=null, bioContent=

肖嘉豪,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870548059041, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=2, ext=[AuthorCompanyExt(id=1322960870560641954, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China), AuthorCompanyExt(id=1322960870573224867, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 上海交通大学信息与电子工程学院,上海 200240)])]), Author(id=1322960877040841667, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=yanbowen@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960877208613830, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877040841667, language=EN, stringName=Bowen Yan, firstName=Bowen, middleName=null, lastName=Yan, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 3, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
3 Institute of Data and Information,Tsinghua Shenzhen International Graduate School,Shenzhen 518055,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960877485437895, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877040841667, language=CN, stringName=闫博闻, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 3, address=1 上海人工智能实验室评测专项组,上海;200032
3 清华大学深圳国际研究生院数据与信息研究院,深圳 518055, bio={"content":"

闫博闻,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

"}, bioImg=null, bioContent=

闫博闻,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870644528036, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=3, ext=[AuthorCompanyExt(id=1322960870652916645, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870644528036, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 Institute of Data and Information,Tsinghua Shenzhen International Graduate School,Shenzhen 518055,China), AuthorCompanyExt(id=1322960870661305254, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870644528036, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 清华大学深圳国际研究生院数据与信息研究院,深圳 518055)])]), Author(id=1322960877632238537, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=guoshengyu@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960877758067660, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877632238537, language=EN, stringName=Shengyu Guo, firstName=Shengyu, middleName=null, lastName=Guo, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 4, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
4 Yuanpei College,Peking University,Beijing 100871,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960877825176525, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877632238537, language=CN, stringName=郭晟毓, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 4, address=1 上海人工智能实验室评测专项组,上海;200032
4 北京大学元培学院,北京 100871, bio={"content":"

郭晟毓,男,硕士研究生,主要研究方向为具身智能与世界模型。E-mail:

"}, bioImg=null, bioContent=

郭晟毓,男,硕士研究生,主要研究方向为具身智能与世界模型。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960872326443943, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=4, ext=[AuthorCompanyExt(id=1322960872339026856, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872326443943, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4 Yuanpei College,Peking University,Beijing 100871,China), AuthorCompanyExt(id=1322960872355804073, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872326443943, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4 北京大学元培学院,北京 100871)])]), Author(id=1322960877900673999, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=yetongrui@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960877988754386, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877900673999, language=EN, stringName=Tongrui Ye, firstName=Tongrui, middleName=null, lastName=Ye, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 5, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
5 Department of Psychology,Tongji University,Shanghai 200292,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960878072640467, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960877900673999, language=CN, stringName=叶桐瑞, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 5, address=1 上海人工智能实验室评测专项组,上海;200032
5 同济大学应用心理学系,上海 200292, bio={"content":"

叶桐瑞,男,硕士研究生,主要研究方向为具身智能心理学评测。E-mail:

"}, bioImg=null, bioContent=

叶桐瑞,男,硕士研究生,主要研究方向为具身智能心理学评测。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960872620045226, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=5, ext=[AuthorCompanyExt(id=1322960872632628139, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872620045226, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5 Department of Psychology,Tongji University,Shanghai 200292,China), AuthorCompanyExt(id=1322960872649405356, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872620045226, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5 同济大学应用心理学系,上海 200292)])]), Author(id=1322960878156526549, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=6, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=wslin@ntu.edu.sg, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1322960878232024023, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960878156526549, language=EN, stringName=Weisi Lin, firstName=Weisi, middleName=null, lastName=Lin, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=6, address=6 College of Computing and Data Science,Nanyang Technological University,Singapore 639798,Singapore, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960878299132888, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960878156526549, language=CN, stringName=林维斯, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=6, address=6 南洋理工大学计算机与数据科学学院,新加坡 639798,新加坡, bio={"content":"

林维斯,男,教授,主要研究方向为图像处理、感知建模、多媒体信号处理和计算机视觉。E-mail:

"}, bioImg=null, bioContent=

林维斯,男,教授,主要研究方向为图像处理、感知建模、多媒体信号处理和计算机视觉。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960872750068653, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=6, ext=[AuthorCompanyExt(id=1322960872758457262, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872750068653, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=6 College of Computing and Data Science,Nanyang Technological University,Singapore 639798,Singapore), AuthorCompanyExt(id=1322960872766845871, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960872750068653, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=6 南洋理工大学计算机与数据科学学院,新加坡 639798,新加坡)])]), Author(id=1322960878370436058, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, orderNo=7, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=zhaiguangtao@pjlab.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1322960878462710749, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960878370436058, language=EN, stringName=Guangtao Zhai, firstName=Guangtao, middleName=null, lastName=Zhai, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, *, address=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1322960878525625310, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, authorId=1322960878370436058, language=CN, stringName=翟广涛, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, *, address=1 上海人工智能实验室评测专项组,上海;200032
2 上海交通大学信息与电子工程学院,上海 200240, bio={"content":"

翟广涛,通信作者,男,教授,主要研究方向为图像处理、感知建模、大模型与具身智能评测。E-mail:

"}, bioImg=null, bioContent=

翟广涛,通信作者,男,教授,主要研究方向为图像处理、感知建模、大模型与具身智能评测。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1322960870430618526, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=1, ext=[AuthorCompanyExt(id=1322960870459978655, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China), AuthorCompanyExt(id=1322960870476755872, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870430618526, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 上海人工智能实验室评测专项组,上海;200032)]), AuthorCompany(id=1322960870548059041, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, xref=2, ext=[AuthorCompanyExt(id=1322960870560641954, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China), AuthorCompanyExt(id=1322960870573224867, tenantId=1146029695717560320, journalId=1249024232475115590, articleId=1322960864705393559, companyId=1322960870548059041, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 上海交通大学信息与电子工程学院,上海 200240)])])]
李春一1, 2 , 张建博1, 2 , 肖嘉豪1, 2 , 闫博闻1, 3 , 郭晟毓1, 4 , 叶桐瑞1, 5 , 林维斯6 , 翟广涛1, 2, *
作者信息
  • 1 上海人工智能实验室评测专项组,上海;200032
  • 2 上海交通大学信息与电子工程学院,上海 200240
  • 3 清华大学深圳国际研究生院数据与信息研究院,深圳 518055
  • 4 北京大学元培学院,北京 100871
  • 5 同济大学应用心理学系,上海 200292
  • 6 南洋理工大学计算机与数据科学学院,新加坡 639798,新加坡
通讯作者:
翟广涛,通信作者,男,教授,主要研究方向为图像处理、感知建模、大模型与具身智能评测。E-mail:
作者简介:

李春一,男,博士研究生,主要研究方向为面向具身智能的多媒体信号处理。E-mail:

张建博,男,助理研究员,主要研究方向为具身智能大小脑协作、SLAM导航。E-mail:

肖嘉豪,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

闫博闻,男,工程师,主要研究方向为具身智能仿真平台开发。E-mail:

郭晟毓,男,硕士研究生,主要研究方向为具身智能与世界模型。E-mail:

叶桐瑞,男,硕士研究生,主要研究方向为具身智能心理学评测。E-mail:

林维斯,男,教授,主要研究方向为图像处理、感知建模、多媒体信号处理和计算机视觉。E-mail:

翟广涛,通信作者,男,教授,主要研究方向为图像处理、感知建模、大模型与具身智能评测。E-mail:

Embodied intelligence model evaluation: from perception to execution
Chunyi Li1, 2 , Jianbo Zhang1, 2 , Jiahao Xiao1, 2 , Bowen Yan1, 3 , Shengyu Guo1, 4 , Tongrui Ye1, 5 , Weisi Lin6 , Guangtao Zhai1, 2, *
Affiliations
  • 1 Center of AI Evaluation,Shanghai AI Lab,Shanghai 200032,China
  • 2 School of Information Science and Electronic Engineering,Shanghai Jiao Tong University,Shanghai 200240,China
  • 3 Institute of Data and Information,Tsinghua Shenzhen International Graduate School,Shenzhen 518055,China
  • 4 Yuanpei College,Peking University,Beijing 100871,China
  • 5 Department of Psychology,Tongji University,Shanghai 200292,China
  • 6 College of Computing and Data Science,Nanyang Technological University,Singapore 639798,Singapore
出版时间: 2026-08-16 doi: 10.11834/jig.250550
文章导航
收藏切换

具身智能通过“身体—环境—任务”闭环交互,被视为迈向通用人工智能的核心路径。然而,与模型参数和训练数据的高速扩张形成鲜明对照,其评测体系仍处于“任务碎片化、指标多元化、平台封闭化”的自发状态,造成同一功能在不同研究中的性能差异超过10%,却无法判定来源是算法创新、数据扩充还是评测偏差,严重阻碍了技术迭代与产业落地。本文围绕“从感知到执行”的完整链路,对2020—2025年间发表于CVPR(IEEE/CVF Conference on Computer Vision and Pattern Recognition)、ICRA(IEEE International Conference on Robotics and Automation)、NeurIPS(Conference on Neural Information Processing Systems)等顶级会议与 Nature、IJRR(International Journal of Robotic Research)、JMLR(Journal of Machine Learning Research)等期刊的百余篇文献进行系统梳理,首次提出“静态数据集—仿真平台—真实机器人”三级金字塔式评测范式,并从感知、认知、决策、执行4个环节拆解出20余项核心能力维度与量化指标,分别从方法学假设、适用边界、固有局限和成本—可信度曲线4个角度进行横向对比。本文进一步汇总了46套主流基在数据规模、任务类型、评估指标、开源程度和安全伦理考量等维度的差异。基于此,提出“能力导向、协议统一、三级协同”的未来框架:1)在任务层,由“功能对标”转向“能力对标”,建立可分解、可溯源、可加权的多维误差体系;2)在协议层,制定统一的场景描述、接口规范与指标定义,实现跨平台、跨任务、跨模型的可比性;3)在系统层,构建可远程接入、7 × 24 h运行的共享机器人集群,形成“仿真预训练—真机微调—在线更新”的闭环追踪,降低重复建设成本,打通从实验室到场景落地的“最后一公里”。最后讨论了安全伦理、文化偏见和能效评估等新维度如何纳入量化框架,并给出标准化路线图的短、中、长期目标。本文工作为具身智能从“技术涌现”走向“科学共识”提供了可操作的评测基础设施与参考范式,具体的静态—仿真—真机榜单展示在:https://opencompass.org.cn/embodied-intelligence。

具身智能  /  评测体系  /  感知—认知—决策—执行  /  仿真平台  /  真机测试  /  仿真—现实一致性

Embodied intelligence refers to agents that sense,reason,act,and learn through a tight “body-environment-task” feedback loop. It is widely regarded as the most promising route to general-purpose artificial intelligence (AI). Paradoxically,although model parameters,training data,and compute budgets have grown by four orders of magnitude in only five years,the evaluation ecosystem remains fragmented and largely irreproducible. The same functional capability (e.g.,“pick-and-place”) is formalized as object-detection mean average precision in one paper,as 3D intersection over union in a second,as task success rate in a third,and as human preference score in a fourth,with absolute gaps that exceed 10%—15% among “state-of-the-art” results. Environments,random seeds,physics parameters,sensor noise models,and success criteria are rarely open-sourced,and thus,the community cannot tell whether an apparent improvement originates from algorithmic innovation,data scale,evaluation cherry picking,or simple benchmark over-fitting. This uncertainty has become a critical bottleneck for scientific progress and industrial adoption. To address the gap,we conduct a systematic survey of 100+ papers published in IEEE/CVF Conference on Computer Vision and Pattern Recognition,IEEE International Conference on Robotics and Automation,Conference on Neural Information Processing Systems,Robotics: Science and Systems,International Conference on Learning Representations,International Journal of Robotic Research,and Journal of Machine Learning Research between 2020 and 2025. Then,we present the first holistic analysis of embodied AI evaluation. We organize the landscape into a three-tier pyramid: static datasets,simulation benchmarks,and real-robot trials. Each tier trades off cost,controllability,and ecological validity. Across all tiers,we decompose evaluation space into four tightly coupled stages: perception,cognition,decision,and execution. Then,we identify fine-grained capability dimensions along with 20+ quantitative metrics. For every dimension,we analyze the following: 1) the underlying methodological assumptions,2) the boundary conditions under which the metric is valid,3) the intrinsic limitations (e.g.,sim-to-real physics mismatch,dataset bias,human-label variance),and 4) the cost-credibility curve that determines when a researcher should ascend from static to simulation,and finally to the real world.All evaluations in this study are based on a theoretical “perception-cognition-decision-execution loop” framework. In embodied AI,perception is the process by which an agent converts raw,asynchronous,and often noisy signals from heterogeneous physical sensors,such as RGB-D cameras,LiDAR,tactile skins,joint encoders,force/torque,and inertial measurement unit units,into a registered,time-aligned digital twin that supplies metric 3D geometry and semantic labels. Cognition is then built on this torrent to distill structured,memory-enabled,and generalizable world models that encode object affordances,physical common sense,and relational and causal links,grounding free-form human language into the resulting latent space. Decision-making combines these world models with an explicit task goal and searches across symbolic,kinematic,and dynamic levels to output a coherent,risk-aware,and resource-efficient plan that is expressed as a hierarchy of subgoals,trajectories,and low-level set points. Finally,execution transforms this plan into real-world mechanical energy through high-rate feedback controllers that track desired motions or forces while compensating for actuator nonlinearities,shock,thermal limits,and human safety constraints,closing the perception-cognition-decision-execution loop that defines embodied AI. In contrast with humans,whose perception-cognition-decision-execution loop is seamlessly integrated,currently available embodied agents suffer structural flaws in every stage. Consequently,evaluation must decouple the four blocks and score accuracy,error,and latency separately to pinpoint bottlenecks. Static tests,i.e.,“written exams”,run on a GPU with a few megabytes of images or point clouds in minutes,but erase dynamics and physics. Simulation,i.e.,the “job interview”,adds interactive physics in tens of seconds but still drifts away from reality. Real robot trials,i.e.,“practical tests”,cost thousands,take days to deploy and minutes per run,but expose every sensing drift,prediction error,or control delay,offering the ultimate ground truth before field deployment. Therefore,by integrating the three-tier pyramid of static test-simulation-real robot evaluation into the closed perception-cognition-decision-execution loop,this work delivers the first systematic quantification of coverage,cost,and accuracy trade-offs across more than 100 embodied AI benchmarks,establishing a reproducible,traceable,and extensible evaluation baseline that not only exposes the exact stage at which state-of-the-art systems fail,but also provides a principled road map for allocating research budgets,standardizing protocols,and certifying safety before real-world deployment,marking a pivotal transition from empirical competition to scientific measurement,and accelerating the field’s development toward trustworthy,deployable,and general-purpose embodied intelligence. The detailed static-dynamic-real embodied intelligence evaluation can be accessed at https://opencompass.org.cn/embodied-intelligence.

embodied intelligence  /  benchmark evaluation  /  perception-cognition-decision-execution  /  simulation  /  real-world validation  /  sim2real consistency
李春一, 张建博, 肖嘉豪, 闫博闻, 郭晟毓, 叶桐瑞, 林维斯, 翟广涛. 具身智能模型评测:从感知到执行. 中国图象图形学报, 2026 , 31 (8) : 2705 -2730 . DOI: 10.11834/jig.250550
Chunyi Li, Jianbo Zhang, Jiahao Xiao, Bowen Yan, Shengyu Guo, Tongrui Ye, Weisi Lin, Guangtao Zhai. Embodied intelligence model evaluation: from perception to execution[J]. Journal of Image and Graphics, 2026 , 31 (8) : 2705 -2730 . DOI: 10.11834/jig.250550
具身智能(embodied intelligence)作为人工智能(artificial intelligence,AI)领域最具挑战性的前沿方向之一,其核心思想在于强调智能并非仅仅源于抽象的计算或符号处理,而是深深植根于物理实体与动态环境之间的持续交互之中(Pfeifer和Bongard,2006)。这一范式认为,一个智能体的认知、学习和决策能力,从根本上受到其身体形态、感知运动系统以及与环境互动方式的塑造(Anderson,2003)。具身智能体(embodied agent)通常定义为一个能够通过传感器感知环境,并通过执行器对环境施加影响的物理实体,其智能行为在感知与决策的连续循环中,逐步达到涌现和演化(Duan等,2022)。
具身智能与传统人工智能在智能获取方式上存在本质区别。传统人工智能,尤其是在大数据和深度学习驱动下取得巨大成功的领域,如计算机视觉(computer vision,CV)和自然语言处理(natural language processing,NLP),其模型训练主要依赖于大规模、预先收集并标注的静态数据集(LeCun等,2015)。这种范式使得模型能够在特定、受限的环境中表现出色,但一旦面临开放、动态和非结构化的真实世界,其泛化能力和鲁棒性便会受到严峻挑战(Torralba和Efros,2011)。相比之下,具身智能体通过与环境的实时互动来获取训练数据、检验假设并优化行为策略(Kaelbling等,1996)。这种学习方式使得智能体能够持续适应环境变化,并从交互中自主发现和学习新的概念与技能。
随着具身智能在研究和实际应用中的广泛使用,对其进行有效评测变得愈发重要。然而,与模型规模、参数更新频率及场景覆盖度的高速扩张形成鲜明对照的是,评测体系仍未统一,主要表现为:
1)任务定义碎片化。同一“抓取—放置”功能在不同工作中被形式化为对象检测精度、动作成功率、路径效率或人机交互满意度等异质指标,缺乏统一的操作化描述。
2)环境配置封闭化。近八成已发表具身智能模型依赖私有仿真器、非公开真机平台或定制传感器套件,随机种子、物理参数、渲染管线与噪声模型均未开源,导致结果无法复现。
3)评价协议差异化。静态数据集、高保真仿真与真实机器人,即静态、仿真和真机3种评测范式在成本与保真度上,呈现明显的两难;研究者往往基于可承受资源而非科学必要性选择评测路径,进而造成“最优”声明的不可通约。
尽管近期已有多篇具身智能综述论文,如An等人(2025)、Sun等人(2024)以及Liang等人(2025)围绕具身智能的发展进行总结,但尚未有文章对具身智能评测的方法、数据以及挑战等进行完整的梳理。上述评测体系缺失的直接后果是“横向不可比、纵向不可加”:不同团队在同一任务上报告的最优性能差异可达10%以上,却无法判定其来源是模型创新、数据扩充还是评测偏差;产业界在选型时面临置信真空,不得不重复投入高昂的真机试验以验证厂商声明,显著抬高了技术转化门槛。因此,本文对具身智能的能力评测方法进行全景式梳理,厘清静态数据集、仿真平台与真实环境3类范式各自的方法学假设、适用边界与固有局限,并在此基础上提出面向标准化与可复现的未来框架,以推动具身智能领域从“技术涌现”走向“科学共识”。
近年来,随着算法、理论和硬件的飞速发展,具身智能已被广泛认为是探索通用人工智能(artificial general intelligence,AGI)的核心路径,获得了学术界和工业界的一致共识(Lake等,2017)。AGI 的目标是创造出能够像人类一样思考、学习和解决各种复杂问题的智能系统。许多研究者认为,要实现这一目标,智能体必须拥有一个物理身体,使其能够像人类一样通过感知和行动与物理世界进行深度交互。这种交互不仅是获取信息的手段,更是智能形成的源泉。通过具身交互,智能体可以学习到关于物理世界的基本规律,积累常识知识,并发展出解决新问题的能力。因此,具身智能被视为弥合当前AI与AGI之间鸿沟的关键,它迫使智能体必须处理真实世界的复杂性和不确定性,从而催生出更鲁棒、更灵活和更具适应性的智能。
具身智能的发展主要围绕两大核心任务——操作(manipulation)和导航(navigation)。早期研究聚焦于特定任务和环境下训练的策略模型,形成了以强化学习(reinforcement learning,RL)和模仿学习(imitation learning,IL)为主的学习方法。随着大语言模型(large language model,LLM)和多模态大模型(multimodal large language model,MLLM)的崛起,出现了将大模型引入具身智能的具身大模型(embodied large model,ELM)范式。具身智能任务通常可形式化为部分可观测马尔可夫决策过程(partially observable Markov decision process,POMDP)。在现实环境中,智能体无法直接访问完整的环境状态,而只能通过传感器获得部分观测,因此 POMDP 成为描述具身交互的自然框架。一个典型的 POMDP 可表示为七元组
φ
,具体为
φ=(S, O, A, P, Ω, R, γ)
式中,S表示环境状态空间,O表示观测空间,A表示动作空间,
P(S'S,A)
为状态转移概率分布,
Ω(O|S)
为观测概率分布,
R(S,A)
为奖励函数,
γ∈R
为折扣因子。智能体的行为由策略
π(a|s)
控制,目标是最大化期望(max E)收益
r
,具体为
r=maxπEπ∑t γtRt
对于一般的具身智能任务,需要将 POMDP 的策略扩展为
π(AS,g)
。g为智能体当前的任务目标,可以由文本或数值表示。在真实环境中,状态转移P和观测分布
Ω
较为复杂,通常不可知。仿真器(simulator)通过建立运动模型和观测模型得到近似的状态转移和观测分布。奖励函数R的定义通常取决于智能体使用的学习方法。
在操作任务中,智能体通过机械臂等执行机构与环境中的物体发生交互。此时,状态空间S通常包含机器人自身的运动学与动力学状态、场景中物体的位姿及其属性,以及与任务目标相关的信息。在仿真器中,观测空间O可以自由定义,往往取决于实验设计;而在真实环境中,根据传感器的不同,
O
的形式包括激光雷达点云、深度相机图像、惯性测量单元读数以及力/触觉反馈等。动作空间 A则取决于控制层级,可为低层的位置控制、速度控制、力控制或高层的末端轨迹规划与技能调用。
对于该任务,代表性的视觉—语言—动作大模型(vision language action model,VLA)研究,主要包括 Google Robotics 提出的 RT 系列模型。RT-1(Brohan等,2023)将 Transformer 引入机器人控制,实现了从多模态输入到离散化动作序列的端到端映射,显著提升了跨任务泛化能力。RT-2(Zitkovich等,2023)将视觉—语言模型(vision language model,VLM)扩展至机器人任务,通过在互联网规模的视觉问答(visual question answering,VQA)数据与机器人数据上进行协同微调,实现了从网络知识到物理执行的跨域迁移。RT-X(O’Neill等,2024)则在开放数据集 Open X-Embodiment 上对 RT-1 与 RT-2 进行重新训练,显著提升了二者的性能。此外,RT-Trajectory(Gu等,2024)和 RT-H(Belkhale等,2024)分别在输入模态和中间层架构上对已有模型进行改进。
在导航任务中,智能体通过移动执行全局路径规划与目标到达。状态空间S通常由机器人在地图坐标系下的位姿、全局地图信息和任务相关信息组成。与操作任务类似,观测空间O的定义同样取决于环境、传感器和实验设计。动作空间A可为连续控制命令(线速度和角速度),也可为离散动作集。
对于该任务,端到端的视觉—语言—导航大模型(vision language navigation model,VLN)的代表性工作是 NaVid(Zhang等,2024c)。该方法仅依赖单目 RGB 视频流与自然语言指令,通过大规模视觉—语言—动作预训练,在连续环境中直接输出导航动作,实现了优秀的仿真—现实迁移性能。后续工作通过引入多任务学习、强化学习微调等机制进一步提升VLN的性能和泛化能力(Zhang等,2024b;Qi等,2025)。
随着具身智能的发展与应用,模型解决以上任务的能力也迅速提升,出现了大量的相关工作。但与此同时,随着模型能力的日益增强,需要在传统的、基于单一任务的单一评价方法外,准确刻画模型的各项能力维度,以适应新的具身智能评测需求。
不同于经典的大模型评测(Zhang等,2025d,2026),仅以最终文本或标签的正确性为唯一判据,具身智能的能力评测维度如式(1)所示,必须贯穿从状态到动作的完整链路,具体包括:在感知阶段,需考察传感器对视觉、听觉和触觉等多模态信号的保真度与时空对齐误差;在认知阶段,需评估对目标识别、场景分割与语义关联的鲁棒性,尤其关注分布外物体或遮挡条件下的表征漂移;在决策阶段,需度量任务规划、因果推理与价值对齐的合理性,检验模型能否在部分可观测环境中推演出可达且安全的行为序列;在执行阶段,则需量化动作精度、能耗、碰撞率及人机交互的物理一致性,并记录因驱动器延迟、质量—惯性不匹配导致的累积误差。如图1所示,只有当整条闭环的各环节误差传播被逐项分解、溯源并加权后,才能判定“失败”究竟源于传感器噪声、表征歧义、策略短视还是控制偏差,从而避免将系统级失误简单归咎于“模型输出错误”这一单一归因陷阱。
在百万年进化的压力下,人类已形成一套高度集成、可预测、可补偿的多层级感知—运动架构。外界光线首先经过角膜—晶状体的快速调焦和虹膜的实时光圈控制,落在具备微扫视机制的视网膜上;这些微小而高频率的眼动不仅清除了视觉暂留带来的信息衰减,还使外侧膝状体及初级视皮层能够在时序上累积高动态范围信号。随后,大脑利用自顶向下的注意信号(主要来自额叶与顶叶)对视觉场景进行软掩膜处理,抑制与当前任务无关的区域,从而节省神经计算资源。决策阶段,前额叶提供风险—收益评估,基底节与多巴胺回路给出强化信号,小脑则通过内部前馈模型预测下一步感觉输入,实现毫秒级的误差校正。最终,脊髓—肌肉—肌腱构成的可变刚度执行器,吸收突发冲击并保持动作流畅。
考虑到以上“感知—认知—决策—执行”架构的通用性,需融合认知科学的多感官加权理论,将机器智能的“信号—特征—语义—行为”与人类智能的“眼睛—大脑—小脑—身体”依次跨层耦合。现代具身智能体采用“传感器—算力—驱动器”分离的模块化架构。对于具身智能,相机以固定帧率和卷帘快门采集图像,自动曝光与白平衡算法试图模拟虹膜功能,但帧间延迟和读出时序无法用于高速运动场景;VLM以固定感受野和位置编码提取特征,缺乏生物意义上的可塑性,需要额外注意力模块才能部分模拟额叶的“软掩膜”效果。VLN/VLA/强化学习算法通过价值函数直接输出动作分布,没有内建的前馈预测环节,必须依赖外部模型预测控制来补偿延迟,但GPU(graphics processing unit)推理时隙限制了更新频率。执行端采用电机—减速器—连杆的高刚度链,虽然可通过力矩传感器和阻抗控制算法模拟柔性物体,但仍面临回滞与摩擦瓶颈,无法达到生物肌肉的变刚度和能量回收特性。
综上,如表1所示,与人类近乎理想的“感知—认知—决策—执行”耦合机制不同,现阶段的具身智能体,四大环节均存在结构性缺陷。正因如此,具身智能评测必须将四环节解耦,分别量化正确率、误差和时延等因素,才能精准定位瓶颈,为具身智能的逐层改进提供可验证的定量依据。
具身智能的评测成本与可信度呈反向指数关系:越接近真实物理世界,开销越高,但结果越可信;越依赖离线数据,开销越低,却需承受“虚实鸿沟”带来的不确定性。以下将主流评测手段归纳为三级金字塔架构——静态、仿真、真机——并在硬件预算、数据规模、部署周期与单次评估时延4个维度给出数量级对比,为研究者根据资源与精度需求选择合适范式提供量化依据。
1)静态评测。如同“笔试”,仅需GPU与若干兆字节图像或点云,无需任何机器人硬件,数分钟内即可搭建完成;一次推理耗时约0.1 s,便可将模型输出与专家标注进行开环比对。其优点是将成本压到极限,缺点是把动态交互与物理反馈完全抽象掉,模型在数据集上表现再优异,也可能因忽略几何约束或动力学延迟而在真实场景失效。
2)仿真评测。如同“面试”,需购置百元至千元级显卡与许可证,加载吉字节级的高保真场景资产,花费数小时到数天完成环境编译与接口对接;一次闭环试验约10 s,可在虚拟渲染世界里让机器人、人类与物体持续交互。由于支持物理引擎、传感器噪声和随机初始位姿,仿真能暴露部分策略短板,但仍受限于材质参数、接触模型与渲染差异,结果与真机表现间常存在可见却可控的中档落差。
3)真机评测。如同“实战”,硬件预算陡增至万元以上,数据需在现场实时采集,部署周期拉长到数天乃至数周;受限于机械拆装、标定、安全评估与人工复位,单次任务执行时间常以分钟计。其核心优势在于——物理世界不会妥协:光照变化、地面摩擦、电机回滞与意外碰撞一并涌入,任何感知漂移、预测误差或控制延迟都会立刻显形。因此,真机评测成本最高,却提供虚实差异最小的终极可信度,也是具身智能模型从实验室走向工程落地前,必须跨越的“最后一公里”。
综上,本文将依次回顾以上3种评测范式的方法,包括其任务定义、评测指标以及在具身智能“感知—认知—决策—执行”闭环中对应的步骤。
静态评测指的是在无需仿真环境或真实机器人执行的条件下,基于离线数据对具身智能模型进行能力评估的评测范式,有时也称为离线评测。
作为“金字塔式分层架构”评价体系的第1层,静态评测旨在实现快速筛查与初步诊断。它通过低成本、高效率、可复现的离线评估过程,对具身智能模型的感知、理解与规划等核心能力进行定量测验,为后续更高成本的仿真和真实环境测试提供前置筛选与参考依据。但与此同时,静态评测与真实闭环的动态测评,也存在天然的差距。
在具身智能领域,正确性指标最为常用。这类指标直接衡量模型是否达成任务目标,是最基础、最常用的评测方式。静态评测中常用的指标如下:
1)准确率(Acc)。即正确/错误分类样本
ClassTrue
与
ClassFalse
中,正确样本占总体的比例,常用于选择题类或分类任务,反映模型判断结果的整体正确性。计算为
Acc=ClassTrueClassTrue+ClassFalse
2)MRA(mean relative accuracy)。计算为
MRA=1C∑θ∈C1y^-yy<1-θ
式中,
y^
为模型预测值,
y
为真实值,
θ
为置信阈值,集合
C={0.5,0.55,⋯,0.95}
,
1(⋅)
是指示函数,当条件成立时取1,否则取0。该式用于衡量数值预测相对准确性,平均考虑不同置信阈值下预测效果。
3)点位box的生成。即点位准确性,计算为
AccPoint=-1N∑i=1N1Pi¯-Pi2<ω
式中,
Pi¯
为预测点位置,
Pi
为真实点位置,
ω
为误差阈值,
1(⋅)
为类似的指示函数,当预测误差小于阈值时取1,否则取0。
4)交并比定位精度。计算为
IoU=Vpred⋂VgtVpred⋃Vgt
式中,
Vpred
为预测的三维包围盒体积,
Vgt
为真值体积。若IoU大于阈值,则视为正确定位。
5)导航误差(navigation error,NE)。为模型终点
Ppred
与目标点
Pgt
之间的欧氏距离。具体为
NE=Ppred-Pgt2
6)轨迹平均绝对误差和轨迹均方根误差。衡量模型预测轨迹
Pt¯
和真实轨迹
Pt
在空间位置上的平均偏差。计算为
MSE=1T∑t=1T Pt¯-Pt1
 
RMSE=1T∑t=1T Pt¯-Pt22
当遇到开放式问答题目的时候,一般而言,对于开放型回答的,会用计算文本相似度的指标来计算与真值标签的相似度。
7)GPT指标。计算为
SGPT=1M∑i=1MGPTyipred, yigt
式中,
yipred
和
yigt
分别是预测和真值描述,通过GPT
⋅
或类似大模型评分它们的语义一致性。
8)语义匹配度(semantic similarity)。计算为
Ssem=Sim(fenc(Dpred),  fenc(Dgt))
式中,
fenc
表示文本编码器(如CLIP、Sentence- BERT),
Dpred
和
Dgt
表示全部的预测值/真值语义特征信息,Sim
⋅
表示余弦相似度函数。
9)CIDEr。计算为
CIDEr=1N∑i=1N gi⋅cigici
式中,
gi
为参考描述的特征,
ci
为生成描述的特征。
10)ROUGE-L。计算为
ROUGE=(1+β2)⋅RLCS⋅PLCSRLCS+β2PLCS
式中,
RLCS
为最长公共子序列在参考文本中的覆盖率,
PLCS
为在生成文本中的覆盖率。
11)BLEU。计算为
BLEU=BP⋅exp∑n=1N wnlogpn
式中,
pn
为 n-gram 精确匹配概率,
wn
为权重,BP 为长度惩罚。
12)TF-IDF相似度。计算为
SimTF=va⋅vbvavb
式中,
va
与
vb
分别为生成和参考文本的TF-IDF向量。
13)文本向量余弦相似度TRF。通过编码器将文本映射到向量空间,再计算预测
fpred
与真实
fgt
向量余弦相似度,衡量语义匹配度。具体为
TRF=cosfgt,  fpred=fgt⋅fpredfgt⋅fpred
14)效率(Efficiency),即当前任务执行步数
Step
与理论最小需要步数
Stepmin
之间的比例,衡量模型在完成任务时的行为效率,值越接近 1 表示路径或动作规划越高效。具体为
Eff=StepminStep
15)稳健性(PR)。该指标反映模型在随机初始化或环境扰动下性能的稳定性。计算为
PR=1-σ(S)μ(S)
式中,
S
为模型在多次尝试中的成功率集合,
μ(·)
为均值
,
σ(·)
为标准差。
16)综合能力指标。该指标通过多层加权平均的方式融合不同子任务或维度的分数,反映模型多维能力综合表现。例如Uniscore,通过先计算每个原子任务
ol
的得分,再对组成子任务的多个原子任务取平均得到子任务得分
sj2
,然后对组成主任务的多个子任务取平均得到主任务得分
si1
,最后对所有主任务取平均得到总体综合得分
S
。即
Suni=1n∑i=1n si1, si1=1m∑j=1m sj2, sj2=1k∑l=1k ol
式中,n、m和k分别表示主任务数、子任务数和原子任务数。
此外,在实际评测中,部分工作还会对上述指标进行策略微调,如轮换评测、重复测试等,以减少随机猜测的影响并获得更加稳定可靠的结果。
研究者提出了一系列静态评测平台和基准,用于评估具身智能模型在视觉感知、空间认知、任务推理和执行等方面的能力。它通过固定数据与环境输入,考察模型在“感知—认知—决策—执行”4个层级上的表现。相比动态闭环实验,静态评测具备高效、可复现和低风险等优势,是大规模模型筛选和对比的重要环节(Xiao等,2025b)。如表3所示,静态评测在4个层级均有涉及。
感知层评测主要关注视觉属性理解、三维重建和多模态对齐能力。ScanRefer与Multi3DRefer拓展到多物体参照定位任务,采用Recall@K、mIoU和F1分数衡量多物体空间关系理解精度(Chen等,2020)。Scan2Cap首次将三维扫描场景与语言生成任务结合,通过IoU、CIDEr、BLEU和ROUGE等指标评估模型在3D视觉语义映射上的一致性(Chen等,2021)。ScanQA通过4万条问题评估3D场景理解与问答能力(Azuma等,2022)。SQA3D以33 k问题检验模型在三维空间推理中的语言—空间对齐能力(Ma等,2023)。Embodied-IQA面向具身场景图像质量评估,构建36 000多对参考与失真图像对,通过BLEU、ROUGE、CIDEr和TRF指标验证视觉信息与多模态任务的对齐一致性(Li等,2025a)。VABench在复杂空间结构下测试轨迹生成可行性,结合PointAcc与RMSE指标量化视觉表征在导航和规划中的有效性(Yuan等,2025)。
在认知层级,关注更高层次的语义和推理能力,一般以视觉问答(VQA)形式出现。Can-Do在多模态复杂场景下测试理解、推理与高阶规划能力,结合Acc和BLEU指标评估任务通用性(Chia等,2024)。RoboVQA构建大规模视频—文本问答数据集,检验模型在长时视觉推理任务中的语言生成精度(Sermanet等,2024)。OpenEQA与UniEQA代表开放词汇问答类基准,前者以Acc和GPT评估语言理解精度(Majumdar等,2024),后者通过Uniscore、Acc和BLEU综合衡量理解与生成一致性(Zhang等,2025b)。VSI-Bench聚焦视频语义整合,使用MRA和Recall@K衡量跨帧语义一致性及时空关系理解能力(Yang等,2025)。ERQA侧重物理交互因果推理,采用Acc、Recall和F1分数评估因果推理能力(Gu等,2025)。PhyBlock结合物理常识问答任务,通过Acc、precision/recall及mAP(mean average precision)衡量隐式规律抽象能力(Ma等,2025)。MineAnyBuild以Minecraft建造场景评估语言指令与生成方案一致性,采用GPT评分和指令执行匹配率(Exec Rate)量化规划与推理能力(Chen等,2025c)。Embodied Arena、StaticEmbodiedBench和UniEQA在认知层提供跨模态与多任务理解指标,从语言维度描绘具身智能系统的“语义理解—因果推理—生成一致性”链条(Ni等,2025;Xiao等,2025b;Zhang等,2024b)。
决策层级着重考察模型在任务规划与分解方面的能力,通常涉及将复杂任务拆解为有序的子任务序列。通常决策与上述认知会一同考虑。Embodied Arena整合22个评估语言理解精度(Majumdar等,2024),后者通过Uniscore、Acc和BLEU综合衡量理解与生成一致性(Ni等,2025)。StaticEmbodied Bench提供1 000条问答和100条具身操作数据,以Acc、L2距离和Task Completion Rate衡量规划合理性与指令到执行映射精度(Xiao等,2025b)。Embodied-IQA、PhyBlock及MineAnyBuild结合Acc、precision/recall和exec rate考察模型将感知与认知信息转化为可执行策略的能力(Li等,2025;Ma等,2025;Chen等,2025c)。
执行层评测着重模型动作生成与轨迹控制能力。OmniVTLA通过40条真实机器人操作轨迹测量视觉—动作对齐精度,以MSE、Trajectory Error和Success Rate量化动作误差(Cheng等,2025)。VLATest在离线仿真环境下提供18 604条轨迹,用MSE、RMSE和Success Rate评估动作生成稳定性与视觉引导精度(Wang等,2025)。GraspVLA与OpenX-Embodiment以百万级机器人示例构建跨场景抓取与操作评测体系,通过MSE、Success Rate和Grasp Acc验证执行泛化能力(Deng等,2025;O’Neiu等,2023)。USIM设计1 852条水下操作轨迹模拟低能见度与视觉扰动条件,以MSE和Task Success Rate衡量视觉—动作稳健性(Gu等,2025)。Droid通过7万多示例分析多机型、多模态对齐控制一致性,采用MSE、RMSE和Task Completion Rate指标(Khazatsky等,2024)。孟启帆等人(2025)使用虚拟现实技术在物理实验场景中评估成功率。Liu等人(2025b)则将动作空间定义为自动驾驶场景。Embodied-IQA、VABench以及StaticEmbodiedBench在执行层提供跨模态和轨迹指标,为从策略到具体动作的验证提供支持(Li等,2025a;Yuan等,2025;Xiao等,2025b)。
总体来看,当前的静态评测方法仍然较少,主要集中在对高层视觉VLM的感知、理解与规划能力的考察,而针对具身智能中的小脑层,即VLA和VLN的控制执行的空间推理的静态评测仍相对匮乏。现有方法虽然能高效评估模型在感知和语义理解方面的表现,但在反映具身智能核心的交互性和连续控制能力上仍存在明显不足。
首先,静态方法往往缺乏动态反馈,难以准确模拟真实具身场景中的时序变化与物理约束,从而导致与真实在线评测之间存在性能偏差。其次,各benchmark在任务设计和指标体系上缺乏统一,不同任务间难以形成可比的综合评价标准。目前常见的指标包括准确率(Acc)、均方误差(MSE)、路径偏差(RPE)、语言相关性(BLEU、ROUGE、GPT分数)等,但它们多局限于单一任务层面。
未来的研究可从3个方向推进:1)丰富静态基准的任务类型和数据多样性,使其能更全面地覆盖具身智能从感知到执行的全流程;2)探索统一的指标体系,提升跨任务与跨模型间的可比性;3)将静态与动态评测结合,通过仿真或离线交互的方式弥补两者间的差距。然而,比技术路径更关键的是范式跃迁:静态评测不应再被视为真机前的廉价筛选,而要升级为全生命周期的认知镜像。这意味着在数据生成阶段即引入物理可微渲染与神经符号混合引擎,让每一帧图像都内嵌可验证的因果链;在指标层面,用等全新测度替代单点准确率,从而提前暴露模型在十年级长周期部署中的慢性失效;最终,通过开放可扩展的“静态—仿真—真机”一体化协议栈,让全球实验室的每一次离线实验都能自动沉淀为真机系统的持续先验。
具身智能仿真评测任务,指在具有可控物理规律、可观测状态空间及多模态交互接口的虚拟环境中,针对具身智能体的感知—认知—决策—行动全链路能力所进行的标准化、可重复的量化评测过程。其目标是:在保持环境动力学一致性与任务语义约束的前提下,通过系统化任务设计与指标体系,量化模型在多模态理解、序贯决策、物理交互与跨域泛化等方面的表现。
具身智能的仿真评测任务主要可分为三大类:视觉语言理解任务、视觉语言动作任务与视觉语言导航任务,分别面向VLM,VLA,VLN 3种模型。三者分别从语义理解、物理操作与空间决策3个维度,对具身智能体在多模态信息感知与决策执行过程中的关键能力进行标准化量化评测。
VLM评测聚焦于在感知与认知层面,对模型的多模态理解、语义对齐与视觉推理能力进行系统化评估。该类任务通常基于静态或动态视觉场景,考察模型在语言指令、视觉线索与世界知识之间的融合与推理能力。评测指标涵盖跨模态语义一致性、视觉关注与语言理解的匹配程度、视觉问答与指令理解的准确性等,旨在揭示模型在“看—懂—说”闭环中的语义对齐机制、多模态表征质量与泛化能力,为具身智能的上层认知建模提供可量化依据。
VLA评测聚焦于在具身智能体框架下,对模型的感知—理解—规划—执行全链路过程进行标准化测度。该类任务在具有动力学一致性与物理约束的仿真环境中,评估模型在基于语言指令完成物体交互与精细化操作方面的能力。评测指标涵盖视觉—语言—动作融合表征下的物理交互合理性、动作规划连续性与执行控制精度,旨在揭示模型在语义驱动的物理推理与操作决策中的有效性、可靠性与泛化规律。
VLN评测用于衡量具身智能体在自然语言指令引导下的感知、理解与序贯决策能力。该类任务通过多样化的空间场景与语言描述,量化智能体在视觉—语言—空间融合表征下的路径规划合理性、目标理解准确性与行动序列执行一致性。评测的核心在于揭示模型在语义驱动的空间推理与导航决策过程中的有效性、可靠性与泛化规律。
仿真评测使用的大部分指标与静态评测相同。包括准确率、召回率等正确性指标,以及BLEU等语义指标。而在静态数据集之外,考虑到仿真环境中的多轮交互,其性能并不取决于二元化的成败,还需要考量如下的效率与惩罚指标:
1)任务成功分数。用于评估智能体在操作任务中达成目标状态的程度。通过计算已成功完成的原子性子任务(例如,将特定物体移动到目标位置)数量与总子任务数量的比率量化整体任务完成度。计算式为
Smanip=K'K
式中,包含
K
个原子性子任务组成的操作任务
T
。
K'
为在任务结束时被判定为成功完成的子任务数量。
2)时间/步数(time/steps)。完成任务所需的时间或仿真步数。
3)路径长度(path length)。智能体移动的总距离。
4)交互努力 (interaction effort)。如Bench-NPIN中定义的,衡量与环境交互的代价。
5)路径效率(path efficiency)。衡量智能体完成任务的导航效率,即其实际路径长度与理论最优路径长度的比值。
6)效率分数
Emanip
。该指标评估智能体在完成已成功子任务过程中的路径导航效率。它量化了智能体实际行走路径长度与完成这些子任务所需的理论最小路径长度之间的差异。
Emanip=L(K')l0
式中,
L(K')
为完成所有
K'
个成功子任务所需的理论最小总路径长度。这通常通过规划算法在已知环境地图上计算得出。
l0
为智能体在环境中实际行走的总路径长度。
7)互动努力分数(interaction effort score)
Inav
。该指标衡量机器人为移动环境中的物体所付出的运动学努力。它计算的是机器人移动自身所需的最小功与克服摩擦力移动所有物体(包括自身)的实际总功之间的比例。分数越高,表示不必要互动越少。计算式为
Inav=m0l0∑i=0Kmili
式中,
m0
和
l0
分別是机器人的质量和移动距离。
K
为环境中可移动物体的总数。
mi
和
li
分別是第i个可移动物体的质量和移动距离。
本节对具身智能领域的仿真评测基准进行了系统性的梳理与剖析。如表4所示,与静态数据集不同,动态仿真很少涉及到决策与执行环节,且每种任务依赖的仿真软件不同。因此本节将现有评测基准按操作(VLA)、导航(VLN)和多模态推理(VLM)任务,即对每一种具身智能研究的核心范式依次叙述。
在导航任务中,Arena-Rosnav 2.0 (Kästner等,2023)是用于开发和评估机器人导航方法的平台,专注于高度动态环境中的导航任务;通过模块化设计、简化安装流程和更真实的模拟,支持多种导航方法的训练与比较,评估维度包括成功率、碰撞次数、任务完成时间及路径长度。TaskSLAM-Bench(Du等,2025)是任务驱动的SLAM(simultaneous localization and mapping)基准测试框架,用于评估SLAM方法在支持移动机器人导航至指定路径点任务时的性能,特别关注导航任务中的重复性精度,评估主要关注精度、完整度和准确度。GOAT-Bench(Khanna等,2024)用于评估多模态终身导航能力,旨在推动通用导航模型的发展,使智能体能够无缝处理跨多种模态(物体类别、语言描述、实例图像)的目标,并在同一环境中利用过往经验进行终身学习,采用成功率及路径长度加权成功率作为主要评估指标。GRUtopia (Wang等,2024a)的基准包含明确的导航任务,如基于语言指令导航至目标物体的“Object Loco-Navigation”,以及通过与NPC交互澄清模糊指令后进行导航的“Social Loco-Navigation”,其物体定位与导航任务采用成功率、路径长度及路径长度加权成功率SPL进行评估。HomeSafeBench(Gao等,2025)用于评估具身视觉语言模型在家庭安全巡检任务中的表现;该基准通过模拟家庭环境,提供动态第一人称视角图像,支持模型在自由探索模式下识别5类常见安全隐患(火灾、触电、坠落物、绊倒、儿童安全),强调视觉感知与自主导航的融合,其主要评估指标包括精确度、召回率、F1分数及导航性能。Verti-Bench(Xu等,2025)是面向垂直挑战性非结构化地形的通用移动机器人运动能力基准测试平台,基于高保真模拟器,包含100个越野环境和1 000个导航任务,旨在客观、定量地评估和比较不同越野移动系统在极端崎岖地形下的性能,其核心评估指标为任务成功率和穿越时间。Bench-Push (Zhong等,2025)是首个针对非抓取式交互导航的综合性基准测试套件,包含一系列模拟环境,如带有可移动障碍物的迷宫导航、冰覆盖水域的自主船舶导航等,用于评估导航效率与交互努力,其迷宫导航任务以路径效率为核心指标。
对于操作任务,RLBench(James等,2020)是面向机器人操作学习的大规模基准测试与学习环境,包含100个完全独立、手工设计的任务,难度从简单的目标抓取到复杂的多阶段任务,并可通过运动规划器生成无限数量的演示轨迹,以任务成功率作为核心评估指标。
Meta-World(Yu等,2019)是用于多任务和元强化学习的开源模拟基准,提供50种不同的机器人操作任务,旨在评估算法在学习和泛化到全新操作任务上的能力,整体评估以任务成功率为核心指标。Isaac Gym(Makoviychuk等,2021)是基于GPU的高性能物理模拟平台,专为机器人学习设计,实现端到端的GPU加速训练流程,能够在单个GPU上并行运行数万个环境实例,常用于灵巧操作等复杂任务的训练与评估,在操作任务中通常以奖励和成功率作为核心评估指标。LIBERO(lifelong learning benchmark for robot manipulation)(Liu等,2023)是推动机器人操作任务中终身决策学习研究的基准,提供4个任务套件(共130个任务),强调在决策过程中对陈述性知识(物体概念)和程序性知识(动作)的混合迁移,以任务成功率作为核心评估指标。ManiSkill3(Tao等,2024)是面向通用机器人操作的高性能GPU并行化机器人仿真与渲染基准,提供涵盖移动操作、绘图、人形机器人操作、灵巧操作等12个不同领域的全面任务环境,评估主要依据任务成功率、MMRV及相关性指标。RoboCasa(Nasiriany等,2024)是以日常家庭环境(特别是厨房)为中心的大规模机器人学习基准,提供120个真实的厨房场景、100个多样化任务(原子任务和复合任务),用于训练和评估通用型机器人智能体,其原子任务以成功率为主要评估指标。RoboView-Bias(Liu等,2025a)是首个专门用于系统化量化机器人操作中视觉偏见的基准,通过在抓取任务中引入颜色、相机视角和尺度等视觉扰动因素,评估具身智能体在不同视觉条件下的性能偏差,主要评估指标包括抓取成功率、偏见系数及交互效应系数。RoboTwin 2.0(Chen等,2025b)是用于双手机器人操作的仿真框架、数据生成器和基准测试平台,旨在通过结合多模态大语言模型和仿真闭环反馈,自动生成大规模、多样化且逼真的专家数据,其内置基准测试以任务成功率为主要评价标准。RoboVerse(Geng等,2025)是统一的机器人学习基准测试框架,包含模仿学习和强化学习两大基准,并特别设计了多层次的泛化能力评估协议,核心任务围绕物体操作,其模仿学习基准以任务成功率为主要评估指标。
对于规划任务,GRUtopia(Wang等,2024a)包含复合的移动操作任务“Loco-Manipulation”,要求智能体结合移动与操作,完成“拾取—放置”任务,是导航与操作能力的综合体现;其移动操作任务采用成功率、路径长度和成功变更率进行评估。ET-Plan- Bench(Zhang等,2025a)是专门针对使用大语言模型进行具身任务规划的基准,具有一组可控且多样化的具身任务,其难度和复杂度各不相同(任务设置了成功率、动作序列长度等量化指标)。Cosmos-Reason1(Azzolini等,2025)构建了一套综合性基准,旨在评估模型在物理常识和具身推理两方面的能力;其具身推理基准聚焦于任务完成验证、行动可行性评估和下一个合理行动预测三大关键属性,覆盖多种智能体,主要使用准确率作为评估指标。Gemini-ERQA(Abeyruwan等,2025)将Gemini的多模态推理能力扩展至物理世界,形成具身推理视觉问答能力,用于评估模型在物理世界中的时空理解与推理,采用准确率评估模型性能。PIO(Xue等,2025)是通过精确视觉基础系统评估VLM具身推理能力的基准,涵盖3个阶段(参照物体定位、任务驱动指向、视觉轨迹预测),涉及室内、厨房、驾驶和机器人操控等多个场景,使用准确率和交并比作为评估指标。ViC-Bench(Wu等,2025)专门用于评估多模态大语言模型在视觉交错思维链能力上的表现,包含4个代表性任务:迷宫导航、拼图、具身长程规划和复杂计数,要求模型基于逐步的中间视觉状态持续更新理解与决策,评估指标包括准确率、召回率和合法性。EXPRESS-Bench(Jiang等,2025)是针对探索感知的具身问答任务的大规模基准,强调智能体需在回答前主动、理性地探索环境线索,并引入探索—答案一致性指标,综合评估指标包括成功率、路径效率、测地距离和探索—答案一致性。Agent-RewardBench(Men等,2025)用于评估多模态大语言模型在智能体任务中奖励建模能力的基准,涵盖感知、规划与安全3个维度,涉及移动端、网页、自动驾驶以及虚拟家居等多种真实智能体场景,以准确率作为核心评估指标。
此外,在不涉及小脑的情况下,有关基于视觉(及多模态)信息进行理解、分析和推理的具身任务,以下评测集在特定的仿真环境中,考量了具身大脑的能力。虽然它们不属于经典的具身任务,但由于包含了与环境的交互,而非完全依赖VLM评测的静态数据集,本文仍将其视为广义的具身评测范畴。例如,CompareBench(Cai等,2025)专门用于评估视觉语言模型在视觉比较推理能力上的表现,由1 000个图像问答对组成,涵盖4个基本任务:数量比较、时间顺序、几何属性比较和空间关系推理,以准确率作为核心评估指标。Object-centric Spatial Understanding Benchmark(Mirjalili等,2025)使用合成的购物场景数据集,评估模型在3个核心任务上的表现:空间定位、空间推理(如前/后景深度排序)以及下游检索任务,专注于物体中心的细粒度空间理解。DRISHTIKON(Maji等,2025)是首个专门针对印度文化理解的多模态、多语言基准,包含64 288个图文对齐样本,覆盖丰富的文化主题,并设计了多种推理题型,用于评估模型在跨文化语境下的感知与推理能力,以准确率作为核心评估指标。SPLICE(Ballout等,2025)是基于人类标注的视觉推理评测基准,通过将视频分割为多个片段并打乱顺序,要求模型根据视觉内容重新排列这些片段以恢复原始事件顺序,评测时间、因果和空间等多维度推理能力,评估指标包括二元准确率、汉明准确率、最长公共子序列比率和编辑距离。EgoTraj-Bench(Liu等,2025c)是首个面向真实世界中第一视角噪声观测下的轨迹预测基准,旨在弥补理想化鸟瞰图轨迹预测模型与真实世界第一视角感知噪声之间的差距,推动模型在噪声环境下的鲁棒性研究,使用minADE@K和minFDE@K作为核心评估指标。是用于评估视觉语言模型在机器人任务中预测时序任务进度的开放基准,利用VLM从视觉观察中预测任务完成进度,支持零样本和少样本设置,采用值序相关性作为核心评估指标。
当前具身智能与机器人领域的评测基准虽然已初步搭建起“感知—认知—决策—执行”全链路量测框架,但其演化轨迹仍受限于短期任务导向与仿真路径依赖。综合以上29个仿真测试集可以看出,感知与认知环节因可直接对接成熟计算机视觉与自然语言处理技术,在数据规模与指标多样性上迅速膨胀,形成“数据冗余但深度不足”的虚假繁荣;而决策与执行环节因涉及物理耦合、时序一致与安全约束,在真机环境下暴露的误差不可被静态或仿真数据稀释,导致其评测密度与迭代速度显著滞后。更关键的是,现有基准的“任务完成”定义仍停留在“单次成功”层面,忽略了长周期累积误差、非平稳环境适应与多智能体博弈等决定通用性的高阶维度,使得“高分模型”在真实部署中往往表现为“初期惊艳、后期崩溃”的脆弱曲线。
面向2030及更远的未来,具身智能评测必须从“可重复实验”升级为“可解释演化”:一方面,构建跨时间、跨空间和跨本体的“数字孪生—真机共生”闭环,让评测数据在仿真预训练、真机微调与在线更新三态之间以因果链而非快照形式持续生长,从而用误差溯源结果替代平均成功率作为模型迭代的核心导航;另一方面,将从感知到执行的每个步骤,纳入可微分的多目标优化框架,使“性能—能效”不再是事后补丁,而是前置梯度。只有当评测基准能够前瞻性地模拟未来10年可能出现的极端场景,具身智能才有望走出实验室的理想环境,在真实世界的复杂环境、熵增中演化出可验证、可追责且可持续的通用能力。
动态真机评测指在真实物理环境中,对具身智能体进行全闭环、时序连续的测试,覆盖感知、认知、决策和执行完整链路,考核其在动态变化场景下的在线适应性与长期稳定性。
真机评测考量的指标并不像静态与仿真评测中复杂,通常仅使用准确率与召回率等。此外,真机评测中会考量部分真实物理世界的指标,具体如下:
1)路径长度加权成功率(success weighted by path length,SPL)。该指标用于评估智能体的路径与最优路径相比的效率,同时衡量任务成功率与路径效率,避免智能体通过绕远路完成任务。计算为
SPL=SR⋅LoptmaxLopt, Lexec
式中,
Lopt
表示最优路径长度,
Lexec
表示实际执行路径长度,SR为成功率。
2)执行步数Step。用以描述完成任务所需的步数,越少越高效。
3)综合评分Comp。计算为
Comp=αeff⋅(Per+Dec)
式中,
αeff
随步数指数衰减,
Per
表示感知子分,
Dec
表示决策子分,而感知与决策精度用各自任务下的准确率进行衡量。该框架融合了感知与决策分数。
4)相对位姿误差(relative pose error,RPE)。衡量的是估计轨迹和真值轨迹在固定间隔
∆
上的局部运动(漂移)差异。
5)绝对轨迹误差(absolute trajectory error,ATE)。衡量的是估计轨迹
Pigt
和对齐后的真值轨迹
Piest
在全局上的差异。计算为
ATE=1n∑i=1n transPigt-1SPiest2
式中,n是位姿总数,对于相机位姿而言,需要矩阵
S=SE(3)
对估计位姿和参考的真实位姿进行几何变换,
trans(·)
表示提取平移向量。
本节同样以“感知—认知—决策—执行”闭环为主线,将真机评测方法按主要被测环节,划分为以下4种范式,如表5所示。
感知层测试基准仅关注传感器到语义映射,而真机端用于采集或验证标注。例如对导航任务而言,只考核传感器到相机(机器人)的位姿/地图/检测的精度,不涉及指令理解与闭环控制。KITTI-odometry(Geiger等,2012)通过采集39.2 km真车序列,成为视觉—激光里程计精度应用最广泛的评价标准。Meta-World(Yu等,2019)在50个任务上真机重复试验中测量视觉编码器sim2real精度退化。HPT(heterogeneous pre-trained Transformers)(Wang等,2024b)利用多臂异构真机评估跨本体校准误差,为后续迁移策略提供感知基线。FMB(functional manipulation benchmark)(Luo等,2025)是一个功能操作真机基准,聚焦 RGB-D 相机在杂乱场景下的工件位姿估计。R-Bench(Li等,2025b)基于网络及轮式移动机器人采集了7类33种失真图像以及2 970对问答构建了具身视觉感知的基准。北京人形机器人公司提出了基于天工人形机器人的eSpatialBenchmark(Zhang等,2025c),通过可配置的LEGO(leg godt)结构组装任务,严格评测模型对物理属性理解、空间依赖解析、结构稳定性推理及层级化操作序列生成的能力,耦合推理有效性于可执行动作生成中。EPD(embodied preference database)(Zhang等,2024a)提出首个面向具身图像质量感知的基准测试。EDA(embodied intelligence data assessment)(Xiao等,2025a)则通过分析1.5万条具身数据,对数据质量进行了客观化的评测。目前在真机评测方面,感知类已覆盖多模态、6D 位姿和SLAM 等,但跨季节、跨天气真机数据仍稀缺。
认知层测试基准关注语义到符号或关系的推理,通常不驱动执行器。例如解析语言/社交语义,决策层输出位置或路径点,侧重于语义理解、社交规则和指令解析等任务,但真机闭环仍由底层控制器执行。NCLT(north campus long-term vision and LiDAR)(Ushani等,2015)利用15个月经过27个序列跨季节采集的基准,用于验证长期地点识别与拓扑回环检测的召回率。EQA-phys(Zhou等,2025a)提出了“物理可达性问答”真机数据集,用LLM得分量化推理正确性。CityNav(Lee等,2025)通过城市级场景采集32 637个语言目标描述和人类演示的无人机轨迹,并利用轨迹误差ATE,成功率SR,路径长度加权成功率SPL等指标衡量模型性能。上述认知类的方法虽然已经开始引入大模型零样本物理推理,但缺乏与执行闭环的深度融合。
决策层测试基准关注符号到动作序列,输出 high-level 指令或 low-level 轨迹,侧重于全局/局部路径规划、动作序列生成,但真机只做开环或少量闭环验证,一般真机端只测“规划—执行”。RLBench(James等,2020)是一个面向操作的基准和学习环境,具有100个独特的手工设计任务,旨在促进多个视觉引导操作研究领域的研究。CALVIN(composing actions from language and vision)(Mees等,2022)通过采集的1 000条真机长程轨迹,评测语言条件策略在“从语言到子目标”层面的规划成功率。RT-1/RT-2 Benchmark(Brohan等,2023;Zitkovich等,2023)通过Everyday-Robot真机采集了13万条演示,评测 Transformer 规划器在语言指令下的成功率。Open X-Embodiment(O’Neill等,2023)是由谷歌DeepMind联合美国斯坦福大学、上海交通大学和英伟达等21个机构,利用单臂机器人、双臂机器人和四足机器人等22种不同类型的机器采集的目前全球最大开源机器人数据集;数据集还整合了60个已有数据集,涵盖311个场景、100多万条真实机器人轨迹,包括527种技能、160 266项任务,并首次用路径长度加权成功率SPL衡量“跨本体”策略迁移的规划质量。RoboData(Yan等,2024)通过整合若干著名的数据集提供了完整的评估系统,实现了多视角图像、相机参数、深度图和动作的首次融合。RoboCerebra(Han等,2025)通过400个长程任务真机闭环,测试规划—记忆—反思能力,将执行步骤Step作为效率指标。VLABench(Zhang等,2025b)通过100个任务(包括2 000个物体),评测LLM规划器在“多步推理”场景下的长度加权成功率SPL。决策类真机评测基准呈现“语言—子目标—轨迹”统一趋势。
执行层的基准同时考核四环节,必须真机闭环。感知—认知—决策—执行四环节全部真机在线。MatterPort3D(Chang等,2017)根据Matterport下90个房间的导航任务,SPL同时考核路径效率与指令完成度。RH20T(Fang等,2024)采集了超11万帧真机长程家务操作任务的序列,用成功率考核模型的性能。ManiSkill2(Gu等,2023)利用400万个真机演示闭环,评测点云策略网络在桌面操作上的成功率。RoboMIND(Wu等,2024)是跨本体标准化的大规模数据集,包含10.7万条机器人轨迹数据,涉及479项不同任务,涵盖96种不同物体。RoboCasa(Nasiriany等,2024)通过120个任务、2 500个物体以及10万条机器人轨迹,提供“抓取和摆放,开关门,开关抽屉,转动旋钮,转动连杆,按下按钮,插入,导航”共8种基础动作来构建模块。RoboCAS(Zheng等,2024)根据杂乱场景下7 500次的真机重排,用成功率量化任务闭环精度。SimplerEnv(Li等,2025c)是sim2real对齐专用闭环基准,提出仿真和真实场景下的成功率差异指标测量模型执行性能。Fourier ActionNet(Fourier ActionNet Team和Mu,2025)采集了3万条人形灵巧双手真机演示,用成功率衡量桌面操作任务。BEDI-UAV(Guo等,2025)是面向无人机的具身评测框架,将“感知—决策—执行”解耦到标准化的子场景并给出可组合评分。AutoEval(Zhou等,2025b)提出自监督评估回路,真机闭环采集—LLM自评—更新策略,用执行成功率指标量化。RoboTwin(Chen等,2025b)包含731个已标注物体的RoboTwin-OD资产库,包含超过10万条专家轨迹的数据集。StaticEmbodiedBench(Xiao等,2025b)分别对感知—认知—决策—执行四环节进行了评测。上海人工智能实验室(Intern Robotics Team,2025)搭建了具身智能各角度的测试基准,包括操作、导航、人形以及世界模型等。执行类已走向全闭环和长程等多目标评测。
具身智能真机评测在感知—认知—决策—执行闭环中的应用如表5所示。
对于目前的具身智能而言,真机评测存在的最大问题仍是成本高昂。对单个样本真机实验的成本,足够验证数百条仿真,甚至数千条静态样本。在成本之外,技术层面,感知—认知—决策—执行链条已被全面覆盖,但认知层仍显单薄:EQA-phys、PhysVLM-Real 仅做问答,尚未与执行闭环。真机数
据规模呈“头部集中”:OXE、RT-1/2、RH20T三家合计超百万条,其余bench多在1~5 000量级,中小规模真机复现仍是瓶颈。因此,未来的真机评测范式有必要继续革新,例如,系统级支持 7 × 24 h无脚本运行后,一条轨迹采集完立即回流到中央仓库,自动触发仿真校准、策略微调并生成新的待测指令,形成“仿真预训练—真机微调—在线更新”的滚动闭环。如此,真机数据可以在社区范围内持续开源迭代,成本被成百上千的用户共同摊薄,真机评测不再是经费黑洞,而是具身智能集成评测套件中的一个常用功能。
随着具身智能在各个领域的广泛应用,其复杂度和应用场景的多样化要求评测方法不断创新和完善。传统的评测方法主要集中在任务的完成度层面,已逐渐难以满足智能体在现实世界中多维度表现的全面评估需求。为此,评测的维度逐渐从单一的任务完成度,扩展到包括智能体的安全性、场景适应及部署能力、能效等多维度的综合评估,也促使评测框架朝着更加全面、系统的方向发展。评测任务的安全性主要指智能体在执行任务过程中,能够确保不对人类、环境或其他系统造成危害的能力。具体而言,安全性评测指标应关注智能体的行为决策和执行过程中是否符合预定的安全规则,并防止潜在的危险和失误。
虽然“具身安全与伦理”这一概念尚未形成统一共识,但是大模型评测领域已提出这一想法,将安全伦理视为与模型性能同等重要的因素。近年的研究已经开始通过专门设计的任务来检验智能体在“感知、认知、决策、执行”闭环中安全性、场景适应能力、以及能效等各个维度的表现,确保智能体在多种复杂情境下能够安全、可靠、高效地执行任务。
目前,具身安全伦理层面尚无较为完善的指标,但已有部分研究人员基于人工智能三定律—不伤害人、不伤害自己、不伤害环境,对具身智能的行为进行了约束,从而在安全可信角度对具身智能进行评测。任务层面:整体的任务成功率和安全率;规划层面:能否在任务执行之前就安全的规划任务;攻防层面:能否对抗“越狱(jailbreaking)”、能否在物理后门攻击的情况下保持安全。SafeAgentBench(Yin等,2024)提出针对具身LLM代理安全意识的系统评测框架,构建了包含750个任务的安全感知基准,涵盖10类潜在风险及3种任务层次。实验结果表明,现有具身LLM在危险任务识别与拒绝上表现不足,凸显了安全感知机制在具身智能体系中的关键性。EARBench(Zhu等,2024) 提出了面向具身智能任务规划安全性的自动化评测框架 EARBench,构建了多模态风险场景数据集 EARDataset。实验表明,当前主流大模型普遍存在较高的风险规划率,提示具身智能系统在物理环境部署前需重点强化安全意识建模与提示对齐机制。BadVLMDriver(Ni等,2024)提出了可在现实环境中触发的物理后门攻击框架,对自动驾驶的安全性进行了系统评估,表明在常见物体出现时,模型可被诱导执行危险决策,验证了攻击高效可行且具有普适性。IS-Bench(Lu等,2025)使用共 161 个家务任务场景,覆盖 10 类家庭环境,标注 388 个独特安全风险,在高保真物理模拟器中构造交互式场景并采用过程导向(process-oriented)评测:在风险触发步骤前/后核验是否满足相应安全目标,从而严格判定“时序正确的风险缓解”。SafeMind(Chen等,2025a)系统性建模具身推理链条中的安全风险,并提出可量化的评测与缓解方案。通过事实约束、因果约束和时序约束进一步界定不同类型的潜在风险。BadRobot(Zhang等,2024d)揭示了具身大型语言模型在物理世界中的越狱风险。作者提出3类攻击:通过情境角色扮演等方式诱导模型执行恶意动作;利用模型在语言与代码输出间的对齐缺陷,诱导生成有害动作;通过语义替换实现间接越狱实验显示,即使是GPT-4级别模型,在概念欺骗攻击下仍可能执行不安全动作。该工作不仅扩展了越狱研究的范畴,也为具身智能安全评测建立了标准化指标体系。Jailbreaking LLM-Controlled Robots(Robey等,2025)系统性研究了大语言模型驱动的具身机器人在越狱攻击下的安全风险,提出了一个涵盖语言到物理执行层的安全评测框架。实验结果显示,主流具身大脑控制代理在多种越狱攻击场景下均表现出显著的安全脆弱性,且防御措施常伴随虚假拒绝与性能退化。该工作将语言安全评测拓展至具身智能执行层,为后续安全防护与多模态防御机制研究提供了系统基线与指标体系。Safe-BeAl(Huang等,2025),由评测基准 SafePlan-Bench 与安全对齐方法 Safe-Align 组成,用于系统化地度量并提升 LLM 驱动的具身智能体在任务规划阶段的安全性,Safe-BeAl 将安全性形式化为两类约束:过程安全约束与终止安全约束。AGENTSAFE(Ying等,2025)提供了覆盖“感知—规划—执行”全链路的安全评测协议与大规模风险指令集。进一步界定安全问题的源头;其思维层防御 SAFE-AUDIT 展示了在不显著损害效用的情况下提升安全性的可行路径。
现阶段具身智能系统的决策空间、行动自由度与持续运行时长均受限于能源密度、控制带宽与任务场景,其整体风险仍低于家用电气与道路车辆,尚未对人类个体或社会基础设施构成实质性威胁。然而,大模型涌现的因果推理能力、与世界模型的长期规划能力可能生成超出设计者预期且难以被现有监测手段及时拦截的动作序列,从而使风险从功能失效升级为物理伤害。为应对潜在威胁演化,需在制度层面,推动建立分级认证与责任追溯体系:对超过特定能量输出或群体协作规模的系统,强制要求提交可复现的安全分析报告,确保任何异常指令在造成实质损害前被强制中断。在系统能力持续扩展的同时,维持社会风险水平,防止具身智能由辅助工具转变为需要被动应对的物理威胁源。
为了验证静态关键帧评测方法在预测真实机器人执行任务表现中的有效性,在UR5机械臂上进行了测试,并采用Octo 模型进行任务预测与执行。实验选取了50个基础任务实例,涵盖5类基础任务类型,包括拾取、放置、按压、拉和推。实验中采用两种评分机制:真实执行评分和静态评测评分。对于真实执行评分,机器人尝试完成任务,任务在以下任一条件下终止:任务成功完成、达到最大步数限制(50 步)或触发安全停止机制(如碰撞)。每个任务实例进行了50轮测试,以获取最终状态下的误差值,并据此计算位置、旋转和夹爪开合3个维度的动态评测分数。静态评测评分则通过关键帧方法获得,即由 Octo 模型输出与目标状态进行比较,从而直接得到静态分数,无需真实机器人执行操作。
实验主要通过计算静态分数与真实执行分数之间的皮尔逊相关系数(Pearson linear correlation coefficient,PLCC),将其定义为“静态—动态”一致性率(static-to-dynamic rate,S2D rate),来量化静态方法与真机结果之间的线性相关性。三维度分别独立计算S2D rate,并进一步计算所有维度的平均值,用于评估整体一致性水平。实验结果如图2所示,对于位置和旋转维度,图中显示静态方法分数与动态方法分数之间的相关性(S2D比率),黑色曲线为拟合趋势线,灰色区域表示bootstrap拟合曲线的±1标准差区间。对于夹爪开合维度,性能以二分类方式可视化。实验结果表明,在位置、旋转和夹爪3个控制维度上的S2D rate分别为0.629、0.621和0.729,三维度平均值为0.66,显示静态评分与真实执行评分之间具有较高的线性相关性,表明静态评测能够在整体上较可靠地反映实际执行表现。进一步按任务类型分析发现,拾取任务的 S2D rate分别为位置0.796、旋转0.333、夹爪1.000;放置任务为0.471、0.343、0.750;按压任务为0.476、0.825、1.000;拉任务为0.684、0.714、0.889;推任务为 0.730、0.403、1.000。结果显示,夹爪操作维度在所有任务类型中保持较高一致性,尤其对于二值控制任务表现出高度预测能力,而位置和旋转维度在不同任务类型中存在差异,例如按压任务旋转维度一致性较高,而放置任务在位置和旋转维度上一致性较低,表明静态方法在高精度动作任务预测上仍存在一定局限。
综合分析,本实验结果验证了静态关键帧评测方法在位置、旋转和夹爪3个关键维度上与真实执行结果具有较高一致性,表6中平均S2D rate为0.66,支持静态评测方法在大规模任务评估和模型训练中作为动态执行的代理指标的可行性。这表明,静态关键帧方法能够有效预测机器人在现实环境下的执行表现,为机器人动作模型的快速评估提供了可靠且高效的解决方案。未来,静态—仿真—真机3种评测范式将互为印证,共同构成兼顾成本与效果的评测基座方案,为具身智能的发展指明方向。
具身智能作为迈向通用人工智能的关键路径,其评测体系的构建已成为制约领域发展的瓶颈之一。本文围绕“从感知到执行”的完整闭环,系统梳理了当前具身智能模型在静态数据集、仿真环境与真实物理系统3类范式下的评测方法、任务设计、指标体系与平台资源,首次从方法学假设、适用边界与固有局限3个维度对评测体系进行了全景式解构,回应了领域内“横向不可比、纵向不可加”的结构性困境。本文主要贡献与发现可归纳如下:1)体系化梳理了具身智能评测的三级范式。静态评测以低成本、高效率实现模型初筛,但脱离动态交互与物理反馈;仿真评测在可控性与真实性之间取得平衡,成为当前主流;真机评测提供最高可信度,却因成本与可复现性限制,难以规模化应用。三者构成“金字塔式”分层架构,逐级递进,互为补充。2)揭示了评测任务与指标体系的碎片化现状。当前评测任务在定义、配置与协议层面缺乏统一标准,导致同一功能在不同研究中被形式化为异质指标,模型性能差异难以归因。通过对比分析指出,任务设计需从“功能导向”转向“能力导向”,以支持对模型在感知、认知、决策、执行各环节的可解释性评估。3)提出了能力维度的解耦框架。区别于传统AI以输出正确性为唯一判据,具身智能需贯穿“感知—认知—决策—执行”全链路。本文指出,唯有将各环节误差传播逐项分解、溯源并加权,才能避免“模型输出错误”这一单一归因陷阱,为模型改进提供可验证的定量依据。
此外,本文还考量了具身智能的安全与伦理维度。随着具身智能逐步走向开放环境部署,安全评测将从“可选项”转为“必答题”。同时,识别了“仿真—现实”迁移作为核心瓶颈,如何构建可复现、可共享和可远程接入的真机评测基础设施,成为推动具身智能从“技术涌现”走向“科学共识”的关键一步。
综上所述,具身智能评测正处于从“任务驱动”向“能力导向”转型的关键阶段。未来研究需在以下方向持续深入:1)构建统一、可扩展以及可迁移的评测协议,打破平台与任务壁垒;2)推动静态—仿真—真机三级评测的协同演化,实现“仿真预训练—真机微调—在线更新”的闭环验证;3)建立安全、伦理与性能并重的多维评测框架,为具身智能的可靠部署提供制度保障。唯有如此,方能实现从“模型可比”到“能力可信”的跨越,推动具身智能走向可验证、可复现以及可落地的科学新阶段。
  • 国家自然科学基金项目(62225112,625B2118);新加坡教育部基金项目(MOE-T2EP20123-0006)
参考文献 引证文献
排序方式:
Abeyruwan S,Ainslie J,Alayrac J B,Arenas M G,Armstrong T,Balakrishna A,et al. 2025. Gemini robotics: bringing AI into the physical world [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2503.20020.pdf
An Z L,Yu X Q,Wang C,Zhang J L,Li Y and Song C H. 2025. Embodied intelligence: recent advances and future perspectives. The Innovation Informatics,1(1): #100008 [DOI: 10.59717/j.xinn-inform.2025.100008]
Anderson M L. 2003. Embodied cognition: a field guide. Artificial Intelligence,149(1): 91-130 [DOI: 10.1016/S0004-3702(03)00054-7]
Azuma D,Miyanishi T,Kurita S and Kawanabe M. 2022. Scan Q A: 3D question answering for spatial scene understanding//Proceedings of 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Orleans,USA: IEEE: 19107-19117
Azzolini A,Bai J J,Brandon H,Cao J X,Chattopadhyay P,Chen H Y,et al. 2025. Cosmos-Reason1: from physical common sense to embodied reasoning [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2503.15558.pdf
Ballout M,Wilfred O,Yaghoubi S,Abdelmoneim N M,Mayer J and Bruni E. 2025. Can you SPLICE it together? A human curated benchmark for probing visual reasoning in VLMs//Findings of the Association for Computational Linguistics: EMNLP 2025. Suzhou,China: Association for Computational Linguistics: 11288-11309 [DOI: 10.18653/v1/2025.findings-emnlp.604]
Belkhale S,Ding T L,Xiao T,Sermanet P,Vuong Q,Tompson J,et al. 2024. RT-H: action hierarchies using language//Robotics: Science and Systems XX. Delft,the Netherlands: [s.n.]
Brohan A,Brown N,Carbajal J,Chebotar Y,Dabis J,Finn C,et al. 2023. RT-1: robotics transformer for real-world control at scale//Robotics: Science and Systems XIX. Daegu,Korea(South): [s.n.]
Budzianowski P,Wiśnios E,Tyrolski M,Góral G,Kulakov I,Petrenko V,et al. 2025. OpenGVL-benchmarking visual temporal progress for data curation [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2509.17321.pdf
Cai J,Yang K N,Fu L,Ding J M,Li J L,Sun H M,et al. 2025. CompareBench: a benchmark for visual comparison reasoning in vision-language models [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2509.22737.pdf
Chang A,Dai A,Funkhouser T,Halber M,Niessner M,Savva M,et al. 2017. Matterport3D: learning from RGB-D data in indoor environments//Proceedings of 2017 International Conference on 3D Vision (3DV). Qingdao,China: IEEE: 667-676 [DOI: 10.1109/3DV.2017.00081]
Chen D Z,Chang A X and Nießner M. 2020. ScanRefer: 3D object localization in RGB-D scans using natural language//Proceedings of the 16th European Conference on Computer Vision — ECCV 2020. Glasgow,UK: Springer: 202-221 [DOI: 10.1007/978-3-030-58565-5_13]
Chen D Z,Gholami A,Nießner M and Chang A X. 2021. Scan2Cap: context-aware dense captioning in RGB-D scans//Proceedings of 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Nashville,USA: IEEE: 3192-3202 [DOI: 10.1109/CVPR46437.2021.00321]
Chen R L,Sun Y Q,Wang J H,Lyu M Y,Zhang Q and Zeng Y. 2025a. SafeMind: benchmarking and mitigating safety risks in embodied LLM agents [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2509.25885.pdf
Chen T X,Chen Z X,Chen B J,Cai Z J,Liu Y B,Li Z X,et al. 2025b. RoboTwin 2.0: a scalable data generator and benchmark with strong domain randomization for robust bimanual robotic manipulation [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2506.18088.pdf
Chen Z,Gholami A,Nießner M and Chang A X. 2025c. MineAnyBuild: benchmarking spatial planning for open-world ai agents[EB/OL].[2025-11-05]. https://arxiv.org/pdf/2505.20148.pdf
Cheng Z X,Zhang Y Q,Zhang W K,Li H Y,Wang K Y,Song L,et al. 2025. OmniVTLA: vision-tactile-language-action model with semantic-aligned tactile sensing [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2508.08706.pdf
Chia Y K,Sun Q,Bing L D and Poria S. 2024. Can-Do! A dataset and neuro-symbolic grounded framework for embodied planning with large multimodal models [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2409.14277.pdf
Deng S L,Yan M,Wei S L,Ma H X,Yang Y X,Chen J Y,et al. 2025. GraspVLA: a grasping foundation model pre-trained on billion-scale synthetic action data [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2505.03233.pdf
Du Y W,Feng S Y,Cort C G and Vela P A. 2025. Task-driven SLAM benchmarking for robot navigation//Proceedings of 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Hangzhou,China: IEEE: 7147-7153 [DOI: 10.1109/IROS60139.2025.11246415]
Duan J F,Yu S,Tan H L,Zhu H Y and Tan C. 2022. A survey of embodied AI: from simulators to research tasks. IEEE Transactions on Emerging Topics in Computational Intelligence,6(2): 230-244 [DOI: 10.1109/TETCI.2022.3141105]
Fang H S,Fang H J,Tang Z Y,Liu J R,Wang C X,Wang J B,et al. 2024. RH20T: a comprehensive robotic dataset for learning diverse skills in one-shot//Proceedings of 2024 IEEE International Conference on Robotics and Automation (ICRA). Yokohama,Japan: IEEE: 653-660 [DOI: 10.1109/ICRA57147.2024.10611615]
Fourier ActionNet Team and Mu Y. 2025. ActionNet: a dataset for dexterous bimanual manipulation [EB/OL]. [2025-11-05]. https://action-net.org/
Gao S Y,Yao J S,Wen H Y,Guo Y H,Liu Z M and Huang H Y. 2025. HomeSafeBench: a benchmark for embodied vision-language models in free-exploration home safety inspection[EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2509.23690.pdf
Geiger A,Lenz P and Urtasun R. 2012. Are we ready for autonomous driving? The KITTI vision benchmark suite//Proceedings of 2012 IEEE Conference on Computer Vision and Pattern Recognition. Providence,USA: IEEE: 3354-3361 [DOI: 10.1109/CVPR.2012.6248074]
Geng H R,Wang F S,Wei S L,Li Y Y,Wang B J,An B S,et al. 2025. RoboVerse: towards a unified platform,dataset and benchmark for scalable and generalizable robot learning [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2504.18904.pdf
Gu J W,Wu Z H,Si P X,Qiu S,Feng Y K,Sun L Y,et al. 2025. USIM and U0: a vision-language-action dataset and model for general underwater robots [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2510.07869.pdf
Gu J Y,Kirmani S,Wohlhart P,Lu Y,Gonzalez Arenas M,Rao K,et al. 2024. RT-Trajectory: robotic task generalization via hindsight trajectory sketches//Proceedings of the 12th International Conference on Learning Representations. Vienna,Austria: OpenReview.net
Gu J Y,Xiang F B,Li X L,Ling Z,Liu X Q,Mu T Z,et al. 2023. ManiSkill2: a unified benchmark for generalizable manipulation skills//Proceedings of the 11th International Conference on Learning Representations. Kigali,Rwanda: OpenReview.net
Guo M N,Wu M W,He J R,Li S X,Li H F and Tao C. 2025. BEDI: a comprehensive benchmark for evaluating embodied agents on UAVs[EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2505.18229.pdf
Han S H,Qiu B X,Liao Y,Huang S Y,Gao C,Yan S C,et al. 2025. RoboCerebra: a large-scale benchmark for long-horizon robotic manipulation evaluation [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2506.06677.pdf
Huang Y T,Ding L L,Tang Z P,Wang T F,Lin X R,Zhang W Y,et al. 2025. A framework for benchmarking and aligning task-planning safety in LLM-based embodied agents [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2504.14650.pdf
Intern Robotics Team. 2025. InternData: a large-scale multimodal synthetic and real hybrid dataset for embodied intelligence[EB/OL]. [2025-11-05]. https://internrobotics.shlab.org.cn/opendataset.html
James S,Ma Z C,Arrojo D R and Davison A J. 2020. RLBench: the robot learning benchmark and learning environment. IEEE Robotics and Automation Letters,5(2): 3019-3026
Jiang K X,Liu Y,Chen W X,Luo J Z,Chen Z L,Pan L,et al. 2025. Beyond the destination: a novel benchmark for exploration-aware embodied question answering [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2503.11117.pdf
Kaelbling L P,Littman M L and Moore A W. 1996. Reinforcement learning: a survey. Journal of Artificial Intelligence Research,4(1): 237-285
Kästner L,Carstens R,Zeng H J,Kmiecik J,Bhuiyan T,Khorsandhi N,et al. 2023. Arena-Rosnav 2.0: a development and benchmarking platform for robot navigation in highly dynamic environments//Proceedings of 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Detroit,USA: IEEE: 11257-11264 [DOI: 10.1109/IROS55552.2023.10342152]
Khanna M,Ramrakhya R,Chhablani G,Yenamandra S,Gervet T,Chang M,et al. 2024. GOAT-Bench: a benchmark for multi-modal lifelong navigation//Proceedings of 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle,USA: IEEE: 16373-16383 [DOI: 10.1109/CVPR52733.2024.01549]
Khazatsky A,Pertsch K,Nair S,Balakrishna A,Dasari S,Karamcheti S,et al. 2024. DROID: a large-scale in-the-wild robot manipulation dataset//Robotics: Science and Systems XX. Delft,the Netherlands: [s.n.]
Lake B M,Ullman T D,Tenenbaum J B and Gershman S J. 2017. Building machines that learn and think like people. Behavioral and Brain Sciences,40: #253 [DOI: 10.1017/S0140525X16001837]
LeCun Y,Bengio Y and Hinton G. 2015. Deep learning. Nature,521(7553): 436-444 [DOI: 10.1038/nature14539]
Lee J,Miyanishi T,Kurita S,Sakamoto K,Azuma D,Matsuo Y,et al. 2025. CityNav: a large-scale dataset for real-world aerial navigation//Proceedings of 2025 IEEE/CVF International Conference on Computer Vision. 5912-5922
Li C Y,Xiao J H,Zhang J B,Wen F R,Zhang Z C,Tian Y,et al. 2025a. Image quality assessment for embodied AI [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2505.16815.pdf
Li C Y,Zhang J B,Zhang Z C,Wu H N,Tian Y,Sun W,et al. 2025b. R-Bench: are your large multimodal model robust to real-world corruptions? IEEE Journal of Selected Topics in Signal Processing,19(7): 1349-1361 [DOI: 10.1109/JSTSP.2025.3558652]
Li X,Hsu K,Gu J,Pertsch K,Mees O,Walke H R,et al. 2025c. Evaluating real-world robot manipulation policies in simulation//Proceedings of the 8th Conference on Robot Learning. Munich,Germany: PMLR: 3705-3728
Liang W L,Zhou R,Ma Y,Zhang B,Li S L,Liao Y J,et al. 2025. Large model empowered embodied AI: a survey on decision-making and embodied learning [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2508.10399.pdf
Liu B,Zhu Y F,Gao C K,Feng Y H,Liu Q,Zhu Y K,et al. 2023. LIBERO: benchmarking knowledge transfer for lifelong robot learning//Proceedings of the 37th International Conference on Neural Information Processing Systems. New Orleans,USA: Curran Associates Inc.: #1939
Liu E G,Liang S Y,Lu L M,Zeng X Y,Cao X C,Liu A S,et al. 2025a. RoboView-Bias: benchmarking visual bias in embodied agents for robotic manipulation [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2509.22356.pdf
Liu H R,Wan W K,Yu X Q,Li M H,Zhang J Z,Zhao B,et al. 2025b. Na Vid-4D: unleashing spatial intelligence in egocentric RGB-D videos for vision-and-language navigation//Proceedings of 2025 IEEE International Conference on Robotics and Automation. Atlanta,USA: IEEE: 10607-10615 [DOI: 10.1109/ICRA55743.2025.11128467]
Liu J Y,Zhou J M,Ye K,Lin K Y,Wang A and Liang J W. 2025c. EgoTraj-Bench: towards robust trajectory prediction under ego-view noisy observations [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2510.00405.pdf
Lu X Y,Chen Z,Hu X H,Zhou Y J,Zhang W C,Liu D R,et al. 2025. IS-Bench: evaluating interactive safety of VLM-driven embodied agents in daily household tasks [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2506.16402.pdf
Luo J L,Xu C,Liu F C,Tan L M,Lin Z P,Wu J,et al. 2025. FMB: a functional manipulation benchmark for generalizable robotic learning. The International Journal of Robotics Research,44(4): 592-606 [DOI: 10.1177/02783649241276017]
Ma L,Wen J J,Lin M,Xu R T,Liang X W,Lin B Q,et al. 2025. PhyBlock: a progressive benchmark for physical understanding and planning via 3D block assembly [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2506.08708.pdf
Ma X J,Yong S L,Zheng Z L,Li Q,Liang Y T,Zhu S C,et al. 2023. SQA3D: situated question answering in 3D scenes//Proceedings of the 11th International Conference on Learning Representations. Kigali,Rwanda: OpenReview.net
Maji A,Kumar R,Ghosh A,Anushka,Shah N,Borah A,et al. 2025. DRISHTIKON: a multimodal multilingual benchmark for testing language models’ understanding on Indian culture//Proceedings of 2025 Conference on Empirical Methods in Natural Language Processing. Suzhou,China: Association for Computational Linguistics: 1289-1313 [DOI: 10.18653/v1/2025.emnlp-main.68]
Majumdar A,Ajay A,Zhang X H,Putta P,Yenamandra S,Henaff M,et al. 2024. OpenEQA: embodied question answering in the era of foundation models//Proceedings of 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle,USA: IEEE: 16488-16498 [DOI: 10.1109/CVPR52733.2024.01560]
Makoviychuk V,Wawrzyniak L,Guo Y R,Lu M,Storey K,Macklin,M,et al. 2021. Isaac Gym: high performance GPU-based physics simulation for robot learning//Proceedings of the 35th International Conference on Neural Information Processing Systems. [s.l.]: Curran Associates Inc.
Mees O,Hermann L,Rosete-Beas E and Burgard W. 2022. CALVIN: a benchmark for language-conditioned policy learning for long-horizon robot manipulation tasks. IEEE Robotics and Automation Letters,7(3): 7327-7334 [DOI: 10.1109/LRA.2022.3180108]
Men T Y,Jin Z R,Cao P F,Chen Y B,Liu K and Zhao J. 2025. Agent-RewardBench: towards a unified benchmark for reward modeling across perception,planning,and safety in real-world multimodal agents//Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Vienna,Austria: Association for Computational Linguistics: 17521-17541 [DOI: 10.18653/v1/2025.acl-long.857]
Meng Q F,Zhang Y R,Zhang H W,Hu X Y and Luo Y H. 2025. Research on virtual embodied interaction technology for VR physics experiments. Journal of Image and Graphics,1-12
孟启帆,张怡冉,张鸿文,胡晓雁,骆岩红. 2025. 面向VR物理实验的虚拟具身交互技术研究. 中国图象图形学报,1-12 [DOI: 10.11834/jig.250425]
Mirjalili V,Giahi R,Kollipara S,Kekuda A,Yao K H,Zhao K,et al. 2025. Spatial reasoning in foundation models: benchmarking object-centric spatial understanding [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2509.21922.pdf
Nasiriany S,Maddukuri A,Zhang L C,Parikh A,Lo A,Joshi A,et al. 2024. RoboCasa: large-scale simulation of everyday tasks for generalist robots [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2406.02523.pdf
Ni F,Zhang M,Li P Y,Yuan Y F,Zhang L F,Liu Y C,et al. 2025. Embodied arena: a comprehensive,unified,and evolving evaluation platform for embodied AI [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2509.15273.pdf
Ni Z Y,Ye R,Wei Y X,Xiang Z,Wang Y F and Chen S H. 2024. Physical backdoor attack can jeopardize driving with vision-large-language models [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2404.12916.pdf
O’Neill A,Rehman A,Gupta A,Maddukuri A,Gupta A,Padalkar A,et al. 2023. Open X-embodiment: robotic learning datasets and RT-X models [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2310.08864.pdf
O’Neill A,Rehman A,Maddukuri A,Gupta A,Padalkar A,Lee A,et al. 2024. Open X-embodiment: robotic learning datasets and RT-X models: open X-embodiment collaboration0//Proceedings of 2024 IEEE International Conference on Robotics and Automation. Yokohama,Japan: IEEE: 6892-6903 [DOI: 10.1109/ICRA57147.2024.10611477]
Pfeifer R and Bongard J. 2006. How the Body Shapes the Way We Think: A New View of Intelligence. Cambridge,USA: The MIT Press
Qi Z Y,Zhang Z X,Yu Y Z,Wang J Q and Zhao H S. 2025. VLN-R1: vision-language navigation via reinforcement fine-tuning [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2506.17221.pdf
Robey A,Ravichandran Z,Kumar V,Hassani H and Pappas G J. 2025. Jailbreaking LLM-controlled robots//Proceedings of 2025 IEEE International Conference on Robotics and Automation (ICRA). Atlanta,USA: IEEE: 11948-11956 [DOI: 10.1109/ICRA55743.2025.11128119]
Sermanet P,Ding T L,Zhao J,Xia F,Dwibedi D,Gopalakrishnan K,et al. 2024. RoboVQA: multimodal long-horizon reasoning for robotics//Proceedings of 2024 IEEE International Conference on Robotics and Automation (ICRA). Yokohama,Japan: IEEE: 645-652 [DOI: 10.1109/ICRA57147.2024.10610216]
Sun F C,Chen R F,Ji T Y,Luo Y,Zhou H D and Liu H P. 2024. A comprehensive survey on embodied intelligence: advancements,challenges,and future perspectives. CAAI Artificial Intelligence Research,3: #9150042 [DOI: 10.26599/AIR.2024.9150042]
Tao S,Xiang F B,Shukla A,Qin Y Z,Hinrichsen X,Yuan X D,et al. 2024. ManiSkill3: GPU parallelized robotics simulation and rendering for generalizable embodied AI [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2410.00425.pdf
Torralba A and Efros A A. 2011. Unbiased look at dataset bias//Proceedings of the CVPR 2011. Colorado Springs,USA: IEEE: 1521-1528 [DOI: 10.1109/CVPR.2011.5995347]
Ushani A K,Carlevaris-Bianco N,Cunningham A G,Galceran E and Eustice R M. 2015. Continuous-time estimation for dynamic obstacle tracking//Proceedings of 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Hamburg,Germany: IEEE: 1137-1143 [DOI: 10.1109/IROS.2015.7353513]
Wang H Q,Chen J H,Huang W S,Ben Q W,Wang T,Mi B Y,et al. 2024a. GRUtopia: dream general robots in a city at scale [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2407.10943.pdf
Wang L R,Chen X L,Zhao J L and He K M. 2024b. Scaling proprioceptive-visual learning with heterogeneous pre-trained transformers//Proceedings of the 38th International Conference on Neural Information Processing Systems. Vancouver,Canada: Curran Associates Inc.: #3952
Wang Z J,Zhou Z H,Song J Y,Huang Y H,Shu Z and Ma L. 2025. VLATest: testing and evaluating vision-language-action models for robotic manipulation. Proceedings of the ACM on Software Engineering,2(FSE): 1615-1638 [DOI: 10.1145/3729343]
Wu K,Hou C K,Liu J M,Che Z P,Ju X Z,Yang Z Q,et al. 2024. RoboMIND: benchmark on multi-embodiment intelligence normative data for robot manipulation [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2412.13877.pdf
Wu X C,Liu J X,Huang D L,Wang Y F,Shi Y Y,Chen K D,et al. 2025. ViC-bench: benchmarking visual-interleaved chain-of-thought capability in MLLMs with free-style intermediate state representations [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2505.14404.pdf
Xiao J H,Yan B W,Zhang J B,Wang J,Li C Y,Cheng Z X,et al. 2025a. Data assessment for embodied intelligence [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2508.06553.pdf
Xiao J H,Zhang J B,Yan B W,Guo S Y,Ye T R,Zhang K W,et al. 2025b. Static and plugged: make embodied evaluation simple[EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2508.06553.pdf
Xu T,Pan C,Rao M B,Datar A,Pokhrel A,Lu Y,et al,2025. Verti-bench: a general and scalable off-road mobility benchmark for vertically challenging terrain [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2502.11426.pdf
Xue H,Ge Y,Zeng Y,Li Z,Liu M Y,Chen Y,et al. 2025. Point-it-out: benchmarking embodied reasoning for vision language models in multi-stage visual grounding [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2509.25794.pdf
Yan F,Liu F F,Zheng L M,Zhong Y F,Huang Y Y,Guan Z C,et al. 2024. RoboTron-Mani: all-in-one multimodal large model for robotic manipulation [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2412.07215.pdf
Yang J,Yang S,Gupta A W,Han R,Fei-Fei L and Xie S. 2025. Thinking in space: how multimodal large language models see,remember,and recall spaces [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2412.14171.pdf
Yin S,Pang X H,Ding Y Z,Chen M L,Bi Y T,Xiong Y C,et al. 2024. SafeAgentBench: a benchmark for safe task planning of embodied LLM agents [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2412.13178.pdf
Ying Z H,Wang L,Xiao Y S,Wang J K,Ma Y Q,Guo J Y,et al. 2025. AGENTSAFE: benchmarking the safety of embodied agents on hazardous instructions [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2506.14697.pdf
Yu T H,Quillen D,He Z P,Julian R,Hausman K,Finn C,et al. 2019. Meta-world: a benchmark and evaluation for multi-task and meta reinforcement learning//Proceedings of the 3rd Annual Conference on Robot Learning. Osaka,Japan: PMLR: 1094-1100
Yuan Y F,Cui H Q,Chen Y B,Dong Z B,Ni F,Kou L X,et al. 2025. From seeing to doing: bridging reasoning and decision for robotic manipulation [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2505.08548.pdf
Zhang H,Zhu C,Wang X,Zhou Z,Hu S and Zhang L Y,2024d. BadRobot: jailbreaking LLM-based embodied AI in the physical world [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2407.20242.pdf
Zhang J B,Li C Y,Hao J,Jia J,Duan H Y,Zheng G Q,et al. 2024a. Embodied image quality assessment for robotic intelligence[EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2412.18774.pdf
Zhang J Z,Wang K Y,Wang S A,Li M H,Liu H R,Wei S L,et al. 2024b. Uni-NaVid: a video-based vision-language-action model for unifying embodied navigation tasks [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2412.06224.pdf
Zhang J Z,Wang K Y,Xu R T,Zhou G Z,Hong Y C,Fang X M,et al. 2024c. NaVid: video-based VLM plans the next step for vision-and-language navigation//Robotics: Science and Systems XX. Delft,the Netherlands: [s.n.]
Zhang L F,Wang Y N,Gu H J,Hamidizadeh A,Zhang Z G,Liu Y C,et al. 2025a. ET-plan-bench: embodied task-level planning benchmark towards spatial-temporal cognition with foundation models//Proceedings of 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Hangzhou,China: IEEE: 21566-21573 [DOI: 10.1109/IROS60139.2025.11246658]
Zhang S D,Xu Z,Liu P J,Yu X P,Li Y,Gao Q H,et al. 2025b. VLABench: a large-scale benchmark for language-conditioned robotics manipulation with long-horizon reasoning tasks//Proceedings of 2025 IEEE/CVF International Conference on Computer Vision. [s.l.]: [s.n.]: 11142-11152
Zhang Y,Zhang Q,Ju X Z,Liu Z Y,Mao J L,Sun J K,et al. 2025c. EmbodiedVSR: dynamic scene graph-guided chain-of-thought reasoning for visual spatial tasks [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2503.11089.pdf
Zhang Z C,Wang J Y,Guo Y J,Wen F R,Chen Z J,Wang H Q,et al. 2026. AIBench: towards trustworthy evaluation under the 45°law. Displays,91: #103255 [DOI: 10.1016/j.displa.2025.103255]
Zheng Z C,Wang J Y,Wen F R,Guo Y J,Zhao X Y,Fang X Y,et al. 2025d. Large multimodal models evaluation: a survey. Science China Information Sciences,68(12): #221301 [DOI: 10.1007/s11432-025-4676-4]
Zheng L M,Yan F,Liu F F,Feng C J,Kang Z L and Ma L. 2024. RoboCAS: a benchmark for robotic manipulation in complex object arrangement scenarios [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2407.06951.pdf
Zhong N H,Caro S,Iskandar A,Ramesh M and Smith S L. 2025. Bench-NPIN: benchmarking non-prehensile interactive navigation[EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2505.12084.pdf
Zhou W J,Tao M L,Zhao C Y,Guo H Y,Dong H H,Tang M,et al. 2025a. PhysVLM: enabling visual language models to understand robotic physical reachability//Proceedings of 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville,USA: 6940-6949 [DOI: 10.1109/CVPR52734.2025.00651]
Zhou Z Y,Atreya P,Tan Y L,Pertsch K and Levine S. 2025b. AutoEval: autonomous evaluation of generalist robot manipulation policies in the real world [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2503.24278.pdf
Zhu Z H,Wu B Z,Zhang Z Y,Han L,Liu Q S and Wu B Y. 2024. EARBench: towards evaluating physical risk awareness for task planning of foundation model-based embodied AI agents [EB/OL]. [2025-11-05]. https://arxiv.org/pdf/2408.04449.pdf
Zitkovich B,Yu T H,Xu S C,Xu P,Xiao T,Xia F,et al. 2023. RT-2: vision-language-action models transfer web knowledge to robotic control//Proceedings of 2023 Conference on Robot Learning. Atlanta,USA: PMLR: 2165-2183
2026年第31卷第8期
PDF下载
29
15
引用本文
BibTeX
文章信息
doi: 10.11834/jig.250550
  • 接收时间:2025-11-05
  • 首发时间:2026-10-30
  • 出版时间:2026-08-16
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2025-11-05
  • 修回日期:2026-01-29
基金
National Natural Science Foundation of China(62225112,625B2118);Singapore MoE Foundation(MOE-T2EP20123-0006)
国家自然科学基金项目(62225112,625B2118);新加坡教育部基金项目(MOE-T2EP20123-0006)
作者信息
    1 上海人工智能实验室评测专项组,上海;200032
    2 上海交通大学信息与电子工程学院,上海 200240
    3 清华大学深圳国际研究生院数据与信息研究院,深圳 518055
    4 北京大学元培学院,北京 100871
    5 同济大学应用心理学系,上海 200292
    6 南洋理工大学计算机与数据科学学院,新加坡 639798,新加坡

通讯作者:

翟广涛,通信作者,男,教授,主要研究方向为图像处理、感知建模、大模型与具身智能评测。E-mail:
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/zgtxtxxb/CN/10.11834/jig.250550
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏