智东西(公众号:zhidxcom)
作者 | 王涵
编辑 | 漠影
过去几年,AI的两次规模化发展,都离不开充足的数据供给。
大语言模型可以直接利用互联网上积累多年的网页和代码数据,通过持续训练提升模型能力;自动驾驶企业则可以依靠量产车辆的影子模式(Shadow Mode),从真实道路中持续收集行驶数据和人工接管记录。以特斯拉为例,其通过全球数百万辆量产车,将数据采集融入日常驾驶过程,不需要额外组织大规模人工采集。
但到了具身智能领域,这样的数据供给条件并不存在。
过去两年,行业主要依靠真机遥操作和第一视角(EGO)可穿戴设备采集数据,累计获得的真机有效数据和EGO数据也只有数百万小时。对于已经投入大量资金的机器人公司和大模型企业来说,想要获得足够规模的高质量训练数据,依然不容易。
10月30日,空间智能公司影溯(InSpatio)在杭州落地全国首个具身仿真数采中心。影溯预计,该中心将单月生产100万小时仿真训练数据,单条数据综合成本约为传统真机遥操作采集的1/10。
全行业花费两年积累数百万小时数据,影溯凭什么计划将产能提升至单月百万小时?要回答这个问题,我们需要先看清当前具身智能数据采集面临的困难,以及影溯如何将现实场景转化为机器人训练数据。
一、 为什么现在的具身行业,做不到大批量的数据供给?
合格的具身Token需要同时包含三个要素,即三维空间观测、真实物理接触反馈和可执行动作序列。
也就是说,数据不仅要记录机器人看到了什么,还要包含机器人如何与物体交互,以及动作发生后产生了怎样的变化。
围绕这些要求,目前行业主要有2条数据获取路径:一条是在物理世界,通过真机和可穿戴设备采集;另一条是在数字世界,利用三维建模和物理仿真生成数据。但渐渐地,两条路径都开始出现效率瓶颈。
1、去物理现场硬采:受限于时间、环境和场地
真机遥操作是目前获取机器人动作数据的主要方式之一,但采集效率并不高。
一名操作人员控制一台机器人工作一小时,扣除设备调试、故障处理和任务复位等时间,有效采集轨迹可能不到半小时。想要扩大数据规模,就需要增加机器人数量和操作人员,采集效率十分受到物理时间和设备规模的限制。
为了降低机器人本体的投入,不少团队转向了EGO第一视角穿戴采集,通过记录人类在真实环境中的操作过程获取数据,但这种方式同样存在局限。
首先,环境调整不够灵活。EGO采集依赖真实场地,如果需要测试不同的杂物遮挡、光照条件或台面材质,就必须安排人员重新进入现场,搬动道具、调整布景,再次进行采集。
其次,很多真实场地并不允许外部团队随意改造,例如营业中的商超、车间和药房等。即使训练中发现了问题,训练团队也未必能够回到原场地复现。
更不用说高危作业区、工业产线、脏乱差环境、安防场所和私人住宅等场景,还存在严格的准入限制,外部团队和设备很难进入。
2、向数字世界要产能:受限于场景建模效率
相比真实环境采集,仿真能够在虚拟环境中反复调整场景和任务,减少对真机和人工的依赖。但仿真平台本身并不能直接提供训练数据,首先要解决的就是场景建模效率问题。
以Isaac Sim等物理仿真引擎为例,平台提供了机器人运行和物理交互的模拟环境,但房间搭建、物体建模、关节绑定、碰撞边界设置,以及摩擦系数等物理参数,仍需要人工处理。找3D美术师从头搭建一个可交互房间,往往需要几天甚至几周,成本和时间投入都不低。
那能不能直接让大模型完成建模?
最近,GPT-6 Astra、Atlas等模型都开始尝试三维场景自动生成,但距离直接用于机器人训练,还有不少问题需要解决。
以GPT-6 Astra调用Blender建模为例,其底层仍然需要经历“调整参数—渲染成图—比对参考图—再次调整参数”的反复过程。在这个流程下,生成一个物体需要几十分钟,一个场景则需要数小时。多轮推理和渲染更是会增加生成成本,程序化拼接出来的场景也容易带有明显的CG感。
除了效率和成本,生成场景的真实性与一致性也很重要。
无论是通过代码参数拼接场景,还是通过单张图片推测物体未被拍摄到的部分,如果缺少真实空间测量作为约束,就很难保证不同视角下的几何结构、整体空间尺度和物理关系一致。这些误差会影响机器人在仿真环境中的操作,也会增加从仿真到现实的迁移难度,也就是业内所说的Real2Sim Gap。
真机和EGO采集受制于时间、场地及环境调整,仿真数据生产则面临人工建模效率低、AI生成成本高、场景真实性不足等问题。
如何快速获得能够支持机器人实际操作的数字场景,成为具身数据规模化生产亟需跨过的一道鸿沟。
二、 影溯的破局思路:用工业流水线逻辑,建一座具身Token工厂
AI算力中心常被称为AI时代的“Token工厂”,通过整合电力、芯片和原始数据,持续输出模型训练和推理所需的Token。
影溯在杭州落地的具身仿真数采中心,也采用了类似的思路。它通过自研的Topos空间智能底座,将现实空间转化为可交互的数字场景,再用于生成机器人训练数据,一共拆成了三道全自动工业产线:
1、上游场景入厂:15分钟把真实场地搬进云端,替代按周计算的手工建模
针对上文所述问题,影溯将场景采集改为多源轻量输入与原生3D生成。
对于能够短暂进入的场地,影溯使用便携式设备进行扫描,设备进场15分钟即可完成上百平方米空间的采集。对于不方便进入的受限或私密场所,则可以使用现场人员拍摄的多视角视频和照片,或者调用原生3D场景生成能力,构建对应的数字环境。
原始数据进入Topos引擎后,系统通过算法完成三个步骤:
第一步是物体拆解。系统自动识别水杯、药盒、抽屉、门把手等可操作物体,并将它们从背景中独立剥离,解决普通三维扫描中物体与场景容易粘连的问题。
第二步是盲区补全。针对相机无法拍摄到的物体背面、底部,以及移走物体后留下的台面空洞,系统调用原生3D生成模型进行补全,生成完整闭合的三维模型。
第三步是物理标定。系统为物体生成碰撞边界,赋予质量、摩擦系数等物理属性,并为柜门、抽屉配置旋转和滑移关节轴,使其能够直接进入物理仿真器。
经过这些处理,现实中的住宅、商超、餐厅和仓库等场景,就可以转化为可运行的数字场景。据影溯介绍,完成扫描后,相关场景能够在几小时内完成转换。
这样一来,经过数字化处理后,同一场景可以在仿真环境中反复使用,也可以调整物体位置、环境条件和交互方式,生成不同的机器人训练场景。
2、中游算力扩展:把现场搬道具和串行采集,变成云端的受控调整与并行合成
真实空间一旦拆解为可编辑的数字母本,EGO 和真机采集最头疼的环境调整难与单机串行瓶颈便迎刃而解。
在影溯的产线上,一个真实场景入库后可以反复调用。需要增加环境变化时,系统可以直接调整数字场景中的参数。之后,系统只需引入少量真实示范动作作为种子,就能在云端启动多个仿真通道,并行规划和执行动作。
底层物理引擎会实时计算抓取、推挤、放置等操作产生的力学结果,并筛除穿模、滑落等失败尝试,最终批量生成包含深度、位姿、接触力和动作语义等信息的具身Token。
这种方法直接改变了具身数据的生产方式:数据产量将更多取决于数字场景的复用程度和云端并行算力规模。原本需要人工反复布置和采集的工作,基本都可以转移到云端完成。
3、下游品控与闭环:拒绝同质化凑数,按模型短板定向补齐数据
数据规模扩大后,如何避免重复采集、保证数据有效性,也是影溯需要解决的问题。
影溯为场景统计设置了去重标准:所有场景都以独立、完整的房屋或经营场所建档。同一房间仅改变灯光或拍摄角度,只计作场景内部的变体,不重复计入场景总数。数据交付端,则按照空间几何(L1)、物理交互(L2)、任务闭环评测(L3)分级供给。
与此同时,数据生产也与下游模型评测形成了闭环。
当客户模型在测试中暴露出短板,例如遇到透明水杯、强反光台面或密集堆叠遮挡时频繁失败,影溯可以根据失败原因,在数字场景中定向生成一批相似的复杂环境,不必重新派人到现场搭建场景、采集数据。新生成的数据用于补充模型薄弱环节,也可以在同一套环境中进行回归验证。
结语:将物理空间作为原材料,具身需要自己的Scaling Law
语言模型之所以能沿着Scaling Law快速提升能力,前提是互联网替人类完成了文本数据的数字化汇集。
而机器人要走出实验室、进入千差万别的真实物理世界,始终面临一个数据转化难题——物理世界本身是连续、无序且无法直接交给模型训练的。
当行业里大多数团队还在靠增加机位、扩招采集员的线性方式逐步积累数据时,影溯给出了另一种解法:把物理空间当成原材料,用三维重建、生成模型与并行仿真搭起一座全天候运转的具身 Token 工厂。
当百万小时量级的物理交互数据开始像工业品一样按月排产,具身智能的大规模训练才有了稳定的数据基础。
本文由 AI图鉴自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
Intellectual (WeChat Official Account:zhidxcom)
The author, Wang Xin
Edit |
Over the past few years, both size-based developments in AI have required adequate data availability.
Large-language models can directly use the web pages and code data accumulated over many years on the Internet to enhance model capabilities through continuous training, while self-pilots can rely on Shadow Mode, a mass-producing vehicle, to continuously collect driving data and manually take over records from real roads. In Tesla, for example, it integrates data collection into day-to-day driving through millions of volume vehicles worldwide, without the need for additional large-scale manual collection.
However, to the level of intelligence, such data are not available.
Over the past two years, the industry has relied mainly on real-air teleworking and first-viewable equipment (EGO) for data collection, and the cumulative availability of real-time data and EGO data has been only a few million hours. For robotics companies and LLM enterprises, which have invested considerable funds, it remains difficult to obtain high-quality training data of sufficient size.
On 30 October, INSpatio was the first home-grown simulation centre in Hangzhou. It is projected that the Centre will produce 1 million hours of training data per month for simulation, at a combined cost of approximately 1/10 of traditional real-life remote operations.
What are the plans to increase production capacity to a million hours per month? To answer that question, we need to see the current difficulties of smart data collection and how to trace reality into robotic training data.
I. Why is it not possible to provide a large volume of data in the present physical industry?
A qualified person, Token, needs to include three elements at the same time, namely, three-dimensional space observations, real physical contact feedback and an enforceable sequence of actions.
That is to say, the data not only record what robots see, but also how robots interact with objects and what changes have been made in action.
With these requirements in mind, the industry currently has two main data acquisition pathways: one in the physical world, collected through real machines and wearable devices, and the other in the digital world, where data are generated using three-dimensional modelling and physical simulation. But gradually, efficiency bottlenecks began to emerge on both tracks.
1. Hard extraction to physical sites: limited time, environment and site
Real telemetry is currently one of the main ways of obtaining data on robotic movements, but collection is not efficient.
An operator controls a robot for one hour, less equipment debugging, malfunctioning and repositioning, and may be able to capture the trajectory effectively in less than half an hour. To scale up the data, the number of robots and operators will need to be increased, and the efficiency of collection is very limited by physical time and size of equipment.
In order to reduce the input of robotics, a number of teams have turned to EGO's first perspective to capture data by documenting human processes in the real environment, but this approach is also limited.
First, environmental adjustment is not flexible enough. The EGO collection relies on the real site and, if it is necessary to test different miscellaneous covers, light conditions or surface materials, it will be necessary to re-enter the site, move the proprietors, adjust the layout and re-gather the collection.
Second, many real sites do not allow outside teams to adapt at will, such as businesses, workshops and pharmacies. Even if problems were identified during the training, the training team would not necessarily be able to return to its original site.
Not to mention the high-risk areas, industrial production lines, dirty environments, secure spaces and private homes, there are also severe access restrictions and access to external teams and equipment is difficult.
2. Energy for the digital world: limited to landscape modelling efficiency
Compared to real environmental gathering, imitations can adapt scenes and tasks over and over again in a virtual environment, reducing reliance on realism and labour. However, the simulation of the flat Z89Z body does not provide training data directly, and the first thing to address is the efficiency of scenario modelling.
In the case of physical simulation engines such as Isaac Sim, the platform provides a simulation environment for robotic operation and physical interaction, but physical parameters such as room construction, object modelling, joint binding, collision boundary setting and friction coefficients still require manual processing. It often takes days or weeks to find a 3D artist to build an interactive room from the head, at both cost and time.
Can we just get LLM to do the modelling?
Recently, GPT-6 Astra, Atlas and others have started to try to automate the 3D scenario, but there are still a number of problems that need to be addressed from direct use in robotic training.
In the case of GPT-6 Astra, which calls for the Blender model, the bottom is still subject to the “adjustment of parameters - rendering of maps - comparison of reference maps - re-adjustment of parameters”. Under this process, it takes several minutes to generate an object and hours to create a scene. Multi-wheel reasoning and rendering increases the cost of generation, and the scenario that comes out of the programmination can easily have a clear CG sense.
In addition to efficiency and cost, authenticity and consistency in the creation of scenarios are important.
Whether it is by encircling the scenes with code parameters or by predicting through a single picture the parts of the object that are not taken, the absence of real spatial measurements as a constraint makes it difficult to ensure consistency in geometry, overall spatial scales and physical relationships across different perspectives. These errors affect robotic operations in the simulation environment and increase the difficulty of moving from simulation to reality, that is to say, Real2Sim Gap in industry.
Real opportunities and EGO collections are subject to time, site and environmental adjustments, while simulation data production is faced with inefficient manual modelling, high AI generation costs, and insufficient authenticity of scenes.
How rapid access to digital scenes that support robotics becomes a gap that data scale production needs to bridge.
II. Twilight thinking: building a Token plant using industrial flow line logic
The AI Calculus Centre is often known as the "Token Factory" of the AI era, and through the integration of electricity, chips and raw data, the continuous output model training and reasoning of Token is required.
A similar line of thought was followed by the pictogram centre, which was located in Hangzhou. It transforms the real space into an interactive digital scene through a self-researched Topos space intelligence base, which is used to generate robotics training data, and has broken down three fully automated industrial lines:
Upstream scenes entering the plant: 15 minutes to move the real site into the cloud, instead of manual modelling on a weekly basis
In response to the above-mentioned questions, the retrospect scene collection was replaced by multi-source light input and primary 3D generation.
For sites that can be accessed for short periods of time, scanning is done using portable equipment, which can be collected in 100 square metres in 15 minutes. For restricted or private places that are not easily accessible, multi-perspective videos and photographs taken by field personnel may be used, or the original 3D scene generation capability may be used to create the corresponding digital environment.
Once the raw data enters the Topos engine, the system completes three steps by algorithm:
The first step is the dismantling of objects. The system automatically identifies operational objects such as water cups, pharmacological boxes, drawers, door handles and strips them independently from their background to solve the problem of the ease with which objects in ordinary 3-D scans are attached to the scene.
The second step is the completion of the blind zone. For objects that cannot be photographed by the camera, on the back, at the bottom, and on the empty surface left behind by the removal of the object, the system calls for completion of the original 3D generation model and produces a fully closed 3D model.
The third step is physical marking. The system generates collision boundaries for objects, assigns physical properties such as mass, friction coefficients and configures the rotation and slide joint axes for cabinet doors, drawers, which allow them to enter the physical emulator directly.
Through these processes, real-life scenarios such as residential, commercial, restaurant and warehouse can be translated into operational digital scenarios. According to a retrospective description, once the scan is completed, the scene can be converted within hours.
In this way, after digitization, the same scene can be used repeatedly in the simulation environment, and the position of the object, environmental conditions and interaction can be adjusted to generate different robotic training scenarios.
Medium-range computing power expansion: conversion of live proptiles and serial collections into cloud controlled adjustments and parallel synthesis
Once real space is dismantled to an editable digital master, EGO and the real machine collect the most painful environmental adjustment and single-phone bottlenecks.
On the hindsight line, a real scene can be called over and over again. When environmental changes need to be added, the system can directly adjust the parameters in the digital landscape. The system then needs only a small amount of real demonstration action as a seed to enable multiple simulation pathways to be launched at the cloud end in parallel with the planning and execution of the action.
The bottom physics engine calculates in real time the mechanical results of the capture, push, placement, etc., and screens failed attempts at piercing models, slides, etc., resulting in bulk generation of body Token with information on depth, position, contact force, and action syntax.
This approach directly changes the way in which data are produced: data production will depend more on the degree to which digital scenes are reused and the magnitude of cloud parallel computing. Work that would need to be done manually in order to be repeated and collected could be largely carried over to the cloud.
3. Downstream control and closed loops: rejection of homogenous compactions and completion of data by model panel orientation
The question of how to avoid duplication of collection and ensure the validity of data, as a result of the expansion of data, is also a question that needs to be addressed retroactively.
Retrospectively, the criteria for weighting the scene statistics are set: all the scenes are stored in separate, complete houses or business premises. The same room changes only the light or the angle of the photograph, counting only variations within the scene and not counting the total number of scenes. The data delivery end is provided according to spatial geometry (L1), physical interaction (L2), mission closed environment assessment (L3).
At the same time, data production has also formed a closed loop with downstream model assessments.
When client models expose short panels in tests, such as frequent failure in the face of transparent water cups, powerful reflectors or dense stacks, phototraces can be used to direct a similar complex set of environments in digital scenes for reasons of failure, without re-entrants to build scenes and collect data. The newly generated data are used to supplement model weaknesses and can also be used for regression validation in the same set of environments.
Conclusion: Physical space as a raw material needs its own Scaling Law
Language models are able to rapidly upgrade their capabilities along Scaling Law provided that the Internet completes the digitization of text data for humans.
And the robot has always faced a data-transformation challenge to get out of the lab and into the real physical world. - The physical world itself is continuous, disorderly and cannot be sent directly to model training.
When most teams in the industry are building up data in a linear manner by increasing their space and recruiting collectors, another solution is given: Using physical space as a raw material, three-dimensional reconstruction, modelling and parallel simulations were used to build a body token plant that operated all day.
When the physical interactive data of a million-hour volume start to flow like industrial products on a monthly basis, a stable data base is created for large-scale smart training.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.