Nvidia 开源 Flora制作机器人视频标注125x比GPT-6 Astra便宜
将一个小时的机器人视频标注为72美分而不是88美分，这是Nvidia与其开放数据引擎弗洛拉承诺的。 但与GPT-6 Astra的比较并不像价格标签所暗示的那样偏差。
机器人的大型AI模型学习需要文字说明的视频，根据Nvidia的GEAR研究实验室，这需要三种标签。 首先，描述视频中发生什么动作，用于选择培训数据。 其次，对机器人的分数如何一步步地进步，这样它就可以通过试验和错误来学习。 第三，判断一项任务是否成功完成，用于在部署期间监测机器人。 大多数现有工具只提供其中一种类型。 GPT-6 Astra等大型语言模型可以生成数个，但对于所涉及的大量视频量来说，它们过于昂贵。
根据论文，弗洛拉覆盖了所有三个。 Nvidia 称系统已经在训练其GR00T型号时运行，在512GB300GPU上标注每天高达20万小时的视频。 这些模型可在Hugging Face上找到。
Flora由三个精细的Qwen3.5型号组成。 一个9B模型将视频分成动作片段，一个27B模型在考虑每个动作之前和之后发生的事情的同时加以描述。 第二种名为Flora-Rewarder(英语：Flora-Rewarder)的27B型机车根据时速的不同承担三个角色。 它以1到5的尺度来评定一集的成功率，将每半秒的步数归为正常，次优，或失败，并根据自定义的路标来分配分数。
按Nvidia自己的估计，最多125x更便宜
在一次有50个视频的测试中，弗洛拉根据Nvidia的成绩略优于GPT-6 Astra，尽管OpenAI的模型被允许使用其全部推理能力。 按Nvidia的估算，标注一个小时的视频与弗洛拉运行了约72美分，而GPT-6 Astra则与约88.50美元。 Claude 电话 Opus 5在同一测试中得分更差，仍然每小时花费约42美元。
不过，弗洛拉的成本数字是预测数字，而不是生产计量。 Nvidia根据每小时每GPU10美元的假定租金价格计算。
Flora 发现动作更好，但Astra经常更准确地描述它们
在公共WGO-Bench上，弗洛拉最擅长探测动作边界，但在总体得分中追踪Astra，在纯描述精确度上落后于Gemini 3.8 Flash. 研究者认为，收益主要来自时间本地化。
在Nvidia自己的DenseCaption Bench上，弗洛拉带领所有度量衡进行人类录音，但对于机器人视频来说，模型排在Astra之后第二位。 研究者也承认了一种方法 GPT-6 电话 Astra评价描述，同时也是被测试的模型之一。
几乎没有其他模型发现中段错误
在Robo Reward Bench上，弗洛拉的误差率比阿斯特拉低27.8%. 文件将空白归结为部分完成的任务。 当一个机器人只给一瓶酒而不是把它从桌子上敲下来时，弗洛拉在5分中分配了3分来匹配人类参考，而Astra只给出1分。
Flora-Rewarder在一集中捕获了53.3%的失败步骤，而没有竞争者获得超过11.7%的成绩，Astra一个也没有捕获。 换句话说，弗洛拉把正常步骤的11%错标为错误。 Astra仍然领先于基于路标的积分和轨迹排名。
弗洛拉在一段有着许多短手动作的视频中，确定了37个个人动作中的34个，而阿斯特拉只捕获了4个。 在反面，弗洛拉有时会将更长的动作分成过多的小步骤，偶尔也会得到错误的描述。 在一个视频中，一个机器人手用布擦过盘子，但弗洛拉形容它是折叠的餐巾。
Nvidia将弗洛拉定位为Scale AI物理AI数据引擎等商业服务的开放替代品。 研究人员可以利用它来放大自己的机器人数据集和测试方法，比如将人类演示转移到机器人身上。 Nvidia正在投资数十亿的开放AI模型，让开发者保持其硬件生态系统并驱动对其芯片的需求，弗洛拉服务于这个目标。
公司还进行了一段时间的工作，通过模拟和自动化数据处理来弥补机器人培训数据的短缺。 在今年早些时候的GTC,Nvidia显示一个数据管道，自动准备，倍增，并评分培训材料。 Flora 新增详细标注和奖励信号从视频到管道。
所有这些都为Nvidia覆盖整个机器人价值链的战略提供了信息，从硬件和培训数据到模拟和AI模型本身。 兹Q 2Z近期的宣布 Gemini 4 Argon以机器人培训过程的类似部分为目标，同时也确定了培训视频和标榜失败行动的工作步骤。
AI News Without the Hype – 由人类治愈
订阅THE DECODER免费阅读，每周AI通讯，我们独家的"AI雷达"前沿报告每年6次，全面存档访问，访问我们的评论部分。
现在订阅
读取全照。
订阅无韵报道。
- 全面查阅THE DECODER的每篇文章
- 没有广告
- 加入评论和社区讨论
- 每周通过邮件转载AI新闻
- 6x/年："AI雷达"——对AI最重要的话题进行深度潜水。
- 每日AI新闻，总是最新的
- 我们完整的十年档案
- 由一个在AI工作10年以上的团队负责
订阅到 The Decoder
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Nvidia open-sources Flora to make robot video labeling 125x cheaper than GPT-6 Astra
Labeling one hour of robot video for 72 cents instead of $88 is what Nvidia promises with Flora, its open data engine. But the comparison with GPT-6 Astra isn't quite as lopsided as the price tag suggests.
Large AI models for robots learn from videos that need text annotations, and according to Nvidia's GEAR research lab, this requires three types of labels. First, descriptions of what action happens when in the video, used to select training data. Second, ratings of how well a robot progresses step by step, so it can learn through trial and error. And third, judgments on whether a task was completed successfully, used to monitor robots during deployment. Most existing tools only provide one of these types. Large language models like GPT-6 Astra can generate several, but they're too expensive for the massive volumes of video involved.
According to the paper, Flora covers all three. Nvidia says the system is already running during training of its GR00T models, annotating up to 200,000 hours of video per day across 512 GB300 GPUs. The models are available on Hugging Face.
Flora consists of three fine-tuned Qwen3.5 models. A 9B model splits videos into action segments, and a 27B model describes them while factoring in what happened before and after each action. A second 27B model called Flora-Rewarder takes on three roles depending on the prompt. It rates an episode's success on a scale of 1 to 5, classifies each half-second step as normal, suboptimal, or failure, and assigns scores based on self-defined rubrics.
Up to 125x cheaper by Nvidia's own estimates
In a test with 50 videos, Flora scored slightly better than GPT-6 Astra according to Nvidia, even though OpenAI's model was allowed to use its full reasoning capacity. Labeling one hour of video runs about 72 cents with Flora by Nvidia's estimate, compared to roughly $88.50 with GPT-6 Astra. Claude Opus 5 scored much worse in the same test and still cost about $42 per hour.
The Flora cost figures are projections, though, not production measurements. Nvidia calculated them based on an assumed rental price of $10 per GPU per hour.
Flora finds actions better, but Astra often describes them more precisely
On the public WGO-Bench, Flora is best at detecting action boundaries but trails Astra in overall score and falls behind Gemini 3.8 Flash in pure description accuracy. According to the researchers, the gains come mainly from temporal localization.
On Nvidia's own DenseCaptionBench, Flora leads across all metrics for human recordings, but for robot videos the model comes in second behind Astra. There's a methodological catch the researchers acknowledge, too. GPT-6 Astra evaluates the descriptions while also being one of the models under test.
Almost no other model catches mid-episode errors
On RoboRewardBench, Flora's error rate is 27.8 percent lower than Astra's. The paper attributes the gap to partially completed tasks. When a robot only tips a bottle over instead of knocking it off the table, Flora assigns 3 out of 5 points to match the human reference, while Astra gives just one.
Flora-Rewarder catches 53.3 percent of failed steps within an episode, while no competitor gets above 11.7 percent and Astra doesn't catch a single one. The tradeoff is that Flora falsely flags about 11 percent of normal steps as errors. Astra still leads on rubric-based scoring and trajectory ranking.
In a video with many short hand movements, Flora identifies 34 of 37 individual actions, while Astra catches only four. On the flip side, Flora sometimes splits longer actions into too many small steps and occasionally gets descriptions wrong. In one video, a robot hand wipes a plate with a cloth, but Flora describes it as folding a napkin.
Nvidia positions Flora as an open alternative to commercial services like Scale AI's Physical AI Data Engine. Researchers can use it to scale their own robotics datasets and test approaches like transferring human demonstrations to robots. Nvidia is investing billions in open AI models to keep developers in its hardware ecosystem and drive demand for its chips, and Flora serves that same goal.
The company has also been working for some time to offset the shortage of robotics training data through simulation and automated data processing. At GTC earlier this year, Nvidia showed a data pipeline that automatically prepares, multiplies, and scores training material. Flora adds detailed labels and reward signals from video to that pipeline.
All of this feeds into Nvidia's strategy of covering the entire robotics value chain, from hardware and training data to simulation and the AI models themselves. Google's recently announced Gemini 4 Argon targets a similar part of the robotics training process, also identifying work steps in training videos and flagging failed actions.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now
Read on for the full picture.
Subscribe for hype-free coverage.
- Full access to every article on THE DECODER
- No ads
- Join the comments and community discussions
- A weekly AI news recap via mail
- 6x/year: "AI Radar" — deep dives on the AI topics that matter most
- Daily AI news, always up to date
- Our full ten-year archive
- Covered by a team with 10+ years in AI
Subscribe to The Decoder
Auto-fetched and translated by AI Atlas. All rights belong to the original author.