Google Deepmind的Genie 4在agent设计上设置了一个现代的旋转，它比LLMs更早。
关键点
- Google Deepmind拥有推出 Genie 4，是一种互动的世界模型，实时按帧计算环境框架，并首次直接生成匹配背景音频和字符对话框。
- Gemini模型在背景中引导事件，规划多步任务，并不断使模拟世界适应用户文本提示和不断变化的条件。
- Genie 4仍然是一种实验性研究模型，在较长的会话和复杂的物理学方面有局限性。 访问目前仅限于选择测试者，以后将扩展至Google AI Ultra用户。
Genie 4应该是实时模拟互动世界，包括声音和说话角色。 Gemini模型在背景中规划了下一步在模拟中会发生什么。 现在只有选定的测试者才能尝试世界模型。
Google Deepmind拥有推出 Genie 4，是Genie 3的继任者，该公司于2025年8月显示。 世界模型不制作完成的视频，而是按帧计算一个场景框架，随时间推移对输入作出反应。 用户用键盘在现场移动，用文字提示引导事件。
根据Deepmind的说法，Genie 4是公司第一个直接产生声音的实时世界模型。 公司称每个世界都有自己的背景音频，如树上的风。 Genie 4也处理对话框，其中的字符应该互相对话，react则实时用于用户输入或事件。
Deepmind认为现实主义的最大好处是模型如何塑造人。 字符应该会自然移动和react到周围，用户应该能够直接控制它们。
Gemini模式计划提前保持世界的一致性
Deepmind认为，Genie 4基于视频模型Gemini Omni的能力，因此世界看起来和行为都很现实。 其他的Gemini模型帮助计划模拟使其保持一致。
如果用户用文字提示来改变天气，Gemini应该将指令适应运行中的场景。 Deepmind 称 Gemini也引导各种投入之间的事件，因此世界不断以合理的方式发展。
Deepmind用多步任务来解释这一过程。 Gemini 3.8号卫星 Flash连续观看场景，将一个进球突破成步骤，并使用新的帧来检查每个步骤是否有效。 如果世界发生变化或用户步入，模型会调整其计划。
Deepmind也在测试Gemini 4 Argon，将其Genie的工作与其机器人研究，Gemini机器人相挂钩。 在一次演示中，阿尔贡打破了玩跳棋的任务，将跳棋分成阶梯。 Genie 4获得这些作为文本指示，并用它们来模拟Apptronik的人类机器人阿波罗在游戏中扮演，没有真正的机器人参与其中。
更长的会话仍然绊倒模型
Deepmind称Genie 4为早期实验模型。 公司认为，世界在短会中保持一致性，但视觉细节可以改变，物体并不总是在较长的模拟中或经过几个复杂的即时变化后持续。
Deepmind 称它仍在研究复杂的物理相互作用，准确的实时声音，以及可读文本。
目前，Genie 4只能用来选择测试者作为研究预览。 它的设定将很快与早期访问Gemini API和Google AI Studio的合作伙伴一起，在Project Genie网络应用中达到Google AI Ultra的订阅者。
Google 称所有视频和音频轨迹都将携带其合成ID水印，该水印隐含着AI生成的内容。
世界模型一旦成熟，就可以成为机器人和AI agents从模拟经验而不是仅仅从数据中学习的训练环境。 Deepmind将Gemini与Genie配对视为向混合世界模型的早期一步，将语言和代码模型的推理与像素级模拟相结合。
AI News Without the Hype – 由人类治愈
订阅THE DECODER免费阅读，每周AI通讯，我们独家的"AI雷达"前沿报告每年6次，全面存档访问，访问我们的评论部分。
现在订阅
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Google Deepmind's Genie 4 puts a modern spin on agent designs that predate LLMs
Key Points
- Google Deepmind has introduced Genie 4, an interactive world model that calculates environments frame by frame in real time and, for the first time, directly generates matching background audio and character dialogue.
- Gemini models steer events in the background, planning multistep tasks and continuously adapting the simulated world to user text prompts and changing conditions.
- Genie 4 is still an experimental research model with limitations in longer sessions and complex physics. Access is limited to select testers for now and will later expand to Google AI Ultra subscribers.
Genie 4 is supposed to simulate interactive worlds in real time, including sound and talking characters. Gemini models plan in the background what happens next in the simulation. Only select testers can try the world model for now.
Google Deepmind has introduced Genie 4, the successor to Genie 3, which the company showed in August 2025. The world model doesn't produce finished videos but calculates a scene frame by frame, reacting to input as it goes. Users move through the scene with the keyboard and steer events with text prompts.
According to Deepmind, Genie 4 is the company's first real-time world model that generates sound directly. The company says each world has its own background audio, such as wind in the trees. Genie 4 also handles dialogue, with characters that are supposed to talk to each other and react in real time to user input or events.
Deepmind sees the biggest gain in realism in how the model renders people. Characters are supposed to move naturally and react to their surroundings, and users should be able to control them directly.
Gemini models plan ahead to keep the world coherent
According to Deepmind, Genie 4 builds on capabilities of the video model Gemini Omni so the world looks and behaves realistically. Other Gemini models help plan the simulation to keep it consistent.
If a user changes the weather with a text prompt, Gemini is supposed to adapt the instruction to the running scene. Deepmind says Gemini also steers events between inputs so the world keeps developing in a way that makes sense.
Deepmind explains the process with multistep tasks. Gemini 3.8 Flash watches the scene continuously, breaks a goal into steps, and uses new frames to check whether each step worked. If the world changes or the user steps in, the model adjusts its plan.
Deepmind is also testing Gemini 4 Argon to tie its Genie work to its robotics research, Gemini Robotics. In one demo, Argon breaks the task of playing checkers into steps. Genie 4 gets these as text instructions and uses them to simulate Apptronik's humanoid robot Apollo playing the game, with no real robot involved.
Longer sessions still trip up the model
Deepmind calls Genie 4 an early, experimental model. According to the company, the world stays consistent over short sessions, but visual details can shift and objects don't always persist in longer simulations or after several complex prompt changes.
Deepmind says it's still researching complex physical interactions, accurate real-time sound, and readable text.
For now, Genie 4 is only available to select testers as a research preview. It's set to reach Google AI Ultra subscribers in the Project Genie web app soon, along with partners who have early access to the Gemini API and Google AI Studio.
Google says all videos and audio tracks will carry its SynthID watermark, which invisibly marks AI-generated content.
Once they mature, world models could serve as training environments where robots and AI agents learn from simulated experience rather than just from data. Deepmind sees pairing Gemini with Genie as an early step toward hybrid world models that combine the reasoning of language and code models with pixel-level simulation.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now
Auto-fetched and translated by AI Atlas. All rights belong to the original author.