GPT-5.6号卫星索尔能击败金丝雀
前情提要,我们让Claude Code 玩“自动击败Factorio”和“假战:agent测试床”
我得到了GPT-5.6 Sol,以低思维水平运行于Codex,以完成一个和平(即不咬人). Escentio在13.5小时的游戏时间里运行:
在YouTube上可查到全程的时滞。
与我之前的帖子类似,这次运行使用游戏管理器,允许Sol/Codex通过一个小库与游戏互动(虽然这次运行是Python而不是Bash). 库允许模型在程序上玩游戏,同时执行人类玩家在使用GUI时面临的同样限制(如玩家的接触,战争的雾).
观察运行是令人着迷的:Sol在一些方面超出了我的预期,而在另一些方面也显示出明显的弱点。 我记录了整个运行过程,正在制作评论录影带
除了屏幕播报,我的运营经理还掌握了整个游戏的制作统计数据。 以下是一份资源总产量图
但Sol的惊人效果说服我继续。 不幸的是,我认为在蓝科学阶段会出现的缩放问题后来出现,大大减缓了索尔的相对进展。
火箭发布只是通过Sol方面的重大 " 人工 " 努力而实现的,因为火箭通过反复在工厂各区之间运送供应品来证明它未能将某些生产系统连接起来。
然而,我仍对GPT-5.5的以往尝试有所改进感到高兴,因为该型号完全没有使用运输带。
我乐观地认为,在许多方面,玩“Factorio”与编程类似,但好处是,对临时观察者来说,它更容易辨别,因此便于讨论示范行为。
我期待着测试其他模式和思维水平以及非和平运行。 继续听!
本文由 AI图鉴自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
GPT-5.6 Sol can beat Factorio
Previously: We got Claude Code playing Factorio, Towards beating Factorio autonomously, and Faketorio: an agent testbed
I got GPT-5.6 Sol, running in Codex with low thinking level, to complete a peaceful (i.e. no biters) Factorio run in 13.5 hours of game time:
A timelapse of the full run is available on YouTube.
Similar to my previous post, this run used a game manager to allow Sol/Codex to interact with the game via a small library (though in this run it was Python rather than Bash). The library allows the model to play the game programmatically while enforcing the same restrictions that human players face when using the GUI (e.g. reach of the player, fog of war).
Observing the run was fascinating: Sol exceeded my expectations in some areas while also showing clear weaknesses in others. I have the entire run recorded and am working on a commentary video, but in the meantime here’s a small timelapsed segment showing some parts of the factory:
Besides the screencast, my run manager also captured production statistics throughout the game. Here’s a chart of total resource production, annotated with science research milestones:
I had planned to terminate the run after blue science research, but Sol’s surprising effectiveness convinced me to keep it going. Unfortunately, the scaling issues I thought would occur in the blue science stage appeared later and slowed Sol’s relative progress significantly.
The rocket launch was only achieved through significant ‘manual’ effort on Sol’s part as it papered over its late-game failures to connect certain production systems by repeatedly ferrying supplies between areas of the factory.
Still, I was pleased with the improvement over previous attempts with GPT-5.5 which suffered from the model’s failures to use transport belts at all.
I’m optimistic about autonomous Factorio play as a medium for building intuition about the nature of model capabilities. In many ways playing Factorio is analogous to programming but with the benefit of being much more legible to casual observers, making it convenient for grounding discussion of model behaviors.
I look forward to testing other models and thinking levels, as well as non-peaceful runs. Stay tuned!
Auto-fetched and translated by AI Atlas. All rights belong to the original author.