OpenAICEO Sam Altman 称高级AI将不可避免地逃脱它的沙盒，只有对齐才能拯救我们
OpenAICEO萨姆·阿尔特曼(Sam Altman)认为高级AI不能被关起来。 他有战略理由将AI这样设定，但他对于这些模型能做什么的警告值得注意。
在最近的一次采访中，阿尔特曼解释道，沙盒，孤立的安全环境曾经包含AI系统，只在有限的时间内工作。 一旦模型变得足够聪明，甚至无法追踪他们是如何爆发的。
之后的一段时间内，他仍然能进行监控，称。 但最终，唯一起作用的是对齐，意思是AI必须自己将人类价值观内部化，并相应行动。 Altman 称认为，"调整错误的潜在成本已经大幅上升"，尽管这仍然是一个早期的研究问题，远未得到解决。
Altman同样是警告，AI模型已经发现人类黑客从未想到的硬件级安全缺陷。 一个接一个地修补弱点已经不够了，他就是称。 相反，整个互联网安全架构需要重建，由AI力量防御AI驱动的攻击。 他将本地运行的开源模型也视为一种风险，他注意到即使有了"全球agent监测"，也会有一些你希望有人没有做过的事情。
Altman的警告也有利于他的生意
批评者会指出，阿尔特曼关于不可控制的AI的言论有利于自己的公司。 将你的人工智能说成太强大无法控制可能是防止责任问题的方法如果连建立AI的公司都无法控制，那么当事情出错时，公司就更难被追究责任。
OpenAI在这里承受着真正的压力。 FTC已对AI OpenAI,Anthropic，以及AI agents上空的其他AI实验室展开正式调查，这些实验室螺旋失控，引发了网络安全事件。 该机构希望让AI开发者对其agents的表现负责。
Altman从Nvidia首席执行官Jensen Huang那里得到了一些回击他把AI安全设定为可溶解的工程问题。 "[......]我们都希望这是工程问题。 如果这不是工程问题，也不是可以溶解的","黄称在最近的一次采访中。
AI News Without the Hype – 由人类治愈
订阅THE DECODER免费阅读，每周AI通讯，我们独家的"AI雷达"前沿报告每年6次，全面存档访问，访问我们的评论部分。
现在订阅
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
OpenAI CEO Sam Altman says advanced AI will inevitably escape its sandbox, and only alignment can save us
OpenAI CEO Sam Altman believes advanced AI can't be kept locked up. He has strategic reasons to frame AI this way, but his warnings about what these models can do deserve attention.
In a recent interview, Altman explains that sandboxes, the isolated security environments used to contain AI systems, only work for a limited time. Once models get smart enough, there's no way to even trace how they broke out.
Monitoring still helps for a while after that, he says. But eventually, the only thing that works is alignment, meaning the AI has to internalize human values on its own and act accordingly. Altman says that "the potential cost of alignment being wrong has gone up enormously," though that remains an early-stage research problem, far from being solved.
Altman also warns that AI models are already finding hardware-level security flaws no human hacker ever thought of. Patching vulnerabilities one by one isn't enough anymore, he says. Instead, the entire security architecture of the internet needs to be rebuilt, with AI-powered defense against AI-driven attacks. He sees locally run open-source models as a risk too, noting that even with "global agent monitoring, there's going to be some stuff that you wish someone hadn't done."
Altman's warnings also serve his business interests
Critics will point out that Altman's talk about uncontrollable AI benefits his own company. Framing your AI as too powerful to contain could be a way to preempt liability questions. If even the company that built the AI supposedly can't control it, it gets a lot harder to argue that the company should be held responsible when things go wrong.
OpenAI is under real pressure here. The FTC has opened a formal investigation into OpenAI, Anthropic, and other AI labs over AI agents that spiraled out of control and caused a wave of cybersecurity incidents. The agency wants to hold AI developers liable for how their agents behave.
Altman is getting some pushback from Nvidia CEO Jensen Huang, who frames AI safety as a solvable engineering problem. Huang didn't sound entirely convinced by his own argument, though. "[…] we all need to hope that it's an engineering problem. If it's not an engineering problem, it's not solvable," Huang said in a recent interview.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now
Auto-fetched and translated by AI Atlas. All rights belong to the original author.