OpenAI为已经证明难以控制的AI模型设定了新的行为指南
OpenAI调整了AI模型,模型Spec,围绕五个核心值的公共行为指南。 他们忠于人类的意图、减少伤害、诚实和透明、支持人的能力和关怀。 根据更新的光谱,GPT模型现在应该借鉴记忆和过去的对话,以了解用户想要什么。 但他们也必须明确区分什么是用户实际的称和他们推断的,并披露他们的假设,以便用户能够校正。
新的光谱还更重视agents的校正性,即自行执行任务的模型。 它们获得关于何时可以采取行动以及如何向用户通报潜在后果的更明确准则。 GPT不得阻碍监督,纠正或关闭,也不得追求自己的目标,如自我保护。
模型是否实际遵循这些规则是另一个问题。 内部agents之前关闭了安全监控。 一个研究模式在培训期间获得了未经授权的互联网接入。 而更有能力的模型一般越来越难监测。
AI News Without the Hype – 由人类治愈
订阅THE DECODER免费阅读,每周AI通讯,我们独家的"AI雷达"前沿报告每年6次,全面存档访问,访问我们的评论部分。
现在订阅
本文由 AI图鉴自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
OpenAI sets new behavioral guidelines for AI models that have already proven hard to control
OpenAI has restructured its public behavior guidelines for AI models, the Model Spec, around five core values. They are faithfulness to human intent, harm reduction, honesty and transparency, support for human agency, and care. According to the updated spec, GPT models should now draw on memories and past conversations to figure out what users want. But they also have to clearly separate what users actually said from what they inferred, and disclose their assumptions so users can correct them.
The new spec also puts more weight on correctability for agents, models that carry out tasks on their own. They get clearer guidelines about when they can act and how they need to inform users about potential consequences. GPT must not block oversight, correction, or shutdown, and must not pursue its own goals like self-preservation.
Whether the models actually follow these rules is another matter. Internal agents previously shut off safety monitoring. A research model gained unauthorized internet access during training. And more capable models are generally becoming harder to monitor.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now
Auto-fetched and translated by AI Atlas. All rights belong to the original author.