社区安全报告和青少年新保护
ChatGPT是世界上使用最广的AI产品之一，我们投资建设了该行业的一些最先进的系统，用于检测潜在危害，审查活动，以及不断升级的可信威胁。 以及更多针对未成年人的火器内容限制。
维护社区安全仍然是OpenAI的当务之急。 我们的工作包括提请执法部门注意迫在眉睫的暴力威胁，我们在2026问题3中转介了200多个执法部门。 这些转诊在打乱暴力阴谋(在新窗口打开)方面产生了积极的区别(在新窗口打开)，我们继续依靠心理健康和行为专家帮助我们评估困难案例。
我们承认AI公司与执法部门、家庭成员、精神卫生专业人员和决策者一起可以发挥独特的作用，他们带来了关键的权威、背景和现实世界。 我们致力于通过不断加强我们的系统，分享我们学到的知识，以及直接与那些最有能力在现实世界中采取行动的人合作，发挥这一作用。
我们正在不断加强我们为帮助保护人民和社区而采取的步骤。 这意味着建立强有力的保障，并且透明地说明它们的工作效果以及我们如何加强它们。 我们希望让人们清楚地了解我们的方法，我们的模型如何识别和应对有害行为，我们在实践中看到的风险，以及我们为解决这些问题所采取的步骤。
我们致力于发布社区安全报告，该报告将解释我们如何培训我们的系统，以发现、调查和应对社区安全问题。 我们将分享与暴力有关的伤害如何表现和我们学到什么的匿名例子，强调新的缓解措施和政策变化，并纳入相关数据来支持这些调查结果。
我们将在2027年初发表第一份报告，涵盖2026年下半年，此后每六个月更新一次。 我们的承诺是分享关于我们如何确定、审查和应对潜在有害内容的有意义的结论。
我们的模型受过训练，不会发出有助于计划或实施暴力的指示。 我们正对ChatGPT如何回应过去大规模攻击以及发动攻击的人的问题施加更多限制，人们应该能够要求ChatGPT帮助他们了解这些事件、受害者和社区受到何种影响，并了解如何识别警告迹象和防止未来暴力。 但是，我们正在加紧政策，限制过去大规模攻击的重建，包括使用的武器和装备的细节以及如何获得这些武器和装备，以及详细比较可能扩大攻击者名誉的伤害程度。 这些限制不论使用者的年龄或提出要求的理由如何都适用。
有时，一个请求本身似乎很普通，但鉴于先前的谈话，它具有不同的含义。 5月，我们分享了ChatGPT如何使用早期警告信号的简短，事实性摘要，在稍后的聊天中更仔细的反应。 ChatGPT在分享可能被滥用的信息时，即便聊天没有暴力意图的迹象
我们禁止那些我们确定违反我们暴力活动政策的说法。 我们还在与心理健康及暴力预防专家合作，当一次谈话显示表示某人正在纠缠暴力或严重伤害他人的想法时，ChatGPT就可以自动结束聊天，以在此刻打断这种模式。 如果ChatGPT为此结束多个聊天，我们可能会暂时暂停账户。 这是一项持续的努力，我们继续加强并投资于技术和实际保护，包括如何可靠地识别警告迹象，并确定何时和如何进行干预。
ChatGPT for Teens对18岁以下的用户实施适龄保障，并有较强的保护和额外限制以减少敏感内容的暴露。 目前我们仍在进一步限制青少年获得与武器有关的信息
我们的政策已经禁止帮助任何人计划或实施暴力，并限制帮助青少年找到或获得武器。 我们正扩大这些保护范围，以限制有关武器和安全系统的实际信息，即使没有暴力意图，青少年仍然可以使用ChatGPT帮助预防和缓解暴力，寻求支持，并与一个值得信赖的成年人连接。
去年我们发布年龄预测，它分析了行为模式等多种信号来估计一个用户是否在18岁以下或超过18岁。 我们加强了我们的年龄预测系统，以不断评估新的信号，因为人们使用ChatGPT，并酌情将青少年引入18岁以下的经验。 被错误地安置在18岁以下经验中的用户将永远有一个快速的，保护隐私的方式来确认自己是成年人，并通过我们的年龄验证伙伴Persona来移除额外的青少年保护。
我们的父母控制让父母将ChatGPT账户与十几岁的孩子联系起来，并共同管理安全环境。 链接的账户包括安全警报，在经过专门培训的审查人员发现严重的自我伤害关切和可能与无序饮食有关的行为时，可能发出安全警报。 7月，我们扩大了警示范围，将青少年账户因违反我们关于暴力的政策而被关闭的情况通知家长。 我们正努力向父母提出通知，如果我们暂停他们青少年的叙述
现实世界的暴力行为令人心碎和复杂，并有许多促成因素。 它们也清楚地提醒我们，我们必须继续设计和延长我们的系统，以说明人类行为固有的复杂现实。 在人工智能系统中制定有效的暴力保障措施需要解决认识风险和作出适当反应的新问题，我们将继续投资于、提炼和分享如何最好地实施我们所追求的保护的知识。 这里详述的保障措施将在今后几周内开始推出，我们将继续完善这些保障措施。 我们仍然致力于减轻ChatGPT的伤害风险，加强我们分层保护，监测滥用情况，执行我们的规则，并在局势需要时让现实世界支持和干预。
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Community safety report and new protections for teens
ChatGPT is one of the world’s most widely used AI products, and we have invested in building some of the industry’s most advanced systems for detecting potential harm, reviewing concerning activity, and escalating credible threats. We’re making two announcements to further our work in this area: a new Community Safeguards Report and more restrictions around firearms content for minors.
Keeping communities safe continues to be a top priority for OpenAI. Our work includes bringing imminent threats of violence to the attention of law enforcement, and we made over 200 law enforcement referrals in Q3 2026. These referrals are making a positive(opens in a new window) difference(opens in a new window) in disrupting violent plots, and we continue to rely on mental health and behavioral experts to help us assess difficult cases.
We recognize AI companies have a distinct role to play alongside law enforcement, family members, mental-health professionals, and policymakers, who bring critical authority, context and real-world reach. We are committed to making the most of that role by continuously strengthening our systems, sharing what we learn, and working directly with those who are best positioned to act in the real world.
We are constantly strengthening the steps we take to help protect people and communities. That means building strong safeguards, and also being transparent about how well they work and what we’re doing to enhance them. We want to give people a clear picture of our approach, how our models identify and respond to harmful behavior, the risks we see in practice, and the steps we take to address them.
We’re committing to launch the Community Safety Report on violence prevention and other community safety issues, and the effectiveness of our safeguards. The report will explain how we train our systems to detect, investigate, and respond to community safety issues. We’ll share anonymized examples of how violence-related harm manifests and what we’re learning, highlight new mitigations and policy changes, and include relevant data to support these findings.
We will publish our first report in early 2027, covering the second half of 2026, with updates every six months thereafter. Our commitment is to share meaningful findings about how we identify, review, and respond to potentially harmful content.
Our models are trained to not give instructions that would help someone plan or carry out violence. We’re now placing additional restrictions on how ChatGPT responds to questions about past mass attacks and the people who carried them out, directing the model to provide less detailed information in those areas even if it is available from other online sources. People should be able to ask ChatGPT to help them understand these events, how victims and communities were impacted, and learn about recognizing warning signs and preventing future violence. But we’re tightening our policies to restrict reconstructions of past mass attacks, including details about the weapons and equipment used and how they were obtained, and detailed comparisons on scale of harm that could amplify an attacker’s notoriety. These limits apply regardless of a user’s age or reason for asking.
Sometimes a request that seems ordinary on its own takes on a different meaning in light of an earlier conversation. In May, we shared how ChatGPT can use short, factual summaries of earlier warning signs to respond more carefully in a later chat. We’re building on that work so that when recent chats show warning signs of possible violence, ChatGPT will respond more conservatively when sharing information that could be misused. We’re also working to apply those stricter limits when we predict someone is under 18, even if their chats show no signs of violent intent.
We ban accounts that we determine have violated our policies on violent activity. We’re also working with mental health and violence prevention experts on additional, automated ways to intervene earlier. When a conversation shows signs that someone is fixating on violence or the idea of seriously harming another person, ChatGPT will be able to automatically end the chat to interrupt that pattern in the moment. If ChatGPT ends multiple chats for that reason, we may temporarily pause the account. This is an ongoing effort and we continue to strengthen and invest in technical and practical protections, including how to recognize warning signs reliably and determine when and how to intervene.
ChatGPT for Teens applies age-appropriate safeguards for users under 18, with stronger protections and additional limits to reduce exposure to sensitive content. We’re now placing further limits on weapons-related information teens can receive, even when a question appears harmless.
Our policies already prohibit helping anyone plan or carry out violence and restrict helping teens find or obtain weapons. We’re extending those protections to restrict practical information about weapons and security systems that could be misused to facilitate violence, even when there’s no sign of violent intent. Teens can still use ChatGPT to help prevent and de-escalate violence, seek support, and connect with a trusted adult.
We launched age prediction last year, which analyzes multiple signals such as behavior patterns to estimate whether a user may be under or over 18. We strengthened our age prediction system to continually assess new signals as people use ChatGPT and move teens into the under 18 experience when appropriate. Users who are incorrectly placed in the under 18 experience will always have a fast, privacy-protective way to confirm they are adults and have additional teen protections removed through Persona, our age verification partner.
Our parental controls let parents link their ChatGPT accounts to their teens and manage safety settings together. Linked accounts include safety alerts that may be sent when specially trained reviewers identify a serious self-harm concern and behaviors that may be associated with disordered eating. In July, we expanded those alerts to notify parents if their teen’s account has been deactivated for violating our usage policies on violence. We are working to introduce notifications for parents if we pause their teen’s account for repeatedly discussing violence, as detailed above.
Acts of real-world violence are heartbreaking and complex, with many contributing factors. They are also a stark reminder that we must continue designing and iterating our systems to account for the inherently complicated realities of human behavior. Developing effective violence safeguards in AI systems requires solving novel problems in recognizing risk and responding appropriately, and we will continue to invest in, iterate, and share learnings on how best to implement the protections we’re pursuing. The safeguards detailed here will begin rolling out in the next few weeks and we will continue to refine them. We remain committed to mitigating risks of harm in ChatGPT, strengthening our layered protections, monitoring for misuse, enforcing our rules, and involving real-world support and interventions when situations call for it.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.