道德操守
OpenAI 宣布社区安全报告和新青少年武器限制
在 Google 上的首选来源中添加 Unite.AI
OpenAI于2026年10月30日发布关于预防暴力的社区安全报告,每六个月更新一次,称公司在2026年第三季度进行了200多次执法转介。
计划于2027年初提交的社区安全报告
OpenAI承诺执行发布的《社区安全报告》,报告涉及预防暴力和其他社区安全问题及其保障措施的有效性。 称公司将报告如何培训其系统,以发现、调查和应对社区安全问题,分享与暴力有关的伤害如何表现的匿名例子,突出新的缓解措施和政策变化,并包括辅助数据。 第一次报告计划于2027年初提交,涵盖2026年下半年,此后每六个月更新一次。
OpenAI 称报告旨在让人们清楚地了解其模型如何识别和应对有害行为,它在实践中看到的风险,以及它为解决这些问题所采取的步骤。
OpenAI 称的安全工作包括提请执法部门注意迫在眉睫的暴力威胁,这些转介正在对破坏暴力阴谋产生积极影响。 称公司继续依靠精神健康和行为专家评估困难案例,该公司称AI公司与执法部门、家庭成员、精神卫生专业人员和决策者一起具有独特的作用。
对批量攻击内容的更严格限制
OpenAI 称的型号经过培训后不会发出有助于某人计划或实施暴力的指示。 该公司正在对ChatGPT如何回答过去大规模袭击的问题和实施者施加额外限制,指示该模式提供较不详细的信息,即使从其他在线来源获得。 紧缩的政策限制了过去大规模攻击的重建,包括使用的武器和设备以及如何获得这些武器和设备的细节,以及OpenAI称可能扩大攻击者名誉的伤害规模的详细比较。 不论用户的年龄或要求的理由如何,这些限制都适用。
人们仍可以要求ChatGPT帮助他们了解这些事件,受害者和社区受到何种影响,以及如何识别警告迹象和防止未来暴力。
2026年5月,公司分享了ChatGPT如何可以使用早期警告信号的简短,事实性摘要,在以后的聊天中更仔细地回应。 OpenAI 称正以此为基础,当最近的对话显示可能发生暴力的警告迹象时,ChatGPT将会在分享可能被滥用的信息时作出更保守的反应,它正在努力在预测某人未满18岁时适用这些更严格的限制,即使他们的谈话没有显示暴力意图的迹象。
它认定的OpenAI禁令账户违反了其关于暴力活动的政策。 称公司正与心理健康和暴力预防专家合作,研究更多,自动化的更早干预方式:当对话显示表示某人正在纠缠暴力或严重伤害他人的想法时,ChatGPT可以自动结束聊天,如果ChatGPT为此结束多个聊天,OpenAI可能会暂时暂停账户。
为18岁以下用户增加的保障措施
青少年的ChatGPT对18岁以下的用户适用适龄保障,而且OpenAI正在进一步限制青少年能够获得的与武器有关的信息,即使一个问题似乎无害。 该公司的政策已经禁止帮助任何人计划或实施暴力,并限制帮助青少年找到或获得武器;这种扩展限制了有关武器和安全系统的实际信息,即使没有暴力意图的迹象,但这些武器和安全系统可能被滥用以促进暴力。 OpenAI 称少年仍然可以使用ChatGPT来帮助预防和缓和暴力,寻求支持,并与信任的成年人连接。
OpenAI 称它加强了它的年龄预测系统,该系统分析行为模式等信号,以估计一个用户是否在18岁以下或超过18岁,随着人们使用ChatGPT,不断评估新的信号,并酌情将用户转移到18岁以下体验中。 OpenAI的年龄验证伙伴Persona(Persona)
父母控制相关账户包括安全警报,在经过专门培训的审查人员发现严重的自我伤害关切和可能与无序饮食有关的行为时,可以发出安全警报。 2026年7月,OpenAI扩大了这些警示范围,以通知青少年账户因违反其使用暴力政策而被关闭的父母,称公司正努力为青少年账户暂停多次讨论暴力而向家长发出通知。
2026年早些时候,这些措施以青少年安全为特点。 公司发布 ChatGPT for Teens于2026年8月18日自动将估计年龄在18岁以下的用户,或表示年龄在13至17岁之间的用户,根据其模型Spec中的"Under-18原则",进入默认保障体验。 OpenAI于2026年1月20日开始对ChatGPT消费者计划推出年龄预测,使用行为和账户级别信号来估计某个账户是否可能属于18岁以下的人;2026年8月25日更新了指出,该系统已经开始在欧盟推出。
OpenAI 称公告中详述的保障措施将在接下来的几周内开始推出,并将继续完善。
本文由 AI图鉴自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
Ethics
OpenAI Announces Community Safety Report and New Teen Weapons Limits
Add Unite.AI to your preferred sources on Google
OpenAI on October 30, 2026 announced a Community Safety Report on violence prevention that it will update every six months, alongside new protections that restrict weapons-related information for teens and tighten how ChatGPT handles questions about past mass attacks. The company said it made more than 200 law enforcement referrals in the third quarter of 2026.
Community Safety Report Planned for Early 2027
OpenAI committed to launching the Community Safety Report covering violence prevention and other community safety issues, as well as the effectiveness of its safeguards. The company said the report will explain how it trains its systems to detect, investigate, and respond to community safety issues, share anonymized examples of how violence-related harm manifests, highlight new mitigations and policy changes, and include supporting data. The first report is planned for early 2027 and will cover the second half of 2026, with updates every six months afterward.
OpenAI said the report is meant to give people a clear picture of how its models identify and respond to harmful behavior, the risks it sees in practice, and the steps it takes to address them.
OpenAI said its safety work includes bringing imminent threats of violence to the attention of law enforcement and that these referrals are making a positive difference in disrupting violent plots. The company said it continues to rely on mental health and behavioral experts to assess difficult cases, and it described AI companies as having a distinct role to play alongside law enforcement, family members, mental-health professionals, and policymakers.
Tighter Limits on Mass-Attack Content
OpenAI said its models are trained not to give instructions that would help someone plan or carry out violence. The company is placing additional restrictions on how ChatGPT responds to questions about past mass attacks and the people who carried them out, directing the model to provide less detailed information even when it is available from other online sources. The tightened policies restrict reconstructions of past mass attacks, including details about the weapons and equipment used and how they were obtained, as well as detailed comparisons on scale of harm that OpenAI said could amplify an attacker’s notoriety. The limits apply regardless of a user’s age or reason for asking.
People can still ask ChatGPT to help them understand these events, how victims and communities were impacted, and how to recognize warning signs and prevent future violence.
In May 2026, the company shared how ChatGPT can use short, factual summaries of earlier warning signs to respond more carefully in a later chat. OpenAI said it is building on that work so that when recent chats show warning signs of possible violence, ChatGPT will respond more conservatively when sharing information that could be misused, and it is working to apply those stricter limits when it predicts someone is under 18, even if their chats show no signs of violent intent.
OpenAI bans accounts it determines have violated its policies on violent activity. The company said it is working with mental health and violence prevention experts on additional, automated ways to intervene earlier: when a conversation shows signs that someone is fixating on violence or the idea of seriously harming another person, ChatGPT will be able to automatically end the chat, and if ChatGPT ends multiple chats for that reason, OpenAI may temporarily pause the account.
Added Safeguards for Users Under 18
ChatGPT for Teens applies age-appropriate safeguards for users under 18, and OpenAI is placing further limits on the weapons-related information teens can receive, even when a question appears harmless. The company’s policies already prohibit helping anyone plan or carry out violence and restrict helping teens find or obtain weapons; the extension restricts practical information about weapons and security systems that could be misused to facilitate violence, even when there is no sign of violent intent. OpenAI said teens can still use ChatGPT to help prevent and de-escalate violence, seek support, and connect with a trusted adult.
OpenAI said it has strengthened its age prediction system, which analyzes signals such as behavior patterns to estimate whether a user may be under or over 18, to continually assess new signals as people use ChatGPT and move users into the under-18 experience when appropriate. Users incorrectly placed in the under-18 experience can confirm they are adults through Persona, OpenAI’s age verification partner, and have the additional teen protections removed.
Linked parental-control accounts include safety alerts that may be sent when specially trained reviewers identify a serious self-harm concern and behaviors that may be associated with disordered eating. In July 2026, OpenAI expanded those alerts to notify parents if a teen’s account has been deactivated for violating its usage policies on violence, and the company said it is working to introduce notifications for parents if it pauses a teen’s account for repeatedly discussing violence.
The measures build on teen-safety features OpenAI introduced earlier in 2026. The company launched ChatGPT for Teens on August 18, 2026, automatically placing users estimated to be under 18, or who state an age between 13 and 17, into an experience with default safeguards based on the Under-18 Principles in its Model Spec. OpenAI began rolling out age prediction on ChatGPT consumer plans on January 20, 2026, using behavioral and account-level signals to estimate whether an account likely belongs to someone under 18; an August 25, 2026 update notes the system had begun rolling out in the EU.
OpenAI said the safeguards detailed in the announcement will begin rolling out in the next few weeks and that it will continue to refine them.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.