aifollow.news
返回 IT之家 科技新闻
IT之家 科技新闻· · 原发布时间 精选AI 评分60

OpenAI 收紧 ChatGPT 暴力内容限制,拟定期公布社区安全报告

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 辅助摘要

OpenAI 表示,ChatGPT 可自动终止显示用户执念于暴力或萌生严重伤害他人念头的对话;同一账户若因此多次被中断,可能遭临时冻结。它还收紧了既往大规模袭击事件细节及青少年可获取的武器信息,并计划从 2027 年初起每半年发布一次社区安全报告。

推荐理由

ChatGPT 用户会遇到更严格的暴力内容回答限制,反复触发对话中断还可能导致账户临时冻结;定期报告则将披露这些防护机制的实际成效。

正文 · AI 翻译

Thanks to IT Home reader 华南吴彦祖 for the tip!

IT Home reported on October 31 that OpenAI said in a blog post published on October 30 local time that keeping communities safe has always been a top priority. Its routine work includes proactively notifying law enforcement of imminent threats of violence. In the third quarter of 2026 alone, OpenAI referred leads on more than 200 cases to law enforcement.

OpenAI pledged to publish a Community Safety Report regularly, systematically disclosing its progress on preventing violence, other community safety issues, and the effectiveness of its safeguards in practice. The first report will be released in early 2027 and will cover safety data from the second half of 2026. Subsequent reports will be published every 6 months.

IT Home learned that OpenAI has added restrictions on how ChatGPT answers questions about past mass attacks and their perpetrators: even when the relevant information is publicly available online, the system will be tightly controlled and provide only extremely brief information. At the same time, people can still use ChatGPT to learn about such events as a whole, their effects on victims and communities, and how to recognize warning signs to prevent future violence.

OpenAI has further tightened its safety policies, strictly limiting detailed accounts of past mass attacks, including specifications of the weapons involved, how they were obtained, and comparisons of the scale of harm that could amplify the perpetrators’ notoriety. These restrictions apply equally regardless of a user’s age or reason for asking.

In addition, when a conversation indicates that a user is becoming fixated on violence or is developing thoughts of seriously harming others, ChatGPT can automatically end the conversation to immediately interrupt that pattern of thought and behavior. If conversations from the same account are forcibly ended multiple times for this reason, OpenAI may temporarily suspend the account.

OpenAI also announced stricter limits on information about guns and other weapons available to teenagers, even when questions appear harmless on the surface. Even if a user shows no violent intent, the system will broadly restrict practical knowledge about weapons and information on bypassing security systems that could be misused to fuel violence.

OpenAI is currently accelerating development of a feature to notify parents immediately when a teenager’s account is temporarily suspended for repeatedly discussing violent content.

发现内容有误?提交纠错