Today ainotis Join

My notis

SafetyPublished Top storyAll news from that day

ChatGPT will be able to end chats that fixate on violence

OpenAI's post of 30 October says these safeguards and tighter teen weapons limits roll out in the next few weeks; it names ChatGPT and no model.

Share

Check our sources · 9 facts from 1 source
White title text, Community Safety Report and New Protections for Teens, centred on a soft yellow-to-green gradient.Image: OpenAI
source · The company's own image of its product, used to report on it

Key points

  1. OpenAI says ChatGPT will be able to end a chat that shows someone fixating on violence, and may temporarily pause an account after several ended chats.
  2. ChatGPT for Teens will restrict practical information about weapons and security systems even without signs of violent intent; for all users, answers on past mass attacks lose weapons detail.
  3. OpenAI says the safeguards begin rolling out in the next few weeks, and that it made over 200 law enforcement referrals in Q3 2026.

What happened

OpenAI says ChatGPT will be able to end a conversation automatically when it shows signs that someone is fixating on violence, and may temporarily pause an account that has several chats ended this way.

OpenAI's post of 30 October, "Community safety report and new protections for teens", says the safeguards "will begin rolling out in the next few weeks", so they are announced rather than all live.

The company says its work includes bringing imminent threats of violence to the attention of law enforcement, and that it made over 200 law enforcement referrals in Q3 2026.

For every user, regardless of age or reason for asking, it is tightening how ChatGPT answers about past mass attacks: less detail on the weapons and equipment used and how they were obtained, and on comparisons of scale of harm.

For teens, ChatGPT for Teens will restrict practical information about weapons and security systems even when a question appears harmless, and OpenAI says it is working on notifying parents when it pauses a linked teen's account for repeatedly discussing violence.

A user wrongly placed in the under-18 experience can confirm they are an adult through Persona, OpenAI's age verification partner. OpenAI also commits to a first Community Safety Report in early 2027, covering the second half of 2026, with updates every six months. The post does not name the model behind ChatGPT's detection.

What it means for you

Our view

These are announced safeguards, not live ones, and the post names no model behind the detection, so how often chats will end or accounts pause is not yet known.

If your organisation lets staff or teenagers use ChatGPT, expect questions about weapons or past attacks to get less detail once the limits arrive, whatever the reason for asking. OpenAI also says it is working on notifying parents when a teen's account is paused, which is not live either.

The first Community Safety Report is promised for early 2027, covering the second half of 2026. Put that date in your calendar and read it for evidence of how the new limits worked.

It adds no new facts.

Share this story

Your reaction

We count reactions per story and day, never who reacted. The counts help us choose what goes in the monthly issue. If you are signed in, your own page shows yours too.

Check our sources

Every sentence above is checked against this source.

1 Community safety report and new protections for teensOpenAI · 30 Oct 2026 · 9 facts Open the source archived copy
  1. OpenAI's post of 30 October 2026 says that when a conversation shows signs that someone is fixating on violence or the idea of seriously harming another person, ChatGPT will be able to automatically end the chat, and that if ChatGPT ends multiple chats for that reason, it may temporarily pause the account.

    When a conversation shows signs that someone is fixating on violence or the idea of seriously harming another person, ChatGPT will be able to automatically end the chat to interrupt that pattern in the moment. If ChatGPT ends multiple chats for that reason, we may temporarily pause the account.
    cite
  2. The post says the safeguards detailed in it will begin rolling out in the next few weeks.

    The safeguards detailed here will begin rolling out in the next few weeks and we will continue to refine them.
    cite
  3. The post says OpenAI made over 200 law enforcement referrals in Q3 2026.

    Our work includes bringing imminent threats of violence to the attention of law enforcement, and we made over 200 law enforcement referrals in Q3 2026.
    cite
  4. The post says OpenAI is placing additional restrictions on how ChatGPT responds to questions about past mass attacks, limiting reconstructions including details about the weapons and equipment used and how they were obtained, and detailed comparisons on scale of harm, and that these limits apply regardless of a user's age or reason for asking.

    We're now placing additional restrictions on how ChatGPT responds to questions about past mass attacks ... we're tightening our policies to restrict reconstructions of past mass attacks, including details about the weapons and equipment used and how they were obtained, and detailed comparisons on scale of harm that could amplify an attacker's notoriety. These limits apply regardless of a user's age or reason for asking.
    cite
  5. The post says ChatGPT for Teens is placing further limits on weapons-related information teens can receive, extending protections to restrict practical information about weapons and security systems that could be misused to facilitate violence, even when there is no sign of violent intent.

    We're now placing further limits on weapons-related information teens can receive, even when a question appears harmless. ... We're extending those protections to restrict practical information about weapons and security systems that could be misused to facilitate violence, even when there's no sign of violent intent.
    cite
  6. The post says users incorrectly placed in the under 18 experience can confirm they are adults through Persona, which it calls its age verification partner.

    Users who are incorrectly placed in the under 18 experience will always have a fast, privacy-protective way to confirm they are adults and have additional teen protections removed through Persona, our age verification partner.
    cite
  7. The post says OpenAI is working to introduce notifications for parents if it pauses their teen's account for repeatedly discussing violence.

    We are working to introduce notifications for parents if we pause their teen's account for repeatedly discussing violence, as detailed above.
    cite
  8. The post says OpenAI will publish its first Community Safety Report in early 2027, covering the second half of 2026, with updates every six months thereafter.

    We will publish our first report in early 2027, covering the second half of 2026, with updates every six months thereafter.
    cite
  9. The post names ChatGPT and ChatGPT for Teens as the products affected and does not name a model used for detection.

    ChatGPT for Teens applies age-appropriate safeguards for users under 18 ... directing the model to provide less detailed information in those areas
    cite

Topics

The morning email

On the mornings we publish: the three top stories and up to four short ones. Free.

We email you a link to confirm. An issue may include one sponsor, always labelled Sponsored · Advertisement. Our emails count opens and clicks, not who made them. Unsubscribe in one click. What we keep