Writing · What's changing

The era of voluntary child safety is ending

The era of voluntary child safety is ending. Courts, attorneys general and regulators are turning platform promises into binding obligations. AI products are now in scope too. Here's what I'm reading this morning:

1/ India The Supreme Court said protections for under-18s on social media must carry legal force. The government is now looking at using the IT Intermediary Rules to require age verification and parental consent.

→ Another major market moves toward mandatory age assurance.

🔗 https://lnkd.in/eb2cHuyR

2/ Florida vs. ChatGPT Floridas AG asked a court to temporarily halt ChatGPT development, citing COPPA violations and weak guardrails for minors.

→ AGs now treat GenAI like social platforms. AI age gating and safety evals need the same rigor as feeds.

🔗 https://lnkd.in/e9NPz8ag

3/ Copilot data labeling 404 Media reports that Prolific contractors review Microsoft Copilot prompts and images for quality tuning. Many are sexual, and some involve minors.

→ Data labeling is moderation work. It needs the same wellbeing support and escalation paths.

🔗 https://lnkd.in/e_5n5E4W

4/ TikTok and Alabama TikTok settled for at least $100M. It agreed to a 2-hour daily limit for minors, overnight restrictions and stronger parental controls.

→ Settlements are now writing product requirements. Expect other states to ask for the same terms.

🔗 https://lnkd.in/eKZKXSxu

5/ Meta in New Mexico A jury found Meta violated state consumer law more than 43M times with deceptive privacy claims. The penalty hearing is on Oct 1.

→ Your public safety claims are litigation evidence. What comms says has to match what enforcement actually does.

🔗 https://lnkd.in/enTemq7Z

The common thread: the question used to be Do you have a policy? Now its Can you prove it works? Which of these hits your roadmap first?

#TrustAndSafety #ContentModeration #OnlineSafety #ChildSafety #AISafety #AgeAssurance

Related

  1. Every public safety claim is something someone can test

    State attorneys general are testing whether what platforms told parents about safety matches what happened, as in Florida's new consumer protection suit against Discord. Give one person the list of public safety claims, attach the evidence behind each, be exact about age checks, and recheck the list whenever the product changes.

    1 min read · Essay · What's changing

  2. What I'm reading: an open policy model, Xbox's adult checks, Discord in Brazil and KOSA

    An open-weights model that scores a message against your written policy in milliseconds (Musubi's PolicyLM-1.7B, which the Workbench's classifier eval can now run), Xbox marking some long-time accounts as adults from their account activity, a Brazilian interim order for Discord to add age verification and parental supervision, and KOSA now needing a recorded Senate vote.

    1 min read · Reading roundup · What's changing

  3. Since 2024, the job is proving it works

    Since 2024 the question has moved from whether you have a policy to whether you can show it works: UK risk assessments that must be redone before significant changes, age assurance as the foundation, 48-hour removal of intimate images under the US TAKE IT DOWN Act, and free open-source tooling. Those duties land on different teams, so the leadership team should name one owner for the whole picture.

    2 min read · Essay · What's changing