Writing · Child safety and age assurance

Voice chat is where safety in games is furthest behind

Voice chat is where safety in games is furthest behind, and I think it's the thing the industry most needs to get right next. A lot of the worst behavior in games happens there: slurs in a match, an adult inappropriately talking to a minor in a party.

Text chat got filters and logs years ago. In a lot of games voice still only gets looked at when a player reports it, and by then the audio is gone. The report goes nowhere, the player learns that, and they stop reporting.

The tools to do better exist now. In June, Aiba brought Amanda, its grooming and toxicity detection, to voice chat through 4Players' ODIN platform. It transcribes the speech, reads the conversation as a whole for grooming, bullying and radicalization patterns, and sends flagged cases to a human moderator for the final call. Modulate's ToxMod, Musubi and GetStream all do proactive live/near live voice moderation as well.

If a game puts kids and adults in voice together, it owes kids the same protection there that it gives them in text. Grooming in games tends to follow a path: a friend request, gifts, private chat, voice, then another app.

Games cant keep treating voice as too hard. The tools exist, and the law is catching up, with the UKs Online Safety Act already counting oral communications as user content. If a game has voice and kids play it, ignoring voice is irresponsible, and its a liability the company is choosing to carry. Voice belongs near the top of the safety roadmap if games are willing to expose their users to it as a feature.

#TrustAndSafety #ChildSafety #GamingSafety #ContentModeration

Related

  1. Grooming is a pattern, not a message

    Responses build as signals stack on adult-to-minor contact, with thresholds tested on past cases, a queue worked by risk, privacy limits agreed up front, and four numbers that show it works.

    2 min read · Essay · Child safety and age assurance

  2. Why early grooming detection matters

    Tools that help platforms spot grooming early protect kids and the communities around them.

    1 min read · Share · Child safety and age assurance

  3. Games are where kids socialize now, and regulators know it

    Grooming builds over weeks and usually moves off-platform. Protections that work act earlier and limit who can reach a child. Measure prevented contact, not just removals.

    1 min read · Essay · Child safety and age assurance