The fight against abusive, intrusive and racist behavior in online games has been a big issue for years. However, notable successes against toxic players remain manageable, for example Blizzard recorded a positive trend through the use of AI in Overwatch.
The AI tool takes a similar approach ToxMod. This program doesn’t filter swear words from text chats, but rather analyzes the voice chat in games live. If a player violates guidelines previously set by moderators, for example by using racist terms, ToxMod should be able to sanction the corresponding section live.
The AI should not only be able to automatically generate sanctionable words overlay with a beep. That alone would be revolutionary, as developers have so far been largely powerless here. With the AI one could better protect players from toxic behavior.
In addition, the AI should also use wavelengths to recognize which intention is hidden behind spoken tones. Say, if someone becomes intrusive, aggressive, or offensive without the use of offensive words, the AI should do so recognize by the pitch of the voice can.
Even (accidentally) too loud players should downregulate ToxMod or Completely mute wanton screamers can. In addition, at the request of the moderators, the AI automatically pronounces penalties or warns players of first-time violations.
Potential dangers
How well this works in practice will have to show as soon as games actually use the technology in live operation. There is a potential risk here that the AI falsely censors harmless communication. However, she should get through Machine learning constantly improve.
Fine tuning and automation should be entirely in the hands of the moderators. The software can do something like this a bit more forgiving in multiplayer shooters so that the obligatory “trash talk” with joking insults can be continued if desired.
A higher-level analysis tool
The video from ToxMod developer Modulate explains in detail how this works:
Link to YouTube content
The inventors of the software first specialized in “voice skins” before developing the ToxMod software. The result is already amazing here:
Link to YouTube content
The Modulate company is behind ToxMod. Like the colleagues from PCGamesN found out in an interview, the founders Mike Pappas and Carter Hoffman met at the renowned US technical university Massachusetts Institute of Technology (MIT).
The AI tool is already available. Developers interested in integrating ToxMod into their games can contact the Website Further information and contact us by email.