Roblox Launches Age-Based Accounts Requiring ID or AI Scans for Child Safety

Q: What specific threat prompted the first-ever U.S. government order for a leading AI company to pull its models offline?

The order was prompted by a reported jailbreak of Anthropic’s Fable 5/Mythos 5 systems that officials believed could expose dangerous cyberattack capabilities. According to the combined reporting, the Commerce Department acted after a security finding showed the models could be prompted past safeguards to inspect code and identify exploitable software flaws. That raised fears that the systems’ unusually strong offensive cyber abilities could be misused to discover zero-day vulnerabilities, chain exploits together, and help automate sophisticated attacks with minimal human input. The national security concern was not just abstract model power, but the possibility that this jailbreak could make those capabilities operational for malicious users, including foreign actors. Some reports also say officials were alarmed by indications that a China-linked group may have accessed Mythos, increasing concern that the model could be reverse-engineered or its capabilities replicated. In short, the immediate trigger was the alleged jailbreak pathway; the underlying threat was that these frontier models could materially lower the barrier to launching advanced cyberattacks against critical systems.

3 articles · Updated · NBC News · Jun 16

Roblox rolled out age-based accounts that require users to verify their age with a government ID or AI-powered face scan before receiving chat and gameplay permissions tied to their age group.
The feature is aimed at addressing child safety concerns on the gaming platform, where critics say young users remain vulnerable to online predators.
Roblox recently reached multimillion-dollar settlements with 3 states over child safety, while several other states are investigating the company or pursuing pending lawsuits.
At Roblox’s San Mateo headquarters, NBC got an early look at the system, including tests by children, as company officials faced questions over whether the new controls will satisfy critics and users.