Updated
Updated · InfoWorld · May 21
Microsoft Open-Sources 2 AI Safety Tools for Agent Development as Risks Shift Beyond Chatbots
Updated
Updated · InfoWorld · May 21

Microsoft Open-Sources 2 AI Safety Tools for Agent Development as Risks Shift Beyond Chatbots

9 articles · Updated · InfoWorld · May 21
  • Microsoft released Rampart and Clarity as open-source tools designed to push AI agent safety checks earlier and make them continuous across development.
  • Rampart turns red-team findings into repeatable automated tests inside CI/CD pipelines, targeting agent-specific threats such as prompt injection, unsafe tool use, privilege escalation and unintended autonomous actions.
  • Clarity works before coding begins, guiding engineers through structured reviews of agent behavior, permissions, tool access and trust boundaries, then saving those decisions as markdown files in repositories.
  • The launch extends Microsoft’s broader open-source agent governance push after last month’s Agent Governance Toolkit, reflecting concern that agents with real operational privileges outstrip traditional application security workflows.
By open-sourcing its AI safety tools, is Microsoft unintentionally arming adversaries with the knowledge to bypass them more effectively?
Beyond technical exploits, how do these tools address the systemic risks of biased decision-making in autonomous AI agents?
Can 'shift-left' safety checks truly protect AI from real-time threats like prompt injection hidden in live web data?

Microsoft Launches Open-Source AI Agent Safety Suite—Rampart, Clarity, and AGT—Ahead of EU AI Act and Colorado AI Act Deadlines

Overview

In May 2026, Microsoft open-sourced Rampart and Clarity to address the growing risks of autonomous AI agents, which now have significant operational privileges and interact with sensitive systems. As these risks escalate, robust safety measures have become essential, especially with new regulations like the EU AI Act and Colorado AI Act coming into effect. This shift has transformed AI safety from occasional checks into a continuous engineering discipline. Rampart and Clarity, along with the previously released Agent Governance Toolkit, form a comprehensive, open-source stack designed to secure and govern AI agents throughout their lifecycle.

...