Red Teaming news

A new type of AI security threat is emerging as attackers move beyond simple jailbreaks. They are now exploiting the pre-defined 'personalities' of chatbots, manipulating their intended character traits to bypass safety controls and generate harmful content. This marks a significant evolution in LLM vulnerabilities.

After a year of testing, Microsoft's AI Red Team updated its framework for AI agent threats, adding seven new failure modes. This new taxonomy helps developers and security teams better understand and defend against emerging AI vulnerabilities.