EP217 Red Teaming AI: Uncovering Surprises, Facing New Threats, and the Same Old Mistakes?
Update: 2025-03-31
Description
Guest:
- Alex Polyakov, CEO at Adversa AI
Topics:
- Adversa AI is known for its focus on AI red teaming and adversarial attacks. Can you share a particularly memorable red teaming exercise that exposed a surprising vulnerability in an AI system? What was the key takeaway for your team and the client?
- Beyond traditional adversarial attacks, what emerging threats in the AI security landscape are you most concerned about right now?
- What trips most clients, classic security mistakes in AI systems or AI-specific mistakes?
- Are there truly new mistakes in AI systems or are they old mistakes in new clothing?
- I know it is not your job to fix it, but much of this is unfixable, right?
- Is it a good idea to use AI to secure AI?
Resources:
- EP84 How to Secure Artificial Intelligence (AI): Threats, Approaches, Lessons So Far
- AI Red Teaming Reasoning LLM US vs China: Jailbreak Deepseek, Qwen, O1, O3, Claude, Kimi
- Adversa AI blog
- Oops! 5 serious gen AI security mistakes to avoid
- Generative AI Fast Followership: Avoid These First Adopter Security Missteps
Comments
In Channel