Anja Manuel on AI, China, and national security
Digest
This podcast discusses the intensifying US-China AI race and its global implications. Anya Manuel, an expert with a unique background in diplomacy, highlights China's surprising advancements, particularly with the DeepSeek AI model. The conversation emphasizes the critical need for the US to maintain technological leadership in dual-use technologies like semiconductors, AI, 5G/6G, biotechnology, and fintech, not just focusing on foundation models. Maintaining this leadership is crucial for controlling technological values and preventing the misuse of AI in areas like cyber warfare, bioterrorism, and autonomous weapons. Strategies for achieving this include increased R&D investment, streamlining government processes, and fostering international cooperation, particularly through Track 2 dialogues with China to build trust and address shared concerns about AI safety. The podcast underscores the importance of addressing the risks associated with AI in national security and the need for proactive mitigation strategies, including focused safety testing of large language models.
Outlines

The US-China AI Race: Global Implications and Technological Leadership
The podcast introduces the US-China AI competition, its impact on global security, political divisions, and economic stability, highlighting growing international concerns about potential future conflicts. Anya Manuel's background and perspective on global dynamics are introduced, emphasizing the role of technology in global power.

China's AI Advancements and US Strategies
Anya Manuel discusses China's progress in AI, specifically mentioning the DeepSeek model. The discussion shifts to US strategies for maintaining technological leadership across various dual-use technologies, stressing the importance of controlling technological values and prioritizing national security.

Maintaining US Technological Leadership and its Importance
The importance of US technological leadership is explored, focusing on value control and the potential for both beneficial and harmful uses of technology. The need to prioritize technologies impacting national security is highlighted. Strategies for winning the tech race, including export controls, R&D investment, and improved government processes, are discussed.

AI in National Security: Risks and Mitigation
The integration of AI in national security is examined, including its use in the Department of Defense and procurement challenges. The risks of AI in cyber warfare, bioterrorism, and autonomous weapons are discussed, along with strategies for mitigation, such as safety testing and international cooperation.

International Cooperation and Addressing AI Risks
Strategies for mitigating AI risks are discussed, including focused safety testing and the importance of international cooperation, especially with China. The role of Track 2 dialogues in building trust and fostering cooperation is emphasized, acknowledging the current strained relationship.
Keywords
DeepSeek Model
A Chinese AI model showcasing rapid advancements in AI capabilities.
Dual-Use Technology
Technologies with both civilian and military applications, crucial for national security.
AI Governance
Rules and regulations guiding responsible AI development and use, requiring international cooperation.
Autonomous Weapons
Weapons systems operating without human intervention, raising ethical and security concerns.
Track 2 Diplomacy
Unofficial dialogues fostering cooperation on complex issues like AI safety.
US-China AI Race
The competition between the US and China for AI dominance.
National Security
The protection of a nation's interests from threats, including those posed by AI.
AI Safety
Ensuring the responsible and safe development and use of AI.
Q&A
What are the biggest risks associated with AI in national security?
AI-enabled cyberattacks, AI facilitating chemical/biological weapons, and the escalatory potential of autonomous weapons.
How can the US maintain technological leadership?
Increased R&D investment, streamlined government processes, and fostering collaboration.
What role does international cooperation play in addressing AI challenges?
Crucial for establishing safety standards, preventing misuse, and promoting responsible AI development. Track 2 dialogues are vital.
What steps should the US administration take regarding AI and national security?
Prioritize innovation, invest in infrastructure, mitigate cybersecurity risks, and build international alliances.
Show Notes
What role can AI play in international diplomacy and national security?
In this episode, Reid and Aria sit down with Anja Manuel, a former diplomat, author, and one of the leading voices in AI and foreign policy. She has the unique ability to bridge the gaps between technology, policy and diplomacy. They discuss international AI governance, China, potential threats of bio-terrorism, and the strategic decisions that the US and its allies must make to navigate this complex landscape of innovation with regulation.
For more info on the podcast and transcripts of all the episodes, visit https://www.possible.fm/podcast/
For the referenced Possible episode featuring Kim Stanley Robinson: https://link.chtbl.com/8YMsBlzg
Topics:
1:21 - Episode introduction
3:44 - Hellos and intros
4:38 - Where the U.S. and China rank in the Great AI Race
6:09 - Deepseek explainer
7:27 - Which technologies the U.S. should prioritize
9:05 - Why it’s important for the U.S. to stay in the lead
10:41 - How to maintain that lead
16:27 - Current examples of AI in national security work
18:30 - Impediments to further integrating AI
20:13 - How to connect national security to cutting edge technology
24:35 - The potential risks to incorporating AI
28:50 - Midroll ad
28:55 - How to stay safe against the risks
32:05 - The helpfulness of AI Safety Institutes
33:25 - International treaties for AI
36:11 - The current U.S.-China relationship
38:50 - How to return to a more positive relationship
41:28 - The economic race
43:25 - Anja’s advice for the new administration
45:01 - Key players and swing states
50:24 - How to make a cyber treaty work
52:57 - Rapid-fire questions
Possible is an award-winning podcast that sketches out the brightest version of the future—and what it will take to get there. Most of all, it asks: what if, in the future, everything breaks humanity's way? Tune in for grounded and speculative takes on how technology—and, in particular, AI—is inspiring change and transforming the future. Hosted by Reid Hoffman and Aria Finger, each episode features an interview with an ambitious builder or deep thinker on a topic, from art to geopolitics and from healthcare to education. These conversations also showcase another kind of guest: AI. Whether it's Inflection’s Pi, OpenAI’s ChatGPT or other AI tools, each episode will use AI to enhance and advance our discussion about what humanity could possibly get right if we leverage technology—and our collective effort—effectively.

















