Discover"The Cognitive Revolution" | AI Builders, Researchers, and Live Player AnalysisE55: Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu
E55: Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu

E55: Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu

Update: 2023-08-23


In this episode, Nathan sits down with Vivek Natarajan and Tao Tu of Google’s Med-PaLM, diving into how they used one of the world’s largest medical datasets ever compiled to develop Med-PaLM M, an AI agent specialized in medical tasks. In this episode, they discuss: Med-PaLM M's “clinically superhuman” abilities and limitations, the rigorous testing and validation that went into the model, and their vision for AI to take over repetitive clerical tasks and allow doctors to focus on patients.


The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.


(00:00 ) Episode Preview

(00:00:56 ) Introducing Vivek Natarajan and Tao Tu

(00:04:18 ) The story of Google’s Medical AI research progress

(00:07:11 ) Multi-modal Med-PaLM

(00:10:32 ) Genomic data - how do you represent it?

(00:11:13 ) Google’s Deep Variant

(00:14:44 ) The successes and failures behind the incredible pace of progress

(00:15:02 ) Sponsors: Netsuite | Omneky

(00:21:54 ) Google’s research culture and assembling an interdisciplinary team

(00:31:36 ) Google’s Pathways

(00:33:40 ) Med-PaLM M's architecture

(00:37:28 ) Working with 3 different model sizes and what you learn

(00:46:56 ) Data and compute required for Med-PaLM M

(00:49:38 ) Med-PaLM M's cycle time

(00:54:56 ) Is a bridge or adapter structure worth implementing?

(01:00:09 ) Can we create an AI doctor?

(01:02:39 ) Emergent capabilities like identifying tuberculosis

(01:09:37 ) Reactions to these emergent capabilities

(01:11:13 ) Moving towards clinical trials and real-world testing

(01:13:01 ) Regulatory and safety considerations

(01:15:03 ) AI safety in the healthcare domain

(01:17:00 ) Potential to transform healthcare access worldwide



Med-PaLM M paper:

Our earlier conversation with Vivek Natarajan on Med-PaLM:


@vivnat (Vivek)

@taotu831 (Tao)

@labenz (Nathan)



SPONSORS: NetSuite | Omneky

NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: and download your own customized KPI checklist.

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.

In Channel
Download from Google Play
Download from App Store








Sleep Timer


End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

E55: Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu

E55: Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu

Erik Torenberg, Nathan Labenz