No Priors: Artificial Intelligence | Machine Learning | Technology | Startups

Ginkgo Bioworks is using DNA as code to digitize the cell programming revolution. Ginkgo is using AI and synthetic biology to keep the next pandemic at bay, and accelerate our production capabilities for medicine, food, and agriculture. Ginkgo’s co-founder and CEO Jason Kelly joins hosts Sarah Guo and Elad Gil to discuss bioengineering protein as a foundational model, specialized data learning from an evolutionary perspective, what we need to prepare for a future pandemic, and more. Jason has served as a member of our board of directors since Ginkgo’s founding in 2008. He has also served as a director of CM Life Sciences II Inc. (Nasdaq: CMII), a special purpose acquisition company with a focus on the life sciences sector, since its initial public offering in February 2021. Jason holds a Ph.D. in Biological Engineering and a B.S. in Chemical Engineering and Biology from the Massachusetts Institute of Technology. Show Links:  Jason Kelly - Co-founder & CEO of Ginkgo Bioworks | LinkedIn   Ginkgo Bioworks The Plausibility of Life: Resolving Darwin's Dilemma Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @jrkelly Show Notes:  (0:00:00) - The Difference Between Software Engineering and Biological Engineering (0:06:51) - Abstractions and Infrastructure in Synthetic Bio (0:09:23) - The Role of AI, Foundation Models that Speak Biology (0:13:17) - AWS for Cell Engineering (0:17:52) - Where are the AI-discovered Drugs? And Data at Gingko (0:19:12) - Pandemic Response and Biosecurity in the Age of AI (0:22:47) - The Likelihood of Existential AI Risk from Lone Actors Harnessing Viruses, and The Need for Defense-in-Depth (0:31:47) - Will Progress in AI Be Biologically Inspired? And Evolution

Replit’s develop-to-deploy platform and new AI tool, Ghostwriter, are breaking down the barriers to entry for beginner programmers. Replit’s CEO, co-founder, and head engineer Amjad Masad joins hosts Sarah Guo and Elad Gil to discuss how AI can change software engineering, the infrastructure we still need, open source foundation models, and what to expect from AI agents. Before co-founding Replit, Amjad Masad worked at Facebook as a software engineer, where he worked on infrastructure tooling. He was a founding engineer at CodeAcademy. Throughout his career, Masad has been an advocate for open-source software. Show Links:  Amjad Masad - CEO & Co-founder of Replit | LinkedIn   Replit Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @amasad Show Links:  Amjad Masad - CEO & Co-founder of Replit | LinkedIn   Replit Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @amasad Show Notes:  0:03:55 - Impact of AI on Code Generation  0:11:09 - Breaking Down Barriers to Entry in Development with Replit 0:14:35 - The Impact of Open Source Models, Meta/Llama 0:20:32 - Bounties, Agents who Make Money 0:24:26 - The Missing Data Spec-to-Code 0:32:29 - Building the Future of AI, Money as a Programmable Primitive

More than 25 million users are using NEAR-powered applications. Co-founder of NEAR protocol and Transformers author Illia Polosukhin joins hosts Sarah Guo and Elad Gil to discuss the intersections of crypto and AI technology, what we should expect from AI agents, decentralized data labeling, why AI’s alignment problem is really a human problem, and more.  Show Links:  Illia Polosukhin - Co-founder of NEAR | LinkedIn   NEAR Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @ilblackdragon Show Notes:  (0:00:00) - Blockchain, AI, and Web3 Intersection (0:06:39) - How We Might Combine Blockchain and AI for Cancer Research (0:23:35) - Inference and Decentralized Data Labeling (0:30:13) - AI SaaS Strategic Challenges (0:38:18) - The Future of Hardware Accelerators

The GPU supply crunch is causing desperation amongst AI teams large and small. Cerebras Systems has an answer, and it’s a chip the size of a dinner plate. Andrew Feldman, CEO and Co-founder of Cerebras and previously SeaMicro, joins Sarah Guo and Elad Gil this week on No Priors. They discuss why there might be an alternative to Nvidia, localized models and predictions for the accelerator market. Show Links:  Andrew Feldman - Cerebras CEO & Co-founder | LinkedIn   Cerebras Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @andrewdfeldman Show Notes:  (0:00:00) - Cerebra Systems CEO Discusses AI Supercomputers (0:07:03) - AI Advancement in Architecture and Training (0:16:58) - Future of AI Accelerators and Chip Specialization (0:26:38) - Scaling Open Source Models and Fine-Tuning

Everything digital is increasingly intermediated through web user experiences, and now AI development can be frontend-first, too. Just ask Guillermo Rauch, the founder and CEO of Vercel, the company behind Next.js. In this episode of No Priors, hosts Sarah Guo and Elad Gil speak to Guillermo about their AI SDK and AI templates, and why Vercel is focused on making it easy for every frontend engineer to build with AI. They also discuss what applications Guillermo's most excited about, how to prepare for the world of bots, whether the winds are changing in web architectures, and why he believes in the AI-fueled 100X engineer. Prior to Vercel, Guillermo co-founded several startups and created the JavaScript library, Socket.io, which allows for real-time bi-directional communication between web clients and servers. Show Links: Guillermo Rauch - CEO & Founder of Vercel | LinkedIn  Vercel Vercel AI Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @rauchg Show Notes:  (0:00:00) - Vercel's AI Strategy and Future Plans (0:10:36) - AI Frameworks, Observability, and Bot Mitigation (0:17:24) - Crawling the Web and Architecture Changes (0:27:54) - AI's Impact on Web Personalization

"Biological Software" is the future of medicine. Jakob Uszkoreit, CEO and Co-founder of Inceptive, joins Sarah Guo and Elad Gil this week on No Priors, to discuss how deep learning is expanding the horizons of RNA and mRNA therapeutics. Jakob co-authored the revolutionary paper Attention is All You Need while at Google, and led early Google Translate and Google Assistant teams. Now at Inceptive, he's applying these same architectures and ideas to biological design, optimizing vaccine production, and magnitude-more efficient drug discovery. We also discuss Jakob's perspective on promising research directions, and his point of view that model architectures will actually get simpler from here, and be driven by hardware. Show Links:  Inceptive - CEO & Founder - Jakob Uszkoreit | LinkedIn   Inceptive Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @kyosu Show Notes:  (0:00:00) - Creating Biological Software (0:06:54) - The Hardware Drivers of Large-Scale Transformers (0:14:32) - Challenges in Optimizing Compute Allocation (0:23:25) - Deep Learning in Biology and RNA (0:32:49) - The Future of Drug Discovery (0:41:41) - Collaboration and Innovation at Inceptive

The future of education is right at your children’s fingertips. Sal Khan, CEO and Founder of Khan Academy, joins Sarah Guo and Elad Gil this week on No Priors. For over a decade, Sal Khan has been trying to reform education, beginning with tutoring his cousins in math.  He's the father of the YouTube "chalk talk" format, and has now served tens of millions of students through Khan Academy.  He guides us through how Khan Academy is using AI to personalize a student's educational experience, transporting students into immersive learning experiences that allow them to debate historical figures, to assisting teachers with lesson plans that address the learning gaps keeping students from reaching their full potential, to a Khanmigo, a tutor for every child.  Prior to founding Khan Academy, Sal worked as a hedge fund analyst. He holds an MS in business from Harvard University, as well as an MS in Engineering and a BS in Computer Science from MIT. Show Links:  Khan Academy - CEO & Founder - Khan Academy | LinkedIn   Khan Academy Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @salkhanacademy Show Notes:  [0:00:06] - Sal Khan's Journey [0:08:41] - Mastery Learning and AI in Education [0:19:53] - Future of AI Tutors in Education [0:23:10] - Education's Future With Generative AI [0:29:35] - Connecting Learning Through Tutoring and Collaboration [0:33:22] - Implications of GPT 4 on Education [0:40:42] - Future of Education and Job Skills [0:46:47] - Importance of Traditional Skills in Education

This week on the podcast, Sarah Guo and Elad Gil answer listener questions on the state of technology and artificial intelligence. Sarah and Elad also talk about the 2024 tech market, what type of companies may reach their highest valuation ever and the (former) unicorns that may go bust. Plus, how do Sarah and Elad define happiness? Hint: it’s a use case for a specialized AI agent.  Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil  Show Links: Cerebras Systems signs $100 million AI supercomputer deal with UAE's G42 | Reuters  Our World in Data  Show Notes:  [0:00:37] - Impact of GPU Bottleneck in the near and long term [0:10:30] - Timeline for existing incumbent enterprises to use AI in products  [0:11:50] - Vertical versus broad applications for AI Agents   [0:19:33] - 2024 tech market predictions & how founders should think about valuations

How are ML developer tools helping to advance our capabilities? Lukas Biewald, CEO of Weights & Biases, joins Sarah Guo and Elad Gil this week on No Priors. Lukas explores the impact of ML in various industries like gaming, AgTech, and fintech through his insightful perspective. He discusses the impact of LLMs, puts them in context of the evolution of ML engineering over the past decade and a half, and tells the backstory of Weights & Biases' success. He gives advice for aspiring AI company founders, placing emphasis on customer feedback and using insecurity as a vehicle for better customer discovery. Prior to founding Weights & Biases, Lukas attacked the problem of data collection for model training as the Founder of Figure Eight, which he sold in 2019. He holds an MS in Computer Science and a BS in Mathematics from Stanford University. Show Links:  Lukas Biewald - CEO & Co-founder - Weights & Biases | LinkedIn   Weights & Biases Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @l2k Show Notes:  [0:00:00] - Lucas Wald's Journey in AI [0:08:16] - Startup Evolution and Machine Learning [0:18:54] - Open Source Models Implications and Adoption [0:29:54] - ML Impact in Various Industries [0:40:27] - Advice for AI Company Founders

Can frontiers as high-stakes as next-generation, AI-enabled defense depend on something as mundane as data integration? Can "large language models" work in such mission critical applications? In this episode of No Priors, hosts Sarah Guo and Elad Gil are joined by Shyam Sankar, the Chief Technical Officer of Palantir Technologies and inventor of their famous Forward Deployed Engineering force. Early employee and longtime leader Shyam explains the evolution of technology at Palantir, from ontology and data integration to process visualization and now AI. He describes how a company of Palantir's scale has adopted foundation models and shares customer stories. They discuss the case for open source AI models fine-tuned on private, domain-specific data, and the challenges of anchoring AI models in reality. Show Links: Shyam Sankar - Chief Technical Officer - Palantir Technologies | LinkedIn   Palantir Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @ssankar Show Notes:  [0:00:00] - Palantir's CTO Discusses Company's Background [0:10:17] - Apollo and AIP [0:20:25] - Future of UI and Application Integration [0:28:29] - Investment in Co-Pilot Models and Education [0:31:22] - Exploring AI Implementation in Various Industries [0:38:19] - Operational and Analytical Workflows in Context

Video dominates modern media consumption, but video creation is still expensive and difficult. AI-generated and edited video is a holy grail of democratized creative expression. This week on No Priors, Sarah Guo and Elad Gil sit down with Devi Parikh. She is a Research Director in Generative AI at Meta and an Associate Professor in the School of Interactive Computing at Georgia Tech. Her work focuses on multimodality and AI for images, audio and video. Recently, she worked on Make a Video 3D, also called MAV3D, which creates animations from text prompts. She is also a talented AI-generated and analog artist herself. Elad, Sarah and Devi talk about what’s exciting in computer vision, what’s blocking researchers from fully immersive Generative 4-D, and AI controllability. No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Show Links: Devi Parikh - Google Scholar  Text-To-4D Dynamic Scene Generation named MAV3D (Make-A-Video3D) Full Research Paper Website with examples of image to 4 D generation Devi’s Substack Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @DeviParikh Show Notes: (0:00:06) - Democratizing Creative Expression With AI-Generated Video (0:08:31) - Challenges in Video Generation Research (0:15:57) - Challenges and Implications of Video Processing (0:20:43) - Control and Multi-Modal Inputs in Video (0:25:50) - Audio's Role in Visual Content (0:39:00) - Don't Self-Select & Devi’s tips for young researchers

Frank Slootman, CEO of Snowflake Computing, joins Sarah Guo and Elad Gil this week on No Priors. Before scaling Snowflake to its blockbuster IPO and beyond, Frank was also the CEO from early to scale for landmark enterprise companies ServiceNow and Data Domain. Frank grew up in the Netherlands and is also the author of three books: Amp It Up, Rise of the Data Cloud, and Tape Sucks. In this episode, our hosts talk with Frank about the opportunity for generative AI in the enterprise, why Snowflake isn't really a data warehousing company, their acquisitions of Neeva and Streamlit, apps within Snowflake, and how AI relates to traditional analytics and BI. He also talks about his personal journey, why it's always a good time to do performance management, and why most leaders struggle to raise the bar for performance. ** No Priors is taking a summer break! The podcast will be back with new episodes in three weeks. Join us on July 20th for a conversation with Devi Parikh, Research Director in Generative AI at Meta. ** No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Show Links: Forbes: How CEO-For-Hire Frank Slootman Turned Snowflake Into Software’s Biggest-Ever IPO Amp It Up: Leading for Hypergrowth by Raising Expectations, Increasing Urgency, and Elevating Intensity Rise of the Data Cloud (Audible Audio Edition): Frank Slootman, Steve Hamm, Zach Hoffman, Snowflake: Books TAPE SUCKS: Inside Data Domain, A Silicon Valley Growth Story eBook : Slootman, Frank: Kindle Store Frank Slootman’s LinkedIn Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @SnowflakeDB Show Notes: [00:06] - Frank’s Insights on Career Success as a three-time CEO [12:42] - The message of his book Amp It Up [25:01] - Future of Natural Language and Data [36:29] - Data Management and Industry Transformation Future [45:13] - Managing Resources in Changing Economic Environment [50:09] - Amping Up Energy and Intensity Amid Economic Headwinds

Fidji Simo, the CEO of Instacart and co-founder of Metrodora Institute, a medical center and research institute for neuroimmune axis disorders, shares her personal journey from growing up in France, to leading the Facebook app, to becoming a wartime CEO. Fidji talks about the future of Instacart, their AI strategy, how the current era of AI is different from prior ML waves, and the impact of LLMs in commerce, robotics and healthcare. She also shares how she earns followership from her teams. ** No Priors is taking a summer break! The podcast will be back with new episodes in three weeks. Join us on July 20th for a conversation with Devi Parikh, Research Director in Generative AI at Meta. ** No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Show Links: May 31, 2023: Instacart users can now plan meals using AI - Fast Company Profile May 13, 2023: Instacart CEO Fidji Simo makes groceries personal. Now she’s doing the same for women’s health December 2, 2021: Rapid Response: Re-founding Instacart, w/ first-time CEO Fidji Simo | Podcast: Masters of Scale with Reid Hoffman Metrodora Institute Fidji Simo’s LinkedIn Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @Fidjissimo Show Notes: [00:01] - Leading With Impact and Authenticity [11:48] - Implementing AI [17:28] - Future of Grocery Shopping With AI [25:38] - AI in Advertising and Commerce [32:54] - Metrodora: AI in Biotech and Healthcare [34:18] - The positive impact of AI, mitigating harm & role of regulations

Olivier Pomel, co-founder and CEO of Datadog, the leading observability company, discusses the company’s founding story, early product sequencing, platform strategy, and acquisitions. Olivier also shares his thoughts on their more recent expansion into security, and why he’s bullish on the potential for AI in DevOps. ** No Priors is taking a summer break! The podcast will be back with new episodes in three weeks. Join us on July 20th for a conversation with Devi Parikh, Research Director in Generative AI at Meta. ** No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Show Links: Nov 22, 2022: Product-led Growth: Founder 1-on-1 with Datadog and Aiven - Olivier Pomel & Oskari Saarenmaa May 25, 2022: Datadog, Inc. (DDOG) CEO Olivier Pomel Presents at J.P. Morgan's 50th Annual Global Technology, Media and Communications Conference Jan 6, 2021: Datadog CEO Olivier Pomel on the cloud computing outlook Datadog’s Official Website Olivier Pomel LinkedIn Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @Oliveur Show Notes: [00:10] - DevOps and AI Potential [06:54] - Datadog and Generative AI [20:40] - Datadog's Acquisition and Expansion Strategy [31:46] - LLMs in Automation and Precision [42:35] - Datadog's Customer Value and Growth

This week on No Priors, Sarah and Elad do another hangout to answer listener questions. Topics include debunking common misconceptions about AI and its implications on the world, the analogy to nuclear power and nuclear safety, the impact of larger context windows, developer productivity, incumbent announcements of AI products, and some requests for (fat) startups. No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @SchimpfBrian Show Notes: [00:21] - What Are People Getting Wrong About AI Right Now? / New Capabilities of NLP [04:35] - Nuclear Power and Safety Concerns [11:12] - Emerging AI Companies and Research [15:54] - China's Hardware Sanctions and Funding Ramp [20:34] - Innovation in Heterogeneous Compute Infrastructure [28:08] - Enterprise Stack and Decision Making [33:44] - Data's Impact on the World

Today on No Priors, we discuss defense technology, AI, drones, and autonomous vehicles (think giant submarine drones!) with Brian Schimpf, the co-founder and CEO of Anduril, a next-generation defense technology company. From his early days of coding at age 12 to working on self-driving cars, and finally founding Anduril, Brian's incredible journey led him to create innovative solutions for pressing defense problems. This episode covers the impact of AI, intelligent software, and other technologies to defense. We discuss the challenges of deploying and selling technology in the government spaceBrian shared his perspective on building general-purpose defense technology, the importance of a software-first approach, and how Anduril is working to solve urgent defense problems with speed and efficiency. As we wrapped up our conversation, we touched on the recent shift in the low cost of space launch, which has changed the way the US thinks about defense. We examined the proliferation of satellites, drones, and hypersonic missiles, and how these technologies can be applied, scaled, and built in a way that can fundamentally shift America's approach to defense. Don't miss this fascinating episode with Brian Schimpf as we uncover the cutting edge of defense technology and its implications for the future. No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Show Links: May 16, 2023: AI in Military Operations and How We Can Prevent It From Outsized Effects May 9, 2023: CNBC Disruptor 50 - Anduril Industries Anduril Website Anduril Newsroom Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @SchimpfBrian Show Notes: [0:00:01] - Exploring AI in Defense Tech [0:05:15] - Lower Cost Defense With Intelligent Software [0:15:10] - Building General Purpose Defense Technology [0:20:41] - Autonomy in Defense Challenges [0:25:05] - Machine Learning in Defense & Intelligence [0:29:06] - Scaling a Defense Tech Company [0:37:08] - The Future of Defense Technology [0:46:53] - Allied Forces and Washington Engagement [0:51:47] - Discussion on Leadership Popularity

In this episode, Sarah and Elad speak with Microsoft CTO Kevin Scott about his unlikely journey from rural Virginia to becoming the driving force behind Microsoft's AI strategy.  Sarah and Elad discuss the partnership that Kevin helped forge between Microsoft and OpenAI and explore the vision both companies have for the future of AI. They also discuss yesterday’s announcement of “copilots” across the Microsoft product suite, Microsoft’s GPU computing budget, the potential impact of open source AI models in the tech industry, the future of AI in relation to jobs, why Kevin is bullish on creative and physical work, and predictions for progress in AI this year. No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Show Links: May 23, 2023: The Verge - Microsoft CTO Kevin Scott Thinks Sydney Might Make a Comeback May 23, 2023: Microsoft Outlines Framework For Building AI Apps and Copilots January 10, 2023: A Conversation with Kevin Scott: What’s Next In AI Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @kevin_scott Show Notes: [00:00] - Kevin Scott's Journey to Microsoft CTO [12:44] - Microsoft and Open AI Partnership [21:18] - The Future of Open Source AI [32:12] - AI for Everyone [45:29] - AI and the Future of Jobs [51:44] - The Future of AI and Regulation [58:10] - Taking a Global Perspective

What if AI could revolutionize healthcare with advanced language learning models? Sarah and Elad welcome Karan Singhal, Staff Software Engineer at Google Research, who specializes in medical AI and the development of MedPaLM2. On this episode, Karan emphasizes the importance of safety in medical AI applications and how language models like MedPaLM2 have the potential to augment scientific workflows and transform the standard of care. Other topics include the best workflows for AI integration, the potential impact of AI on drug discoveries, how AI can serve as a physician's assistant, and how privacy-preserving machine learning and federated learning can protect patient data, while pushing the boundaries of medical innovation. No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Show Links: May 10, 2023: PaLM 2 Announcement April 13, 2023: A Responsible Path to Generative AI in Healthcare March 31, 2023: Scientific American article on Med-PaLM February 28, 2023: The Economist article on Med-PaLM KaranSinghal.com Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @thekaransinghal Show Notes: [00:22] - Google's Medical AI Development [08:57] - Medical Language Model and MedPaLM 2 Improvements [18:18] - Safety, cost/benefit decisions, drug discovery, health information, AI applications, and AI as a physician's assistant. [24:51] - Privacy Concerns - HIPAA's implications, privacy-preserving machine learning, and advances in GPT-4 and MedPOM2. [37:43] - Large Language Models in Healthcare and short/long term use.

Mustafa Suleyman, co-founder of DeepMind and now co-founder and CEO of Inflection AI, joins Sarah and Elad to discuss how his interests in counseling, conflict resolution, and intelligence led him to start an AI lab that pioneered deep reinforcement learning, lead applied AI and policy efforts at Google, and more recently found Inflection and launch Pi. Mustafa offers insights on the changing structure of the web, the pressure Google faces in the age of AI personalization, predictions for model architectures, how to measure emotional intelligence in AIs, and the thinking behind Pi: the AI companion that knows you, is aligned to your interests, and provides companionship. Sarah and Elad also discuss Mustafa’s upcoming book, The Coming Wave (release September 12, 2023), which examines the political ramifications of AI and digital biology revolutions. No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Show Links: Forbes - Startup From Reid Hoffman and Mustafa Suleyman Debuts ChatBot Inflection.ai Mustafa-Suleyman.ai Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @mustafasuleymn Show Notes: [00:06] - From Conflict Resolution to AI Pioneering [10:36] - Defining Intelligence [15:32] - DeepMind's Journey and Breakthroughs [24:45] - The Future of Personal AI Companionship [33:22] - AI and the Future of Personalized Content [41:49] - The Launch of Pi [51:12] - Mustafa’s New Book The Coming Wave

How do you personalize AI models? A popular school of thought in AI is to just dump all the data you need into pre-training or fine tuning. But that may be less efficient and less controllable than alternatives — using AI models as a reasoning engine against external data sources. Kelvin Guu, Senior Staff Research Scientist at Google, joins Sarah and Elad this week to talk about retrieval, memory, training data attribution and model orchestration. At Google, he led some of the first efforts to leverage pre-trained LMs and neural retrievers, with >30 launches across multiple products. He has done some of the earliest work on retrieval-augmented language models (REALM) and training LLMs to follow instructions (FLAN). No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode. Show Links: Kelvin Guu Website Google Scholar FLAN: Finetuned Language Models Are Zero-Shot Learners Simfluence: Modeling the Influence of Individual Training Examples by Simulating Training Runs ROME: Locating and Editing Factual Associations in GPT Branch-Train-Merge: Scaling Expert Language Models with Unsupervised Domain Discovery Large Language Models Struggle to Learn Long-Tail Knowledge  Sign up for new podcasts every week. Email feedback to show@no-priors.com Follow us on Twitter: @NoPriorsPod | @Saranormous | @EladGil | @Kelvin_Guu Show Notes: [1:44] - Kelvin’s background in math, statistics and natural language processing at Stanford [3:24] - The questions driving the REALM Paper [7:08] - Frameworks around retrieval augmentation & expert models [10:16] - Why is modularity important [11:36] - FLAN Paper and instruction following [13:28] - Updating model weights in real time and other continuous learning methods [15:08] - Simfluence Paper & explainability with large language models [18:11] - ROME paper, “Model Surgery” exciting research areas [19:51] - Personal opinions and thoughts on AI agents & research [24:59] - How the human brain compares to AGI regarding memory and emotions [28:08] - How models become more contextually available [30:45] - Accessibility of models [33:47] - Advice to future researchers