This 20-min episode comes from our friend Nathaniel Whittemore's excellent daily podcast The AI Breakdown Podcast. This episode aired on June 1, 2023, and covers the latest developments from OpenAI, including new features, a cybersecurity grant program, and their new process rewards model for trading. We hope you enjoy it as much as we do. Subscribe to The AI Breakdown podcast: https://pod.link/1680633614 Subscribe to The AI Breakdown on YouTube: https://www.youtube.com/@TheAIBreakdown

In this episode, Nathan sits down with Joshua Browder of DoNotPay, the world’s first robot lawyer. They chat about the current state of AI use in law, what policymakers should consider in regulating AI, and the ethics of robo-lawyers for consumer use.  The Cognitive Revolution is a part of the Turpentine podcast network. Learn more: Turpentine.co RECOMMENDED PODCAST: Media Empires from Turpentine: https://link.chtbl.com/mediaempires A new podcast where Erik Torenberg interviews influential media creators, podcasters, newsletter writers, and media entrepreneurs to learn exactly how they built their empires. Check out the first episode with Austin Rief, CEO of Morning Brew. TIMESTAMPS: (00:00) Episode Preview (03:46) Joshua Browder and the story of DoNotPay (04:50) The value incurred through an AI lawyer (07:17) What are the legal and financial injustices that motivates Joshua’s work? (12:46) How does the AI negotiate with a Comcast chat agent? The future for DoNotPay (16:28) Consumer security (21:08) The ethics of DoNotPay (22:27) Should AI need to disclose that it’s AI? (24:47) How much human intervention is necessary in AI tooling? (27:15) Where does the burden of proof lie for AI regulation and ethics? (31:47) Advice to policymakers (35:45) AI Liability (38:05) AI Arms Race (43:55) Productive bot interactions  (45:18) AI-powered arbitration  (49:28) How the consumer experience might change two years from now (51:45) AI Superapps (56:06) Moats in AI (57:11) How much money does DoNotPay save people today? (01:00:58) Consumer and enterprise timelines given AI (01:06:53) What will AI replace?  (01:09:34) Impact of AI in different industries (01:12:35) The legal field’s view of AI (01:19:38) Deflationary factors in running DoNotPay (01:30:08) What are non-obvious ways to save money? (01:33:51) Joshua’s favorite AI tools  (01:34:52) Would Joshua get a Neuralink implant?  (01:35:57) AI hopes and fears LINKS: https://donotpay.com/ TWITTER: @jbrowder1 (Joshua) @DoNotPay (DoNotPay) @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) SPONSOR: Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NEWSLETTER: More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan Labenz sits down with Ronen Eldan and Yuanzhi Li of Microsoft Research to discuss the small natural language dataset they created called TinyStories. Tiny Stories is designed to reflect the full richness of natural language while still being small to support research with modest compute budgets.  Using this dataset, they began to explore aspects of language model performance, behavior, and mechanism by training a series of models that range in size from just 1 million to a maximum of 33 million parameters – which is still just 2% the scale of GPT-2. In this conversation, Nathan, Ronen, and Yuanzhi touch on LM reasoning, emergence, interpretability, and what understanding can be extended to LLMs. LINKS: Tiny Stories paper: https://huggingface.co/papers/2305.07759 TIMESTAMPS: (00:00) Episode Preview (07:12) The inspiration for the Tiny Stories project (15:07) Sponsor: Omneky (15:44) Creating the Tiny Stories dataset (21:27) GPT-4 vs GPT-3.5 (24:13) Did the TinyStories team try any other versions of GPT-4 (29:23) Curriculum models and weirder curriculums (35:34) What does reasoning mean? (46:27) What does emergence mean? (01:01:44) The curriculum development space (01:11:40) The similarities between models and human development (01:20:12) Fewer layers vs. more layers (01:29:22) Attention heads (01:33:40) Semantic attention head (01:36:54) Neuron technique used in developing the TinyStories model (01:52:20) Interpretability work that inspires Ronen and Yuanzhi TWITTER: @CogRev_Podcast @EldanRonen (Ronen) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan and Erik analyze the moats of the most powerful companies in AI. The paradigm-shifting technology has led to a flourishing open-source community with market share. Yet, the big players have key competitive advantages that can be examined from many different angles. LINKS: Nathan’s Twitter thread on AI moats that sparked this discussion: https://twitter.com/labenz/status/1654853321876815872 Read about the 9 moats at length in our newsletter: https://cognitiverevolution.substack.com/p/the-leaked-google-memo-and-a Leaderboard for AI rankings: https://lmsys.org/ PODCAST RECOMMENDATION: The AI Breakdown: https://pod.link/1680633614 As anyone in AI knows, the pace of progress of new releases is relentless. The AI Breakdown is a daily podcast (10-20min long) that helps us ensure we don't miss anything important by curating news and analysis. TIMESTAMPS: (00:00) Episode Preview (01:36) Where are the moats in AI? (07:31) Open source vs. closed (15:24) Recommendation: The AI Breakdown Podcast (16:39) Sponsor: Omneky (20:46) AI Safety (33:00) Which players are going to win? 9 Moats. TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Today’s episode is a deep dive into the collision of AI and the future of entertainment, against the backdrop of the still-raging Writers Guild of America (WGA) strike. Nathan Labenz sits down with Trey Kollmer, Sophia Lear, and Garrett Schabb – all seasoned television writers and Guild members – to discuss the labor dispute. While the strike encompasses many dynamics, the timely intersection with a rapidly changing AI landscape has the writers entwined in the wild possibilities and existential threats of paradigm-shifting technology. Other entertainment guilds and labor unions are watching closely. Note: Nathan kicks off this episode with a longer-than-usual introduction and analysis as the subject matter of this episode requires some added context. If you would prefer to dive straight into the interviews, follow the timecodes below to skip ahead (and maybe give the intro a listen when you finish!) More about our guests Trey Kollmer, Sophia Lear, and Garrett Schabb and their work: Trey Kollmer, currently co-executive producer for the TV show Ghosts, was described to me as perhaps the single most knowledgeable guild member on the topic of AI. Follow him at @treyko on Twitter. Sophia Lear has been a writer for TV shows including Ghosts, The Unicorn, and New Girl, and was also previously an assistant literary editor for the New Republic. Garrett Schabb has written for shows including Tosh.0 and Suits (of Meghan Markle fame), and has also written for Crooked Media.  Follow him at @garrettschabb PODCAST RECOMMENDATION: The AI Breakdown: https://pod.link/1680633614 As anyone in AI knows, the pace of progress of new releases is relentless. The AI Breakdown is a daily podcast (10-20min long) that helps us ensure we don't miss anything important by curating news and analysis. TIMESTAMPS: (00:00) Preview (01:54) Introduction and analysis for this episode  (09:02) Trey Kollmer breaks down the dynamics of compensation, ownership and crediting for WGA writers, issues at the heart of the strike (14:52) Sponsor: Omneky (15:09) Recommendation: The AI Breakdown (17:16) What are the attitudes and implementation of AI in the writer’s room? (22:42) Usefulness of AI for script writing (and will better training out of jailbreaks make it less useful?)  (30:59) The main two AI-related demands of the labor dispute (34:44) Is there any way to police or standardize use? (42:48) Writers’ diverse reactions to AI, from hostility to experimentation (50:00) Picturing a long term Utopian future (57:46) Sophia Lear breaks down sentiments around GPT-4, AI-generated scripts and the previous eras of crappy sitcoms and bad streaming series (written by humans) (1:08:19) Dissecting quality  (1:11:27) Whose jobs are safe? (1:17:03) Garrett Schabb breaks down dystopian/realistic view of studio’s incentives (1:20:33) How Garrett uses ChatGPT (1:27:37) Ethical boundaries of using the model to write like your favorite writers (1;32:16) The two types of storytelling in the future, UBI and decoupling writing from a profession TWITTER: @CogRev_Podcast @treyko (Trey) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan Labenz sits down with Andrew Feldman, CEO and Co-Founder of Cerebras Systems, a company building a new class of computer system for accelerating AI and changing the future of work. Cerebras Systems is the creator of the world’s largest chip, at 2.6 trillion transistors. In this episode, they discuss the founding story of Cerebras, the experience of creating the world’s largest chip, and the process that goes into chip design and manufacturing for an AI-focused chip.  This episode is the first part of our hardware exploration series focused on the people building at the forefront of hardware applications in AI. LINKS: Cerebras: https://www.cerebras.net/ Book: The Chip War by Chris Miller PODCAST RECOMMENDATION: The AI Breakdown: https://pod.link/1680633614 As anyone in AI knows, the pace of progress of new releases is relentless. The AI Breakdown is a daily podcast (10-20min long) that helps us ensure we don't miss anything important by curating news and analysis. TIMESTAMPS (00:00) Preview (04:27) Andrew’s story of creating the world’s largest chip and Cerebras (07:19) What is a chip? (08:14) The diversity of chips and what they can accomplish (09:47) What is it like to design a 2.5 trillion transistor chip? (12:41) The founding story of Cerebras and building the team (14:20) Sponsor: Omneky (23:00) What was the hardest part about building the company? (26:11) What happens after designing the chip’s blueprint? (27:29) The tradeoffs needed in chipmaking  (34:08) The comparison between chips and neural networks (38:31) The generalization vs specialization of a chip  (40:11) Sparse compute vs dense compute (43:55) Ghost in the machine (46:54) Supply chain challenges of the Cerebras chip (54:59) The future for chips (58:19) Building chip clusters (58:57) The Cerebras business model (01:00:41) Building a chip cluster vs using a Cerebras chip (01:02:57) Giant chips on the edge (01:05:32) What is the edge?  (01:08:04) Andrew’s favorite AI products (01:10:08) Would Andrew get a Neuralink implant? (01:14:16) Consciousness and chips (01:17:50) AI hopes and fears TWITTER: @CogRev_Podcast @andrewdfeldman (Andrew) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan Labenz sits down with engineer Shreya Rajpal, the creator of Guardrails AI, a new Python library that allows developers to add a layer of output, validation and correction to their code. Practically guardrails can ensure a reliable interface between language models and more traditional deterministic software systems. At the same time, mind-bending and potentially risky use case frameworks like Guardrails allow developers to ask and answer entirely new kinds of questions. Talking to Shreya really reinforced just how early we are in LLM’s impact on the software industry. We were introduced to Shreya’s work when recording our interview with Matt Welsh, the CEO of Fixie.AI (Ep 19: How AI Agents Will Change How We Work). LINKS: Guardrails AI: https://shreyar.github.io/guardrails/ RECOMMENDED PODCASTS: Upstream: https://link.chtbl.com/Upstream TIMESTAMPS: (00:00) Episode preview (05:00) Why Shreya built Guardrails AI (08:33) Common ways LMs can “go off the rails” and how Guardrails can correct it (13:45) Discussion of validators (15:31) Sponsor: Omneky (18:48) Business and creative use cases of Guardrails AI (25:00) What can be achieved by Guardrails AI that cannot be achieved by traditional code (32:44) How agents work vs how Guardrails works (35:34) AI as shepherd vs delegating to AI and the role of human understanding (39:54) Trust deficit and risks (46:33) Is it realistic to imagine GPT-4 using Guardrails? (52:00) How Shreya thinks about security (57:02) How Shreya thinks about embeddings (1:05:05) How Shreya thinks about problemsolving with LMs (1:07:50) Shreya on OpenAI’s Evals Library, Anthropic’s Constitutional AI (1:12:55) Discussion of determinism (1:15:00) Recommendations for developers to minimize overhead (1:26:00) Predictions about providers in the space of LMs (1:29:30) Shreya’s favorite AI tools (1:30:00) Would Shreya get a neuralink implant (1:31:50) Biggest hopes and fears for AI TWITTER: @CogRev_Podcast @ShreyaR (Shreya) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan sits down with Vivek Natarajan, research scientist at Google Health. Vivek leads the Google Brain moonshot behind Med-PaLM, Google’s flagship medical large language model, featured in The Economist, The Scientific American, CNBC, and Forbes. In this episode, they discuss the foundational models that Vivek and team built before Med-PaLM, the techniques used to develop Med-PaLM which will be of interest to anyone developing AI systems for high-stakes use cases, and the capabilities for Med-PaLM to equalize access to medical knowledge and care. This episode is part of a series centered on talking to the people at the cutting edge of building AI-driven solutions in medicine. PODCAST RECOMMENDATION: Upstream: https://link.chtbl.com/Upstream LINKS: https://sites.research.google/med-palm/ FEEDBACK / COLLABORATE WITH NATHAN: Email: TCR@turpentine.co TIMESTAMPS: (00:00) Episode preview (03:43) The story of how Med-PaLM came to be (09:41) Building Med-PaLM’s infrastructure (13:10) The US medical licensing exam as a measure of AI progress (15:23) Sponsor: Omneky (18:17) Practicality of benchmarking in real-world usage (21:39) Overcoming the shortfalls of Flan-PaLM with Med-PaLM (25:08) Choosing to use soft prompting over few shot prompting (30:36) The process of training Flan-PaLM (37:31) A curriculum approach to soft-prompting (38:43) Layperson vs expert interactions with LLMs (43:54) How did the Google team facilitate user exploration of the model’s capabilities? (46:58) Shift in techniques from Med-PaLM to Med-PaLM2 (50:21) Using different prompting strategies with Med-PaLM2 (57:33) Is Med-PaLM 2 preferred over clinicians? (01:02:28) Will there be a multimodal version of Med-PaLM? (01:04:52) Breakthroughs required for AI to further advance human potential (01:10:23) The Med-PaLM business plan (01:12:08) Is there a vision for a consumer product? (01:15:46) The pros and cons of pre-training a model (01:19:45) Vivek’s favorite AI products (01:21:01) Would Vivek get a Neuralink implant? (01:23:08) AI hopes and fears TWITTER: @CogRev_Podcast @vivnat (Vivek) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: MusicLM More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

[Bonus Episode] Future of Life Institute Podcast host Gus Docker interviews Conjecture CEO Connor Leahy to discuss GPT-4, magic, cognitive emulation, demand for human-like AI, and aligning superintelligence. You can read more about Connor's work at https://conjecture.dev Future of Life Institute is the organization that recently published an open letter calling for a six-month pause on training new AI systems. FLI was founded by Jann Tallinn who we interviewed in Episode 16 of The Cognitive Revolution. We think their podcast is excellent. They frequently interview critical thinkers in AI like Neel Nanda, Ajeya Cotra, and Connor Leahy - an episode we found particularly fascinating and is airing for our audience today. The FLI Podcast also recently interviewed Nathan Labenz for a 2-part episode: https://futureoflife.org/podcast/nathan-labenz-on-how-ai-will-transform-the-economy/ SUBSCRIBE: Future of Life Institute Podcast: Apple: https://podcasts.apple.com/us/podcast/future-of-life-institute-podcast/id1170991978 Spotify: https://open.spotify.com/show/2Op1WO3gwVwCrYHg4eoGyP TIMESTAMPS: (00:00) Episode introduction (01:55) GPT-4  (18:30) "Magic" in machine learning  (29:43) Cognitive emulations  (40:00) Machine learning VS explainability  (49:50) Human data = human AI?  (1:01:50) Analogies for cognitive emulations  (1:28:10) Demand for human-like AI  (1:33:50) Aligning superintelligence  If you'd like to listen to Part 2 of this interview with Connor Leahy, you can head here:  https://podcasts.apple.com/us/podcast/connor-leahy-on-the-state-of-ai-and-alignment-research/id1170991978?i=1000609972001

Nathan and Erik sit down with Neal Khosla, founder of Curai Health, a venture-backed virtual care startup using AI to provide low-cost primary healthcare. Prior to his current role at Curai, Neal was a machine learning researcher at Google and Stanford. In this episode, they discuss the current state of AI in medicine, what the future patient experience may look like, and how developments in AI healthcare may interact with different regulatory and social forces across the globe.  FEEDBACK  We'd love to hear your feedback or answer any listener questions live on an upcoming episode. DM @labenz on Twitter or email us at Info@turpentine.co with "TCR" in the subject line. We'd appreciate it immensely if you left us a review on Apple Podcasts or a rating on Spotify! TIMESTAMPS (00:00) Preview (04:32) The future of AI in medicine (12:50) Patient experience in AI-driven medicine and the current state of AI in medicine (15:04) Sponsor: Omneky (20:34) Building the LLM architecture for medicine (25:25) Current state of the art for AI in medicine (28:54) Evaluating LLM performance in medicine (31:49) Benchmarking LLMs in medicine (39:17) Using the Socratic method in training LLMs (43:57) Multimodal systems and deploying multiple models in medicine  (51:30) The future of LLM creation and usage (59:47) The interaction of AI medicine with social and regulatory forces (01:11:00) AI adoption in countries with centralized healthcare systems (01:13:37) How should we regulate the usage of AI in medicine? (01:16:57) AI-first systems in medicine (01:18:19) Is there an obligation to deploy AI in medicine in its current state? (01:20:48) Neal’s favorite AI products (01:22:21) Would Neal get a Neuralink implant? (01:24:54) AI hopes and fears TWITTER: @CogRev_Podcast @nealkhosla (Neal) @labenz (Nathan) RECOMMENDED PODCASTS: Upstream: https://link.chtbl.com/Upstream SPONSOR: Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com

Nathan sits down with Professor Zak Kohane, the Chair of the Department of Biomedical Informatics at Harvard Medical School, and co-author of the new book, The AI Revolution in Medicine, for which Sam Altman, OpenAI’s CEO wrote the foreword to the book. Professor Kohane was among a select few people to receive early preview and research access to GPT-4 in the fall of 2022, and his approach to exploring and characterizing how AI is about to transform medicine.  The book is out May 13, 2023 and can be ordered here (or on Amazon by searching for "The AI Revolution in Medicine") Regardless of the field you're in, Dr. Kohane's combination of deep immersion, enthusiastic exploration, pragmatic optimism, risk awareness, realism, and forward-thinking vision make this a worthy example for others to study and emulate. PODCAST RECOMMENDATION: Youtube: @UpstreamwithErikTorenberg  Audio: https://link.chtbl.com/Upstream TIMESTAMPS: (00:00) Episode preview (05:29) Dr. Isaac Kohane’s story (15:00) Sponsor: Omneky (16:29) Advice to others thinking of applying AI to their own disciplines (20:33) The tension of using AI in medicine (25:04) The Trial Paradigm of AI  (31:15) Is it possible to use GPT as a healthcare provider in population studies? (34:14) The Trainee Paradigm of AI (36:09) The Partner Paradigm of AI and how doctors should use AI (40:33) AI provided interaction and how that can improve patient care (42:26) The Torchbearer Paradigm of AI (42:59) Can GPT independently conduct medical research? (46:58) The future for impactful use cases of AI in medicine (51:04) Integrating AlphaFold into language models (54:10) AI-alignment and patient data in medicine TWITTER: @CogRev_Podcast @labenz (Nathan) @zakkohane (Isaac) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: cognitiverevolution.substack.com

Nathan Labenz sits down with prominent – and notably prescient – AI media figures Robert Scoble and Ben Tossell. They discuss what the work of being an AI scout looks like, how to bring the mainstream along with emerging AI developments, and their predictions and hopes for AI. Robert Scoble is a long-time Silicon Valley technology explorer and connector, a futurist who's met so many technology legends in their primes that he's now also something of a historian. https://scobleizer.blog/ Ben Tossell is the creator of Ben's Bites, an AI round up newsletter meant to be read in 5 minutes or less, read by over 90,000 subscribers. https://www.bensbites.co/ This episode caps off our series centered on talking to rising voices in AI media: people who are now only working overtime to understand everything going on in AI, but also creating thought leadership and educational content meant to help others get up to speed as well. BOOK RECOMMENDATION: The Scout Mindset from author Julia Galef PODCAST RECOMMENDATION: Upstream with Erik Torenberg: https://link.chtbl.com/Upstream TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) @Scobleizer (Robert) @bentossell (Ben Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More original content from Nathan is published in our Substack: https://cognitiverevolution.substack.com/

Nathan Labenz sits down with Rachel Woods, founder of The AI Exchange, an AI education platform with over 130,000 subscribers on TikTok. They discuss Rachel’s experience consulting for public and private companies on AI strategy, how teams should think about their AI strategy, and how Rachel uses AI in her own business. Rachel was previously a data scientist at Meta, and a founder of a venture-backed e-commerce startup, where she began to use chatGPT in her startup operations. This episode is the second in a series centered on talking to rising voices in AI media: people who are now only working overtime to understand everything going on in AI, but also creating thought leadership and educational content meant to help others get up to speed as well. TIMESTAMPS: (00:00) Episode preview (02:59) Rachel Woods’ story (04:30) State of the public who comes across videos (9:49): How do you frame AI to business owners and how should they use it? (15:29) Sponsor: Omneky (18:58) How should teams set up their AI strategy for success? (26:41) The leap from GPT 3.5 to GPT-4 (30:42) Step changes of AI and public perception of capabilities (35:17) Common misconceptions people have about AI (36:22) How Rachel uses AI in her business (44:09) What’s your style of prompt engineering for content creation? (46:01) How AI will change the way we use a computer in the next year? (49:34) Bing launch and how companies launch AI products (54:15) AI safety and restraint (1:00:11) Alpaca and LLaMA (1:04:16) Rachel’s favorite products in AI (1:05:24) Would Rachel get a Neuralink implant? (1:07:55) AI hopes and fears RECOMMENDED PODCAST: Upstream: https://link.chtbl.com/Upstream TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) @rachel_l_woods (Rachel) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

Nathan Labenz and Erik Torenberg sit down with Sarah Guo and Elad Gil, notable investors and co-hosts of the AI-focused No Priors podcast. They discuss how Sarah and Elad are approaching AI investment opportunities right now, how that differs from how they've thought about investing in the past, where in the stack from hardware to applications they expect to see value accrue, what modes of human-AI interaction they are most interested in, and more. Sarah is the founder of $100M AI-focused venture fund Conviction VC, which she launched last fall. She was previously General Partner at Greylock. Elad is a serial entrepreneur and a startup investor. He has invested in over 40 companies now worth $1B or more each, and is also author of the High Growth Handbook. This episode is the first in a series centered on talking to rising voices in AI media, people who are now only working overtime to understand everything going on in AI, but also creating thought leadership and educational content meant to help others get up to speed as well. We highly recommend Erik Torenberg’s interview show "Upstream". Guests include Ezra Klein, Balaji Srinivasan, David Sacks, and Marc Andreessen. Subscribe here: Spotify: https://open.spotify.com/show/7wHYcVRmMP6rWQL9lVQJlL Apple: https://podcasts.apple.com/us/podcast/upstream-with-erik-torenberg/id1678893467 LINKS: No Priors Podcast on Spotify: https://open.spotify.com/show/0O65xhqvGVhpgdIrrdlEYk No Priors on Apple Podcast: https://podcasts.apple.com/us/podcast/no-priors-artificial-intelligence-machine-learning/id1668002688 Elad Gil's blog: https://blog.eladgil.com/ Sarah Guo's blog: https://sarahguo.com/blog TIMESTAMPS: (00:00) Episode preview (04:43) What is software 3.0 (09:14) Disruption coming from startups or incumbents? (13:42) Sarah and Elad identify overlooked investment opportunities in AI (15:19) Sponsor: Omneky (15:46) Future of social media (22:45) AI agents & personal co-pilots (25:32) Where to invest in AI? (31:11) How our kids will interact with AI (34:50) How to gain conviction as an investor in AI (45:07) When should founders raise money and when should they bootstrap? (46:28) How should startups spend their capital now that we have AI capabilities? (48:10) Sarah & Elad’s favorite products in AI (51:39) Would Sarah & Elad get a neuralink implant? (53:41) AI hopes and fears TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) @sarahnormous (Sarah) @eladgil (Elad) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

Raza Habib is on the front lines of LLM implementation as CEO of Humanloop, a Y Combinator backed startup that helps companies of all kinds, small and large bridge the gap from API access to successful LLM deployment. Nathan sat down with Raza to hear what he has learned in the process of helping so many companies on their LLM implementation journeys – and he did not disappoint – as you'll hear, he shared a bunch of concrete examples of customer use cases, practical challenges that people face, and the strategies they use to overcome them. Also, check out the Hackaprompt 2023 competition. There are $40,000 worth of cash and AI credit prizes available.  The competition begins on May 5 and will run for 3 weeks, after which we'll have the organizer Sander Schulhoff, who is also the creator of LearnPrompting.org, on the show to talk about the results. Head to this link to sign up: https://www.aicrowd.com/challenges/hackaprompt-2023 Also, we recommend Erik Torenberg’s interview show "Upstream". Guests include Ezra Klein, Balaji Srinivasan, David Sacks, and Marc Andreessen. Subscribe here: [Apple Podcasts] bit.ly/3z8TldL [Spotify] bit.ly/40letd0 TIMESTAMPS: (00:00) Preview of episode (07:00) Humanloop’s mission and surprising customer base (12:10) Why a language model is so advantageous (15:00) Customization and understanding model performance (18:14) Sponsor: Omneky (18:35) Users graduating from playground experimentation to develop robust implementations  (23:25) Raza’s two mental models for using AI (27:50) How customers are actually integrating API (31:50) Challenge of evaluation and feedback (43:33) Prediction: more fine tuning in the immediate future (47:00) RLHF myth-busting (57:12) Robust agents need feedback loops (1:02:27) AI productization challenges (01:07:32) Adopt or die moment for incumbents (01:11:19) Fast iteration cycles (1:15:45) Rapid fire questions for The Cognitive Revolution guests TWITTER: @CogRev_Podcast @RazRazcle (Raza) @labenz (Nathan) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

Nathan Labenz sits down with Matt Welsh, the CEO and co-founder of Fixie.AI which just raised $17M in seed funding. The technology world's attention has turned en masse to AI agents over the last month, but Matt, a former Harvard professor and ex-Google, has been focused on AI agents for longer over at Fixie. The platform is currently in developer preview mode, where developers can build agents and end users can try them. Agents hold the promise of handling not only the core cognitive work, but many of the messy implementation details as well – the searching & finding, sorting through & scanning, signing in & navigating, reading documentation & using APIs – all the manual ad hoc routing of information for which we act today as human plumbing. TIMESTAMPS: (00:00) Preview of the episode (02:08) Why AI Agents are so topical right now, and Matt's prescience with Fixie (06:40) How Matt started Fixie (10:55) How AI Agents "figure out the plumbing" (15:57) How Matt envisions work changing in the near term + concrete examples (22:40) Building your own agent (26:00) New threat model and guardrails of this new paradigm (34:48) Synthetic memories in autonomous agents (42:39) Examples of incredible use cases (48:00) Single sign on idea (51:00) Form factor for AI-assisted living (54:32) Matt's hopes and fears for AI TWITTER: @CogRev_Podcast @mdwelsh (Matt) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. https://www.omneky.com/ More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com Also, check out the debut of co-host Erik's new long-form interview podcast Upstream, whose guests include David Sacks. Ezra Klein, Balaji Srinivasan, and Marc Andreessen. Subscribe: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 Music Credit: OpenAI's Jukebox

Nathan dives in with Alex Albert, a 22-year-old computer science student at the University of Washington, who has become a prolific creator of Jailbreakchat.com and author over at The Prompt Report.com. This is Alex's first podcast appearance! Please enjoy this thought-provoking conversation with Alex Albert as part of 'Prompt Engineering Week' at The Cognitive Revolution. Thank you to everyone for listening, and shout out to those who commented to let us know how you discovered the show – it was interesting to see the responses across platforms. We'd appreciate you leaving us a review in the Apple Podcasts Store: https://podcasts.apple.com/us/podcast/id1669813431 TIMESTAMPS: (0:00) Preview of Alex on this episode (6:00) How Alex lent structure to his jailbreaking activities early on (8:00) AI is fun and interesting and it's being overshadowed by hype and confusion (12:15) Does Alex see cases of jailbreaking for utility? (16:13) Sponsor: Omneky (25:59) GPT-4 is best for jailbreaking (33:20) Role-play jailbreaks can work (43:59) How to think about exploring black box technology (45:19) Training models to override bad behavior (54:55) Content filters are a band-aid (1:07:14) AI safety (1:13:02) AI models require scrutiny. (1:19:39) Optimism - humans will figure it out TWITTER: @CogRev_Podcast @alexalbert__ (Alex) @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. https://www.omneky.com/ More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com Also, check out the debut of co-host Erik's new long-form interview podcast Upstream, whose guests include David Sacks. Ezra Klein, Balaji Srinivasan, and Marc Andreessen. Subscribe: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 Music Credit: OpenAI's Jukebox

For anyone who discovered this show on Twitter, Riley (@goodside) likely needs no introduction – after all, he spent most of 2022 posting his explorations of OpenAI's text-davinci-002, and quickly became one of the must-follow accounts in AI. Riley Goodside is the world's first Staff Prompt Engineer at Scale AI, and is an expert in prompting large language models and integrating them into AI-powered applications. Few have spent as much time on the language model frontier, so I hope you enjoy this unique conversation with Riley Goodside. Also, check out the debut of Erik Torenberg's new long-form interview podcast "Upstream". Guests include Ezra Klein, Balaji Srinivasan, David Sacks, and Marc Andreessen. Subscribe here: (Apple Podcasts) bit.ly/3z8TldL (Spotify) bit.ly/40letd0 TIMESTAMPS: (0:00) Preview of the episode (05:13) Riley's unique background (11:24) Riley's original narrow moat (15:07) Sponsors: Omneky (17:02) LLMs can take on ncreasingly complex instructions (27:41) Language models can do math (30:05) Models can learn from context (37:29) Fine-tune models for tasks (38:47) Automate instruction following (44:34) Large language models are alien text prediction (52:27) Avoid mode collapse by framing (59:05) Composing AI capabilities like Lego bricks (1:00:37) Language models solve tasks (1:05:37) GPT-3 solves real-world tasks (1:15:03) GPT-4's amazing capabilities (1:17:03) Multimodal abilities unlock possibilities (1:25:03) Compare models for best task fit (1:26:24) Compare models using trial and error (1:36:15) AI and the future of work (1:42:29) GPT-4 can provide second opinions (1:45:06) AI safety discussion (1:50:20) AI permeates society cautiously (1:55:26) The AI revolution underway TWITTER: @CogRev_Podcast @Goodside (Riley) @scale_AI (Scale) @labenz (Nathan) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/

Nathan Labenz dives in with Jaan Tallinn, a technologist, entrepreneur (Kazaa, Skype), and investor (DeepMind and more) whose unique life journey has intersected with some of the most important social and technological events of our collective lifetime. Jaan has since invested in nearly 180 startups, including dozens of AI application layer companies and some half dozen startup labs that focus on fundamental AI research, all in an effort to support the teams that he believes most likely to lead us to AI safety, and to have a seat at the table at organizations that he worries might take on too much risk. He's also founded several philanthropic nonprofits, including the Future of Life Institute, which recently published the open letter calling for a six-month pause on training new AI systems. In this discussion, we focused on: - the current state of AI development and safety -Jan's expectations for possible economic transformation - what catastrophic failure modes worry him most in the near term - How big of a bullet we dodged with the training of GPT-4 - Which organizations really matter for immediate-term pause purposes - How AI race dynamics are likely to evolve over the next couple of years Also, check out the debut of co-host Erik's new long-form interview podcast Upstream, whose guests in the first three episodes were Ezra Klein, Balaji Srinivasan, and Marc Andreessen. This coming season will feature interviews with David Sacks, Katherine Boyle, and more. Subscribe here: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 LINKS REFERENCED IN THE EPISODE: Future of Life's open letter: https://futureoflife.org/open-letter/pause-giant-ai-experiments/ Eliezer Yudkowsky's TIME article: https://time.com/6266923/ai-eliezer-yudkowsky-open-letter-not-enough/ Podcast: Daniela and Dario Amodei on Anthropic- https://podcasts.apple.com/ie/podcast/daniela-and-dario-amodei-on-anthropic/id1170991978?i=1000552976406 Zvi on the pause: https://thezvi.substack.com/p/on-the-fli-ai-risk-open-letter TIMESTAMPS: (0:00) Episode Preview (1:30) Jaan's impressive entrepreneurial career and his role in the recent AI Open Letter (3:26) AI safety and Future of Life Institute (6:55) Jaan's first meeting with Eliezer Yudkowsky and the founding of the Future of Life Institute (13:00) Future of AI evolution (15:55) Sponsor: Omneky (17:20) Jaan's investments in AI companies (24:22) The emerging danger paradigm (28:10) Economic transformation with AI (33:48) AI supervising itself (35:23) Language models and validation (40:06) Evolution, useful heuristics, and lack of insight into selection process (43:13) Current estimate for life-ending catastrophe (46:09) Inverse scaling law (54:20) Our luck given the softness of language models (56:24) Future of Language Models (1:01:00) The Moore’s law of mad science (1:03:02) GPT-5 type project (1:09:00) The AI race dynamics (1:11:00) AI alignment with the latest models (1:14:31) AI research investment and safety (1:21:00) What a six month pause buys us (1:27:01) AI’s Turing Test Passing (1:29:33) AI safety and risk (1:33:18) Responsible AI development. (1:41:20) Neuralink implant technology

Nathan Labenz and Erik Torenberg delve into the upcoming economic transformation and the future of work in light of the threshold crossed by GPT-4. Also, check out the debut of Erik's new long-form interview podcast "Upstream" with Erik Torenberg whose guests in the first three episodes were Ezra Klein, Balaji Srinivasan, and Marc Andreessen. This coming season will feature interviews with David Sacks, Katherine Boyle, and more. Subscribe here: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 LINKS REFERENCED IN THE EPISODE: Microsoft research paper: https://arxiv.org/abs/2303.12712 TIMESTAMPS: (0:00) Preview (1:56) Unpacking "There will be economic transformation," Nathan’s reflection after red teaming GPT-4 (4:55) A cross-section of prompts Nathan ran through GPT-4 (17:00) Sponsor: Omneky (18:00) Future of business and a new style of Taylorism of knowledge work (28:00) The “shrinking category of work” and a new definition of work (36:00) A future of “Muggles” and the 1000x developer (51:15) Are we facing a bifurcated economy and regulations from special interest groups? (58:30) Upcoming morale shift of white-collar workers and predictions TWITTER: @CogRev_Podcast @labenz (Nathan) @eriktorenberg (Erik) Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com/