713: Llama 2, Toolformer and BLOOM: Open-Source LLMs with Meta's Dr. Thomas Scialom
Update: 2023-09-12
Description
Artificial General Intelligence, RLHF’s application in AI, and how entrepreneurs can enter the AI industry: Meta’s AI Research Scientist Thomas Scialom gives us behind-the-scenes insights into developing Llama 2 and what’s in the works for Llama 3. With host Jon Krohn, he discusses the future of Artificial General Intelligence, why the Galactica science-focused LLM was taken down, and what he learned from it.
This episode is brought to you by AWS Inferentia (https://go.aws/3zWS0au), by Grafbase (https://grafbase.com), the unified data layer, and by Modelbit (https://modelbit.com), for deploying models in seconds. Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.
In this episode you will learn:
• Llama 2: Behind the Scenes of Today’s Top Open-Source LLM [05:04 ]
• Responsible use of Llama 2 [15:26 ]
• Toolformer: LLM That Learns How to Use External Tools [24:57 ]
• Galactica: The Science-Specific LLM and Why It Was Brought Down [36:57 ]
• Is AGI Around the Corner? [57:03 ]
• Advice for AI entrepreneurs [1:05:46 ]
• How Thomas develops and manages large-scale AI projects [1:14:42 ]
Additional materials: www.superdatascience.com/713
This episode is brought to you by AWS Inferentia (https://go.aws/3zWS0au), by Grafbase (https://grafbase.com), the unified data layer, and by Modelbit (https://modelbit.com), for deploying models in seconds. Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.
In this episode you will learn:
• Llama 2: Behind the Scenes of Today’s Top Open-Source LLM [05:04 ]
• Responsible use of Llama 2 [15:26 ]
• Toolformer: LLM That Learns How to Use External Tools [24:57 ]
• Galactica: The Science-Specific LLM and Why It Was Brought Down [36:57 ]
• Is AGI Around the Corner? [57:03 ]
• Advice for AI entrepreneurs [1:05:46 ]
• How Thomas develops and manages large-scale AI projects [1:14:42 ]
Additional materials: www.superdatascience.com/713
Comments
In Channel
Download from Google Play
Download from App Store
United States00:00
00:00
x
