713: Llama 2, Toolformer and BLOOM: Open-Source LLMs with Meta's Dr. Thomas Scialom

Artificial General Intelligence, RLHF’s application in AI, and how entrepreneurs can enter the AI industry: Meta’s AI Research Scientist Thomas Scialom gives us behind-the-scenes insights into developing Llama 2 and what’s in the works for Llama 3. With host Jon Krohn, he discusses the future of Artificial General Intelligence, why the Galactica science-focused LLM was taken down, and what he learned from it. This episode is brought to you by AWS Inferentia (https://go.aws/3zWS0au), by Grafbase (https://grafbase.com), the unified data layer, and by Modelbit (https://modelbit.com), for deploying models in seconds. Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information. In this episode you will learn: • Llama 2: Behind the Scenes of Today’s Top Open-Source LLM [05:04] • Responsible use of Llama 2 [15:26] • Toolformer: LLM That Learns How to Use External Tools [24:57] • Galactica: The Science-Specific LLM and Why It Was Brought Down [36:57] • Is AGI Around the Corner? [57:03] • Advice for AI entrepreneurs [1:05:46] • How Thomas develops and manages large-scale AI projects [1:14:42] Additional materials: www.superdatascience.com/713