Ever wondered how chatbots like ChatGPT predict the perfect response? Robert Loft and Haley Hanson unravel the magic behind large language models, inspired by a fascinating explainer for the Computer History Museum.
We break it down:
- The basics: What LLMs are and how they predict words.
- Training in action: From pre-training on massive data to fine-tuning with human feedback.
- The transformer revolution: How attention mechanisms enable context-rich predictions.
- The mind-blowing scale: Billions of parameters, GPUs, and computations spanning eons.
This episode is perfect for AI-curious minds seeking a fun, accessible intro to large language models. Plus, we’ll point you to resources and exhibits to explore further!
