Ever wondered how chatbots like ChatGPT predict the perfect response? Robert Loft and Haley Hanson unravel the magic behind large language models, inspired by a fascinating explainer for the Computer History Museum.

We break it down:

The basics: What LLMs are and how they predict words.
Training in action: From pre-training on massive data to fine-tuning with human feedback.
The transformer revolution: How attention mechanisms enable context-rich predictions.
The mind-blowing scale: Billions of parameters, GPUs, and computations spanning eons.

This episode is perfect for AI-curious minds seeking a fun, accessible intro to large language models. Plus, we’ll point you to resources and exhibits to explore further!

Inside the Mind of AI: How Large Language Models Work 17:30 Share

The Quantum Drift

Shownotes Transcript

Inside the Mind of AI: How Large Language Models Work