Inside the Mind of AI: How Large Language Models Work

Ever wondered how chatbots like ChatGPT predict the perfect response? Robert Loft and Haley Hanson unravel the magic behind large language models, inspired by a fascinating explainer for the Computer History Museum.

We break it down:

• The basics: What LLMs are and how they predict words.
• Training in action: From pre-training on massive data to fine-tuning with human feedback.
• The transformer revolution: How attention mechanisms enable context-rich predictions.
• The mind-blowing scale: Billions of parameters, GPUs, and computations spanning eons.

This episode is perfect for AI-curious minds seeking a fun, accessible intro to large language models. Plus, we’ll point you to resources and exhibits to explore further!