What would a "theory" of machine learning tell us? In this episode Tom meets with the person who invented what is now the widely accepted definition of supervised machine learning: Turing Award recipient and Harvard Professor Leslie Valiant.

Leslie tells us how he got interested in the problem, his contribution, the evolution of machine learning theory over the decades, and his advice to new researchers.

Tom speaks with Ross Quinlan, whose algorithms C4.5 and ID3 helped establish decision trees as one of the most popular approaches in machine learning, and who founded RuleQuest Research, which accelerated the commercial adoption of machine learning.

Ross (published as "JR Quinlan") describes a sabbatical visit to Stanford University where he took a course that drove him to invent the first successful learning algorithm for decision trees, follow-on research that led to decision trees becoming one of the most popular machine learning algorithms, and his experience moving from academia into the commercial world.

Tom interviews Rich Sutton, Research Scientist at Keen Technologies, Professor of Computing Science at the University of Alberta and co-winner of the 2024 ACM Turing Award for his foundational research on reinforcement learning.

Rich discusses why the common framing of machine learning as 'supervised learning' is insufficient, and how reinforcement learning reframes the problem. He discusses how reinforcement learning has developed as a subfield of machine learning, the influence of Harry Kopf on his early thinking, his long-time collaboration with Andy Barto, his views about today's state of the art, and more.