• Episode 3 - Elevators Up, Stairways Down

  • Feb 28 2023
  • Length: 21 mins
  • Podcast
Episode 3 - Elevators Up, Stairways Down cover art

Episode 3 - Elevators Up, Stairways Down

  • Summary

  • Jeff and Seymour use stories and analogies to explain the two main approaches to AI: Bottom-Up and Top-Down. The recent wave of AI success is mostly based on the bottom up  path which includes machine learning, neural networks, and deep learning. Related links:

    • The case of the construction worker with a nail in his boot
    • Murray Shanahan's excellent December 2022 paper Talking About Large Language Models
    • Meta / Facebook AI research's September 2020 blog post on Retrieval Augmented Generation and Segmentation
    • DeepMind / Google AI's December 2021 paper on using a Retrieval-Enhanced Transformer (aka Retro) and a database of 2-trillion tokens for improved LLM capabilities. 

    Questions and comments? Talk to us.

    Show More Show Less

What listeners say about Episode 3 - Elevators Up, Stairways Down

Average Customer Ratings

Reviews - Please select the tabs below to change the source of reviews.