Stepfunction Podcast

Episode 3 - Elevators Up, Stairways Down


Listen Later

Jeff and Seymour use stories and analogies to explain the two main approaches to AI: Bottom-Up and Top-Down. The recent wave of AI success is mostly based on the bottom up  path which includes machine learning, neural networks, and deep learning. Related links:

  • The case of the construction worker with a nail in his boot
  • Murray Shanahan's excellent December 2022 paper Talking About Large Language Models
  • Meta / Facebook AI research's September 2020 blog post on Retrieval Augmented Generation and Segmentation
  • DeepMind / Google AI's December 2021 paper on using a Retrieval-Enhanced Transformer (aka Retro) and a database of 2-trillion tokens for improved LLM capabilities. 

Questions and comments? Talk to us.

...more
View all episodesView all episodes
Download on the App Store

Stepfunction PodcastBy Jeff Hwang and Seymour Duncker