Into the Bytecode

#51 – Jeffrey Quesnelle on Nous Research, large language models, and the human mind


Listen Later

This is my conversation with Jeffrey Quesnelle, cofounder of Nous Research.

Timestamps:
- (00:00:00) intro
- (00:01:08) working with new technologies
- (00:06:15) Nous Research origin story
- (00:14:08) open frontiers in research
- (00:26:07) fourier transforms for gradient compression
- (00:32:58) math behind distributed training
- (00:38:18) sponsor: Splits
- (00:39:02) neural networks history and fundamentals
- (00:51:29) the human mind and AI, hyperdimensional representation
- (01:01:15) intuition and reasoning
- (01:15:00) parallels with reinforcement learning
- (01:19:15) the cat is out of the bag
- (01:47:11) deeper mysteries

Links:
- Jeffrey Quesnelle: https://jeffq.com/
- Jeffrey Quesnelle on X: https://x.com/theemozilla
- Nous Research: https://nousresearch.com/
- Psyche: https://nousresearch.com/nous-psyche/

Thank you to our sponsor for making this podcast possible:
- Splits: https://splits.org

Into the Bytecode:
- Sina Habibian on X: https://twitter.com/sinahab
- Sina Habibian on Farcaster: https://warpcast.com/sinahab
- Into the Bytecode: https://intothebytecode.com

Disclaimer:
This podcast is for informational purposes only. It is not financial advice nor a recommendation to buy or sell securities. The host and guests may hold positions in the projects discussed.

...more
View all episodesView all episodes
Download on the App Store

Into the BytecodeBy Sina Habibian

  • 4.9
  • 4.9
  • 4.9
  • 4.9
  • 4.9

4.9

29 ratings


More shows like Into the Bytecode

View all
The Daily by The New York Times

The Daily

111,917 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

426 Listeners