Sign up to save your podcasts
Or
Share BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model
The paper introduces BTLM-3B-8K, a new state-of-the-art 3 billion parameter language model that outperforms existing models and provides excellent long context performance. It is compact, requiring less memory and compute, making it accessible for mobile and edge devices.
https://arxiv.org/abs//2309.11568
YouTube: https://www.youtube.com/@ArxivPapers
PODCASTS:
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
View all episodes
By Igor Melnyk
5
33 ratings
The paper introduces BTLM-3B-8K, a new state-of-the-art 3 billion parameter language model that outperforms existing models and provides excellent long context performance. It is compact, requiring less memory and compute, making it accessible for mobile and edge devices.
https://arxiv.org/abs//2309.11568
YouTube: https://www.youtube.com/@ArxivPapers
PODCASTS:
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
More shows like Arxiv Papers
View all
Exchanges
970 Listeners
Odd Lots
1,967 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,948 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,182 Listeners
Hard Fork
5,530 Listeners
UnHerd with Freddie Sayers
195 Listeners
Unsupervised Learning with Jacob Effron
52 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
491 Listeners