Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [short] Infini-gram: Scaling Unbounded -gram Language Models to a Trillion Tokens
Language models remain relevant, especially for text analysis and improving neural large language models. Modernizing -gram models involves training at the same scale as neural LLMs and using a new -gram LM with backoff.
https://arxiv.org/abs//2401.17377
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Infini-gram: Scaling Unbounded -gram Language Models to a Trillion Tokens
Language models remain relevant, especially for text analysis and improving neural large language models. Modernizing -gram models involves training at the same scale as neural LLMs and using a new n-gram LM with backoff.
https://arxiv.org/abs//2401.17377
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
39 min - [short] Arrows of Time for Large Language Models
Autoregressive language models exhibit time asymmetry in predicting next versus previous tokens, contrary to information theory expectations. Theoretical framework and implications are discussed.
https://arxiv.org/abs//2401.17505
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Arrows of Time for Large Language Models
Autoregressive language models exhibit time asymmetry in predicting next versus previous tokens, contrary to information theory expectations. Theoretical framework and implications are discussed.
https://arxiv.org/abs//2401.17505
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
31 min - [short] WEAVER: Foundation Models for Creative Writing
https://arxiv.org/abs//2401.17268
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
4 min - WEAVER: Foundation Models for Creative Writing
https://arxiv.org/abs//2401.17268
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
31 min - [short] H2O-Danube-1.8B Technical Report
https://arxiv.org/abs//2401.16818
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
4 min - H2O-Danube-1.8B Technical Report
https://arxiv.org/abs//2401.16818
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
13 min - [short] Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling
Large language models require abundant compute and data for training, which is infeasible due to costs and data scarcity. The proposed WRAP method uses rephrased web data to improve pre-training efficiency and model performance.
https://arxiv.org/abs//2401.16380
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling
Large language models require abundant compute and data for training, which is infeasible due to costs and data scarcity. The proposed WRAP method uses rephrased web data to improve pre-training efficiency and model performance.
https://arxiv.org/abs//2401.16380
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
29 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,967 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,764 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,561 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
102 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners