Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] Pre-training Small Base LMs with Fewer Tokens
The paper explores a method to create effective small language models by inheriting transformer blocks from larger models and training on a small subset of data.
https://arxiv.org/abs//2404.08634
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - Pre-training Small Base LMs with Fewer Tokens
The paper explores a method to create effective small language models by inheriting transformer blocks from larger models and training on a small subset of data.
https://arxiv.org/abs//2404.08634
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
20 min - [QA] Probing the 3D Awareness of Visual Foundation Models
The paper explores whether visual foundation models represent 3D structure. Experiments reveal limitations in current models' 3D awareness. Code and analysis available at specified GitHub link.
https://arxiv.org/abs//2404.08636
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
11 min - Probing the 3D Awareness of Visual Foundation Models
The paper explores whether visual foundation models represent 3D structure. Experiments reveal limitations in current models' 3D awareness. Code and analysis available at specified GitHub link.
https://arxiv.org/abs//2404.08636
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
11 min - [QA] Is ChatGPT Transforming Academics' Writing Style?
Analyzing one million arXiv papers, we find ChatGPT's influence on abstracts increasing, especially in computer science, with potential positive and negative impacts on academic writing.
https://arxiv.org/abs//2404.08627
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
12 min - [short] Is ChatGPT Transforming Academics' Writing Style?
Analyzing one million arXiv papers, we find ChatGPT's influence on abstracts increasing, especially in computer science, with potential positive and negative impacts on academic writing.
https://arxiv.org/abs//2404.08627
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - Is ChatGPT Transforming Academics' Writing Style?
Analyzing one million arXiv papers, we find ChatGPT's influence on abstracts increasing, especially in computer science, with potential positive and negative impacts on academic writing.
https://arxiv.org/abs//2404.08627
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
18 min - [QA] JetMoE: Reaching Llama2 Performance with 0.1M Dollars
JetMoE-8B, a cost-effective large language model, outperforms existing models, showcasing impressive performance with an efficient architecture and open accessibility for collaboration and advancement in LLM development.
https://arxiv.org/abs//2404.07413
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - [short] JetMoE: Reaching Llama2 Performance with 0.1M Dollars
JetMoE-8B, a cost-effective large language model, outperforms existing models, showcasing impressive performance with an efficient architecture and open accessibility for collaboration and advancement in LLM development.
https://arxiv.org/abs//2404.07413
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - JetMoE: Reaching Llama2 Performance with 0.1M Dollars
JetMoE-8B, a cost-effective large language model, outperforms existing models, showcasing impressive performance with an efficient architecture and open accessibility for collaboration and advancement in LLM development.
https://arxiv.org/abs//2404.07413
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
16 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners