Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
The paper introduces Layerwise Importance Sampled AdamW (LISA) as a memory-efficient alternative to Low-Rank Adaptation (LoRA) for large language models, outperforming both in various fine-tuning tasks.
https://arxiv.org/abs//2403.17919
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
13 min - [short] LLAMAFACTORY: Unified Efficient Fine-Tuning of 100+ Language Models
LLAMAFACTORY is a unified framework for efficient fine-tuning of large language models, offering customization without coding through LLAMABOARD. Empirically validated for language tasks. Available on GitHub.
https://arxiv.org/abs//2403.13372
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - LLAMAFACTORY: Unified Efficient Fine-Tuning of 100+ Language Models
LLAMAFACTORY is a unified framework for efficient fine-tuning of large language models, offering customization without coding through LLAMABOARD. Empirically validated for language tasks. Available on GitHub.
https://arxiv.org/abs//2403.13372
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
15 min - [short] MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions
MagicLens introduces self-supervised image retrieval models using text instructions to capture diverse search intents beyond visual similarity, outperforming previous methods with smaller model size.
https://arxiv.org/abs//2403.19651
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructions
MagicLens introduces self-supervised image retrieval models using text instructions to capture diverse search intents beyond visual similarity, outperforming previous methods with smaller model size.
https://arxiv.org/abs//2403.19651
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
16 min - [short] A comparison of Human, GPT-3.5, and GPT-4 Performance in a University-Level Coding Course
Study compares student and AI performance in physics coding assignments. Students outperformed AI, with prompt engineering improving AI scores significantly. Human evaluators could distinguish AI-generated work from student work.
https://arxiv.org/abs//2403.16977
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - A comparison of Human, GPT-3.5, and GPT-4 Performance in a University-Level Coding Course
Study compares student and AI performance in physics coding assignments. Students outperformed AI, with prompt engineering improving AI scores significantly. Human evaluators could distinguish AI-generated work from student work.
https://arxiv.org/abs//2403.16977
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
13 min - [short] ViTAR: Vision Transformer with Any Resolution
This paper introduces ViTAR, a Vision Transformer with dynamic resolution adjustment and fuzzy positional encoding, enhancing scalability across different image resolutions while maintaining high performance.
https://arxiv.org/abs//2403.18361
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
3 min - ViTAR: Vision Transformer with Any Resolution
This paper introduces ViTAR, a Vision Transformer with dynamic resolution adjustment and fuzzy positional encoding, enhancing scalability across different image resolutions while maintaining high performance.
https://arxiv.org/abs//2403.18361
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
18 min - sDPO: Don't Use Your Data All at Once
Proposing stepwise DPO for aligning large language models with human preferences, improving performance and outperforming models with more parameters.
https://arxiv.org/abs//2403.19270
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners