Sign up to save your podcasts
Or
Share Arxiv Papers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Arxiv Papers
By Igor MelnykScience
Arxiv Papers episodes
- [QA] What makes unlearning hard and what to do about it
Research explores machine unlearning, removing specific training data from models. Investigates factors affecting unlearning difficulty and algorithm performance, introducing Refined-Unlearning Meta-algorithm (RUM) to enhance existing methods.
https://arxiv.org/abs//2406.01257
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - What makes unlearning hard and what to do about it
Research explores machine unlearning, removing specific training data from models. Investigates factors affecting unlearning difficulty and algorithm performance, introducing Refined-Unlearning Meta-algorithm (RUM) to enhance existing methods.
https://arxiv.org/abs//2406.01257
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
18 min - [QA] Learning to Play Atari in a World of Tokens
DART introduces discrete abstract representations for transformer-based learning, improving sample efficiency and outperforming previous methods on Atari games.
https://arxiv.org/abs//2406.01361
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - Learning to Play Atari in a World of Tokens
DART introduces discrete abstract representations for transformer-based learning, improving sample efficiency and outperforming previous methods on Atari games.
https://arxiv.org/abs//2406.01361
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
12 min - [QA] Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models
Investigating if small language models can improve large models by pruning datasets based on perplexity, leading to enhanced downstream task performance and reduced pretraining steps.
https://arxiv.org/abs//2405.20541
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
10 min - Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models
Investigating if small language models can improve large models by pruning datasets based on perplexity, leading to enhanced downstream task performance and reduced pretraining steps.
https://arxiv.org/abs//2405.20541
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
13 min - [QA] Contextual Position Encoding: Learning to Count What's Important
Large Language Models (LLMs) use attention mechanisms for token interactions. Current position encoding methods lack abstraction levels. CoPE introduces contextual position encoding for improved addressing and performance.
https://arxiv.org/abs//2405.18719
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min - Contextual Position Encoding: Learning to Count What's Important
Large Language Models (LLMs) use attention mechanisms for token interactions. Current position encoding methods lack abstraction levels. CoPE introduces contextual position encoding for improved addressing and performance.
https://arxiv.org/abs//2405.18719
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
20 min - [QA] JINA CLIP: Your CLIP Model Is Also Your Text Retriever
Proposed multi-task contrastive training method improves CLIP models for text-only tasks, achieving state-of-the-art performance on text-image and text-text retrieval tasks with jina-clip-v1 model.
https://arxiv.org/abs//2405.20204
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
8 min - JINA CLIP: Your CLIP Model Is Also Your Text Retriever
Proposed multi-task contrastive training method improves CLIP models for text-only tasks, achieving state-of-the-art performance on text-image and text-text retrieval tasks with jina-clip-v1 model.
https://arxiv.org/abs//2405.20204
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
9 min
About Arxiv Papers
From the publisher's feed
Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…
format. Our service fills the gap between overly brief paper summaries and time-consuming full paper reads. You gain academic insights in a time-efficient, digestible format. Code behind this work: https://github.com/imelnyk/ArxivPapers
More shows like Arxiv Papers
Exchanges
968 Listeners
Odd Lots
1,960 Listeners
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
436 Listeners
The Daily
111,708 Listeners
All-In with Chamath, Jason, Sacks & Friedberg
10,107 Listeners
Hard Fork
5,564 Listeners
UnHerd with Freddie Sayers
216 Listeners
Unsupervised Learning with Jacob Effron
51 Listeners
Latent Space: The AI Engineer Podcast
101 Listeners
BG2Pod with Brad Gerstner and Bill Gurley
477 Listeners