Arxiv Papers

By Igor MelnykScience

Arxiv Papers episodes

March 12, 2024 Stealing Part of a Production Language Model
The paper introduces a model-stealing attack to extract information from black-box language models, revealing hidden dimensions and proposing defenses.

https://arxiv.org/abs//2403.06634

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

25 min
March 11, 2024 [short] Stacking as Accelerated Gradient Descent
The paper proposes a theoretical explanation for the success of stacking in training deep neural networks, showing it implements Nesterov's accelerated gradient descent, validated through experiments.

https://arxiv.org/abs//2403.04978

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

27 min
March 11, 2024 Stacking as Accelerated Gradient Descent
The paper proposes a theoretical explanation for the success of stacking in training deep neural networks, showing it implements Nesterov's accelerated gradient descent, validated through experiments.

https://arxiv.org/abs//2403.04978

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

27 min
March 11, 2024 [short] ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment
ELLAdapts Large Language Models to enhance text-image alignment in diffusion models, improving comprehension of dense prompts without retraining, demonstrated superior performance in dense prompt following.

https://arxiv.org/abs//2403.05135

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

3 min
March 11, 2024 ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment
ELLAdapts Large Language Models to enhance text-image alignment in diffusion models, improving comprehension of dense prompts without retraining, demonstrated superior performance in dense prompt following.

https://arxiv.org/abs//2403.05135

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

9 min
March 10, 2024 [short] Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
Chatbot Arena is an open platform using crowdsourcing for evaluating Large Language Models based on human preferences, proving credible and widely referenced in the LLM community.

https://arxiv.org/abs//2403.04132

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

3 min
March 10, 2024 Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
Chatbot Arena is an open platform using crowdsourcing for evaluating Large Language Models based on human preferences, proving credible and widely referenced in the LLM community.

https://arxiv.org/abs//2403.04132

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

15 min
March 09, 2024 [short] GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Training large language models faces memory challenges. Gradient Low-Rank Projection (GaLore) reduces memory usage by up to 65.5% in optimizer states while maintaining efficiency and performance.

https://arxiv.org/abs//2403.03507

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

3 min
March 09, 2024 GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Training large language models faces memory challenges. Gradient Low-Rank Projection (GaLore) reduces memory usage by up to 65.5% in optimizer states while maintaining efficiency and performance.

https://arxiv.org/abs//2403.03507

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

16 min
March 08, 2024 [short] Yi: Open Foundation Models by 01.AI
The Yi model family introduces powerful language and multimodal models, achieving high performance on various benchmarks through data quality and scalable infrastructure.

https://arxiv.org/abs//2403.04652

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

3 min

About Arxiv Papers

From the publisher's feed

Running out of time to catch up with new arXiv papers? We take the most impactful papers and present them as convenient podcasts. If you're a visual learner, we offer these papers in an engaging video…