Arxiv Papers

The paper introduces Titans, a new architecture combining neural long-term memory and attention, outperforming Transformers in various tasks while efficiently handling larger context windows.

https://arxiv.org/abs//2501.00663

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper introduces Titans, a new architecture combining neural long-term memory and attention, outperforming Transformers in various tasks while efficiently handling larger context windows.

https://arxiv.org/abs//2501.00663

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

This paper proposes adaptive batch size schedules for large-scale language model training, enhancing efficiency and generalization, while outperforming traditional methods in pretraining models, particularly smaller ones.

https://arxiv.org/abs//2412.21124

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

This paper proposes adaptive batch size schedules for large-scale language model training, enhancing efficiency and generalization, while outperforming traditional methods in pretraining models, particularly smaller ones.

https://arxiv.org/abs//2412.21124

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper introduces Functional Risk Minimization (FRM), a framework improving performance in various learning tasks by comparing functions instead of outputs, enhancing understanding of generalization in over-parameterized models.

https://arxiv.org/abs//2412.21149

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper introduces Functional Risk Minimization (FRM), a framework improving performance in various learning tasks by comparing functions instead of outputs, enhancing understanding of generalization in over-parameterized models.

https://arxiv.org/abs//2412.21149

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper presents HuatuoGPT-o1, a medical LLM that enhances complex reasoning through verifiable problems and reinforcement learning, outperforming existing models in medical problem-solving.

https://arxiv.org/abs//2412.18925

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper presents HuatuoGPT-o1, a medical LLM that enhances complex reasoning through verifiable problems and reinforcement learning, outperforming existing models in medical problem-solving.

https://arxiv.org/abs//2412.18925

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper introduces InfAlign, an inference-aware alignment framework that optimizes language model performance during inference, outperforming existing methods by 8-12% on helpfulness and harmlessness benchmarks.

https://arxiv.org/abs//2412.19792

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper proposes a consistency metric for evaluating forecasting AIs, using arbitrage principles, and introduces an automated system to benchmark predictions against logically-related questions.

https://arxiv.org/abs//2412.18544

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers