Sign up to save your podcasts
Or
Share Titans: The ML Architecture Breaking 2M Token Barriers
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Titans: The ML Architecture Breaking 2M Token Barriers
Deep dive into DeepSeek's Titans architecture, featuring dual memory systems, three variants (MAC/MAG/MAL), and unprecedented 2M+ token processing. Plus, implications for AI accessibility and pricing.
Sources:
[1] https://arxiv.org/abs/2501.00663
[2] https://www.marktechpost.com/2025/01/16/google-ai-research-introduces-titans-a-new-machine-learning-architecture-with-attention-and-a-meta-in-context-memory-that-learns-how-to-memorize-at-test-time/
[3] https://www.chinatalk.media/p/deepseek-ceo-interview-with-chinas
View all episodes
By Matthias LauDeep dive into DeepSeek's Titans architecture, featuring dual memory systems, three variants (MAC/MAG/MAL), and unprecedented 2M+ token processing. Plus, implications for AI accessibility and pricing.
Sources:
[1] https://arxiv.org/abs/2501.00663
[2] https://www.marktechpost.com/2025/01/16/google-ai-research-introduces-titans-a-new-machine-learning-architecture-with-attention-and-a-meta-in-context-memory-that-learns-how-to-memorize-at-test-time/
[3] https://www.chinatalk.media/p/deepseek-ceo-interview-with-chinas