Sign up to save your podcasts
Or
Share Continual Learning via Sparse Memory Finetuning
Share to email
Share to Facebook
Share to X
Share to email
Share to Facebook
Share to X
Or
Continual Learning via Sparse Memory Finetuning
In this episode:
• The Frozen Brains of AI: Linda introduces the problem of static LLMs and the challenge of 'catastrophic forgetting.' Professor Norris provides historical context on this long-standing issue in AI and introduces the day's paper on continual learning.
• Why Can't Models Just Keep Learning?: The hosts discuss traditional approaches to continual learning, like data replay and regularization. Linda explains why modern methods like LoRA, while better than full finetuning, still fall short of solving the forgetting problem.
• Memory and Sparsity: The Secret Sauce: Linda details the paper's main contribution: Sparse Memory Finetuning. She explains the concepts of memory layers and how the authors use a TF-IDF-like mechanism to identify and update only a tiny fraction of model parameters.
• Learning vs. Forgetting: The Showdown: Linda and Professor Norris analyze the paper's striking results, highlighting how the proposed method learns new facts effectively while forgetting dramatically less than both full finetuning and LoRA. They discuss the Pareto frontier plot as a key piece of evidence.
• What's Next for Lifelong Learners?: The hosts discuss the implications and future directions for this research, such as applying the technique to more complex skills beyond fact acquisition. They conclude that sparse updates are a promising path toward creating truly dynamic AI models.
• The Frozen Brains of AI: Linda introduces the problem of static LLMs and the challenge of 'catastrophic forgetting.' Professor Norris provides historical context on this long-standing issue in AI and introduces the day's paper on continual learning.
• Why Can't Models Just Keep Learning?: The hosts discuss traditional approaches to continual learning, like data replay and regularization. Linda explains why modern methods like LoRA, while better than full finetuning, still fall short of solving the forgetting problem.
• Memory and Sparsity: The Secret Sauce: Linda details the paper's main contribution: Sparse Memory Finetuning. She explains the concepts of memory layers and how the authors use a TF-IDF-like mechanism to identify and update only a tiny fraction of model parameters.
• Learning vs. Forgetting: The Showdown: Linda and Professor Norris analyze the paper's striking results, highlighting how the proposed method learns new facts effectively while forgetting dramatically less than both full finetuning and LoRA. They discuss the Pareto frontier plot as a key piece of evidence.
• What's Next for Lifelong Learners?: The hosts discuss the implications and future directions for this research, such as applying the technique to more complex skills beyond fact acquisition. They conclude that sparse updates are a promising path toward creating truly dynamic AI models.
View all episodes
By Mechanical DirkIn this episode:
• The Frozen Brains of AI: Linda introduces the problem of static LLMs and the challenge of 'catastrophic forgetting.' Professor Norris provides historical context on this long-standing issue in AI and introduces the day's paper on continual learning.
• Why Can't Models Just Keep Learning?: The hosts discuss traditional approaches to continual learning, like data replay and regularization. Linda explains why modern methods like LoRA, while better than full finetuning, still fall short of solving the forgetting problem.
• Memory and Sparsity: The Secret Sauce: Linda details the paper's main contribution: Sparse Memory Finetuning. She explains the concepts of memory layers and how the authors use a TF-IDF-like mechanism to identify and update only a tiny fraction of model parameters.
• Learning vs. Forgetting: The Showdown: Linda and Professor Norris analyze the paper's striking results, highlighting how the proposed method learns new facts effectively while forgetting dramatically less than both full finetuning and LoRA. They discuss the Pareto frontier plot as a key piece of evidence.
• What's Next for Lifelong Learners?: The hosts discuss the implications and future directions for this research, such as applying the technique to more complex skills beyond fact acquisition. They conclude that sparse updates are a promising path toward creating truly dynamic AI models.
• The Frozen Brains of AI: Linda introduces the problem of static LLMs and the challenge of 'catastrophic forgetting.' Professor Norris provides historical context on this long-standing issue in AI and introduces the day's paper on continual learning.
• Why Can't Models Just Keep Learning?: The hosts discuss traditional approaches to continual learning, like data replay and regularization. Linda explains why modern methods like LoRA, while better than full finetuning, still fall short of solving the forgetting problem.
• Memory and Sparsity: The Secret Sauce: Linda details the paper's main contribution: Sparse Memory Finetuning. She explains the concepts of memory layers and how the authors use a TF-IDF-like mechanism to identify and update only a tiny fraction of model parameters.
• Learning vs. Forgetting: The Showdown: Linda and Professor Norris analyze the paper's striking results, highlighting how the proposed method learns new facts effectively while forgetting dramatically less than both full finetuning and LoRA. They discuss the Pareto frontier plot as a key piece of evidence.
• What's Next for Lifelong Learners?: The hosts discuss the implications and future directions for this research, such as applying the technique to more complex skills beyond fact acquisition. They conclude that sparse updates are a promising path toward creating truly dynamic AI models.