Latent.Space

[LIVE] Anthropic Distillation & How Models Cheat (SWE-Bench Dead) | Nathan Lambert & Sebastian Raschka


Listen Later

Swyx joined SAIL! Thank you , , , , , and many others for tuning into SAIL Live #6 with and . Sharing here for the LS paid subscribers.

We covered:

Interconnects AIHow much does distillation really matter for Chinese LLMs?Distillation has been one of the most frequent topics of discussion in the broader US-China and technological diffusion story for AI. Distillation is a term with many definitions — the colloquial one today is using a stronger AI model’s outputs to teach a weaker model. The word itself is derived from a more technical and specific definition of…Read more18 days ago · 72 likes · 19 comments · Nathan Lambert

Get more from Latent.Space in the Substack appAvailable for iOS and AndroidGet the app

...more
View all episodesView all episodes
Download on the App Store

Latent.SpaceBy Latent.Space