Intelligence Unbound

Defeating Nondeterminism in LLM Inference


Listen Later

This episode dive deep on the Thinking Machines Lab publication that addresses the challenge of achieving reproducibility in large language model (LLM) inference, noting that even with "greedy sampling" (temperature set to 0), results are often nondeterministic.

...more
View all episodesView all episodes
Download on the App Store

Intelligence UnboundBy Fourth Mind