<p>History of tokenization going back to 70s language modeling, modern tokenization approaches with BPE, and the future of token-free bitestreams</p>

History of tokenization going back to 70s language modeling, modern tokenization approaches with BPE, and the future of token-free bitestreams

Tokenizers now and in the future

Two Stanford friends who flooded their kitchen using dish soap instead of dishwasher detergent have somehow become AI experts. One builds startups, the other studies at Cambridge - together they break down LLMs and machine learning with zero BS and maximum banter.

Share Tokenizers now and in the future

Sign up to save your podcasts

Tokenizers now and in the future

Tokenizers now and in the future