On this episode of Unsupervised Learning, Razib catches up with Nikolai Yakovenko about the state of AI at the end of 2024. Yakovenko is a former professional poker player,and research scientist at Google, Twitter and Nvidia. With a decade in computer science, Yakovenko has been at the forefront of the large-language-model revolution that has given rise to multi-billion dollar companies like OpenAI, Anthropic and Perplexity and hundreds of smaller startups. Currently, he is the CEO of DeepNewz, an AI-driven news startup that leverages OpenAI's latest model. Full disclosure: Razib actively uses and recommends the service and is an advisor to the company.

Razib and Yakovenko first review what makes the last few years special, the rise of large-language-models on top of neural network architecture of transformers. Yakovenkoi discusses how far they've come since OpenAI released ChatGPT to the public in the fall of 2022, and how people have been using the underlying technology to develop applications atop it. Despite predictions of mass unemployment, Razib points out that two years later America is at full employment, and only niche fields like translation have been impacted. In contrast, Yakovenko points out that most software developers use artificial intelligence in some form to aid in their daily engineering work, noting the possibility that the AI revolution is integrating itself seamlessly as a utility for preexistent jobs. They also discuss the fact that though AI is a booming field, only one brand-name company has so far emerged in the industry, OpenAI. Though they agree that the current hype cycle is now abating, it is clear that the major investments in the field like data centers will continue from major players as AI-driven applications like self-driving cars become more and more mainstream.