The Confusion Matrix

Alex and Pete discuss Alex’s rebuild of his perma-regenerating LLM chat client. This time he did it properly! No messing, just hardcore, disciplined, systematic, agent-coding goodness. Join them as he walks Pete through the process in excruciating, step-by-step detail. The Vanishing Gradients episode Alex mentions.

Alex and Pete examine OpenAI’s comprehensive report on ChatGPT usage patterns, analysing classification methodologies and user behaviour across consumer and workplace contexts. They discuss the shift from advice-seeking to task execution, the dominance of writing and information-seeking functions, and implications for future AI adoption and market opportunities.

Pete and Alex examine AI model evaluation methodologies, comparing traditional machine learning metrics with the qualitative assessment challenges of large language models. They discuss the collaborative requirements between technical and business teams to establish evaluation criteria for generative AI systems, highlighting the subjective nature of testing conversational outputs versus binary classification tasks. With the help […]

Pete and Alex dig into cybersecurity risks with AI agents and generative AI systems. They cover two main problems: people coding dodgy applications without security knowledge, and hackers directly exploiting AI agents that have access to tools and data. Despite the scary possibilities, they reckon most vulnerabilities are manageable with decent security practices. Practical AI […]

Pete and Alex recap their recent AI discussions, covering why language model “hallucinations” are actually normal behaviour, how most AI proof-of-concepts fail due to poor ideas rather than technical issues, the impact on jobs and graduate recruitment, and the rise of AI coding agents that are reshaping software development. Practical AI – Dealing with increasingly […]

Alex and Pete discuss MIT’s study revealing 95% of GenAI projects fail despite massive enterprise investment. They explore why companies struggle to scale beyond pilots, the “shadow AI economy” of employees secretly using personal AI tools, and practical strategies for successful implementation including adaptive systems and treating AI procurement like business process outsourcing.

Alex explains his slow but unstoppable gravitation to text based interfaces and an “everything via the terminal” mentality. After all, who needs graphical operating systems? To do this, Pete and Alex take a ramble through the history of nerd-first user interfaces, discuss why keyboard layouts are stupid, how this relates to window based OSes and […]

Pete and Alex ponder whether we are at the point where LLMs are as good as they are going to get, and what the implications of this are. This requires a dip into the murky depths of what businesses exist to do and how the randomness that the LLMs generate is antithetical to how businesses […]

Join Alex and Pete as they discuss building software that suits only your needs and idiosyn-crazies using AI. Surely this is a good thing, and not just another apocalypse in disguise? There’s only one way to find out!

Pete and Alex discuss the challenges of deploying language models in end-user facing systems, the dilemma of diversity vs accuracy of output, and how all of this is a giant headache for data scientists and software engineers alike.