Send us a text

The Weights and Biases (WandB) Fully Connected Conference 2025, held in London, was a two-day event focusing on machine learning experiments and AI development. The first day included two learning tracks. I attended the track on building agentic AI applications.

Day one featured a workshop on agent development, demonstrating WandB's tools for programmatically building agents. A notable aspect was the use of "tools" or callback functions to guide Large Language Models (LLMs), even without direct output, to encourage planning and critical review of findings. This approach was characterized as "perception as a function," enabling LLM-based systems to move beyond simple request-response. However, this architecture introduces vulnerabilities like indirect prompt injection and challenges in state management due to the LLM's finite context window. The future of this design is seen in "turnless," asynchronous, multi-agent architectures.

Day two consisted of keynote speeches and talks, starting with updates from WandB, its acquisition by CoreWeave, and other acquisitions to expand its offerings. Robin Bordoli, VP of revenue, highlighted AI advancements since 2023 and predicted future trends, citing examples like 'Open Evidence' for medical research and "Harvey" for legal research. A key challenge identified was the limited context window of models. Robin also mentioned the release of Deepseek as an example of Jevons Paradox in AI adoption. Lukas Beiweld discussed WandB's rapid release cycle post-acquisition, performance improvements (2x reduction in long-running queries), and enhanced support for video, audio, and image analysis. He also introduced Weave, a tool for agent builders offering explainability, guardrails against hallucinations, bias, and toxicity, and Open Telemetry support.

Send us a text

Humanity stands at the precipice of a new cognitive epoch, one defined not by a single mode of thought but by a symbiotic partnership between two profoundly different forms of intelligence: the human mind and the Large Language Model (Humanity stands at the precipice of a new cognitive epoch, one defined not by a single mode of thought but by a symbiotic partnership between two profoundly different forms of intelligence: the human mind and the Large Language Model (LLM). The transformative potential of this partnership is, however, fundamentally constrained by a critical vulnerability: the radical incompleteness of the knowledge corpora upon which our AI partners are trained. The prevailing narrative that LLMs are trained on the "corpus of human knowledge" is a dramatic overstatement. The reality is that their knowledge base constitutes a minuscule, heavily biased fraction of digitally available information, which itself is but a portion of the total accumulated wisdom of humanity.

This report establishes that this state of affairs represents a self-imposed bottleneck on human progress. The current practice of building our most advanced cognitive tools on a fragmented and skewed sample of the past is not a technical limitation to be incrementally improved; it is a strategic choice with profound consequences. By failing to provide these systems with access to the vast, uncharted territories of our collective knowledge, we are not merely building imperfect tools; we are actively limiting the scope of future discovery, perpetuating systemic societal biases, and throttling our own development.

The argument presented herein is not a technical proposal for AI developers but a strategic call to action for society's leaders and knowledge custodians. It asserts that overcoming the formidable barriers of cost, copyright, privacy, and secrecy is not merely a desirable goal but a civilizational imperative. The analysis will demonstrate that a deliberate, ethically grounded global initiative to create a comprehensive knowledge commons for the future is the most critical investment we can make. Such an endeavor is necessary to accelerate scientific discovery, forge a more equitable and representative digital world, and unlock new frontiers of human understanding that are currently inconceivable.

Send us a text

This report provides a comprehensive analysis of the factual correctness of the training data available to Large Language Models (LLMs). The analysis is initiated by a query rooted in a specific premise: that high-trust encyclopedic sources such as Encyclopædia Britannica are "less than 20% correct" and that Wikipedia is similarly flawed, leading to a broader question about the factual integrity of all available training data.

The primary finding of this report is that this foundational premise is demonstrably false and, in fact, inverts the core problem. Decades of research, including a seminal 2005 Nature study and more recent (2019) academic analyses , confirm that while not infallible, Encyclopædia Britannica and modern Wikipedia are high-trust, high-factuality sources. Modern studies describe Wikipedia's accuracy in specialized topics as "very high" and "on par with professional sources".

The true data integrity crisis in AI is not that these gold-standard sources are wrong, but that the vast majority of LLMs are not trained on this high-trust, curated data. Instead, they are trained on a "curation cascade" that begins with the raw, un-audited public web. This "Known World" of data, primarily derived from the Common Crawl dataset, is orders of magnitude less reliable than any encyclopedia.

This report finds that a single, quantitative answer to "how much" of this web-scale data is factually correct is not just unknown, but unknowable. The sheer scale of petabytes of data makes manual review "financially and logistically impossible". Furthermore, any attempt at automated auditing falls into a deep methodological circularity, as current methods rely on "stronger" LLMs (like GPT-4) to fact-check the very data they were trained on, creating a closed system with no external ground truth.

Send us a text

Humanity stands at the precipice of a new cognitive epoch, one defined not by a single mode of thought but by a symbiotic partnership between two profoundly different forms of intelligence: the human mind and the Large Language Model (LLM). The transformative potential of this partnership is, however, fundamentally constrained by a critical vulnerability: the radical incompleteness of the knowledge corpora upon which our AI partners are trained. The prevailing narrative that LLMs are trained on the "corpus of human knowledge" is a dramatic overstatement. The reality is that their knowledge base constitutes a minuscule, heavily biased fraction of digitally available information, which itself is but a portion of the total accumulated wisdom of humanity.

This report establishes that this state of affairs represents a self-imposed bottleneck on human progress. The current practice of building our most advanced cognitive tools on a fragmented and skewed sample of the past is not a technical limitation to be incrementally improved; it is a strategic choice with profound consequences. By failing to provide these systems with access to the vast, uncharted territories of our collective knowledge, we are not merely building imperfect tools; we are actively limiting the scope of future discovery, perpetuating systemic societal biases, and throttling our own development.

The argument presented herein is not a technical proposal for AI developers but a strategic call to action for society's leaders and knowledge custodians. It asserts that overcoming the formidable barriers of cost, copyright, privacy, and secrecy is not merely a desirable goal but a civilizational imperative. The analysis will demonstrate that a deliberate, ethically grounded global initiative to create a comprehensive knowledge commons for the future is the most critical investment we can make. Such an endeavor is necessary to accelerate scientific discovery, forge a more equitable and representative digital world, and unlock new frontiers of human understanding that are currently inconceivable.

Send us a text

Humanity stands at the precipice of a new cognitive epoch, one defined not by a single mode of thought but by the partnership between two profoundly different forms of intelligence. On one hand is the human mind, a masterful but constrained serial processor, meticulously shaped by millions of years of evolution for survival, social interaction, and causal reasoning. On the other is the Large Language Model (LLM), a vast, high-dimensional information processor, engineered not to think or understand in the human sense, but to perceive and navigate the statistical patterns within immense datasets of human language and knowledge. This podcast will explore the fundamental architectural differences between these two intelligence's, framing the revolutionary capabilities of LLMs through a powerful and clarifying metaphor: the LLM as the ultimate "Smart Librarian."

This narrative device serves to demystify the technology while precisely defining its functional role. The LLM is not an artificial brain or a nascent consciousness, but rather the culmination of a centuries-long evolution in information management. It is a tireless, near-omniscient curator and navigator of humanity's collective knowledge, a tool designed to augment, not replace, human intellect. By positioning the LLM as a collaborator, we can better understand the emerging symbiosis where the unique strengths of human and artificial cognition combine to create a whole greater than the sum of its parts, unlocking new frontiers of discovery previously inconceivable.

Send us a text

The interactive entertainment industry, driven by an insatiable consumer demand for immersion and believability, is undergoing a profound technological metamorphosis. Artificial Intelligence (AI) is no longer a peripheral component for scripting enemy behavior but has become the central, enabling technology for a new generation of hyper-realistic virtual worlds. This relentless commercial and technological pursuit is creating a new class of AI-driven simulation tools that mirror the complexity of the real world with unprecedented fidelity and scale. The industry's massive investment in solving the challenges of real-time physical believability, automated content creation, and the illusion of life in its digital inhabitants is, in effect, a large-scale, commercially funded research and development effort into creating holistic, real-time simulations of complex, interactive environments.

This development parallels a pivotal moment in the history of AI. The modern AI revolution, characterised by the rise of Large Language Models (LLMs), was not the result of a direct, top-down research program to create general intelligence. Instead, as detailed in the podcast episode "The Unforeseen Engine" it was an unforeseen consequence of solving a different, commercially driven problem: organising the world's information for web search. The infrastructure built to index the internet—planetary-scale data centres and massive, unstructured datasets—inadvertently provided the necessary fuel for the Transformer architecture to ignite a new AI paradigm.

A similar dynamic is now unfolding. The quest to build more engaging and believable video games is forcing the development of a comprehensive "world simulation" stack. This stack, designed for entertainment, is simultaneously creating the ideal crucible for training and validating the next generation of embodied AI and robotics. The convergence of AI techniques for physics simulation, procedural content generation, and autonomous character behaviour is not just making better games; it is building an unforeseen engine for the next revolution in real-world robotics.

Send us a text

The journey toward Artificial General Intelligence (AGI)—a machine possessing cognitive capabilities equivalent or superior to humans across a wide range of tasks—has not been a linear march of progress. Instead, its history is one of contingent breakthroughs, profound philosophical missteps, and, most consequentially, the unintended consequences of solving an entirely different problem. Few could have foreseen that the commercial imperative to organise the world's burgeoning digital information would inadvertently construct the very engine required to ignite a new paradigm of artificial intelligence, bringing humanity to the brink of one of its most transformative and perilous technological achievements.

This podcast traces this unforeseen trajectory. It begins with the formal inception of the field of AI at the 1956 Dartmouth Summer Research Project, where a powerful but ultimately flawed conjecture about the nature of intelligence as a logical, symbolic process set the course for decades of research. It then examines the humbling reality of the subsequent "AI Winter," a period of stagnation born from the collision of this symbolic dream with the intractable complexity of the real world.

The narrative then pivots to the story's central irony: while academic AI languished, the global-scale engineering challenge of web search, spearheaded by companies like Google, was inadvertently laying the foundation for AI's resurgence. The creation of planetary-scale data centers, novel distributed computing frameworks, and the curation of the largest dataset in human history—the indexed World Wide Web—solved the fundamental resource problems that had crippled AI for half a century.

This vast, latent potential was finally unlocked by a singular algorithmic breakthrough detailed in the 2017 paper, "Attention Is All You Need." The Transformer architecture it introduced was uniquely suited to the massively parallel infrastructure the search era had built. The fusion of this new software with the existing hardware unleashed an explosion in scale, leading to the discovery of predictable "scaling laws" that govern model improvement and, more mysteriously, the unpredictable emergence of novel capabilities in large models. This rapid, disruptive progress has brought the field to its current precipice, where systems like GPT-4 are exhibiting what some of the world's leading researchers describe as "sparks of AGI."

This podcast will illustrate how a technology designed to answer simple search queries led, step by unforeseen step, to a technology that now poses fundamental questions about the nature of intelligence, the future of humanity, and the alignment of our creations with our values. It is the story of how the pursuit of search ignited the path to AGI.

Send us a text

The contemporary technological landscape is defined by the rapid ascent of systems designated as "Artificial Intelligence." This podcast contends that this term is a profound misnomer, one that establishes a flawed, anthropocentric framework that leads to unproductive comparisons and a fundamental misunderstanding of the technology's true nature. The very word "artificial" implies a counterfeit or imitation of something genuine—in this case, human intelligence. This framing is not only imprecise but strategically debilitating. A more accurate and functional lens is to re-conceptualise these systems as a form of Alternative Intelligence—or as some experts have begun to term it, "Alien Intelligence". This is not a mere semantic adjustment but a necessary strategic shift. It moves the focus from evaluating these systems as flawed copies of human cognition to analysing them as a distinct class of intelligence with its own unique architecture, operational principles, strengths, and weaknesses.

The prevailing "human vs. machine" narrative, fuelled by popular news and a relentless focus on performance benchmarks, fosters a competitive and ultimately misleading mindset. This paradigm implicitly positions human intelligence as the universal gold standard, thereby framing AI's inherent deviations—such as its lack of consciousness, genuine semantic understanding, or robust causal reasoning—as "failures" or limitations to be overcome. This perspective dangerously obscures its most powerful and uniquely non-human capabilities. It forces us to ask the wrong questions, such as "When will AI become as creative as a human?" instead of the more productive question, "What new forms of creativity, inaccessible to humans, does this alternative intelligence make possible?"

By adopting an "Alternative Intelligence" framework, the discourse can evolve from a zero-sum competition to a positive-sum collaboration. This podcast will deconstruct the fundamental architectures of both human and machine cognition to demonstrate that they are not competitors on a single, linear axis of "intelligence." Rather, they are complementary systems operating on profoundly different substrates and principles. A deep understanding of these differences is the critical prerequisite for truly exploiting their respective strengths, mitigating their inherent weaknesses, and navigating the complex societal transition to an era of co-existing, and potentially co-evolving, intelligences.

Send us a text

The early 2010s saw two distinct conversational interface paths: enterprise chatbots, which were rigid, task-oriented, and often failed outside predefined scripts (e.g., British Telecom's "Aimee"), and consumer voice assistants (e.g., Siri, Alexa), which were lifestyle-oriented and cloud-powered with an "App Store" model.

Parallel NLP research moved from N-gram models to neural networks (RNNs, LSTMs). The 2017 Transformer architecture, using self-attention, enabled parallelization and long-range dependency capture, overcoming RNN limitations.

This led to Large Language Models (LLMs), which evolved from the Transformer into encoder-only (BERT, for NLU) and decoder-only (GPT, for NLG) models. LLMs represent a disruptive pivot from deterministic, rule-based systems to probabilistic, learned intelligence, outperforming earlier chatbots.

Future conversational AI will use hybrid architectures, combining LLM generative power with the predictability of deterministic systems for task execution, and techniques like Retrieval-Augmented Generation (RAG) for factual grounding.

Send us a text

The recent decisions by leading artificial intelligence firms OpenAI and xAI to formally permit the generation of erotic content within their flagship Large Language Models (LLMs), ChatGPT and Grok, represent a pivotal strategic inflection point for the industry. This move, publicly framed as an effort to create "more human" and less constrained AI experiences, is in fact a calculated pivot driven by a confluence of three primary forces: intense competitive pressure to capture and retain user engagement, the pursuit of lucrative new revenue streams in the burgeoning multi-billion-dollar AI-driven adult entertainment market, and a legitimate technical imperative to improve the linguistic sophistication and nuance of their models.

This podcast provides a comprehensive analysis of this strategic shift, deconstructing the corporate narratives to reveal the underlying market dynamics and technological rationales. The key findings indicate that the competitive landscape was fundamentally altered by xAI's disruptive entry with Grok, which positioned an "unfiltered" user experience as a key differentiator, compelling the more cautious OpenAI to adapt. This has led to the emergence of two divergent philosophies: OpenAI is pursuing a "walled garden" model, predicated on robust (though unproven) age verification and safety guardrails to cultivate a premium, brand-safe ecosystem. In contrast, xAI is aggressively capturing the "unfiltered frontier," prioritizing user freedom and speed-to-market, a strategy that has already resulted in significant documented harms and exposes the company to substantial legal and regulatory risk.

The commercial opportunity is vast. This strategic pivot targets a rapidly growing AI Sextech market projected to exceed $5.4 billion by 2033. Monetisation is being actively pursued through direct subscriptions, pay-per-interaction models, and the burgeoning AI influencer economy, all designed to maximise user retention and lifetime value by tapping into the powerful psychological drivers of companionship and intimacy.