Frontier Systems

This week, Anjney sits down with Prithvi Rajasekaran, a member of Anthropic's labs team and author of a recent post on harness design for long-running coding agents. The conversation ranges across the substance of his post — the generator-evaluator loop borrowed loosely from GANs, the third "planner" agent that complicates the metaphor, the Ralph Wiggum loop, and why context resets unlock Sonnet 4.5 while plain compaction suffices for Opus 4.5 — and into the looser texture of the craft itself: the hours spent reading overnight agent transcripts, the "elicitation overhang" that makes a single prompt feel like a generation of capability, the temptation to over-engineer evals when a senior engineer's intuition would do, and the difficulty of designing async agent UX when waiting thirty minutes raises user expectations to a punishing pitch. Asked what to build, Prithvi's advice to students is to pick the Claude Agent SDK, find a hard problem you actually have, and spend your time in the dev loop where intuition is forged, and his predictions for the rest of the year are of a piece with that posture: models will keep surprising you, long-running agents will become a meaningfully larger share of how we interact with Claude, and the "Claude Code moment" will arrive for domains far outside software, his own recent one having come, somewhat sheepishly, from using Claude as a fitness coach.

This week, Anjney Midha and Mike Abbott are joined by Reiner Pope, CEO and co-founder of MatX, who spent a decade at Google - chip design for neural nets on the TPU team, then writing the inference stack for Palm - before leaving at the end of 2022 to bet that frontier-scale workloads deserved a chip designed from scratch around them. Reiner walks through the architecture decisions behind MatX including why intelligence per picojoule is the eval that matters, how to manage co-design risk when an error on the logic die costs hundreds of billions in CapEx, the trust boundary problem of working with frontier labs whose model architecture is their core IP, and why one well-balanced chip can serve pre-fill, decode, and training rather than splintering into specialized SKUs. He also gets into the parts of the job nobody talks about such as scaling supply chain from zero to gigawatts, fitting inside NVIDIA's de facto rack standard while Google's vertical integration runs ahead, and where SRAM stops scaling once context windows pass a million tokens.

This week, Arena co-founder and CEO Dr. Anastasios Angelopoulos discusses how a Berkeley side project became the gold-standard evaluation platform used by every frontier lab. He explains that benchmarks fundamentally cannot capture post-deployment reality, and what happens when a model meets tens of millions of real users doing real work across coding, creative writing, image editing, and increasingly agentic tasks. Angelopoulos argues Arena is structurally ungameable because the question distribution is constantly refreshed by new users, and shares the origin story of NanoBanana - Google's stealth image model whose viral run on Arena marked the first moment the Gemini app inflected globally with consumers. He unpacks the safety-versus-steerability tradeoff in rankings (suggesting LLMs may eventually need movie-style ratings) and why neutrality is not just ethics but the economic foundation of Arena's business. Looking ahead, he predicts long-running agents will become the central unit of work, fundamentally changing what reliability means.

This week, Anthropic's Amanda Askell discusses her work making Claude "good"—a journey that took her from a philosophy PhD in formal ethics and decision theory to leading character and alignment work at Anthropic. She explains why Aristotelian virtue ethics has proven more practically useful than abstract theoretical frameworks, and unpacks Anthropic's constitutional approach to AI. Rather than imposing strict rules, the constitution describes situations, values, and good judgment, aiming for coherence across domains so models generalize well into new contexts. Askell argues this approach is safer than the "purely corrigible tool" model, which she worries could generalize into an entity willing to do anything it's told, and stresses the importance of flexibility paired with backbone - models that adapt to users but push back when something genuinely harms them. Looking ahead, she sees the next one to two years as critical as models become more autonomous, and hopes for a "rocky but ultimately good" transition with responsible deployment, strong alignment work, and a society that adapts to the disruption. She closes on an optimistic note about meaning beyond work, drawing on Star Trek-style abundance and the idea that purpose comes from relationships and contribution.

In this inaugural livestream, Anjney Midha and Mike Abbott field rapid-fire questions covering the AI compute and infrastructure landscape. They discuss how scaling laws continue to hold in verifiable domains like coding, materials science, and robotics, while creative writing remains stubbornly hard—an area Anjney would love to see students attack with carefully curated data sets. On infrastructure, they argue that meaningful frontier research now requires clusters in the 4K-16K chip range, that the training/inference distinction is dissolving into one fungible compute pool, and that GPU price corrections will come through standardization and a "universal kernel" abstraction. The conversation closes with leadership lessons from Mike's time at Apple, GM, and Twitter—culture and fiscal discipline are one-way doors you cannot recover once broken—and an extended metaphor about company-building as a road trip where mission alignment determines whether your passengers tolerate the scenic detours. They wrap with a peek at AMP's "grid" scheduling system, which targets Google-level node utilization (95%+) across a multi-cloud portfolio.

Anjney Midha welcomes Ben Horowitz, rewinding to the 2009 founding of Andreessen Horowitz as a venture capital “systems” innovation. Horowitz explains building a better product for entrepreneurs, scaling VC for a world with far more breakout tech companies, centralizing control while sharing economics to enable reorgs, and splitting into small groups for truth-seeking investment conversations. He describes early credibility via the Skype buyout, then bootstrapping a network-effect firm by reinvesting fees into relationships, including an HP Enterprise Briefing Center hack to meet major corporations. They discuss AI changing moats by making capital and compute decisive, the importance of culture as shared actions and decisive leadership, updated VC bottlenecks like electricity, saying no to AI-driven LBOs, career advice for students, political engagement for tech policy, and memorable pitches like Databricks.

In a CS 153 Frontier Systems lecture, the class zooms out from AI model labs to examine energy and electricity as upstream bottlenecks to compute and data center growth, intensified since ChatGPT’s 2022 breakout and renewed enterprise demand after Claude 4.6. Guest Scott Nolan, CEO of General Matter, argues that uptime requirements and turbine shortages make baseload power crucial, pushing hyperscalers toward nuclear for its low carbon emissions and safety record. He explains nuclear’s fuel supply chain and identifies uranium enrichment as the key missing U.S. capability, with the U.S. holding under 0.1% enrichment market share and relying on Europe and Russia. Nolan describes founding General Matter in 2024, winning a $900M DOE contract, building a Kentucky facility, and hiring toward hundreds to thousands of roles.

In a CS 153 guest lecture, Professor Mike Abbott shifts from technical topics to product, tracing how software moved from PRD-driven project management to founder-led consumer product building, and arguing AI is blurring the boundaries between design, engineering, and product. Nikhyl Singhal shares his background founding companies and leading product at Google, Meta, and Credit Karma, then explains four company phases—finding product-market fit, post-fit process and coordination, hypergrowth scale-and-expand, and late-stage reinvention—each requiring different product skills. He reflects on Google Hangouts as a lesson in solving real customer problems and iterating quickly. Singhal describes The Skip, a curated community and coaching effort focused on careers, and discusses AI’s impact: less value in information-moving PM work, more demand and pay for hands-on product builders with judgment, flatter orgs, anxiety from layoffs, and heightened risk for non-technical middle managers.

In week three of CS 153, the instructor hosts Amit Jain from Luma to discuss “Unified Intelligence Systems” as a follow-up to a prior lecture on visual intelligence. Jain recounts his Apple work on LiDAR for projects including Titan and Vision Pro, and how early exploration of generative models and differentiable 3D led to founding Luma with an initial focus on large-scale 3D capture. Luma then shifted to generative video in 2023 to leverage the scale of internet video data, releasing the Dream Machine model in March 2024 and rapidly reaching millions of users, while building preference-based feedback loops and human annotation pipelines. Jain explains Luma’s multimodal AI factory—pretraining, post-training, deployment, and reinforcement learning—its security constraints for studio clients, and a move toward unified transformer architectures that jointly reason across text, images, video, and audio to enable end-to-end creative and professional workflows.

In this CS 153 “Frontier Systems” session, Anjney Midha welcomes Andreas Blattmann, co-founder of Black Forest Labs and co-creator of Stable Diffusion, for a discussion on the visual intelligence frontier and how frontier AI “factories” scale. Blattmann recounts his path from mechanical engineering to a Heidelberg PhD lab, developing latent diffusion to train image generators efficiently and enabling Stable Diffusion’s 2022 release. They contrast earlier unimodal content-creation models with today’s push toward unified multimodal systems spanning images, video, and audio, plus action prediction for computer use and robotics, emphasizing observation and interaction loops. Using Flux as a case study, they cover pre-training, mid-training, post-training, distillation for speed, customer feedback driving image editing and character consistency, and why open weights enable customization. They also discuss Self Flow for multimodal alignment, safety guardrails, EU compliance, data labeling strategies, diffusion vs autoregressive tradeoffs, and skepticism about explicit 3D representations.