Plain Strata

Plain Strata: Why the Frontier Stays in One Room


Listen Later

The Thursday Layer. In late 2025, the team with the best claim to dislike centralized AI did the centralized thing: Prime Intellect, whose whole identity is training models scattered across homes and offices on different continents, put every chip for its strongest model, INTELLECT-3, in one building, and trained it the old way. Not a loss of nerve. A number. Every training step, thousands of processors have to share an update roughly the size of the model itself: about 200 gigabytes for a 100-billion-parameter model. Inside a cluster that takes seconds. Across ordinary home internet it takes more than five hours, once per step, for a run of hundreds of thousands of steps. That ratio has a name, the communication wall, and this episode builds it from the ground up: the four real tricks for holding it down, the models that proved each one, and why every trick's quality ceiling gets worse exactly as the model grows. Along the way: data gravity, the force that also explains why industries cluster in one city. No prior knowledge assumed. The voices in this show are AI-generated; the research and writing are human. Decentralized AI, layer by layer.
...more
View all episodesView all episodes
Download on the App Store

Plain StrataBy Plain Strata