Training built the centralised AI factory. Inference is quietly un-building it — because serving predictions to users is a latency, geography, and cost problem the industry already solved once, for content, twenty-five years ago.
Read the written version, with its diagrams and tables: https://bradshaw.cloud/writing/ai-grid-inference-is-a-cdn-problem/
Personal views, not those of my employer.