Most people using AI tools carry a wrong mental model of what a language model actually is — and that wrong model leads to predictable, costly mistakes. This episode is the keystone of the AI Foundations series: one core idea that makes everything else make sense.

AI-generated (NotebookLM) audio overview. Source: HexLocal in-house research — Research - What an AI Model Actually Is (AI Foundations, Ep. 1) (Dr. Priya Nair). Primary external sources include the OpenAI hallucination paper, Anthropic interpretability research, the peer-reviewed "Stochastic Parrots" paper, and current model provider documentation from OpenAI and Anthropic.

- A language model does one thing: predict the next token. It is not a database, not a search engine, and not a person who "knows" things.

- The model stores statistical patterns and relationships — not facts in a lookup table — which is why it can generate plausible-sounding answers that are simply wrong.

- Text generation is probabilistic sampling, not retrieval: the same prompt can produce different outputs, and there is no internal signal separating "confident" from "guessing."

- Hallucination is structural, not a bug awaiting a fix — it follows directly from how prediction works.

- What you actually use (ChatGPT, Claude) is a system built around a model: the raw model plus a system prompt, tools, retrieval layers, and guardrails.

- Get this mental model right and the rest of the AI Foundations curriculum lands; carry the wrong one and almost nothing sticks.