Smart Brevity

Smart Brevity

By JamiepluscoffeeBusinessCareers
Download on the App Store

Smart Brevity episodes

  • Smart Brevity 7: Score the net, not the gross: memory, training data, and benchmarks judged against the plain baseline
    Score the net, not the gross: memory, training data, and benchmarks judged against the plain baseline; Memory tax: agent memory must beat naive RAG over raw history, and often does not.; Benchmarks as difficulty measures: measure mismatch and coverage gaps hide what a score really says.; Decision grounding: train only on actions the agent could justify from what it saw.; Turn-level credit assignment: agents decide in turns, so RL should assign credit per turn.; Interface lock-in: fine-tuning one answer format improves only that readout.; Decision models as routing economics: send yes/no agent steps to cheap typed-answer models.; In-situ interventions: a few dozen examples
    9 min
  • MailDump 11: Thirteen Out of One Hundred
    Why coding agents ace the benchmark and flunk the job, what happens to content when the reader is an agent, three ways to handle a tax-loss problem, dosing versus rewriting aging, how early hires get picked, and an archive thread on engaging versus excluding in conservation.
    8 min
  • Smart Brevity 5: Guarantees come from structure, not from asking nicely
    Guarantees come from structure, not from asking nicely; Waypoint-gated distillation: transfer only the RL shifts that early and late training agree on; Decision-native models: null-aware, order-proof, scalable, and cacheable by construction; Thinking inertia: no-think switches leak reasoning, so measure answer-only compliance; Demo versus delivery evals: held-out acceptance, business-uplift scoring, priced clarifying questions; User-modifiable harnesses: users edit the agent loop, subagents, and routing; Cache-aware economics: stable prefixes first, judge models by cost per completed task
    9 min
  • Smart Brevity 4: The signal is narrower than it looks: recency posing as memory, failures that teach, less supervision that wins
    The signal is narrower than it looks: recency posing as memory, failures that teach, less supervision that wins; Memory-need stratification: pooled memory scores mostly measure recency; Memory framing: calling context "memories" changes how often it gets used; Hindsight-to-foresight distillation: failed runs teach when group rewards are flat; Reliability over coverage: distill only where tokenizers align cleanly; Experience retention: raw logs versus summarized playbooks for learning agents; Cheap discriminative judges for closed-answer evals at volume; Brain and hands split: editable harnesses, cloud reasoning, device actions; Action gating: approval policy plus readable
    8 min
  • MailDump 9: Colleges Close, Solar Goes Red, and Who Checks the Work
    American colleges are closing on arithmetic, not AI. Solar booms in the reddest states for business reasons. Private ownership explains more of the top one percent than its reputation suggests. Plus the offices and software seats that headcount no longer fills, cheap thinking versus costly experiments, and who checks AI's work. From the archive: speed in founder writing.
    8 min
  • Smart Brevity 3: Your training signal has a shape, and it can lie: who teaches, how loudly, and who checks
    Your training signal has a shape, and it can lie: who teaches, how loudly, and who checks; On-policy distillation scaling: small RL teachers can lift bigger students past themselves; Multi-teacher distillation: normalize each teacher's feedback spread or the loudest domain wins; RIDE: extrapolate the RL direction in hidden states, not in word probabilities; Co-cheating: self-play loops reward shared errors; cross-fitted graders break the echo; Decision models: calibrated classifiers as cheap routers and eval judges; UCB tree search over experiment notebooks, and the reward hacking it invites; Environment interaction shape decides what skills transfer; Cost per completed t
    8 min

About Smart Brevity

From the publisher's feed

My way of learning