One architecture decision, a fifth of the context
The setting: a live system with 10 years of production data and traps that exist nowhere in the code — a database whose latin1 columns deliberately hold UTF-8 bytes, passwords still on MD5 because a legacy reader depends on them. Exactly the kind of system where a confident newcomer is dangerous.
An AI session cold-started with nothing but the spec folder. It read about ten spec files — roughly 15k tokens — and from that alone assessed a proposed chat feature, settled its architecture, and wrote two new specs plus a migration. It never opened a single source file.
The session's own estimate for reaching the same understanding from raw source: 50–100k+ tokens and several extra rounds of tool calls — and some questions it would have answered wrongly, with confidence, because the facts simply aren't in the code.
HONESTY BOX
Self-reported by the session, one data point, not a benchmark. The gap is the point, not the precision.