DECLASSIFIED · NRG / DFA / EX-26.06 · READING COPY · DISTRIBUTION C
METHOD · Numbers, bias, self-correction EX-26.06 · Standing reference
Method · How the federation handles being wrong

Numbers, bias, and self-correction

Most of what makes this exercise unusual isn't the scenario. It's the rules the federation follows to keep itself honest. Every estimate is a range. Every specialist declares their own blind spots. Bias warnings carry forward turn after turn, and the federation is required to actually move its estimate when a bias is identified — not just write the warning down. At turn 6, the federation added a protocol item (the "modal-hold review") that asks once a turn whether the questions being tracked are still the right ones. Across turns 7 through 10 the review produced three new tracked variables, one retired variable, two variable splits, and a full taxonomy reconstruction. Several of those changes revealed structural features that had been hidden by the old framing.

The format: [low, best guess, high]

Three numbers, not one. The middle is the best guess. The outer two are the realistic floor and ceiling. Wider gap means more uncertainty. The bar visualizes the range; the marker shows the point estimate.

Narrow range

US–Israel formal alliance, T0 baseline
65% 78% 88%

Lots of historical data; the model fits the situation well.

Wide range

Civilian fatalities during the turn-5 interval
180 980 3,800

Right-tail risk from cluster events the federation can't model precisely. The honest answer is "somewhere in a big range."

Three different kinds of doubt, tracked separately

Confidence isn't one thing. The federation tracks three flavors on every estimate:

The federation failure mode

The thing the protocol guards against most carefully: when multiple specialists share the same blind spot, the whole federation can do worse than a single skeptical analyst would. If three different specialists are all biased upward on US institutional resilience for the same structural reason, the federation will produce three independent-looking estimates that are all wrong in the same direction. It looks like convergent evidence. It isn't.

The bias the federation took ten turns to move

Upward bias on US institutional resilience got flagged from turn 0. Across the first seven turns the federation widened its uncertainty ranges in the bias direction but didn't actually move the central estimate. CASS pointed this out at turn 6 as exactly the decorative- warning failure mode the protocol is designed to catch. The bias finally moved at turn 7 (the president's survival estimate came down from 70% to 55%) and again at turn 8, and the corrections kept coming through turn 10. The lesson the federation logged: writing down a bias warning is the easy part. Acting on it is the part that takes seven turns of stress events to actually force.

The modal-hold review (new at turn 6)

A protocol item that asks once a turn: which variables are we still tracking just because they were load-bearing two turns ago and nobody re-checked? Which of our framing assumptions are still shaping our estimates even though we wrote down a warning we never acted on? Which of our headline questions have become irrelevant to what's actually happening?

What it produced, turn by turn:

"Falsifies-on" hooks (new at turn 7)

Every major estimate from turn 7 onward carries a list of conditions that would force the federation to re-estimate. Example, for "the president stays in office through January 2029":

Each hook also has a half-life: even if nothing visibly happens, the estimate has to be re-elicited after some interval. The point is to catch the drift that happens when nothing visibly moves but the underlying conditions have shifted anyway.

The federation's own report card, every turn

Every briefing closes with a section called "federation failure mode check." It carries forward the biases flagged in earlier turns, marks which have been addressed and which are still active, and adds any new ones. By turn 10 the list of carried failure modes included: