Skip to content

The three states and the safety budget

Below shows how regime splits into three states (world, epistemic, resource) alongside the safety budget & its interactions with the regime. Click on the displayed boxes to view inside.

World stateWhat is control actuallyworth here?– what the model is like– how capable it is– how checkable research is– what has happened so farEpistemic stateWhat do we justifiablythink it's worth?– confidence in alignment– interpretability findings– the track record– evaluation resultsResource stateCan we afford to acton what we think?– political will — the account– price: usefulness tax– price: compute– price: delaymeasured ≠ actualthe accountPolitical willstaff · public · governmentthe aisles — the regime sets prices$usefulness taxspent from political will$compute · internal politicsspent from political will$delay · the racespent from political willthe basket — a techniquecontrol's baskettaxcomputedelayincidents & evidencepublic buy-inpassed policy

1. World state

A regime can be split into three parts that behave very differently. The first is the world state: the facts on the ground, both known and unknown.