agentsQ6to verify
Song, Agarwal, Wen 2024 — GitHub Copilot increases project-level open-source code contributions by 5.9%
A project-level study using proprietary GitHub Copilot usage data finds that Copilot adoption is associated with a 5.9% increase in open-source code contributions — a much smaller effect than the 55.8% controlled-task speedup, and consistent with a 'compressed generation cost + expanded governance cost' story rather than a pure productivity story.
Project-level change in open-source code contributions associated with Copilot usage+5.9% in code contributions at the project level
- Sample
- Project-level analysis using proprietary Copilot usage data; exact project N not extracted to verification.
- Methodology
- Econometric analysis of project-level contribution metrics using proprietary GitHub Copilot usage data, with adoption-vs-non-adoption comparisons.
What this means
- Field-setting effect (+5.9% project contributions) is roughly 1/10th the controlled-task effect (+55.8% time-to-completion) — a striking gap that any honest productivity synthesis must surface.
- Implies that the bottleneck in collaborative OSS work is not raw code-generation but the surrounding governance (review, integration, attribution, maintainer attention) — generation gains do not translate proportionally to contribution gains.
- Supports the institutional-economic prediction that AI compresses some transaction costs (generation, drafting) while amplifying others (governance, validation, attribution).
Source
SSRN working paper (Song, Agarwal, Wen) · Fangchen Song et al. · 2024 · peer-reviewed
Context
- What came before
- The 55.8% controlled-task speedup result (Peng et al. 2023) had become the implicit baseline for Copilot productivity expectations. Field-setting evidence was thinner.
- What comes next
- Verify exact project-N and effect-size estimate. Pair with the 'Vibe Coding Kills Open Source' theoretical model + Cito & Bork polluted-well argument — the +5.9% short-run gain must be evaluated against the second-order substrate-quality dynamics.
- Where this lands
- Encyclopedia Part I §1.3 (methodology gap — controlled vs naturalistic), Part IV (product/operations), Part VII (network-mediated adoption — OSS contribution dynamics).