Data: From Business Records To Model Inputs · Lesson 17

How To Document And Govern AI Data

Governance connects meaning, decisions and operating responsibility to the actual data path. Documentation is useful when it helps someone act and verify the affected result.

Study And Save Progress

Watch The Lesson

6 min 36 sec

Read the video transcript

Our fictional returns assistant has an owner for its source policy, an operator for its index, and a team that answers customers. A policy correction exists upstream, but the request still uses the old version. Who has to decide, who has to act, and what evidence permits the affected service to resume? Governance becomes useful when those

responsibilities connect to the actual path. Data governance assigns decision rights, ownership, standards and accountability for data use. It should help people establish what exists, what it means, who may use it, how it changes and who resolves a problem. A policy without an operating responsibility leaves these questions unanswered. Define the responsibilities for the organization;

job titles alone cannot perform the work. A data owner can be accountable for the asset's intended use and decisions. A steward can maintain definitions, quality and day-to-day processes. Engineers implement movement, storage and technical controls. Domain experts clarify the business meaning, while security, privacy and legal specialists address their relevant requirements. Small teams can combine roles,

but a person needs clear authority and an escalation route for each responsibility. The UK government's data ownership model, published in April 2026, distinguishes owner, steward and custodian responsibilities in its public-sector context. It is an example for thinking about accountability, rather than a mandatory staffing chart for every company. In our service, the responsible owner establishes

the applicable use and who can approve resumption; the steward checks the policy meaning; the operator investigates the stale update boundary. Documentation should support those decisions. A catalog helps people discover the data and responsible contacts. A data dictionary defines fields, units, allowed values and business meaning. A dataset card explains how a collection

was created, its intended uses and limitations. Hugging Face's dataset-card guidance provides 1 concrete pattern. A card saying clean customer data gives little help with a real incident. For this returns collection, state its row grain, dates, population, sources, rights, target definition, annotation process, exclusions, splits, gaps, update process and accountable owner.

If a field called date could mean purchase time or processing time, the dictionary needs to settle that distinction. If the training split targets later unseen customers, the card should preserve the group-and-time claim and its limitations. Unknown information belongs on the investigation list. Gebru and colleagues' Datasheets for Datasets proposal, first posted in March 2018 and published in 2021,

asks creators to document a collection's motivation, composition, collection process and recommended uses. Its purpose is to improve communication between creators and users. Apply that idea to our card: a field saying only daytime requests were collected changes whether we can claim night-time coverage. The steward must mark that gap and seek a suitable test before expanding the claim.

A completed datasheet supports that decision; it cannot make missing observations appear. Return to the policy incident with supplied trace evidence. Request Q17 used V1, while the authorized source and its permitted extraction already contain V2. Under the fictional purchase-date rule, O101's June 10 purchase requires V2,

which applies from June 1. The stale boundary lies between extraction and the index used by the request. The technical cause remains unknown. The steward confirms the applicability and relevant exception; the operator investigates the job, publication or routing evidence; the owner coordinates the affected-use decision. A proposed recovery refreshes the intended

index and defines a new request test. Inspect the returned passage, version, exception and access behavior. A May purchase control still requires V1 under the same rule, so a blanket newest-version replacement could break another case. Keep the affected action held until the required evidence and responsible decision are established. A diagram or completed checklist does

not show that the test actually passed. Other changes need the same connection to operations. A schema change needs consumer compatibility and tests. A revoked permission needs the affected runtime paths restricted. A quality incident needs scope assessment and communication to relevant users. W3C's provenance model describes entities, activities and agents as a way to represent relationships;

recording those relationships does not prove truth, authorization or complete capture. Use the representation to support investigation and responsibility. Pause and restart with this question. Explain how a policy source reaches 1 assistant answer, naming the responsible source version, extraction, chunking, index, access filter, retrieval, model context, response and trace.

Where would an unowned step create a risk? Each step needs an accountable process that preserves the relevant identity and meaning. The source and applicable version feed permitted extraction and complete chunks; the index and access path select authorized evidence for the request; the model uses that context and the response keeps its trace.

An unowned update or control can leave stale or unauthorized information in use. The trace helps locate the failure, while recovery still requires evidence and a responsible decision. For practice, assign responsibilities for a correction and complete a small dataset-description record with unknowns marked. Then trace the request across the 4 data roles developed in this course: training, independent evaluation,

runtime evidence and application state. Keep their update, access and testing rules distinct. You can now explain how business representations become inputs, what can be lost or distorted along the way, and who must act when the result is unsuitable. Use that explanation to build the project architecture and test packet, rather than beginning with a list of products.

Main Point

Governance connects meaning, decisions and operating responsibility to the actual data path. Documentation is useful when it helps someone act and verify the affected result.

Key Points

1. Assign work on the same incident

The supplied fictional Q17 trace uses V1 while authorized source/extraction V2 are present. O101's 10 June purchase requires V2 under the rule V1 through 31 May/V2 from 1 June. The stale boundary is extraction-to-request-facing index; its technical cause is not supplied.

The steward confirms policy meaning and exception. The operator investigates indexing, publication and routing evidence. The accountable owner coordinates the affected-use decision and appropriate specialists. A planned rerun should inspect version/passage/exception/access for O101 and preserve the May-purchase V1 control. No actual recovery or approval is supplied.

UK government's data ownership model, 16 April 2026, distinguishes owner/steward/custodian responsibilities in government. Use its mechanism of accountability thoughtfully; a private organization can assign roles differently. [UK-OWN]

2. Make a description usable

A catalog locates assets and contacts. A dictionary defines the grain, units, fields and conventions. A dataset card records creation, intended use, limitations, rights and other relevant context; Hugging Face provides a practical pattern. [HF-CARD]

For this course's returns data, include population/dates, source versions, label guide, exclusions, partition rules, known gaps, updates and owner. Mark unknowns. The project supplement's 68/17 split describes a hypothetical joint later/unseen-customer task with checkout inputs and mature 30-day outcomes; it is not evidence of actual quality or performance.

3. Connect change to controls

Schema changes affect consumers; policy corrections affect index/applicability; permission changes affect runtime access; incidents require scope and communication. W3C PROV-O's entity/activity/agent relationships provide a formal provenance representation. They do not certify accuracy, rights or complete lineage. [W3C-PROV]

The worksheet supplies a fillable incident assignment and dataset-description outline. Resolve unknowns through named owners and evidence. Finish by separating training, independent evaluation, retrieval and application state in the architecture; the same source may support distinct authorized uses through different processes.

4. A dated example

Gebru and colleagues' Datasheets for Datasets proposal, first posted in March 2018 and published in 2021, asks creators to document a collection's motivation, composition, collection process and recommended uses. Its purpose is to improve communication between creators and users. Apply that idea to our card: a field saying only daytime requests were collected changes whether we can claim night-time coverage. The steward must mark that gap and seek a suitable test before expanding the claim. A completed datasheet supports that decision; it cannot make missing observations appear.

5. Bringing the lesson together

The opening stale-policy incident now has named decisions, operators and expected verification evidence. Your project can connect source meaning, transformations, data roles, permissions and accountability in one usable architecture.

Learning Checks

Attempt each answer before expanding the reasoning.

M13-L17-Q01

Explain how a policy source reaches one assistant answer, naming the responsible source version, extraction, chunking, index, access filter, retrieval, model context, response and trace. Where would an unowned step create a risk?

Show reasoning

Each step needs an accountable process that preserves the relevant identity and meaning. The source and applicable version feed permitted extraction and complete chunks; the index and access path select authorized evidence for the request; the model uses that context and the response keeps its trace. An unowned update or control can leave stale or unauthorized information in use. The trace helps locate the failure, while recovery still requires evidence and a responsible decision.

Sources

Learner Materials

Download Lesson 17 Learner Materials

Use the supplied fictional cases and templates for practice.

Practice

Write your answer, compare it with the model answer and decide what to revisit. These written checkpoints are self-assessed.

Pause and restart with this question. Explain how a policy source reaches one assistant answer, naming the responsible source version, extraction, chunking, index, access filter, retrieval, model context, response and trace. Where would an unowned step create a risk?

Show The Model Answer

Each step needs an accountable process that preserves the relevant identity and meaning. The source and applicable version feed permitted extraction and complete chunks; the index and access path select authorized evidence for the request; the model uses that context and the response keeps its trace. An unowned update or control can leave stale or unauthorized information in use. The trace helps locate the failure, while recovery still requires evidence and a responsible decision.

Compare your reasoning with the model answer. These written checks are self-assessed.

Open Practice And Save Your Work