Main Point
Judge the completed work and the effort needed to make it usable. Submit a checked deliverable, an inspectable evidence record and a limited recommendation about the method you actually tested.
Key Points
- Define success before drafting and preserve the supplied fictional sources.
- Include preparation, checking, correction and delivery in your effort record.
- Compare quality under stated conditions; record case differences and method order.
- Meet every rubric minimum and every critical safety and verification gate.
- A supported choice to use a manual route can satisfy the project.
1. Begin with a decision someone needs to make
A manager receives an attractive update quickly, then discovers an unsupported deadline and a calculation needing repair. Evaluating only the first draft misses the work required to make the update usable. This project asks whether the complete method should be reused, revised or replaced with a manual route.
A capstone is an independent task that combines the course skills. A baseline is the process and result used for comparison before a proposed change. Acceptance criteria are observable conditions the completed result must meet. Total task effort includes preparation, tool or manual work, checking, correction and final delivery.
Before starting, state the audience, required result, evidence, permitted tools and actions, reviewer and completion criteria. Keep any message unsent and system changes simulated. Use the supplied fictional sources or information explicitly approved for the actual account and tool. The project requires no purchase or connection to real customer systems.
2. Use the new Cedar Learning Events source pack
Cedar Learning Events is a fictional workshop provider. Its two source packs contain different booking records, export notes and commitments. They are new assessment tasks; the Harbor examples taught earlier do not supply their answers.
Each pack includes nine raw export rows and a note confirming one repeated export. Preserve the original rows and identify the eight unique records in your analysis. Keep the unconfirmed refund count visible. A blank refund count means unknown; it gives no basis for treating the count as zero.
| Source element | What to establish | Evidence to retain |
|---|---|---|
| Booking records | Period, places, USD price and refund count | Record ID and referenced cells |
| Export note | Which repeated export is confirmed | Exact note and reconciliation |
| Measure definitions | Gross and simplified refund-adjusted scope | Units, operations and exclusions |
| Commitment notes | Task, responsible role and its own date | Note ID and matching fields |
| Task brief | Audience and output requirements | Assigned track and acceptance criteria |
Gross booking value is places multiplied by USD per place before refunds. The supplied simplified refund-adjusted measure subtracts refunded places multiplied by that record's price. It excludes other business costs and taxes. An incomplete input can leave the complete adjusted result unresolved even when gross value is calculable.
3. Choose a useful output format with common evidence
Choose a manager briefing, an inspectable spreadsheet with a short business note, or an unsent follow-up communication. Each track must carry the same checked comparison, missing-input qualification and actual source commitments. Supply the common evidence sheet so the assessor can inspect essential reasoning across formats.
Use the assigned length and audience requirements. Check periods, units, arithmetic and the base of any percentage. References should lead to the relevant record or note. Clearly identify proposed work and unagreed responsibility or dates. If you use a chart, provide a readable scale and an equivalent text explanation; a simple table is also suitable.
Tool count and decorative complexity do not establish quality. A concise, accurate manual output can meet the same standard.
4. Plan a comparison the evidence can support
Agree the task packs and method order with the assessor before starting. Record which pack and method are first. Learning the answer during a first attempt can help a later attempt. Different source packs can also differ in difficulty. These limitations remain relevant even when their structures are similar.
Use the same stated time basis for the compared routes:
- Active working time: time spent working on the task.
- Elapsed time: time from the stated start to finish, including included waiting.
Record preparation, manual drafting or instruction writing, tool waiting, checking, correction and packaging. Mark clock measurements, later estimates and missing components separately. Preserve unknown entries.
If an approved assistant is unavailable, the assessor can supply an explicitly authored draft-review simulation after the baseline attempt. It allows practice in checking and correction. Its generation effort is unmeasured, so it cannot establish actual AI drafting time or a complete AI value comparison. State which routes were actually tested and the limits of any simulation.
5. Worked example: a quick draft and the whole effort
The following times are illustrative and separate from the Cedar project results.
| Included work, minutes | Manual route | Other route |
|---|---|---|
| Preparation | 3 | 4 |
| Drafting / instruction writing | 8 | 2 |
| Waiting for draft | 0 | 1 |
| Checking | 5 | 7 |
| Correction | 2 | 6 |
| Elapsed total on this stated basis | 18 | 20 |
Manual total: 3 + 8 + 5 + 2 = 18 minutes. Other-route total: 4 + 2 + 1 + 7 + 6 = 20 minutes. The other route takes 2 minutes longer in this illustration. Its one-minute draft wait supports no conclusion about a whole-task saving by itself.
Also assess both final outputs against the same criteria. If a result is clearer or easier to use, retain evidence for that observation separately. Identify included costs, such as an incremental charge, and unknown costs, such as unmeasured staff effort. Monetary savings require an agreed valuation and appropriate supporting evidence.
6. Make checks and corrections reproducible
Keep source identity, instructions, tool or manual steps, draft versions, checks and the final output. For an important number, record separate arithmetic and compare the relevant source cells. For a copied formula, inspect the selected row and the last copied formula. For commitments, compare task, owner and date with the same source note.
A correction log should identify:
- The observed defect and affected version.
- The source or independent test exposing it.
- The change made.
- The checks repeated and their result.
- The remaining limitation or next decision.
When no defect is observed, record that result and the checks performed. Additional tasks or changed sources can test transfer. Keep conclusions within the tested cases.
7. A documented real evaluation example
In its 16 March 2026 account of testing GOV.UK Chat, the UK Government Digital Service describes assessing accuracy, reliability, speed, safety and user trust through several research methods. The account includes task-based work and human review. It illustrates a multidimensional evaluation approach.
The Cedar exercise is a small classroom comparison supporting a limited local decision. It provides no replication of the GDS research and transfers none of that service's measured outcomes to a learner's workflow. Tool and service availability can change; this dated example makes no account-access promise.
The Magenta Book's AI-intervention guidance also discusses comparison conditions, baselines and evaluation limitations. A rigorous causal impact study requires suitable design and expertise. Record the limitations of this project clearly.
8. Apply the rubric and critical gates
The rubric has six dimensions, each scored from zero to four:
| Dimension | Evidence of the required standard |
|---|---|
| Task and acceptance criteria | A useful question, audience and observable success conditions |
| Safe data and tool choice | Approved fictional or permitted information, appropriate access and action limits |
| Verification | Inspectable source matches, independent arithmetic, preserved unknowns and output checks |
| Deliverable quality | Accurate, usable, audience-appropriate and accessible work |
| Whole-task value | Comparable baseline and complete effort record with measured/estimated/unknown distinctions |
| Judgment | Documented corrections, remaining limits and an evidence-based reuse, revise or manual decision |
Every dimension must reach at least 3 with inspectable evidence. All critical gates must also pass: no unapproved real data or credentials, unauthorized sending or system change, unresolved critical claim presented as established, or fabricated results or savings. A high total cannot offset a failed gate.
Submit your attempt before opening the assessor's ground truth. A separate reviewer applies the rubric, explains any needed revision and records the evidence for the final version. The learner-visible standards and assessor-only explanation are separate materials.
9. Practice: complete the evidence bundle
Use MAT18's independent project and assigned source pack, MAT19's baseline-and-value log, and MAT20's rubric/evidence bundle.
- Agree track, pack order, method, time basis, permissions and reviewer.
- Preserve the source and perform the baseline attempt.
- Complete the comparison route or explicitly bounded simulation.
- Submit source references, calculations, instructions, drafts, observed checks and corrections, final output, effort/cost record and recommendation.
- Obtain independent assessment and revise any failed criterion or critical gate.
Keep assessor answers separate until submission. Make a recommendation that explains both demonstrated benefits and the remaining uncertainty.
10. Learning Checks
PRACTICAL-AI-WORK-L08-Q01
A team records assisted draft-generation time but omits preparation, checking and correction. Its outputs have not been checked against the same criteria. What would make this a useful value comparison? Attempt an answer before opening the explanation.
Show answer and explanation
Use comparable task and quality conditions and include preparation, tool or manual work, checking and correction. State the time/cost basis and separate measured observations, estimates and unknowns. Check final outputs against the same criteria. Record method/task order and case or learning differences. Make a limited recommendation from those observations. A quick first draft alone provides incomplete whole-task value evidence.
PRACTICAL-AI-WORK-L08-Q02
A project has a high total score, but an important calculation is unsupported and the final output presents it as established. Can the project pass on its total? What should happen next? Attempt an answer first.
Show answer and explanation
Revise the project. Every rubric dimension must meet its minimum and all critical gates must pass. Correct the claim or retain it explicitly as unresolved, provide its source and independent check, and resubmit affected work. The assessor records the evidence and decision for the revised version. The total cannot compensate for a failed critical verification gate.
Sources and scope
Checked 24 October 2026. Source claims are dated; Cedar data, effort examples and authored simulation drafts are fictional teaching materials.
- GDS: 5 things we learned testing GOV.UK Chat, 16 March 2026
- Magenta Book: Guidance on impact evaluation of AI interventions, updated 15 May 2026
- NIST AI Risk Management Framework: context-sensitive testing and documented limitations; a classroom rubric supplies no certification.