Foundation Models: Tokens, Attention, And Generation · Lesson 14

How AI Uses Extra Computing To Reason

Extra answering-time work is useful when a defined proposal/checking process improves relevant results within the task’s resource and authority constraints. Evaluate behavior rather than infer quality from explanation length.

Study And Save Progress

Watch The Lesson

6 min 57 sec

Read the video transcript

A team receives a long, confident answer to a seating calculation. It asks for 12 groups of 18 seats, with 24 seats reserved. The answer says 204 seats remain. Would a longer explanation make that result more dependable? Follow a proposed answer,

a check against the task, a comparison of outcomes, and a resource budget. The useful change is an improvement we can inspect under the conditions in which the result will be used. First define the behavior the task requires. Here the arithmetic is 12 times 18, giving 216 seats,

then subtract 24, leaving 192. The proposed 204 is a supplied wrong answer. We have not run a model to produce or correct it. An explanation can be long and still contain this error. For this task, a successful result

includes the right calculation and an interpretable connection to the supplied reservation rule. Inference-time computation is work done while answering. A system can generate intermediate tokens, propose several candidates, search possible steps, call a tool or check a result. Ordinary extra answering work can use fixed learned parameters.

Training changes parameters under a learning procedure; the additional computation in this seating example need not perform such an update. More work can therefore alter the response process without creating a newly trained model. Consider a proposed checking path. Candidate A says 204 seats and candidate B says 192.

A permitted calculator computes 12 times 18 minus 24 and returns 192. A comparison can reject A's arithmetic and retain B's compatible result. The candidate outputs and checker response are a classroom construction. The important relationship is visible: the check tests a specified part

of the answer against the task, rather than choosing whichever explanation sounds more confident. A checker also has a scope. Correct arithmetic does not establish that all 216 seats exist, that the reservation is authorized or that another safety constraint was omitted. Those facts need appropriate evidence.

A search tool can bring in current material, and code execution can test a specified candidate. The system must select a suitable tool, provide the right input, interpret its output and respect the application's action permissions. Generating several answers also does not guarantee an independent check.

Candidates can repeat the same misconception or copy an unsupported assumption. Counting their agreement can amplify a shared error. Define what the verifier actually tests, and inspect remaining failure modes. For the seating task, comparing each calculation with the supplied quantities is useful;

a majority of unverified 204 answers would still be wrong. The DeepSeek-R1 paper, first released in January 2025 and revised in January 2026, supplies a dated research case. Its R1-Zero training used rule-based rewards for verifiable mathematical, coding and logical tasks, with accuracy and format feedback.

This is evidence about a particular reinforcement-learning program. It helps explain the value of a defined correctness signal, while remaining distinct from our fixed-parameter answering-time checker. An explanation shown to a user can provide checkable solution steps, assumptions and source evidence.

It need not be described as a complete faithful transcript of internal computation. For our example, showing 12 times 18 equals 216 and 216 minus 24 equals 192 makes the calculation inspectable. A polished rationale alone cannot establish that every internal decision or external assumption was correct.

Now compare resource budgets using hypothetical results. On a specified test set, approach A solves 80% of cases in 2 seconds each; B solves 90% in 20 seconds each. B has a 10-percentage-point higher success rate and takes 10 times as long under these supplied conditions.

The figures are an illustration, not reported DeepSeek results or a measurement we performed. A decision requires the task's deadline, value and consequences of failure. For an interactive preview that must arrive within 3 seconds, the 20-second route misses the stated deadline. For an asynchronous review where an error

is costly, its additional success may justify the delay if the test is relevant. Include actual resource cost, failed attempts, retries and human review in that comparison. Define a useful correct result and the workload before deciding that extra computation is worth spending. Pause at the 80%-in-2-seconds

versus 90%-in-20-seconds illustration. What evidence would support a claim that B's extra computation is useful for a particular task? Explain why the longer answer itself is insufficient, and identify the time tradeoff. We need a controlled comparison on relevant cases, with correctness criteria, failure types,

time and cost measured under stated conditions. The supplied success difference is 10 percentage points, with 10 times the time per case. Whether that is useful depends on the deadline and failure consequences. Response length alone does not demonstrate correctness or justify the extra resource use.

Try a new evaluation design. A scheduling assistant can propose 3 plans and use a rule checker for room capacity and time conflicts. Describe a comparison with its unchecked route while holding the relevant model, inputs and task cases constant. Which outcomes should remain blank until

the test runs, and what would you check before allowing an automatic booking? Compare plan validity, failure categories, latency and resource cost under the defined workload and budget. Record the checker rules and any permitted differences in generation settings or candidate count. Keep observed success,

time and cost blank until measured. Before booking, confirm action permission and the applicable schedule and capacity evidence. A valid-looking proposal or available tool does not authorize the action. Extra computation earns its place when an appropriate comparison shows a useful change within the task's constraints.

You can now distinguish a proposal, its verifier, an explanation and an authorized action without treating length as evidence. The next lesson turns from work during an answer to planning the model size, training data and compute used to create the learned parameters.

Main Point

Extra answering-time work is useful when a defined proposal/checking process improves relevant results within the task’s resource and authority constraints. Evaluate behavior rather than infer quality from explanation length.

Key Points

1. Make the proposal inspectable

The supplied task has 12 groups of 18 seats and 24 reserved seats. Candidate A proposes 204 remaining seats; candidate B proposes 192. The arithmetic check is:

`12×18=216`

`216−24=192`

The checker can reject A’s arithmetic and retain B’s compatible result. These candidates and the check are classroom illustrations, not recorded model/tool runs. The result does not verify that the seat inventory is correct or that the reservation is authorized.

2. Separate inference work from learning

While answering, a system can generate intermediate tokens, sample candidates, search, call a permitted tool or verify a result. These processes can use fixed learned parameters. Training updates parameters under its learning procedure.

Extra candidate sampling is not an independent verifier. Candidates may share the same unsupported assumption; a majority of wrong 204 answers would remain wrong. Inspect what the checking operation tests and what its inputs establish.

3. Read a bounded primary research case

The DeepSeek-R1 report, initially released 22 January 2025 and revised 4 January 2026, describes R1-Zero’s rule-based reinforcement-learning rewards for verifiable mathematical, coding and logical tasks. Accuracy and format provide defined feedback. This training program illustrates the importance of a specified correctness signal; it is separate from the fixed-parameter seating checker.

No benchmark ranking, current product capability or guarantee from longer responses is inferred from this case.

4. Explain the system boundary

A calculator can check a calculation; search can provide material; code execution can test a candidate. The system must use the appropriate tool, provide correct inputs and interpret the returned evidence. The application still controls whether any external action is authorized.

Showing `12×18−24=192` provides reproducible reasoning for the supplied arithmetic. It does not establish every external premise or reveal a complete faithful transcript of internal computation. Keep checkable steps, source evidence and assumptions visible.

5. Compare a hypothetical resource tradeoff

ApproachSuccess on the stipulated casesTime per case
A80%2 seconds
B90%20 seconds

The difference is 10 percentage points; B takes 10 times as long. These are supplied hypothetical values, not DeepSeek results or observations from an experiment performed here.

A 3-second interactive deadline rules out the 20-second route under these timings. In asynchronous review, the additional success may justify delay if the test is relevant and failure is costly. Include actual resource cost, retries, human review and failure consequences. Different workloads may support different choices.

6. Design evidence before choosing a budget

Hold the relevant cases, model and inputs constant when comparing a defined extra-work route with a baseline. Record candidate counts, checker rules and any permitted configuration differences. Evaluate correct useful results and failure types, with time and cost under the stated workload.

Observed results remain blank until the test runs. This lesson authorizes no experiment or booking.

7. Closing

You can follow proposal → specified check → outcome comparison → resource decision, while keeping an authorized action separate. Next, examine the size, data and compute tradeoffs involved in training the model itself.

8. Learning Checks

Attempt the questions before opening the explanations. Use the blank worksheet to specify your comparison.

M14-L14-Q01

In a hypothetical relevant test, A solves 80% of cases in 2 seconds each and B solves 90% in 20 seconds each. What evidence would support choosing B for a particular task? Quantify the success/time tradeoff and explain why a longer answer alone is insufficient.

Your explanation/design: ____________________

Show explanation after your attempt

B has a 10-percentage-point higher success rate and takes 10 times as long under the supplied conditions. A useful claim needs a controlled comparison on relevant cases with correctness criteria, failure types, latency and resource cost recorded. The choice also depends on deadline, failure consequences, retries and human review. A 20-second route misses a 3-second deadline. Response length alone establishes neither a correct result nor a worthwhile resource tradeoff.

M14-L14-P01

A scheduling assistant can propose 3 plans and use a rule checker for room capacity/time conflicts. Design a comparison with an unchecked route, holding relevant model, input and task cases constant. Which outcomes remain blank until the test runs? What must be checked before an automatic booking?

Your explanation/design: ____________________

Show explanation after your attempt

Define case validity rules and compare plan correctness/failure categories, latency and resource cost under a stated workload and budget. Record checker rules and candidate-count/settings differences rather than treating them as hidden constants. Leave observed success, time and cost blank until measured. Before booking, verify action permission and applicable schedule/capacity evidence; tool availability or a proposed plan does not authorize the action.

Sources

Learner Materials

Download Lesson 14 Learner Materials

Use the supplied fictional cases and templates for practice.

Practice

Write your answer, compare it with the model answer and decide what to revisit. These written checkpoints are self-assessed.

In a hypothetical relevant test, A solves 80% of cases in 2 seconds each and B solves 90% in 20 seconds each. What evidence would support choosing B for a particular task? Quantify the success/time tradeoff and explain why a longer answer alone is insufficient. Your explanation/design: ____________________

Show The Model Answer

B has a 10-percentage-point higher success rate and takes 10 times as long under the supplied conditions. A useful claim needs a controlled comparison on relevant cases with correctness criteria, failure types, latency and resource cost recorded. The choice also depends on deadline, failure consequences, retries and human review. A 20-second route misses a 3-second deadline. Response length alone establishes neither a correct result nor a worthwhile resource tradeoff.

Compare your reasoning with the model answer. These written checks are self-assessed.

A scheduling assistant can propose 3 plans and use a rule checker for room capacity/time conflicts. Design a comparison with an unchecked route, holding relevant model, input and task cases constant. Which outcomes remain blank until the test runs? What must be checked before an automatic booking? Your explanation/design: ____________________

Show The Model Answer

Define case validity rules and compare plan correctness/failure categories, latency and resource cost under a stated workload and budget. Record checker rules and candidate-count/settings differences rather than treating them as hidden constants. Leave observed success, time and cost blank until measured. Before booking, verify action permission and applicable schedule/capacity evidence; tool availability or a proposed plan does not authorize the action.

Compare your reasoning with the model answer. These written checks are self-assessed.

Open Practice And Save Your Work