Validation
Open a model's validation record from Verify, read its checks by Data, Functionality and Results, and re-run them when the model changes.
Where: Models→a model→Scenarios→Base→Verify→Open the validation report to see and fix the failing rules
Every model carries one validation record. It answers three questions separately: is the data sound, does the model do what you asked, and are its results right. It never presents an out-of-date answer as a current one. You open it from Verify: when not every validation rule passes, the Checks section offers Open the validation report to see and fix the failing rules, which closes Verify and opens the Validation drawer.
Open the record
The Validation drawer opens on the right with the model's name (Running instant checks… first). Press Esc, click outside it, or click Close to close it.
The drawer's footer notes: "“Run checks” reads the last solve. Nothing is solved again."
If the checks ran on an older revision, the top of the drawer says so: "Checks ran against rev 4; the model is at rev 6. Run checks to refresh."
Read the badge
Beside the drawer's title and the model's name, a badge gives the record's verdict:
| Badge | Means |
|---|---|
| Validated | Every check that ran passed. |
| Warnings | Something needs a look; nothing is blocking. |
| Not passing | At least one blocking finding. |
| Stale | Some checks ran on an earlier revision. |
| Not validated | Nothing has run yet. |
A pass never reads as complete while something is outstanding: each pillar below counts what still needs review. Any change to the model turns the record stale straight away.
Read the three pillars
| Pillar | Asks |
|---|---|
| Data | Is the data loaded and consistent? |
| Functionality | Does the model do what you asked for? |
| Results | Are the results sound? |
Each pillar has its own verdict and a summary: N checks · N blocking · N warnings · N need review · N stale, or no checks have run. A stale pillar adds ", stale (model changed since)" and a Stale pill. need review counts checks that haven't run as well as checks no machine can verify. Failing pillars open; the others start closed, and eode remembers which you opened in this browser. An empty pillar reads "No data checks have run yet. Use “Run checks” above."
Read a check
Each row shows an icon, the check's name, a small tier chip for how costly the check is to run, and either N findings or its status. Failing checks sort first and open by themselves; click any row to open it. Hover a row and click ▶ ("Re-run this check") to re-run that one check.
| Status | Means |
|---|---|
| pass | Passed. A passing check shows No findings. or its own message. |
| failing | Has findings. A red mark means blocking; a triangle means a warning. |
| needs review | No machine can check this; a person has to. |
| stale | Ran on an earlier revision. |
| pending | Hasn't run. |
| skipped | Doesn't apply to this model, or couldn't run, for example because an input is missing. |
| check crashed | The check itself errored, rather than quietly passing. |
An open check lists its findings: where (sheet · row N · column), what's wrong, and a suggestion on its own line. After 25 it adds + N more.
| Pillar | Checks |
|---|---|
| Data | Data validation rules, Table contracts, Imported artifact sanity |
| Functionality | A structural check of the model, and a check that each capability the model claims really engages when it solves. |
| Results | Structural invariants, Revenue KPI cross-check, Verified since last change, Workbook reconstruction fidelity, a rating of the quality of the solve, a check that traces the results back to your data, and two checks that solve again: Results still hold after changes (fresh solve) (Verify again) and the limits check (Which limits hold you back?, below). |
Run the checks
The buttons in the drawer header:
| Button | Does |
|---|---|
| Run checks | "Re-run the instant + cached-solve checks (no re-solve)." Runs in the background; each row updates as it finishes. Recorded in the audit log. |
| Which limits hold you back? | Solves the model once more and reports which of your limits actually hold the plan back, and which cost nothing. |
| Ask RIA to help fix these | Shown when a check is failing or crashed. Puts "Help me fix these failing validation checks:" and the failing checks in the message box of the conversation beside the scenario, ready to send, and closes the drawer. |
Which limits hold you back? is disabled while another run is in progress.
Verify again after a change
When the model's structure changed after it was last verified, the drawer opens with a banner: "This model has changed since it was last verified." and Verify again ("Solves the model again and checks its results still match what was recorded when it was built").
Verify again solves the model once and runs Results still hold after changes (fresh solve). The result reads "Verified again: N of M checks hold on the current model, against the results recorded with your data." (or with sample data). A check that no longer holds says so, with the suggestion: "If you meant to change this, load your data again to record the new expected results. If not, the model no longer does what it was built to do." Imported models have no recorded results, so the check shows needs review.
Read the disclosures
Above the pillars, the drawer lists up to four caveats, worst first, and only when they apply:
- "None of your accepted requirements is verified against real data yet: …"
- a capability whose check couldn't be run: "Treat it as present-but-unproven."
- a scenario whose headline number includes an estimated amount, or isn't verified against booked economics;
- "No business KPIs are valued yet. The solve completed, but none of its business values has been checked."
Accept blocking findings knowingly
When the capability check under Functionality is failing on blocking findings, its row offers to record that you accept them:
- Open the row. It reads "Accepting N blocking finding(s) records a decision against this revision. A reason is required."
- Type a reason in "Why are these acceptable for this model?".
- Click Accept knowingly.
The row then reads "Accepted knowingly by …: “…”" and "Recorded in the audit log. Editing the model returns these to blocking." The acceptance applies to this revision only. No other check offers it.
Other trust signals
- The Base figure on a scenario's screen says when its own checks disagree with it; see Read results.
- Verify checks one scenario's numbers; KPIs carry a Verified or Estimated stamp.
Limits
- Each check stops after 15 seconds, except the result-tracing check (30 seconds), the limits check (15 minutes) and Verify again (20 minutes).
- 25 findings per check are listed, with the rest counted.
- Up to four disclosures.
Related
- Verify: evidence for one scenario, and the way into this drawer
- Read a model's record: where the model stands
- How eode checks a model