Scenario · Insurance claim authority
The Claim That a Confidence Score Could Not Close
An image model is 94% confident. Four of its twelve images belong to the wrong building, and the claim cannot advance until the evidence is corrected and a qualified human makes the coverage decision.
- What this is
- A published decision scenario. Its setting and values are invented for illustration.
- What this shows
- How declared facts and rules produce a traceable result when conditions change.
- What this does not show
- A customer deployment, measured outcome, or transfer of authority to software.
Narrated film · 1:10
The Claim a Confidence Score Could Not Close
Follow an insurance decision where evidence, exceptions, and a qualified reviewer matter more than a single score.
1:10
Story
Start with the event and the decision it creates.
The story
08:42 — a high score enters the claim
Qualified adjuster Rina Patel receives a claim packet at Harbor Lantern Mutual. Its image model reports 0.94 confidence for one narrow class: “wind-pattern damage present in the supplied image set.” The result, CV-OUT-440, comes from model ROOF-CV-8 running against all twelve images in inspection revision INSPECT-R8.
The score may help Rina prioritize the review. It does not establish that the images belong to the covered property, that wind caused the damage, that the policy covers it, that the estimate is reasonable, that anyone acted improperly, or that Rina may settle the claim. Before she can make a coverage decision, the packet must show what the score actually describes and which evidence belongs to the dwelling.
08:45 — a plausible subtraction is rejected
A draft automation proposes:
$18,640 draft repair scope - $2,500 deductible = $16,140 proposed payable
Grid rejects the transition because the left-hand value is not an authorized covered amount. Before payment arithmetic can run, the packet still needs image-to-property mapping, cause and policy review, accepted scope, data-integrity state, adjuster identity and delegation, an exact human decision, and—if the payable amount exceeds the authored $10,000 limit—a supervisor disposition.
A deductible is not a bridge from an estimate to coverage. Before qualified authorization, payable is unresolved—not zero and not $16,140.
09:03 — missing explanation evidence narrows permitted use
The image vendor's explanation artifact is unavailable for fourteen minutes. The 0.94 result remains retained, but the declared region-of-interest map and input-quality notes required by authored review policy AI-CLAIM-5 cannot be retrieved.
The packet becomes incomplete-for-adverse-or-terminal-use. Grid does not assume that missing evidence supports the score or generate a substitute explanation.
09:17 — new inspection evidence changes the image set
Inspection steward Mateo Diaz publishes INSPECT-R9. Images IMG-09 through IMG-12 depict a detached shed, not the insured dwelling. The revision preserves R8, identifies each changed image, and records the correction basis.
ROOF-CV-8 is rerun only on the eight dwelling images and returns 0.71 confidence for the same narrow class. The score changed because the exact input changed. Its authority remains zero.
09:19 — one correction changes the whole packet
The correction advances a declared affected cone:
- Detached-structure endorsement
END-17now requires separate human interpretation, making the prior dwelling-only coverage summary stale. - Four $1,100 shed lines move out of the dwelling draft, reducing it from $18,640 to $14,240.
- The internal planning reserve falls from
$18,640 × 1.15 = $21,436to$14,240 × 1.15 = $16,376. - A provenance mismatch opens
MANUAL DATA-INTEGRITY REVIEWwithout asserting misrepresentation, intent, claimant fault, or fraud.
The claimant notice draft, settlement proposal, reserve explanation, and model summary become stale. Historical R8 artifacts remain immutable.
09:24 — three paths preserve consumer protections
The authored model compares exactly three paths:
| Path | Result | Why |
|---|---|---|
| Close at $16,140 using 0.94 and the original estimate | Rejected | Score scope, image membership, coverage authority, and amount basis are invalid. |
| Deny or refer as fraud because four images were misassigned | Rejected | A data mismatch does not establish intent, fraud, noncoverage, or an adverse decision. |
| Correct the evidence, hold terminal action, and complete qualified coverage and integrity reviews | Reviewable path | It preserves source correction, consumer-impact controls, authority, and external state. |
Reviewable does not mean covered, denied, payable, or settled.
10:02–10:08 — human coverage authority remains separate from payment
The data-integrity reviewer attributes the mismatch to the scenario's inspection export mapping and closes the provenance exception without a fraud allegation. That disposition does not determine coverage.
Rina reviews the corrected inspection, the eight-image result, the applicable policy and endorsement, the $14,240 scope, the remaining source gaps, the model limits, the integrity finding, and her represented delegation. Under the scenario rules, she determines that exactly $11,900 is covered.
Only then may Grid calculate:
authorized covered amount = $11,900
deductible = $2,500
payable = max(0, $11,900 - $2,500) = $9,400
Because $9,400 is below the authored $10,000 supervisor threshold, no supervisor signature is required. A negative case above that limit must stop and may not split payment to evade authority.
Rina signs DECISION-204-R5. The external payment system acknowledges instruction PAY-REQ-710. Coverage is authorized, but payment execution, bank settlement, and claimant receipt remain unresolved.
The 0.94 score helped identify what required review. It did not establish the covered amount, authorize the payment, or close the claim. Corrected evidence and Rina's decision established the covered amount and authorized the instruction; execution, settlement, notice, and administrative closure remained external.
Next day — external reports close only their own loops
Payment-system report PAY-EXEC-711 records execution. Bank report BANK-SETTLE-90 later records settlement. Communication record NOTICE-320 reports the reviewed notice delivered.
Those facts may satisfy the authored administrative close gate. They do not prove fair treatment, correct coverage, claimant understanding, repair completion, absence of harm, or a real-world result. Complaints, reconsideration, appeal, litigation, and regulator processes remain external.
Why this setting is recognizable
The NAIC Model Bulletin on the Use of Artificial Intelligence Systems by Insurers addresses governance, documentation, data quality, testing, transparency, and human involvement around AI-supported consumer-impacting insurance decisions. The NAIC Unfair Claims Settlement Practices Act, Model 900 provides a model framework for claim investigation and disposition while anticipating jurisdiction-specific adoption. The voluntary NIST AI Risk Management Framework 1.0 describes rights-preserving risk management across AI design, deployment, use, and evaluation.
Those materials ground only bounded claims and AI-governance context. The NAIC documents are model materials, not universal law, and NIST does not certify a model or insurer. None of the sources establishes this claim, validates ROOF-CV-8, decides coverage or fraud, authorizes payment, proves legal compliance, substantiates Grid, or shows an outcome.
Where the model stops
Grid can represent exact source and model revisions, scope a score, calculate deterministic consequences, expose missing or contradictory evidence, trace a correction, compare authored paths, assemble a review packet, and calculate payment after a qualified human supplies the covered amount. It cannot determine cause, coverage, fraud, liability, fair treatment, legal meaning, claim closure, settlement authority, payment, repair, or claimant outcome.
This page contains no real claimant, address, property, policy text, claim number, image, protected characteristic, payment account, insurer, jurisdiction, vendor secret, production threshold, fraud feature, credential, or live operating instruction. Every amount and rule is fixture-bound.
What remains to prove
Source revision 2026-08-27.1 has reviewed domain context, product boundaries, a high-consequence evidence profile, and a public-suitability finding, so this authored, non-advisory scenario can be published at R2. The fixture itself remains authored.
The next proof is an exact integer-cent implementation of the twelve-image and eight-image states, 0.94 and 0.71 scoped outputs, fourteen-minute explanation gap, $4,400 correction, $14,240 scope, $16,376 reserve candidate, three paths, data-integrity stop, $11,900 human covered amount, $2,500 deductible, $9,400 payable, $10,000 authority threshold, and separate payment, settlement, and notice reports. It needs an independent oracle, negative cases, retained execution and verification evidence, and a high-consequence assurance review. Intended-environment work would additionally require insurer-owned legal, policy, fairness, consumer-rights, model-risk, identity, payment, records, security, and complaint controls. Nothing in that path turns a confidence score into permission to close a claim.
Decision path
Follow the changed fact step by step.
A calculation, proposal, approval, execution report, and outcome are different events. The order keeps those boundaries visible.
- 01 · 08:42
A high score enters the claim
CV-OUT-440 reports 0.94 confidence for one narrow visual class on twelve exact images without establishing property identity, cause, coverage, fraud, amount, or authority.
- 02 · 08:45
A plausible subtraction is rejected
The model refuses to turn an $18,640 draft scope minus a $2,500 deductible into $16,140 payable because no qualified covered amount exists.
- 03 · 09:03
Missing explanation evidence narrows permitted use
A fourteen-minute vendor gap leaves the score retained but incomplete for terminal or adverse use under the authored review policy.
- 04 · 09:17
New inspection evidence changes the image set
INSPECT-R9 moves IMG-09 through IMG-12 to a detached shed, and the model rerun on eight dwelling images returns 0.71 without gaining authority.
- 05 · 09:19
One correction reaches four operational surfaces
Policy review reopens, dwelling scope falls to $14,240, the reserve candidate falls to $16,376, and a provenance exception opens without becoming a fraud allegation.
- 06 · 09:24
Three bounded paths preserve consumer-impact controls
Closing from the original score and inferring fraud are rejected; corrected evidence plus qualified review is the only reviewable path.
- 07 · 10:02–10:08
Human coverage authority remains separate from payment
Rina authorizes the scenario's $11,900 covered amount, Grid calculates $9,400 after deductible, and PAY-REQ-710 acknowledges an instruction without proving execution or settlement.
- 08 · Next day
External reports close only their own loops
PAY-EXEC-711, BANK-SETTLE-90, and NOTICE-320 report execution, settlement, and notice without proving fair treatment, repair, understanding, or a real outcome.
Evidence and limits
What the scenario represents—and what real-world use still requires.
Represented in this scenario
- Exact image identities, inspection and model revisions, class scope, confidence, explanation availability, estimate lines, policy pointers, review state, authority, calculations, and external reports
- The original and corrected affected cone, unresolved fields, three bounded paths, consumer-impact stops, amount threshold, and separate decision and payment evidence
- Model result, data-integrity disposition, adjuster decision, supervisor exception, payment acknowledgment, execution, bank settlement, and notice as distinct states
Required integration and operating work
- Author and qualify insurer-owned schemas, policy and jurisdiction semantics, model governance, fairness and consumer-impact controls, identity and delegation, reviewer experiences, accessibility, records, security, payment reconciliation, and correction workflows
- Implement the deterministic fixture, freeze an independent oracle, test missing, stale, mismapped, unauthorized, adverse, above-limit, split-payment, returned-payment, indeterminate, and corrected paths, and retain exact execution, verification, and high-consequence assurance evidence
Decisions that remain with people and institutions
- Cause, coverage, fraud, liability, claim denial or closure, reserve sufficiency, fair treatment, legal or policy meaning, or a consumer-impacting determination
- Adjuster or supervisor delegation, claimant notice, payment instruction, payment execution, bank settlement, repair, appeal, complaint, or litigation state
- Model validity, fairness, compliance, savings, accuracy, cycle time, lower loss, Grid performance, or any claimant or operating outcome
Evidence, authority, and publication recordView the scenario contract, capability record, authority stages, verification status, and related work.
Scenario contract
The setting, trigger, decision, and authority boundary.
- Setting
- Harbor Lantern Mutual, an invented property insurer handling one synthetic homeowners claim in an invented jurisdiction.
- Timeframe
- One inspection-review day followed by an external settlement report
- Trigger
- Inspection revision INSPECT-R9 reassigns four of twelve images and $4,400 of draft scope from the insured dwelling to a detached shed.
- Decision
- Whether the packet is complete enough for a qualified coverage decision, which consequences must be corrected, and whether an exact payment instruction may be authorized.
- Authority
- Mateo Diaz owns image identity and correction; qualified adjuster Rina Patel owns the represented coverage determination within the scenario's authored delegation; a supervisor owns exceptions above the amount limit; and external payment, banking, and communication systems own execution, settlement, and notice state.
Confidence belongs to one question
A 0.94 score has zero settlement authority.
Image scope, correction, coverage review, exact arithmetic, human authority, payment acknowledgment, execution, settlement, and notice remain connected without becoming one automated claim decision.
- Model evidence0.94 on twelve images
The score supports one declared visual class and cannot answer property identity, cause, coverage, fraud, or amount.
- CorrectionFour images move to the shed
The dwelling rerun returns 0.71, scope falls by $4,400, and every dependent artifact advances visibly.
- ReviewData mismatch is not fraud
A provenance exception enters manual review without inferring intent, claimant fault, or an adverse decision.
- Human authority$11,900 becomes $9,400
Rina supplies the authored covered amount; only then may the model subtract the $2,500 deductible.
- External evidencePayment and settlement stay separate
Request acknowledgment, execution, bank settlement, and notice delivery each require their owning source.
What is established
What is documented, what this scenario combines, and what still needs testing.
This separates documented capabilities from authored combinations in the scenario. Neither proves a complete deployment or outcome.
Documented building blocks
Capabilities described in maintained Grid documentation or another named source.
- Reviewed product primitives document typed values, formulas, versioned relationships, reactive dependencies, provenance, history, governed artifacts, connectors, and audience-specific surfaces within their stated limits; they do not establish an insurance, policy, claims, fraud, reserve, or payment product.
- Reviewed product primitives document dependency inspection, predicates, explanation, attributable workflow ingredients, and correction lineage within documented scope; they do not establish image truth, cause, coverage, fraud, fairness, legal meaning, payment authority, execution, or settlement.
Combined in this scenario
Capability combinations represented in this scenario that still require end-to-end evaluation.
- The authored Scenario composes a synthetic claim schema, score-scope contract, affected cone, integer-cent reserve proposition, three review paths, authority matrix, consumer-impact gates, and separate payment and notice evidence.
- Inspection, model, policy, estimate, data-integrity, adjuster, supervisor, payment, banking, notice, and correction experiences would be built around exact revisions and role boundaries without centralizing their authority.
Not yet proved
Integration, operating, policy, or evidence work that is not complete.
- No package-owned executable fixture, independent oracle, negative-case suite, retained execution and verification record, derivative-parity review, high-consequence assurance review, or intended-environment evaluation has yet established the authored behavior.
- No qualified policy interpretation, model validation, bias or fairness program, legal and consumer-rights workflow, identity, delegation, inspection, estimate, claims, fraud-review, notice, payment, banking, security, records, or target-environment integration exists, and no observed outcome exists.
Proof and limits
What this scenario supports—and what remains to validate.
These states describe the scenario source and its defined checks. Real-world validation requires separate evidence.
- Scenario publication
- PublishedReleased August 27, 2026 as an operating scenario.
- Source readiness
- R2 · Sources reviewedDomain support and product capability boundaries have been reviewed.
- Scenario check
- Checks not runScenario revision 2026-08-27.1 defines the steps and expected results; the checks have not run yet.
- Independent review
- PendingThe expected results have not received independent review.
- Deployment evidence
- NoneNo customer deployment, production performance, or real-world outcome is claimed.
- Next proof required
- Advance beyond R2Run the defined checks, retain the results, and have an independent reviewer check the expected results.
Evidence and stewardship
What supports this scenario—and when it must be reviewed again.
Illustrative evidence
Authored, non-advisory insurance scenario using synthetic records and grounded by reviewed NAIC and NIST materials; it is not a coverage decision, claim instruction, model validation, customer deployment, legal conclusion, or measured Grid outcome.
Invented elements. Harbor Lantern Mutual and every person, policy, claim, image, model, threshold, amount, authority, decision, payment, and outcome are invented. NAIC and NIST materials ground only bounded claims and AI-governance context, while reviewed Grid documents support generic primitives—not coverage, fraud, legal compliance, model validity, payment authority, integration, deployment, or result.
- Owner
- Grid FYI Editorial
- Reviewed
- August 27, 2026
- Review due
- February 27, 2027
- Source revision
- 2026-08-27.1
- Scenario package
- insurance-claim-confidence-could-not-close
Related work
Related reading and examples.
These links are chosen as direct companions to this scenario.