Regulated DocumentsField engagement

In a regulated domain a wrong answer is a liability, so the system has to know when it does not know, and show what it relied on.

Fractional CTO and lead engineer.
closed-domain
grounded
human
in the loop
abstention
as a correct output
Fluent summary

Either party may terminate on material breach with thirty days notice.

nothing to check it against
Cited extraction

Termination on material breach, thirty days notice. section 9.3

traceable to the source
The same fact, two outputs. One asks to be believed. The other can be checked in seconds against the source.
What was at stake

The output of this system is where a professional's decision begins. Someone reads it, relies on it, and signs something they are personally accountable for. A confident wrong answer is worse than no answer here, because nobody downstream can see that it is wrong. A missed clause becomes advice given without it, a misquoted term becomes a position taken on the wrong footing. What the professional needs from the tool is the ability to verify, and that is the product.

How this works

A grounded system points at the sentence it relied on, and that is what makes its answer checkable.

Most document AI follows the same broad steps. The document is parsed, so that headings, clauses, definitions and schedules become structure the software can navigate. A question, such as what this agreement says about termination, is turned into a search for the passages that address it. A language model then reads those passages and writes an answer. Grounding means the answer is tied back to the exact spans of text it came from, so each statement arrives with a pointer a reader can follow.

Grounding solves one problem and leaves another. It makes each claim checkable, because the reader can look at the span beside it. It does nothing about what was never claimed. A summary of a long agreement covers whatever the model judged salient, and if a material provision was skipped there is no sentence on the screen to reveal the gap. This is why a closed domain matters. When the system works on a known type of document and is looking for a known list of provisions, absence becomes a finding. The output can say that a provision was searched for and not found, which is a statement a professional can act on.

Two controls sit on top. Hallucination control compares each claim with its span and withholds or flags any claim the span does not support, including the subtler case where the citation points at the wrong clause. And the review surface puts claim and source side by side, with low-confidence and unusual items marked, so a professional can confirm or reject each point quickly. The tool narrows where attention is needed. The judgement stays with the person accountable for it.

Parse the document
clauses, definitions, schedules
Search for each listed provision
the closed domain defines the list
Extract with its span
every claim carries a pointer
Check support
unsupported claims withheld or flagged
Professional review
claim and source side by side
Found, not found and unsure are all outputs. Silence is not.
FigureHow a document moves through this system. Each provision on a defined list is searched for, extracted with the span it came from, and checked for support before it reaches a reviewer. A provision that cannot be found is reported as not found and never left out silently.
The constraint

Fluency is the wrong target, because a fluent answer is not a verifiable one. The failures in this domain are particular. An unsupported claim. A citation pointing at the wrong passage. And most dangerous of all, the material provision the system never mentions, which is invisible because there is nothing on the screen to check it against.

ARBITRARY CHUNK
Party B shall indemnify Party A|except where loss arises from gross negligence
carve-out split from the obligation, meaning lost
CLAUSE SEGMENT
section 7.1Party B shall indemnify Party A, except where loss arises from the gross negligence of Party A.
obligation and carve-out, retrieved as one unit
An obligation and its exception are a single legal thought. Segment on a token count and the model retrieves the duty without the carve-out that guts it.
Where it usually breaks

Document AI in regulated work fails most dangerously by leaving things out.

The failures people expect are the visible ones: a claim the document does not support, or a citation to the wrong clause. Those are serious, and they can at least be caught by someone who checks. The worse failure is omission. A summary that skips a material provision looks complete. The reader has no reason to go looking for something the tool never mentioned.

The second pattern is a shift in who is doing the work. A tool that produces polished prose invites the reader to trust it, and a busy professional under time pressure often will. If the tool offers no easy way to verify, the choice becomes re-reading the whole document, which removes the point of the tool, or trusting it, which removes the point of the professional.

01

The unsupported claim

The output states something the document does not say, in the same confident register as everything that is correct.

02

The misattributed citation

A real clause is cited, so the claim looks grounded. The clause, read closely, says something else.

03

The provision never mentioned

Something material is in the document and absent from the output. Nothing on screen hints that it exists.

04

Polish that discourages checking

A clean paragraph reads as finished work, and the reviewer checks less than the stakes require.

05

The unfamiliar document

A document type the system was never scoped for is processed anyway, and its gaps fall outside anything the system knows to look for.

Open summary
A fluent paragraph
covers what the model found salient
Claims without pointers
verification means re-reading
Silent on what it skipped
the omission is invisible
Closed-domain extraction
A defined list of provisions
the system knows what to look for
Each finding with its span
verification takes seconds
Not found stated explicitly
absence becomes a finding
Completeness can only be checked against a list. A summary has no list.
FigureThe same document handled two ways. An open summary shows what the model noticed and hides what it skipped. A closed-domain extraction works from a defined list, so a missing provision is reported as missing, which is something a reviewer can see and act on.
The fork

The reflex, and the fix.

Road not taken

Summarise the document with a language model

Pull

A polished summary in seconds, and it demonstrates beautifully on a clean document.

Why not

No grounding, no guarantee that anything material was included, and no way to verify. It produces exactly the output a professional cannot rely on.

Road taken

Grounded extraction with review built in

Accepted

Closed-domain scoping, grounding on retrieved spans, hallucination control, and a review surface with a human in the loop.

Bought

An answer a professional can confirm quickly, and an explicit signal whenever the system is not confident.

Decision

Build a tool that supports professional judgement with checkable evidence, and never one that asks for that judgement to be handed over.

How it was built
01Parse
›
02Ground
›
03Extract
›
04Verify
›
05Review
01

A closed domain with a defined scope

The system answers within a defined document domain, for a defined set of provisions. That boundary is what makes grounding and completeness checks possible at all, because the system knows what it is supposed to find.

02

Every claim bound to its source

Each claim is tied to retrieved source content. A claim with no support is withheld or flagged before anyone sees it. A plain pipeline lets that claim through, because it never asks where the claim came from.

03

Review designed in from the start

The review surface is part of the system and was designed alongside it. The tool does the finding. The professional does the judging.

Inside the key decisions

What each choice cost, and what it bought.

ANarrowing to a closed domain

An open system that answers anything about any document is easier to sell and impressive to demonstrate. Restricting the system to defined document types and defined provisions gives up that breadth. What it buys is the ability to check completeness, because a list of what should be found makes absence visible. It also makes grounding sharper, since the system knows what each passage is meant to support. An open system cannot tell a reader what it missed, and in this domain that is the question that matters most.

BWithholding unsupported claims

Each claim is checked against the span it came from, and a claim without support is withheld or flagged. The output is sometimes thinner as a result, and occasionally a correct claim is held back because its support was not clear enough. The trade is deliberate. A professional can work with a flagged gap. They cannot work with a confident error that looks identical to a verified fact.

CDesigning the review surface as part of the system

Most tools treat review as whatever the user does after the output appears. Here the review surface was designed with the rest, showing each claim beside its source and marking low-confidence and unusual language. That costs interface work that never shows up in an accuracy figure. It is what lets a professional confirm a point in seconds, and it keeps the judgement with the person who is accountable for it.

DTreating abstention as a correct output

When the system is unsure, or the language is unusual or conflicting, it says so. A tool that flags uncertainty can look less capable beside one that always answers. In a regulated setting the flag is the useful part, because it tells the professional exactly where to spend their attention.

The gate
Does the retrieved span actually support this claim?
Show it beside its source
the reviewer confirms in seconds
Withhold or flag for review
uncertainty shown openly, never hidden
The tool does the finding. The professional does the judging.
FigureThe check every extracted claim passes before it reaches a reviewer. If the source span supports it, the claim is shown beside that span. If not, it is withheld or flagged, so nothing reaches the professional looking more certain than the evidence allows.
How it was measured

A single headline number hides where a system fails. This work was scored on the dimensions that actually decide whether it holds in production, measured on real, held-out cases rather than the demo path.

Support rate for extracted claimsCitation accuracyFlagged-for-review rateRecall on material provisions
Recall on material provisionscatches what was never mentioned
Support rate for extracted claimsis each claim backed by its span
Citation accuracydoes the pointer go to the right clause
Flagged-for-review ratehow much lands with a person, and why
A system measured only on what it says will never be tested on what it leaves out.
FigureWhat each evaluation measure is designed to catch. Support rate and citation accuracy test the claims that appear. Recall on material provisions tests the ones that do not, which is the failure a reader cannot see for themselves.
figures

What it produces
Without this discipline

A clean paragraph that the professional still has to verify by reading the whole document, with no signal about what was left out.

This system

Grounded, checkable output with uncertainty shown openly, and a review surface where a professional confirms each point in seconds instead of re-reading the document.

closed-domaingroundedhallucination controlhuman-in-the-loop
The operating envelope

What it owns, and what it hands to a person.

Handled with confidence
Defined provisions on supported document types
Claims bound to retrieved source content
Flagged for review
Low confidence
Unusual or conflicting language
Out of scope by design
Professional judgment and strategy
Wholly novel document types
The honest limit

It speeds up review and makes the output checkable. It does not exercise professional judgement. The professional remains accountable for what they sign, and flagged items exist so that a person verifies them. It is not advice.

What it generalizes to

Where correctness carries legal weight, an answer that cannot be traced to its source is an answer nobody can use. Bind every claim to something checkable, let the system abstain, and put the output where it can be verified quickly.

What to take from this

Grounding makes each claim checkable, but only a defined scope of what should be found can reveal what was left out.

In regulated work the most dangerous error is omission, because nothing on the screen prompts the reader to look for it.

Withholding or flagging an unsupported claim is better than presenting it, because a flagged gap can be handled and a confident error cannot be seen.

Design the review surface with the system, with each claim beside its source, so verification takes seconds and judgement stays with the accountable person.

Evaluate recall on the things that matter, not only the accuracy of what the system chose to say.

How we engage

You have a system like this one.
Tell us where it stands.

Whether it is failing, not yet built, or about to meet a scale it has never seen, we can tell you what we see.

Start a conversation
mostafa@opulion.dev · Response within 24 hours · By inquiry