You Don't Trust AI Output by Hoping It's Right, You Verify It With a Second AI
Hallucination fear blocks AI adoption. Learn how verifier and adversarial agents engineer trustworthy AI output before it reaches a customer or regulator.
TL;DR: Hallucination fear blocks AI adoption. Learn how verifier and adversarial agents engineer trustworthy AI output before it reaches a customer or regulator.
The single biggest reason European SMEs stall on AI adoption is not cost, integration, or skills. It is fear: what if the model makes something up and we send it to a customer, a regulator, or the tax authority?
That fear is rational. Language models can produce confident, fluent, wrong answers. But the fix is not to wait for a model that never errs, that model does not exist. The fix is to engineer verification: a separate checking step that inspects the output before anyone trusts it.
We saw this pattern win in public. At Anthropic's Claude Opus 4.8 Build Day hackathon on 13 June 2026 in San Francisco, 310 builders selected from 1,500 applicants, 12 hours each, $500 of credits, two of the three winning teams made their AI output trustworthy the exact same way (S1): with verifier and adversarial sub-agents that check the first AI's work before it is accepted. This article unpacks that pattern and shows how to apply it to the everyday outputs your business already cares about.
The Lesson From the Hackathon: Trust Is Built, Not Hoped For
Two winning projects converged on the same engineering idea, independently, under time pressure.
Tekton: every component validated against the historical record
Holly Tang and Austin Burgess built Tekton, a system that reconstructs historic buildings across 339 construction states (S1). Reconstruction is exactly the kind of task where a model could plausibly invent a detail. So they did not trust the generation step on its own.
Verification relied on independent verifier sub-agents that graded each reconstruction in isolated context windows, with self-correction loops rechecking component placement until every test passed (S1). Every build was measured against the historical record and its citations, so the finished model followed documented rules. The generator proposed; a separate verifier, in a fresh context with no shared assumptions, checked, flagged, and the system corrected itself before moving on.
Sim Francisco: an adversarial agent that tries to break the answer
Tanmayi Priya Dasari and Tejas Prabhune built Sim Francisco, a synthetic population of the city used to model behaviour. To verify the model's work, they had Claude work alongside a verifier and an adversarial agent (S1), not just a checker, but an agent whose job is to attack the conclusion and surface where it fails.
The result is the part that matters for sceptical executives: the simulation forecast the 2024 vote at 81.3% against an actual 83.8%, and Prop A at 70% against an actual 70.38% (S1). Output that lands that close to reality is not luck. It is what you get when a second agent stress-tests the first before anyone reports a number.
The pattern: a fresh, isolated, sometimes hostile second opinion
Strip away the domains and the shape is identical:
- A first AI produces work.
- A second AI, in a fresh and isolated context, checks it, against sources, against logic, sometimes adversarially.
- Only verified output is trusted.
The isolation matters. A checker that shares the original context tends to inherit the original mistake. A verifier with a clean window, pointed only at is this claim supported?, catches what the author missed. This is the sensor half of harness engineering: the part of an AI system that measures whether the output is good enough to use.
Why This Is the Answer to Your Hallucination Fear
European SME leaders almost never object to AI in the abstract. They object to one specific scenario: an unverified output reaching someone who will act on it.
The mistake is treating that as a model-quality problem (we'll adopt once it's accurate enough). It is a process problem. You will never reach zero error from the model alone. You reach trustworthy output by adding a verification layer that catches errors before they leave the building, the same way you already require a second signature on a payment or a second read on a contract.
The hackathon winners did not have better models than everyone else; they all had Opus 4.8. They had better harnesses around the model.
Hoping It's Right vs Engineered Verification
| Dimension | Hoping it's right | Engineered verification |
|---|---|---|
| Trust basis | The model felt confident | A separate step confirmed it |
| Error discovery | The customer or regulator finds it | An automated verifier or reviewer finds it |
| Sources | Implied, unchecked | Checked against citations, flagged if missing |
| Adversarial test | None | An agent tries to break the answer |
| High-risk output | Same path as low-risk | Routed to a human before release |
| Auditability | The AI said so | A logged trail of what was checked |
| Failure mode | Silent and external | Caught and internal |
The right-hand column is not more expensive AI. It is more engineered AI.
What a Verification Layer Looks Like in an SME Workflow
You do not need a hackathon team to apply this. You need to decide, for each AI-assisted output, what checks it must pass before a human relies on it. Four layers, used in combination by risk:
1. Automated verifier (the default for everything)
A second model pass, ideally in a fresh context, whose only job is to ask: Is every claim here supported by the input I was given? It returns a pass, or a list of unsupported statements. This is the Tekton move, scaled down. It runs on every output and costs seconds.
2. Source and citation check
For anything containing a fact, figure, or quote, the verifier must point to where it came from, the source document, the row in the spreadsheet, the clause in the contract. No source, no trust. An output with an unsourced number is treated as failed, not as probably fine.
3. Adversarial review
For consequential or contested output, add an agent (or person) whose job is to disagree, to find the weakest claim and push on it. This is the Sim Francisco move. Adversarial review is how you catch the plausible but wrong answers that a friendly checker waves through.
4. Human in the loop on high-risk output
Some outputs must never go out on an automated pass alone: anything to a regulator, anything with legal or financial consequence, anything a customer will treat as a commitment. Here the AI drafts and verifies; a named human approves. The AI does the volume; the human owns the risk.
Routing by risk
| Output | Automated verifier | Source check | Adversarial | Human approval |
|---|---|---|---|---|
| Internal summary | Yes | Optional | No | No |
| Customer email | Yes | Yes | Optional | Spot-check |
| Contract summary | Yes | Yes | Yes | Yes |
| Financial figure in a report | Yes | Yes | Yes | Yes |
| Regulatory or tax filing | Yes | Yes | Yes | Yes (named) |
The point is not to put every output through every gate. It is to decide deliberately, per output type, which gates apply, and to log that the gates ran.
Where This Meets the EU AI Act
This is not only good practice; for a growing set of use cases it is becoming an expectation. The EU AI Act is phasing in: its transparency obligations apply from 2 August 2026, and the obligations for high-risk (Annex III) systems were postponed to 2 December 2027 by the 2026 Digital Omnibus (S2). Article 13 requires that high-risk AI systems be transparent and their operation documented well enough for a deployer to interpret and use the output appropriately (S3).
A verification layer produces exactly the artefact that obligation needs: a record of what was checked, against which sources, and who approved it. The AI generated it is not an audit trail. The output was verified against these sources, stress-tested by an adversarial review, and approved by a named person is. Engineering verification and meeting your documentation duties turn out to be the same work done once.
First AI Movers' Role: We Build the Verification Harness
This is our harness-engineering practice in one sentence: guides that shape how the AI produces work, and sensors that measure whether the output is good enough to use. Verifier agents, source checks, adversarial review, and human in the loop routing are the sensor half.
We do not hand you a clever model and wish you luck. We build the verification layer around your real workflows, the customer email, the contract summary, the financial figure, the regulatory filing, so that AI output is checked, sourced, and auditable before it reaches a customer or a regulator. That is what converts AI from a liability you fear into a tool you can stand behind.
Frequently Asked Questions
Doesn't using a second AI to check the first just double the chance of error?
No, because the verifier runs in a fresh, isolated context with a narrow job: confirm each claim against the input. It is not generating; it is auditing. A checker that shares the original context can inherit the original mistake, which is why isolation matters. Tekton's verifier sub-agents worked in separate context windows for exactly this reason.
Can't I just tell the model to be accurate and not make things up?
That is hoping, not engineering. Instructions reduce errors at the margin but never to zero, and you have no evidence afterwards about which outputs were actually reliable. A verification step gives you a pass/fail signal and a record. The hackathon winners all had the same strong model; what set them apart was the checking layer around it.
Is this expensive or slow for a small company?
The automated verifier and source check add seconds and cents per output and can run on everything. The heavier gates, adversarial review and human approval, apply only to high-risk output, which is a small fraction of your volume. You spend the effort where the consequences are, not everywhere.
What's the first thing to verify if I'm just starting?
Start with any output that contains a number or a fact and leaves the building, customer-facing claims, figures in reports, anything cited to a source. Add a source check first: no source, no trust. It is the cheapest gate and it catches the errors that cause the most damage.
Further Reading
- Harness engineering: PR quality gates for European companies
- AI adoption fears: an honest guide for European SME leaders
- The EU AI Act before August 2026: what European SMEs must do now
- What three hackathon winners teach small companies about building with AI
Build the Verification Layer Before You Trust the Output
If hallucination fear is what is holding your team back, the answer is not a braver leap of faith, it is an engineered checking step. We build the verification harness so you can trust what the AI produces.
Start with a free AI Readiness Assessment to see where verification belongs in your workflows, then work with us on AI consulting to put the sensors in place. We build the verification layer so you can trust the output.
Follow First AI Movers on LinkedIn for practical AI frameworks and decision guides.
About the author
- PhD in Computational Linguistics. I build the operating systems for responsible AI. Founder of First AI Movers, helping companies move from "experimentation" to "governance and scale." Writing about the intersection of code, policy (EU AI Act), and automation.
Comments
Join the discussionNo comments yet. Be the first to comment.

