Six layers. No single error ships.
A case becomes a certified record only after clearing all six layers. Fail any one, and it goes back or is discarded. This page covers the chain, how professionals are calibrated before they join it, how disagreements are settled, and how confident we are in each answer.

- 01Authoring by qualified professionals
- 02Rule-based machine checks
- 03Independent solving
- 04Review
- 05Adjudication
- 06Evidence and integrity
Layer 1: Authoring by qualified professionals
Cases are written by calibrated professionals in the domain, from a fixed template: facts, documents, question, expected answer fields. Every author's identity and credential are checked against their profession's register, and every author has passed calibration in the capability they write for. How credentials are checked.
Layer 2: Rule-based machine checks
Our platform runs fixed checks, with no AI involved: are all fields complete, are formats valid (GSTINs, state codes, amounts), does anything look like real data (real names, real registration numbers), is the case too similar to an existing one in either pool? Failures go straight back to the author.
Layer 3: Independent solving
At least two professionals solve each case without seeing each other's answers: the treatment, the posting, the legal basis and their confidence. Agreement on the answer and the basis moves the case on; anything else triggers a third solver.
Layer 4: Review
A different, higher-tier professional checks the agreed answer and its reasoning, and flags any ambiguity or missing exception.
Layer 5: Adjudication
Where solvers disagree, or a reviewer raises a problem, a senior professional decides and writes the reasoning. Genuinely contested cases are marked ambiguous and kept out of pass/fail scoring. The full routing rule is below.
Layer 6: Evidence and integrity
The legal desk ties the final answer to the governing section, rule, notification or circular, with a valid-as-of date: no citation, no certification. Integrity checks confirm the work was done by the people credited, within normal time patterns, with no signs of AI-written answers. Evidence and currency · Keeping human-certified answers human.
What each control prevents
| Control | What it prevents |
|---|---|
| Qualified authors | Unrealistic or badly framed cases; cases written outside the author's demonstrated capability |
| Independent review | One person's error or blind spot becoming the answer |
| Evidence verification with valid-as-of dates | Answers not supported by the law, or supported by a rule that has since changed |
| Duplicate checks across pools | The same facts appearing in a training dataset and a held-out benchmark |
| Rubric validation | Scoring rules that mark a correct alternative wrong, or let a serious error pass |
| Adjudication | Genuine disagreement being averaged away or decided by whoever answered last |
| Version control | A result that cannot be traced to the exact case and answer it was marked against |
| Test-set access restrictions | Held-out answer keys reaching contributors, customers or the open web |
| Customer acceptance tests | A delivery that meets our standard but not the specification you approved |
Two reviews do not make an item 100% correct. Independent solving and review catch most individual error. High-risk items, where a wrong answer would be costly or the law is intricate, get an additional authoritative-source check, specialist adjudication or an independent calculation before release.
Calibration: credentials get you in, calibration gets you work
A qualification shows someone studied the law. It does not show they apply it accurately, consistently and to our standard. So before anyone touches a customer's case, they prove it.
- Calibration test.
A timed set of 25 cases with certified answers, in the domain and at the level the professional will work at. Pass marks are set per domain and per role.
- Probation.
The first 30 pieces of work are all checked by a senior reviewer. Feedback is given on every correction.
- Continuous measurement.
After probation, every contribution keeps being measured: agreement with other solvers, agreement with adjudicators, reviewer corrections, and planted control cases with known answers.
Calibration decides which roles a professional can take (solver, reviewer, case writer, adjudicator), which topics they are assigned (calibration is by topic, not just by domain) and which tier they are paid at. Accuracy that falls below the standard triggers re-calibration and closer review; repeated problems remove a professional from the network and their recent work is re-checked. Before every new mission, the selected team completes a short calibration round on that mission's topics, so differences in interpretation are settled at the start. How we qualify professionals · Reliability profiles.
What we measure for each professional
| Measure | What it shows |
|---|---|
| Calibration score | Accuracy on known cases before starting |
| Agreement with final certified answers | How often their answer survives review and adjudication |
| Control-case accuracy | Accuracy on hidden cases with known answers |
| Acceptance rate | Share of work accepted first time |
| Consistency | Same answer when the same point is asked differently |
These scores route work. They are never published or sold.
Adjudication: two opinions first, a senior decides when they differ
If one professional says something, it is an opinion. If two work independently and reach the same answer for the same legal reason, that is evidence. If they differ, that is a signal worth investigating, not something to average away.
- Two solvers answer each case independently.
- Same answer, same legal basis: a reviewer checks it, then on to the legal desk.
- Different answers, or the same answer for different reasons: a third solver answers independently.
- Still split: a senior adjudicator reviews all answers, decides, and writes the reasoning.
- Genuinely contested law, where qualified professionals would reasonably differ: the case is marked ambiguous.
Adjudicators are senior professionals with 12 or more years of practice in the domain and a strong record of agreement with final certified answers. They never settle cases they solved themselves.
What an adjudication records
| Item | Example |
|---|---|
| All solver answers and reasons | Blocked (80%) · Allowed (90%) · Allowed (85%) |
| The decision | Credit allowed |
| Written reasoning | The proviso applies to legally required facilities |
| Edge notes | Recovery from employees needs separate treatment |
| The tempting wrong answer | Treating it as a blocked credit |
The answer a capable professional nearly gave is often exactly what an AI gets wrong. We keep it in the record, so test reports can explain failures and training data can teach the difference. And consensus is not the end: even unanimous professionals can be wrong, so every final answer still goes to the legal desk. Evidence and currency.
Confidence: how sure are we, as a number with its reasons
Every certified record carries a confidence score from 0 to 100. It tells you how strongly the answer is supported, not just what the answer is. AI teams use it to weight training data; test reports use it to separate firm failures from borderline ones.
| Factor | What raises it | What lowers it |
|---|---|---|
| Agreement | Independent solvers agree on answer and reason | Split answers, or agreement for different reasons |
| Who agreed | Solvers with strong track records | Newer or lower-tier solvers only |
| Review and adjudication | Clean review; clear adjudication with reasoning | Reviewer corrections; close adjudication calls |
| Legal evidence | Direct statutory text or clear circular | Reliance on interpretation or limited authority |
| Currency | Recently verified against current law | Near a pending or recent change |
The exact weighting is documented in our method note and is the same for every record.
How to read the score
- 0190–100Firmly settled
- 0275–89Well supported, with some judgment
- 0360–74Supported, but open to argument
- 04Below 60Not certified
| Score | Meaning | How we use it |
|---|---|---|
| 90–100 | Firmly settled | Scored normally in tests; safe for training |
| 75–89 | Well supported, with some judgment | Scored normally; flagged in reports where relevant |
| 60–74 | Supported, but open to argument | Used with care; explained in reports |
| Below 60 | Not certified | Not used, or moved to the ambiguous set |
Bands may be refined as we gather more data. Where qualified professionals legitimately disagree and the law does not settle it, the case goes into a separate ambiguous set: valuable for testing whether an AI recognises uncertainty, but never scored as simply right or wrong. You see the score in each data record, in test reports next to each failed case, and in the quality report delivered with every dataset.
Variants from certified templates
Planned, subject to founder decision. Software may generate scenario variants (amounts, counts, dates) from a certified template by fixed rules, each spot-checked by a professional. People still write and certify every answer; a variant changes the numbers around a legal point that has already been certified, never the point itself.
Measured, not assumed
We track first-pass agreement, adjudication rates, reviewer corrections and errors found after certification, and use them to improve case writing and calibration. We plan to publish headline quality figures every quarter from mid-2027.
Quality chain: questions people ask
What are the six layers of the quality chain?+
Authoring by qualified professionals, rule-based machine checks, independent solving, review, adjudication, and evidence with integrity checks. Only cases that clear all six are certified.
Why not ask ten professionals on every case?+
Most cases do not need it, and it would add cost without adding certainty. Extra solvers are added only when a case is hard. For flagship or unusually difficult sets, larger panels are used deliberately.
Who can be an adjudicator?+
Senior professionals with 12 or more years of practice in the domain and a strong record of agreement with final certified answers. They never settle cases they solved themselves.
What score is needed to pass calibration?+
Pass marks are set per domain and per role. For solvers it is currently 80%, and 85% for reviewers. A professional's first 30 pieces of work are all checked by a senior reviewer.
Does two professionals agreeing make an answer certain?+
No. Two reviews do not make an item 100% correct. Every answer is still tied to the law by the legal desk, and high-risk items get an authoritative-source check, specialist adjudication or an independent calculation on top.
Are low-confidence answers used?+
Answers below the certification threshold are not used, or move to the ambiguous set, where they test whether an AI recognises uncertainty rather than being scored right or wrong.
Zynoviq