guide

How each check is verified

A check that fires on a clean production is worse than no check: it teaches the reader to ignore the report and it makes the certificate worthless. So every rule here is held to two files, not one.

Two files per rule, and the second one is the hard part

Each rule has a fixture that contains the defect and a fixture that looks close enough to trip it but is correct. The defect file proves the rule can fire. The clean file proves it does not fire on a production a lawyer would serve, which is the failure that actually costs a buyer trust.

The clean fixtures are deliberately awkward: a citation of a Bates number in the body text, a page numbered in a different series, a document break that lands on a page boundary, an exhibit label that reads like a stamp. Those are the shapes that produce false positives in every checker we have seen.

Withdrawn checks

Two checks were withdrawn rather than shipped: in both cases the rule was correct and the PDF reader could not see the thing it was judging. The fix belonged in the extractor, not in the rule. A check that cannot see its own defect is not a check, it is a coin toss with a citation.

What the certificate attests

  • The exact list of checks that ran, by name.
  • The checks that did not run, and why - usually because a protocol value was not supplied, or the file could not be read.
  • A SHA-256 hash of every file, taken before the check and again after it, so the certificate is tied to the bytes that were actually read.
  • The time the check completed and the engine version that ran it.

What it does not attest

It does not attest that the production is responsive, complete, or compliant with a court's local rules. It does not read privilege. It checks internal consistency: whether the set agrees with itself, and whether the load file agrees with the pages. Saying so on the certificate is what makes the rest of it usable in front of a partner.

Frequently asked questions

Can I see the test files?

The fixtures are synthetic productions built to contain a specific defect, and they are not published. A sample report from a synthetic set is at /samples, and the rule catalogue at /checks is generated from the engine.

What happens when a rule is wrong?

It is withdrawn from the run rather than left in place, the certificate lists the checks that ran, and the rule is rebuilt against a fixture that reproduces the false positive.