Why review is required
DocIQ drafts criteria from the specification, but only a person can confirm that the draft represents the intended decision. Analysis remains locked until the criteria are reviewed and approved.
Review each criterion
- Title and description: make the requirement precise enough that different reviewers would interpret it similarly.
- Mandatory status: use this only when failure truly affects eligibility or compliance.
- Weight or importance: reflect decision value, not how easy the evidence is to find.
- Expected evidence: describe what would demonstrate the requirement without prescribing irrelevant wording.
- Scoring guidance: make the anchors distinguish absent, partial, and complete evidence.
- Source citation: open the cited specification page and confirm the criterion is grounded in it.
Approve the set
- Resolve warnings and inspect low-confidence extractions first.
- Remove duplicate criteria and separate requirements that need independent judgements.
- Check that weights express the intended priorities.
- Confirm every criterion has a valid source citation or an explicitly documented human addition.
- Save changes, then approve the requirement set to unlock the next stage.
After approval
Approved criteria are versioned. If the requirements change later, create a new revision and rerun affected candidates so historical reports remain reproducible.
Note: Avoid tailoring criteria after seeing candidate results. If a legitimate correction is necessary, document it and reassess every candidate consistently.