JewelVerdict
TypeA grade's result: `agree`, `disagree`, or `skip`, with optional notes.
What a custom grade returns. agree and disagree are the graded outcomes that feed the agreement rate; skip marks a pair that was not a real decision moment, excluded from the numbers. Whether an abstention counts as a disagreement is the grade's call: abstaining where the human also did nothing is agreement.
JewelVerdict.ts
interface JewelVerdict { verdict: 'agree' | 'disagree' | 'skip' notes?: string trace?: string | string[] }
Fields
verdict
'agree' | 'disagree' | 'skip'
The grade. skip means this pair was not a graded decision moment (a housekeeping touch).
notes
string
Short prose on a disagreement: what differed.
trace
string | string[]
The judge runTask's traceId, when grade used a model.