POST /api/judge judges one ticket against the pack’s published version and stores the evaluation. The route accepts an API key only, with judgments:run.
Response
200 returns the stored judgment. result is the full object from Results.
typesafe-ai/jev, called once per ticket. modelId is the identifier the gateway returned. Pin checks to that field.
A gateway or output failure is also 200. result.status is review and reviewReasons contains the error kind. The evaluation is still stored.
Idempotency
Idempotency-Key is optional, 1 to 128 characters. The same user and the same key on this route returns the stored evaluation and does not call the model again.
The key is stored per surface. A key used on POST /api/judge does not collide with the same string on the inbound webhook.
A gateway_auth or gateway_unavailable result does not store the key. Send the same key again to retry.
externalId is your ticket id. It is not the idempotency key.
Errors
Field reference:
POST /api/judge in the API reference tab.