Skip to main content
POST /api/judge judges one ticket against the pack’s published version and stores the evaluation. The route accepts an API key only, with judgments:run.

Response

200 returns the stored judgment. result is the full object from Results.
The evaluation model is typesafe-ai/jev, called once per ticket. modelId is the identifier the gateway returned. Pin checks to that field. A gateway or output failure is also 200. result.status is review and reviewReasons contains the error kind. The evaluation is still stored.

Idempotency

Idempotency-Key is optional, 1 to 128 characters. The same user and the same key on this route returns the stored evaluation and does not call the model again. The key is stored per surface. A key used on POST /api/judge does not collide with the same string on the inbound webhook. A gateway_auth or gateway_unavailable result does not store the key. Send the same key again to retry. externalId is your ticket id. It is not the idempotency key.

Errors

Field reference: POST /api/judge in the API reference tab.