# judged.systems

> Judge one support ticket. Typed answers, a deterministic result, and a stored evaluation.

- [judged.systems](https://judged.systems/docs/index.md): Judge one support ticket and store a typed, inspectable result.
- [Quickstart](https://judged.systems/docs/quickstart.md): Publish a pack, create an API key, and judge one ticket.
- [Concepts](https://judged.systems/docs/guides/concepts.md): The ticket, the pack, the published version, the evaluation, and the label.
- [Packs](https://judged.systems/docs/guides/packs.md): Edit a draft, publish an immutable version, and move documents in and out.
- [Questions](https://judged.systems/docs/guides/questions.md): Write choice, score, and boolean questions the model can answer from the ticket.
- [Results](https://judged.systems/docs/guides/results.md): How thresholds turn model answers into accept or review.
- [Integrations](https://judged.systems/docs/guides/integrations.md): Where keys, REST, inbound, outbound, and MCP are configured.
- [Authentication](https://judged.systems/docs/guides/authentication.md): Sessions, API keys, MCP OAuth, and the permission each route checks.
- [Judge a ticket](https://judged.systems/docs/guides/rest.md): POST /api/judge with an API key and a published pack.
- [MCP](https://judged.systems/docs/guides/mcp.md): Connect an MCP client with OAuth and judge a published pack.
- [Webhooks](https://judged.systems/docs/guides/webhooks.md): Accept a ticket with 202, then verify the signed completion POST.
- [Overview](https://judged.systems/docs/guides/overview.md): Counts, the 14-day chart, reviews waiting, and recent evaluations.
- [Playground](https://judged.systems/docs/guides/playground.md): Judge one ticket against a draft or a published pack from the app.
- [Evaluations](https://judged.systems/docs/guides/evaluations.md): List and read stored judgments. Rows are append-only.
- [Reviews](https://judged.systems/docs/guides/reviews.md): Read a review, record a label, and see whether it agrees with the model.
- [Experiments](https://judged.systems/docs/guides/experiments.md): Store a dataset and judge it with a published pack. The app screen is on the roadmap.
- [Redaction](https://judged.systems/docs/guides/redaction.md): What is replaced before a ticket is stored or sent to the model.
- [Errors](https://judged.systems/docs/guides/errors.md): HTTP status codes, the error body, and failures that are stored as review.
- [Roadmap](https://judged.systems/docs/guides/roadmap.md): Experiments is the current build. judged AI and threshold replay come after it.
- [List packs](https://judged.systems/docs/api-reference/packs/list-packs.md): Requires packs:read.
- [Create a pack](https://judged.systems/docs/api-reference/packs/create-a-pack.md): Requires packs:write. An omitted name is stored as Triage.
- [Get a pack](https://judged.systems/docs/api-reference/packs/get-a-pack.md): Requires packs:read. document is the draft. liveDocument is null when the pack has no published version.
- [Delete a pack](https://judged.systems/docs/api-reference/packs/delete-a-pack.md): Requires packs:write.
- [Update a pack draft](https://judged.systems/docs/api-reference/packs/update-a-pack-draft.md): Requires packs:write. Updates the name, the draft document, or both.
- [Publish the draft](https://judged.systems/docs/api-reference/packs/publish-the-draft.md): Requires packs:write. Copies the draft into a new published version and makes it the live version.
- [Restore a published version onto the draft](https://judged.systems/docs/api-reference/packs/restore-a-published-version-onto-the-draft.md): Requires packs:write. versionId must be a published version of this pack.
- [Compare two versions](https://judged.systems/docs/api-reference/packs/compare-two-versions.md): Requires packs:read. from and to are version ids of this pack.
- [Export a pack](https://judged.systems/docs/api-reference/packs/export-a-pack.md): Requires packs:read. document is the draft.
- [List versions](https://judged.systems/docs/api-reference/packs/list-versions.md): Requires packs:read.
- [Import a pack](https://judged.systems/docs/api-reference/packs/import-a-pack.md): Requires packs:write.
- [Judge a ticket](https://judged.systems/docs/api-reference/judge/judge-a-ticket.md): API key only. Requires judgments:run. Judges the published version. An optional Idempotency-Key returns the stored evaluation when the same key is sent again. A gateway failure does not store the key.
- [List evaluations](https://judged.systems/docs/api-reference/evaluations/list-evaluations.md): Requires judgments:read. Returns up to 50 rows. Pass nextCursor back as cursor.
- [Get an evaluation](https://judged.systems/docs/api-reference/evaluations/get-an-evaluation.md): Requires judgments:read.
- [Write a label](https://judged.systems/docs/api-reference/labels/write-a-label.md): Requires labels:write. Stores a human answer for one question. Does not change the evaluation.
- [Delete a label](https://judged.systems/docs/api-reference/labels/delete-a-label.md): Requires labels:write.
- [List reviews](https://judged.systems/docs/api-reference/reviews/list-reviews.md): Requires judgments:read. Evaluations whose status is review. Returns up to 50 rows.
- [List datasets](https://judged.systems/docs/api-reference/datasets/list-datasets.md): Requires packs:read.
- [Create a dataset](https://judged.systems/docs/api-reference/datasets/create-a-dataset.md): Requires packs:write.
- [Add tickets to a dataset](https://judged.systems/docs/api-reference/datasets/add-tickets-to-a-dataset.md): Requires packs:write. Tickets are redacted before they are stored. A dataset holds at most 250 tickets. JSON body is { tickets }. text/csv needs a header row with subject and customerMessage. externalId is optional.
- [List simulations](https://judged.systems/docs/api-reference/simulations/list-simulations.md): Requires simulations:run.
- [Start a simulation](https://judged.systems/docs/api-reference/simulations/start-a-simulation.md): Requires simulations:run. Judges the dataset with the pack's published version. Returns before the run finishes.
- [Get a simulation](https://judged.systems/docs/api-reference/simulations/get-a-simulation.md): Requires simulations:run.
- [Get stats](https://judged.systems/docs/api-reference/stats/get-stats.md): Requires judgments:read.
- [List webhook endpoints](https://judged.systems/docs/api-reference/webhooks/list-webhook-endpoints.md): Requires packs:read. One endpoint per user. The secret is not included.
- [Save a webhook endpoint](https://judged.systems/docs/api-reference/webhooks/save-a-webhook-endpoint.md): Requires packs:write. Replaces this user's endpoint. The secret is returned once.
- [Delete a webhook endpoint](https://judged.systems/docs/api-reference/webhooks/delete-a-webhook-endpoint.md): Requires packs:write.
- [List completion deliveries](https://judged.systems/docs/api-reference/webhooks/list-completion-deliveries.md): Requires packs:read. Up to 50 deliveries, newest first.
- [Accept an inbound ticket](https://judged.systems/docs/api-reference/webhooks/accept-an-inbound-ticket.md): API key only. Requires judgments:run. Idempotency-Key is the delivery id and is required. Returns 202 and keeps judging. The pack must have a published version. A repeated delivery id returns the existing event.
- [Completion](https://judged.systems/docs/api-reference/webhooks/completion.md): judged.systems POSTs this body to the user's saved HTTPS endpoint after a judgment. The body has no ticket. Redirects are not followed. A 2xx response is delivered. A network failure, 429, and 5xx are retried, up to 5 attempts. Other responses are not retried.

## OpenAPI Specs

- [openapi](/docs/openapi.json)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.