Objects reference ​
An object is one rule set driftbench applies, written as data: a kind, an id and addressable items. A project tailors a shipped object by writing one that extends it, under driftbench/<kind>/<id>.yaml beside driftbench.yaml or in its objects: key; a spec or a block names the objects it uses under uses. The kinds: policy/value-check (when a value the agent wrote is the right value), policy/blame (who a failure is attributed to, and where its fix goes), policy/placement (where a fix goes, by how often a mistake recurs), policy/links (how blocks link to prompt units, and when a link is stale), policy/selection (which blocks a change selects), policy/gating (what not_run, blocked and inconclusive do to ci), policy/stats (which interval is the headline), check-set (the machine checks and their order), judge-council (the judges, their mode, assignment and escalation), diagnostic (a procedure that runs after the checks and writes a diagnosis), prompt-template (a model-facing text with named parts and a fingerprint), deviation-class (a deviation the driver can inject, and its recovery window), persona (who the simulated user is), scenario (what the simulated user wants and knows), persona-defaults (the defaults every persona extends), run-profile (the run settings: driver, model, seed, trials). driftbench object lists, explains, extends and validates them; see the CLI and driftbench help core-objects. The object file comes first, then the uses map. The page lists every field, generated from the zod schemas the CLI uses.
- Keys are snake_case. An unknown key is an error.
- Descriptions come from the schemas. An empty cell means the schema has no description for that field yet.
Contents ​
ItemFile ​
One object file.
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
kind | string matching ^[a-z][a-z0-9-]*(\/[a-z][a-z0-9-]*)?$ | yes | The kind: policy/value-check, policy/blame, check-set, diagnostic, ... | |
id | string matching ^[A-Za-z0-9][A-Za-z0-9._-]*(\/[A-Za-z0-9][A-Za-z0-9._-]*)*$ | yes | The id, unique within the kind and the layer. | |
version | string or number | no | A free label. The content hash, not this label, is the identity. | |
extends | string matching ^[A-Za-z0-9][A-Za-z0-9._-]*(\/[A-Za-z0-9][A-Za-z0-9._-]*)*$ or null | no | The object of the same kind this one extends; null or absent for a root. | |
description | string | no | What the object is for. | |
params | map of string to any value | no | Object-level parameters shared by the items. | |
order | list of strings, each matching ^[A-Za-z0-9][A-Za-z0-9._-]*$ | no | The item order: every enabled item once. A file uses order or item moves, not both. | |
items | list of ItemPatch | no | The items, or the operations on the parent items. |
ItemPatch ​
An operation on one item of the parent object, or a new item with add: true.
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
id | string matching ^[A-Za-z0-9][A-Za-z0-9._-]*$ | yes | The item to change, or with add: true the new item's id. | |
add | true | no | Adds a new item. Needs title, when, effect and impl. | |
title | string, not empty | no | A new title for the item. | |
enabled | boolean | no | false disables the item, true enables it again. | |
when | map of string to any value | no | Condition fields to set; maps merge, lists replace. | |
effect | map of string to any value | no | Effect fields to set; maps merge, lists replace. | |
params | map of string to any value | no | Params to set: maps merge, lists replace, +key appends, -key removes. | |
impl | string matching ^(builtin|plugin):\S+$ | no | Another implementation for the same rule. | |
cites | string | no | A source for the reader. | |
applies_to | AppliesTo | no | Where the rule applies: maps merge, lists replace. | |
before | string matching ^[A-Za-z0-9][A-Za-z0-9._-]*$ | no | Moves the item just before this one. | |
after | string matching ^[A-Za-z0-9][A-Za-z0-9._-]*$ | no | Moves the item just after this one. |
AppliesTo ​
Where an item applies: skills, tools or unit patterns. Absent means everywhere.
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
skills | list of strings, each not empty | no | Skill names the evidence must name one of. | |
tools | list of strings, each not empty | no | Tool labels the failing call must have one of. | |
units | list of strings, each not empty | no | Unit patterns, such as R#41/*, a unit must match one of. |
Uses ​
The objects this spec or block uses. Absent keys use the shipped defaults.
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
value_check | ObjectRef | no | policy/value-check: how a value the agent wrote is compared. | |
blame | ObjectRef | no | policy/blame: who a failure is attributed to. | |
placement | ObjectRef | no | policy/placement: where a fix goes. | |
links | ObjectRef | no | policy/links: how blocks link to prompt units. | |
selection | ObjectRef | no | policy/selection: which blocks a change selects. | |
gating | ObjectRef | no | policy/gating: what not_run, blocked and inconclusive do to ci. | |
stats | ObjectRef | no | policy/stats: which interval is the headline. | |
check_set | ObjectRef | no | check-set: the machine checks and their order. | |
judges | ObjectRef | no | judge-council: the judges, their mode and assignment. | |
diagnostics | list of strings, each matching ^[A-Za-z0-9][A-Za-z0-9._-]*(\/[A-Za-z0-9][A-Za-z0-9._-]*)*$ | no | The diagnostic objects that run after the checks. |
ObjectRef ​
Write one of these forms.
- string matching
^[A-Za-z0-9][A-Za-z0-9._-]*(\/[A-Za-z0-9][A-Za-z0-9._-]*)*$ - a mapping with the fields below
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
extends | string matching ^[A-Za-z0-9][A-Za-z0-9._-]*(\/[A-Za-z0-9][A-Za-z0-9._-]*)*$ | yes | The object this inline one extends. | |
items | list of ItemPatch | no | Operations on the parent items. | |
order | list of strings, each matching ^[A-Za-z0-9][A-Za-z0-9._-]*$ | no | The item order. | |
params | map of string to any value | no | Object-level parameters. |