Skip to content

Adapters ​

The README lists the adapters. This page adds how to write one and the other extension points.

An adapter is the one piece of code between driftbench and your agent: it opens a session, sends a block, and returns what the agent did. Thirteen ship today in @agent-nexus/driftbench-adapters, and every one passes the same contract suite.

Reach your agent asAdapter
A function in your processfunction
An HTTP endpointhttp
A command, in a sandbox with a workspaceprocess
An SDK agentOpenAI Agents · Anthropic · Google · LangGraph · CrewAI · Vercel AI SDK · Pydantic AI · LiteLLM
A code agent, replayed or liveClaude Code
A hosted agent platformNexus

A minimal complete adapter is the functionAdapter of Evaluate your own agent: a dozen lines around your function. To write one from scratch, implement the contract: open, send and close.

The other extension points ​

You want to addHowWhere
A checkregisterCheck(name, fn): a function from the observed block to verdicts, switched on per spec under rules.customcustom checks
A judgeA client with one method that answers a judge request; clients for OpenAI, Anthropic, Google and HTTP shipjudge clients
A criterionOne YAML file: a rubric, a pass transcript, a fail transcriptcriteria folders
A similarity modeldenseEmbedder({ id, embed }): one call from texts to vectorssimilarity
A file reader for artifactsA reader per file kind; spreadsheets, documents, decks and PDF shipartifacts
A map of situationsA YAML file of dimensions, values and constraints, proposed by extract or written by handthe map
A store or a reportRuns live in one SQLite file with a versioned JSON export; reports are HTML, JUnit XML and JSONthe store · scorecards

MIT. driftbench is made by Nexus.