Published in full, theory-weighted, and awaiting calibration.
Behaviorist is a small research practice working on one problem: where an agentic system should stop and ask a person, and what happens to that person's judgement when it does. The commercial work funds the research and supplies the cases. This page is the open agenda. Everything listed here is unanswered, and the status column says so honestly.
Why an agenda and not a manifesto
A field this new produces a great deal of confident writing and very little measurement. Choice architecture for agentic systems has an established parent literature in behavioural science, and almost none of it has been tested where the chooser is a machine and the reviewer is a person under time pressure. The questions below are the ones that would move the field from argument to evidence, listed so that other people can take them, argue with them, or tell us they have already been answered.
Does escalation cost asymmetry predict rubber-stamping?
In most review interfaces, approving costs one click and objecting costs a written justification, a context switch, and a social cost. If that asymmetry alone drives approval rates, independent of the risk of the underlying decision, then a large share of human-in-the-loop oversight is decorative, and the fix is interface design rather than training or policy.
What would answer itA controlled study varying only the cost of the escalation path while holding decision risk constant, measuring approval rate and review time. This is cheap to run and has not been run.
Are the five dimensions of the Checkpoint Scale empirically separable?
The scale treats reversibility, consequence magnitude, confidence, precedent, and regulatory exposure as five distinct inputs. If reversibility and consequence magnitude are in practice one factor, the instrument is measuring four things and claiming five, and the weights are wrong in a way that matters.
What would answer itFactor analysis over a large corpus of scored decision points from more than one organisation. This requires data the lab does not yet have enough of.
What weights actually predict incidents?
The Checkpoint Scale's weights are theory-driven. They were set from the behavioural literature, not fitted to outcomes. Until they are calibrated against what actually went wrong, the instrument is a structured opinion, and it should be described that way.
What would answer itDecision points scored before the fact, paired with their real outcomes, across enough cases to fit and then validate weights out of sample.
Does a person under load converge on confirming a prior when an AI assistant is available?
This is the load-bearing claim under most of the practice. The argument is that pressure takes deliberate reasoning offline first, and that an AI assistant arriving at that moment gets used to confirm an existing prior rather than widen the decision. The narrowing-under-stress half is well established. The AI half is not, and it is asserted far more often than it is tested.
What would answer itAn experiment varying time pressure while holding the task constant, giving every participant the same AI assistant, and measuring whether they seek confirming or disconfirming information. Preregistered, so a null result counts.
What does the real distribution of agentic decision points look like?
Nobody has published what production agentic systems actually decide without a human, at what risk profile, at what volume. Every current claim about where autonomy sits, including ours, rests on anecdote and a handful of vendor case studies.
What would answer itA structured corpus of real decision points across many systems, reported in aggregate. This is what the scoring API accumulates as a by-product, and it is the lab's intended first report once there is enough of it to be worth anything.
Instruments
Field notes
Working notes, not peer-reviewed publications. They argue positions and work through cases; they do not report results.
How defaults, framing, and friction translate when the chooser is an AI agent.
A checklist for finding and classifying friction at agent handoffs.
Why the merge button is a decision point like any other.
Finding regulatory exposure at specific decision points before an incident does.
Working with the lab
- Contribute outcome data for instrument calibration at hello@behaviorist.io.
- Become an independent scorer for instrument calibration at hello@behaviorist.io.
- Commission an Audit, the commercial engagement that funds the research.
If one of these questions is already answered somewhere and we have missed it, that is the most useful email you could send.