Research

    The Behaviorist Lab

    Behaviorist is a small research practice working on one problem: where an agentic system should stop and ask a person, and what happens to that person's judgement when it does. The commercial work funds the research and supplies the cases. This page is the open agenda. Everything listed here is unanswered, and the status column says so honestly.

    Why an agenda and not a manifesto

    A field this new produces a great deal of confident writing and very little measurement. Choice architecture for agentic systems has an established parent literature in behavioural science, and almost none of it has been tested where the chooser is a machine and the reviewer is a person under time pressure. The questions below are the ones that would move the field from argument to evidence, listed so that other people can take them, argue with them, or tell us they have already been answered.

    01

    Does escalation cost asymmetry predict rubber-stamping?

    Why it matters

    In most review interfaces, approving costs one click and objecting costs a written justification, a context switch, and a social cost. If that asymmetry alone drives approval rates, independent of the risk of the underlying decision, then a large share of human-in-the-loop oversight is decorative, and the fix is interface design rather than training or policy.

    What would answer it

    A controlled study varying only the cost of the escalation path while holding decision risk constant, measuring approval rate and review time. This is cheap to run and has not been run.

    Status: Open. Not yet run.
    02

    Are the five dimensions of the Checkpoint Scale empirically separable?

    Why it matters

    The scale treats reversibility, consequence magnitude, confidence, precedent, and regulatory exposure as five distinct inputs. If reversibility and consequence magnitude are in practice one factor, the instrument is measuring four things and claiming five, and the weights are wrong in a way that matters.

    What would answer it

    Factor analysis over a large corpus of scored decision points from more than one organisation. This requires data the lab does not yet have enough of.

    Status: Open. Blocked on corpus size.
    03

    What weights actually predict incidents?

    Why it matters

    The Checkpoint Scale's weights are theory-driven. They were set from the behavioural literature, not fitted to outcomes. Until they are calibrated against what actually went wrong, the instrument is a structured opinion, and it should be described that way.

    What would answer it

    Decision points scored before the fact, paired with their real outcomes, across enough cases to fit and then validate weights out of sample.

    Status: Open. Requires outcome data from partner organisations.
    04

    Does a person under load converge on confirming a prior when an AI assistant is available?

    Why it matters

    This is the load-bearing claim under most of the practice. The argument is that pressure takes deliberate reasoning offline first, and that an AI assistant arriving at that moment gets used to confirm an existing prior rather than widen the decision. The narrowing-under-stress half is well established. The AI half is not, and it is asserted far more often than it is tested.

    What would answer it

    An experiment varying time pressure while holding the task constant, giving every participant the same AI assistant, and measuring whether they seek confirming or disconfirming information. Preregistered, so a null result counts.

    Status: Open. Not yet run. This is the lab's first intended study.
    05

    What does the real distribution of agentic decision points look like?

    Why it matters

    Nobody has published what production agentic systems actually decide without a human, at what risk profile, at what volume. Every current claim about where autonomy sits, including ours, rests on anecdote and a handful of vendor case studies.

    What would answer it

    A structured corpus of real decision points across many systems, reported in aggregate. This is what the scoring API accumulates as a by-product, and it is the lab's intended first report once there is enough of it to be worth anything.

    Status: Open. Accumulating.

    Instruments

    The Checkpoint Scale (v1.0)

    Published in full, theory-weighted, and awaiting calibration.

    Field notes

    Working notes, not peer-reviewed publications. They argue positions and work through cases; they do not report results.

    Choice Architecture for Agentic AI

    How defaults, framing, and friction translate when the chooser is an AI agent.

    Auditing Friction in Multi-Agent Systems

    A checklist for finding and classifying friction at agent handoffs.

    The Merge Button Is a Decision Point

    Why the merge button is a decision point like any other.

    Regulatory Exposure Is a Decision Point, Not a Department

    Finding regulatory exposure at specific decision points before an incident does.

    Working with the lab

    If one of these questions is already answered somewhere and we have missed it, that is the most useful email you could send.