A stop that is not the window
Once a coding agent is
reliable enough to use every
day, the missing piece is a
stop that is not the context
window and not fatigue.
Willison’s January was what
he calls AI mania: any
minute the agent was not
building felt wasted. He had
it build a JavaScript
interpreter in Python, then
a WebAssembly runtime in
Python. Afterward he asked
whether the world needed a
slow, buggy, half-baked
Python JavaScript
interpreter. He does not
think it does. That question
is the stop. Capability was
not a reason to keep the
plate spinning.
The same notes are careful
about review. He recounts
two rules a security company,
StrongDM, had been following
since July 2025: code must
not be written by humans, and
code must not be reviewed by
humans. They had decades of
security experience and were
exploring the edge of what
is possible and responsible,
not issuing a house style
for everyone else. The
useful question, as he
frames it, is what you use
to stay confident when you
are not reading every line.
“Don’t read the code”
without a named check is
just not looking. People
still decide whether the
check is the right check,
and whether the thing should
exist. They do not have to
re-audit every line a test
can already trip.
He closes the keynote on why
the job feels harder. The
easy work is gone. If it is
easy, the agent does it.
What is left is difficult.
He borrows a line from Greg
LeMond: it doesn’t get
easier, you just get faster.
Speed is not a reason to
skip the stop. A loop that
can fill a night will fill
a night, unless something
other than the window tells
it to quit.
-
Write “reliable enough”
next to a harness you run,
not a model name alone.
-
Leave sandbox status open
until a breakout attempt
fails closed on your
machine. A session count
at a conference is not a
patch.
-
Any sentence the agent
sends as the person —
home, approved, tests
passed, review done —
needs a check from this
turn. If there is no
check, the sentence is “I
have not checked.”
-
If you are not reading
every line, name the check
that replaced the read: a
test, a trace, a property,
a device run. “The agent
said it passed” is not the
check.
-
After the demo works, ask
who needed it. If the
answer is that the loop
was idle, stop the loop.
This morning, take one
outbound sentence your agent
is allowed to send as you
and write the check it must
pass first. If the only
source is a template, you
have a presence claim with
the sensor removed.
Further read:
2026 in LLMs (so far) — Simon Willison