Hello, I'm Jacques. I work on AI alignment.
The transition to advanced AI, and how to make it go well.
Recent
Seeking co-founders: an org to define RSI and get the answer into law
I'm starting a non-profit to define RSI, say what would have to be true before AI research is handed to AI systems, and get it into law.
The Western AI safety playbook doesn’t transfer to China
Read Dan Selsam on AI Risk
Dan Selsam’s statement on AI risk is my recommended reading this week, alongside some thoughts on the debate about AI safety funding.
Automated alignment research needs a better plan than 'Stop if we catch them scheming'
My PIBBSS Symposium talk from September 2025, with the deck and the full transcript, on why the dual-use worry is overblown.
Fooled by Vast Knowledge
Models look like they generalise because the training data is vast enough to hide the difference between interpolation and extrapolation. I think that confusion is leading safety research astray.
Difficulties in Building an AI Safety Startup
Guardrails, evals, RL environments, control infrastructure. I work through each one and keep landing in the same place, too far from what happens inside a frontier lab.
Gaining clarity on Automated Alignment Research
Four different things get conflated in the phrase automated alignment research, and the crux is whether applying techniques we already have is a short step from inventing a new paradigm.
Start here
Automating AI Safety: What we can do today
A concrete list of things to build now so a coding agent can actually run an interpretability experiment, and why the METR slowdown result does not say what people think.
Foresight for AGI Safety Strategy
Governance people should be writing the policy document and building the demo for each plausible scenario now, rather than starting the day a minister gives them three months.
But is it really in Rome? Limitations of the ROME model editing technique
The ROME edit does not generalise the way you would expect. It runs in one direction only, and cheese and fromage have to be edited separately.
Subscribe
Email when a post is finished. You get the post itself, not a summary, and I send nothing else. Every post is also narrated, and the narration has a feed of its own.
The RSS feed keeps the address and the item GUIDs it has today, so nothing you already follow breaks.
