Over a thousand people working in artificial intelligence labs signed a letter called "Pacing the Frontier." Pacing the Frontier is an international call to create pause mechanisms: the concern is that models capable of improving other models could accelerate beyond our capacity to understand or regulate them. They're not asking to stop the race. They're asking for the option to choose the pace when it becomes necessary.
This request comes from within. Among the signatories are Jack Clark and Chris Olah from Anthropic, alongside chief scientists from OpenAI, Meta, Google DeepMind, and Thinking Machines. The very people building these systems are now asking for ways to limit them.
Why ask for brakes while competing to move faster?
The answer reveals real tensions within the labs leading the race. Some time ago Anthropic had already explored the risks of autonomous self-improvement. This letter expands on that idea with support from nearly a dozen organizations and public backing from OpenAI and Anthropic.
What's different here is the origin. Warnings used to come from external academics or former employees with nothing left to lose. This time the voice comes from people with equity, bonuses, and active careers within the industry. OpenAI stated that the world will need to pace the rate of progress at some future point. That conditional says more than it appears to.
Who decides when a pause is needed?
The same labs that would compete to ignore the pause reserve that definition for themselves. That's where a structural conflict emerges: the referee is also a player. This dynamic is described in The Generosity in the Doorway. When those who cause the problem also design the remedy, incentives tend to align in predictable ways.
I'm not talking about bad faith. Structures matter more than intentions. There's also an angle between global powers: if only the United States and its labs define these tools, China and emerging economies are left out of the table where the rules get decided. An agreement without real verification between rivals doesn't slow anything down. It just redistributes the speed.
I'm still not sure whether this letter stems from genuine alarm, strategic positioning, or both at once. The technical risk of self-improving models is well documented. However, the letter avoids details about external audits, veto power, or what happens when a lab decides its particular case doesn't apply.
I've seen similar tensions in other organizations. When a group asks to be regulated, it's worth looking at who ends up outside that regulation and who gets to say "not yet." This letter answers neither question. It proposes an international effort without clear accountability mechanisms.
Credit is due for the fact that so many people inside these labs signed something public. That doesn't happen by accident: it suggests genuine friction between what competition demands and what seems prudent. Effective brakes require a clear separation between builder and watchdog. This proposal, for all its apparent good will, still doesn't offer that distance.
Stones don't lie. But can those leading the race write rules that actually rein in themselves?
Sources
1. Open letter "Pacing the Frontier," signed by employees of OpenAI, Anthropic, Google DeepMind, Meta, and Thinking Machines
2. Public statements from OpenAI and Anthropic on X regarding the pace of AI progress
3. Anthropic technical report on self-improving AI
4. Yves Laurent, The Generosity in the Doorway