Channel: Nate Herk | AI Automation
We Might Actually Need to Stop AI
The Signal
OpenAI and Anthropic are both publicly advocating for a coordinated global slowdown of frontier AI development, while simultaneously racing their own projects into the public market. The central tension is that both labs admit commercial and national incentives make unilateral restraint impossible, framing a verifiable international treaty as the only viable mechanism to avoid an unchecked AI race. Whether these requests stem from genuine safety precautions or strategic reputation management remains a point of intense speculation, as does the feasibility of enforcing such a treaty across competing global powers.
The Case
- OpenAI published a broad vision on June 8 to ensure AGI benefits humanity—including developing an 'AI automated researcher' by March 2028—but the plan hinges on an international group having the authority to slow model development when necessary.
- Anthropic, a competing AI lab, released a report earlier that month requesting a verifiable way to pause progress if AI becomes 'too scary,' an idea that depends on verifying that all other international players are pausing as well.
- The narrator argues that the labs are not calling for self-imposed brakes but for an external referee, noting that the incentives around commercial and national competition are effectively impossible for any single lab to escape.
- Infrastructure for training frontier models leaves a massive, visible footprint, including power consumption rivaling small cities and the demand for tens of thousands of specialized chips, which the narrator suggests makes global verification technically possible.
- The real barrier to a slowdown is the incentive misalignment where no participating nation wants to fall behind the next leader, meaning a pause only holds if breaking it costs more than the potential reward of winning the race.
- On June 12, the U.S. government ordered Anthropic to suspend public access to its AI tools 'Claude Mythos' and 'Claude Fable,' a specific intervention the narrator cites as a concrete governance event separate from the broader industry debates.
The 1 Minute Signal Take
The evidence suggests that neither lab is capable of slowing down independently, making the prospect of a voluntary safety-first race a fantasy. The speaker’s pivot to individual skill acquisition—betting on persistent human judgment rather than specific company outcomes—is the only actionable advice in an otherwise gridlocked policy environment. Watch for the speaker's follow-up on the Anthropic suspension, but treat the general predictions about 20-year shifts as speculative, as the video is more valuable for its synthesis of the labs' incentive structures than for its forecasting.
Time saved:
Tags
Channel: Nate Herk | AI Automation
