Usage and Economic Scale

• The Warren system operates as a cloud-based development pipeline where 86% of runs require no direct human prompts, often relying on pre-written plans instead.2:06
• Over 1,000 agent runs cost $1,348 between May 14 and July 2, averaging $1.48 per pull request; the system was its own largest consumer, accounting for 57% of those runs and $800 of total spend.0:40
• West shifted his workflow from local terminal agents to 100% cloud-based orchestration, currently routing 13 projects—including those used by real companies—through Warren.6:01

Reliability and Limitations

• The system reports a 91% success rate, though 57 runs failed during the tracking period; the most significant failure mode identified was agents simply neglecting to commit their work.7:17
• Autonomous 'bug watch' agents often fail to identify issues that West detects manually, suggesting that while the triggering of agents is automated, the actual quality of debugging remains inconsistent.4:43
• West currently uses high-end Opus-class models for nearly all tasks, which he acknowledges is inefficient; he expects costs to drop significantly as he migrates routine tasks to smaller, cheaper models.1:02