I Battle Tested Sakana Fugu's Fable Killer

Video thumbnail: I Battle Tested Sakana Fugu's Fable Killer
Jun 23, 202612m 16s video lengthNate Herk | AI Automation

The Signal

Sakana AI’s Fugu Ultra is an orchestration system that routes tasks to multiple frontier models rather than acting as a singular smarter LLM. While promotional claims suggest this approach achieves superior performance, the central tension concerns whether these gains justify the significantly slower speeds and higher costs observed in practical use. A reader trying to decide if this is a usable upgrade versus a marketing-heavy novelty must weigh the speaker’s controlled, tie-heavy test results against the potential for orchestration to manage complex, multi-model workflows.

The Case

  • Fugu Ultra functions as a conductor that breaks down tasks, distributes them to specialist frontier models like GPT or Gemini, and aggregates the outputs into a single API response.1:11
  • In a controlled side-by-side test of 38 tasks, the speaker—a content creator who maintains a 400,000-member community of developers—found that 36 tasks ended in a tie, with Claude Opus 4.8 winning the remaining two.2:17
  • The performance difference on time and money was substantial: Fugu Ultra took 357 minutes and cost approximately $50, whereas the comparative Claude Opus 4.8 workflow finished in 80 minutes for about $10.9:34
  • The speaker notes that while the architecture—which can be integrated into Claude Code via a specific markdown file and API key—is promising, it currently automated a manual routing strategy that he already performs more efficiently with Codex.
  • While the speaker believes orchestration is the strategic future of AI work, he remains skeptical of the current product, as the observed quality did not justify the 4.5x slower runtime and 5x higher costs for his knowledge-work needs.8:04
  • The exact model composition used by Fugu remains unverified, with the speaker speculating it relies on a mix of leading frontier models based on the nature of the requested task.2:49

The 1 Minute Signal Take

The speaker’s harness provides a repeatable, transparent basis for his skepticism, making his cost-performance critique significantly more reliable than the unverified benchmark superiority claims found in promotional material. He effectively steelmans the case for orchestration as a vital future capability before correctly dismissing it as an inefficient tool for his current solo workflow. Skip this video, as the summary captures the essential empirical results and the speaker's core conclusion.

Pro Analysis

Strategic Significance

  • Fugu Ultra represents the shift from 'model-first' to 'workflow-first' AI. It demonstrates that the industry is...

Full analysis always available on Pro.

Time saved:10m 18s

Share this

Tags