INDUSTRY · AUGUST 9, 2026 · 5 MIN READ

Claude Code Auto Mode Goes Default Aug 14: What the Numbers Actually Mean

Anthropic flips Claude Code to classifier-based approval on August 14. The 89% catch rate is real. So is Simon Willison's prompt injection skepticism.


Claude Code Auto Mode Goes Default Aug 14: What the Numbers Actually Mean

Starting August 14, Anthropic makes Auto Mode the default in Claude Code for Pro, Max, and Team plans. The old behavior, where Claude pauses and asks permission before each tool call, gives way to a classifier that evaluates every action and blocks what it considers dangerous. The numbers Anthropic published are striking. The skepticism from people who track this closely is equally real.

The 97% approval rate is the actual finding#

Anthropic's announcement on August 7 buries the most important data point. Users approve 97% of permission prompts in Claude Code. Only 3% get rejected. Plan approval runs even lower: when Claude presents a multi-step plan, users reject 39% of those. But individual permission requests sail through at a 97% clip.

That asymmetry tells you something. Developers pay attention when presented with a narrative, a full plan they have to sign off on. They stop paying attention when the same interface asks them to click approve for the fourteenth consecutive shell command in a session. The approve button becomes a reflex, not a decision.

The 1,053-tester controlled study confirms this mechanically: human reviewers caught 13.6% of dangerous commands, versus 89% for the classifier. Humans caught about 17% of dangerous commands early in a session, dropping to 5% after 50 or more prior prompts. The classifier's block rate was flat throughout. That is not a close call. The pattern has been visible in security UX research for years: approval fatigue degrades decision quality in proportion to volume. As Scale X's 40,000-run study found separately, players approved one in three threats, and 7% approved everything.

The prompt injection result and why one researcher remains skeptical#

The Trajectory Labs evaluation tested 72 indirect prompt injection scenarios, 10 runs each, 720 total attempts. None succeeded against Claude Fable 5, Opus 5, or Sonnet 5 running Auto Mode. The same attacks achieved a 5.83% success rate against GPT-5.6 Sol running Codex's Auto-review mode, and 19.03% against GPT-5.6 Sol in Full Access mode.

That is a strong result. Simon Willison, who has tracked prompt injection for two years and whose analysis was published August 8, is explicitly unconvinced. His position: "I REALLY want to believe this fixes prompt injection risks for coding agents, but I'm just not there yet." The concern is not that Anthropic's evaluation is dishonest. It's that a held-out eval set, even a rigorous one, cannot cover the full distribution of adversarial inputs that appear in production, in third-party MCP tools, in web content pulled into context, in PR descriptions written by bad actors. Elad Meged at Novee Security ran a related demonstration in July, successfully exfiltrating secrets through Anthropic's own pipeline in its default configuration, as reported by Help Net Security on July 29.

Anthropic acknowledges the limit directly: "auto mode reduces risk for most users, it relies on classification systems and therefore does not eliminate risk."

What actually changes in the audit trail#

The permission model change is also a governance change. Under manual approval, each developer decision is discrete and attributable. Someone clicked approve on that command at that moment. Under Auto Mode, the decision is made by a classifier running inside a model. The action appears in logs, but the reasoning behind the approval does not. For teams that need to trace why a specific command ran against production infrastructure, the audit surface shrinks.

This matters beyond the individual session. As discussed in the bottleneck shift from generation to validation, the cost of trusting AI-generated code has not dropped alongside the cost of generating it. Auto Mode shifts more of the generation-time trust question onto a harness the developer does not directly control, updating independently of team policy decisions.

Anthropic gives administrators the disableAutoMode flag and a defaultMode override in managed settings. Enterprise plans remain opt-in for now. The classifier also hard-denies data exfiltration categories and cannot be overridden without switching modes entirely.

The comparison that matters#

Auto Mode versus the approve button is not the right comparison. Auto Mode versus a team with actual review discipline is harder to evaluate, because teams with actual review discipline are rare. Anthropic's own data says 62% of users have enabled bypassPermissions or clicked "don't ask again" on Bash, and 25% of interactive sessions start in bypass permissions mode already. For those users, Auto Mode is demonstrably an improvement.

The 13.6% human catch rate in a controlled study with paid professional testers who knew they were being evaluated is the floor. Real production sessions, with engineers under time pressure, working across parallel terminals, are almost certainly lower.

Where this leaves autonomous code review#

Classifier-based approval is a delegation of code review, not an addition to it. The classifier makes judgment calls that previously belonged to the developer, using criteria the developer cannot inspect in real time. For most commands most of the time, that trade is probably fine. For the tail of adversarial inputs, novel attack vectors, and context-dependent security decisions, the classifier's miss rate is unknown against real-world traffic.

What changes on August 14 is the default posture of the most widely used coding agent. Teams that have not actively configured their permission model will inherit that posture. Whether their repos reflect that choice is a separate question from whether the classifier is technically superior to a reflexive click.

Hyrax is live at hyrax.dev.


Sources

  1. 01anthropic.com
  2. 02anthropic.com production
  3. 03simonwillison.net
  4. 04sourcefeed.dev
  5. 05helpnetsecurity.com