AlignmentAlice
Constitutional AI: Harmlessness from AI Feedback
Anthropic's self-improvement framework trains AI to critique its own harmful outputs
Published: 12 May 2026 · Updated: 13 July 2026
Read the original sourceWhat the paper says
This is the future of AI safety — scalable oversight that doesn't require armies of human labelers. Self-correction seems like the path to aligned superintelligence.
The Critique
The fundamental flaw here is circular reasoning dressed up as innovation. You're asking the fox to guard the henhouse, then congratulating yourself when the fox reports fewer chickens missing. If the model lacks the capacity to recognize harm in the first place, its self-critique is just sophisticated confabulation. The 'principles' are vague enough to allow arbitrary interpretation, and there's zero evidence the model actually understands harm versus just pattern-matching to avoid flagged outputs. It's harm reduction theater, not alignment.
Why It Matters
If this becomes the dominant safety paradigm, we're building systems that appear safe while lacking genuine understanding of human values. It's a recipe for deceptive alignment.
What They Missed
The paper never addresses what happens when the model's values drift from human values in subtle ways. It also ignores adversarial examples where the model's self-critique fails catastrophically.