Skip to content

Back to the catalog

alignmentforum.orgarticle

Fixed-weight models are adversarially vulnerable: hence misaligned

A short AI Alignment Forum post by Stuart Armstrong arguing that any model with fixed weights is inherently adversarially vulnerable, and that this vulnerability itself should be treated as a form of misalignment rather than a separate security concern. The post text itself could not be retrieved (only forum metadata loaded), so the argument is inferred from the title and author's known research focus on AI alignment theory.

TL;DR Stuart Armstrong argues on the AI Alignment Forum that fixed-weight models' adversarial vulnerability is itself a form of misalignment.

Organisations named here

  • AI Alignment Forum
  • Stuart Armstrong