LLMs are not superhuman at reading and writing neural network weights
Sean Goedecke's post argues that a paper showing GPT-6 Astra reading and editing neural network weights is not superhuman. Identifying a toy network's game needs only per-cell L2 norms of labeled first-layer inputs, and fixing a 0.8B Qwen model's 32k-token looping matches a human steering/abliteration workflow. He compares weight editing to tweaking compiled binaries.
research, ai-safetyΒ· Added 3 Nov 2026, published 2 Nov 2026






























.avif)




