Disrupting a coordinated model-distillation campaign
OpenAI describes a coordinated adversarial-distillation campaign that tried to extract protected, encrypted reasoning from its models. It began 1 July and peaked 24-25 July with 16,000 requests from over 4,000 users; a related cluster of more than 15,000 users was disrupted by 28 July. Attackers copied encrypted reasoning from one conversation and asked a model in another to decrypt it. OpenAI attributes a core cluster to individuals associated with Moonshot AI (Kimi). Mitigations were account bans, signup and infrastructure controls, closing a reasoning-replay pathway, holding streamed output that might expose reasoning, and sharing findings through the Frontier Model Forum.
Organisations named here
- Frontier Model Forum
- Moonshot AI
- OpenAI
Technologies named here
- OpenAI models
- Kimi K3
- LLM
- Frontier Model Forum
- OpenAI reasoning-replay pathway
- OpenAI streamed output
Techniques named here
- adversarial distillation
- encrypted reasoning replay
Concepts named here
- Model distillation
- Protected (encrypted) reasoning
- Reasoning replay
Related in AI Security
