Multi-teacher on-policy distillation
Named by 4 kept items in this workspace.
Search every workspace for Multi-teacher on-policy distillation. It matches the name as written, so it can find other things that share it.
The items that name it 4
Trains a student with on-policy distillation over several teacher models to merge experts into one model.
MOPD
MOPD
All techniques in this workspace.