DeepSpeed
Named by 3 kept items in this workspace.
Search every workspace for DeepSpeed. It matches the name as written, so it can find other things that share it.
The items that name it 3
Training library; Python hook overhead gave a 9.59x speedup case, since fixed upstream.
Used to run multi-GPU training of LittleBit/LittleBit-2 with a ZeRO-3 configuration (configs/zero3.json).
Distributed training system compared against Soup's layer streaming; ZeRO-3 across eight cards was found slower than one card training resident
All technologies in this workspace.