Tensor parallelism
Named by 5 kept items in this workspace.
Search every workspace for Tensor parallelism. It matches the name as written, so it can find other things that share it.
The items that name it 5
TP
Splits broad operations such as attention across accelerators by KV heads or context ranges, followed by a compact reduction.
TP
All techniques in this workspace.