Post-training quantization
Named by 8 kept items in this workspace.
Search every workspace for Post-training quantization. It matches the name as written, so it can find other things that share it.
The items that name it 8
Low-bit quantization of large language models after training to reduce memory footprint and computational cost. The page frames accuracy at low precision as depending on quantization ranges, linear transformations and weight rounding.
Reduces the memory footprint of vision-language-action models after training, though keeping task performance at lower bit widths is hard.
PTQ
PTQ
PTQ
AWQ, GPTQ
All techniques in this workspace.