GSD-LQ: Zero-calibration sub-4-bit compression and 7B in 3.78 GB VRAM

 (github.com)

1 points | by Phantom309-CED 10 hours ago ago

1 comments