Grinder12: 0.96-Bit Lossless Streaming KV-Cache (16.55x VRAM Savings

 (github.com)

3 points | by AMICLLC 4 days ago ago

1 comments