Show HN: Fast NF4 dequantization Triton kernel (1.41x faster than bitsandbytes)

 (github.com)

5 points | by Griffith-7 15 hours ago ago

1 comments

  • DiabloD3 9 hours ago ago

    Neat, can't wait to see a llama.cpp PR for this.