2x Tesla p100s, q6_k quant, Qwen 3.8 27B ~60tps

 (github.com)

3 points | by Kmic68 12 hours ago ago

2 comments

  • enslavedrobot an hour ago ago

    Interesting. What system were running the cards on?

  • Kmic68 12 hours ago ago

    [dead]