Benchmarking OSS inference vendors on cost/latency

(github.com)

1 points | by patrickdevivo 3 hours ago ago

1 comments

  • yackrru 2 hours ago ago

    In most cases, Fireworks is more expensive than Sail and Wafer, so it's interesting that for Kimi K3.1 Pro, Wafer actually costs more than Fireworks, even though Wafer offers cheaper pricing on OpenRouter. If Wafer were slower than Fireworks, I'd guess it was due to the reasoning diverging (generating more tokens), but it's actually faster. Hmm, I'm not sure what to make of this.