Using the Lamborghini of inference engines for serverless Llama 3

 (modal.com)

1 points | by birdculture 13 hours ago ago

1 comments

  • gnabgib 13 hours ago ago

    Title: Serve an interactive language model app with latency-optimized TensorRT-LLM