Modal Auto Endpoints: Optimized inference you own

(modal.com)

18 points | by handfuloflight a day ago ago

4 comments

  • DIVx0 a day ago ago

    FYI, it seems Modal will add $70 to your free "standard" accounts when you try out Endpoints.

  • Hizonner a day ago ago

    I'm a bit confused. In my world, "I own it" means it's running on hardware physically in my control, by default physically in my possession, and nobody can turn off my account...

    • crsv a day ago ago

      I had the same thought. I don't own the inference here, I just have more granular access to the inference process, right? Seems like the only way I would own inference is if I own the hardware it's running on?

  • StrauXX a day ago ago

    How is this different from say BiFrost?