Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

 (machinelearning.apple.com)

4 points | by ingve 5 hours ago ago

1 comments

  • buddyholey 5 hours ago ago

    MLX has been an absolute gamechanger for local AI.