2 points | by floathub 5 hours ago ago
1 comments
The thesis being that if you can pack multiple models onto a single GPU, you can actually increase processing capacity with a fixed amount of hardware.
The thesis being that if you can pack multiple models onto a single GPU, you can actually increase processing capacity with a fixed amount of hardware.