2 points | by ansnadeem 11 hours ago ago
1 comments
A few days ago Sam Altman was on Stripe’s Cheeky Pint podcast talking about the memory shortage. On people running models locally he said:
"It’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer. And be used 5% of the time."
I’ve been running models on my own machine for a few months now so I wanted to see what my numbers actually look like.
A few days ago Sam Altman was on Stripe’s Cheeky Pint podcast talking about the memory shortage. On people running models locally he said:
"It’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer. And be used 5% of the time."
I’ve been running models on my own machine for a few months now so I wanted to see what my numbers actually look like.