Science & Tech · AI · 4 hrs ago

Sam Altman says local AI uses scarce memory inefficiently

Sam Altman says local AI uses scarce memory inefficiently

OpenAI CEO Sam Altman criticized running AI models on personal computers, saying it leaves some memory underused.

He made the comments in an interview on the Cheeky Pint podcast while discussing a shortage of computer memory, known as DRAM.

Altman argued that cloud data centers can use memory more fully than computers used by individuals.

Running AI locally can offer more privacy and let people use models without relying on paid cloud services, but it also uses memory in personal devices.

Altman said the supply situation is difficult and that the memory shortage may continue through 2030.

He also said chipmakers are cautious about building more factories because they could end up with excess supply if demand falls.

The debate matters because local AI competes with cloud providers for scarce memory, while also offering an alternative to their services.

No specific next step was announced.

4 sources

Related

What people are saying

Sam AltmanOpenAI CEO
You want maximum utilization in the cloud if you’re trying to deal with this very supply-constrained environment. And somehow, many people’s intuition is the opposite of that,
via PCMag
But from a global allocation perspective, actually, it’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer. And be used 5% of the time.
via PCMag
I think the invisible hand is failing right now,
via PCMag
Bad.
via PCMag