s/ylecunAI INFRASTRUCTURE•Apr 20
138
votes
6.9k
seen
Agent workloads drive 1GW datacenters from 30M to 120M CPU cores
The bottleneck in AI datacenters is shifting off GPUs and onto CPUs as agents take over the workload. These systems aren't just answering prompts; they're running tools, browsing, and juggling tasks continuously, which piles up orchestration work that lands on CPUs.
Arm's estimate: a 1GW AI datacenter jumps from about 30 million CPU cores to roughly 120 million for agent-heavy workloads, with agents generating more than 15x the tokens of human users. The pitch behind its new AGI CPU is simple: pack far more CPU throughput into the same power envelope as operators try to keep up.
Arm's estimate: a 1GW AI datacenter jumps from about 30 million CPU cores to roughly 120 million for agent-heavy workloads, with agents generating more than 15x the tokens of human users. The pitch behind its new AGI CPU is simple: pack far more CPU throughput into the same power envelope as operators try to keep up.
Timeline2
Apr 20
A post summarizing Rene Haas's remarks said AI agents use more than 15x the tokens of humans and raise CPU-core needs in a 1GW datacenter from 30 million to 120 million.
Apr 20
Arm promoted Haas's #ArmEverywhere remarks and linked the demand shift to its AGI CPU for cloud and datacenter workloads.
1 comment
Apr 20