Science & Tech · AI · 1 hr ago

Arm AGI CPU nearly doubles AMD's modelled rack performance in AI tests

Arm AGI CPU nearly doubles AMD's modelled rack performance in AI tests

A Signal65 assessment found that Arm's AGI CPU nearly doubled AMD's modelled rack-level performance across seven tests for agentic AI, which uses software to carry out tasks with some autonomy.

The comparison was with AMD's EPYC 9755 processor and included workloads such as running tools, retrieving information and serving AI models.

The estimates assumed a 24-kilowatt rack could hold 21 to 23 Arm servers, compared with 13 dual-socket AMD systems.

Arm's average advantage was 1.99 times, with results ranging from 1.43 to 3.19 times across the tests.

The advantage partly reflects how many servers fit within the same power limit, rather than a direct comparison of individual processors alone.

The results are modelled, and final production hardware has not yet been tested, so they do not show that Arm is faster for all computing or across complete data centers.

If the advantage holds in further testing, Arm servers could let operators run more AI workloads within existing power limits, but software compatibility, costs and real-world conditions will affect adoption.

1 source

Related

What people are saying

Mohamed AwadArm executive vice president for Cloud AI
The industry needs to measure how well systems handle the work agents actually complete,
via TechRadar