Science & Tech · Big Tech & Internet · 1 hr ago

Google's confidential AI system uses AMD Epyc CPUs instead of Axion

Google's confidential AI system uses AMD Epyc CPUs instead of Axion

Google introduced the TPU 8tx, a system for running AI work with confidential computing protections.

It pairs Google's TPU 8t accelerator with fifth-generation AMD Epyc processors, rather than Google's own Axion CPU.

The system is aimed at governments and regulated businesses that want to work with private data without moving it between clusters.

AMD says its security technology helps isolate the system and protect prompts, model weights and other data while the TPU is running.

Google has not explained the choice, but its current confidential-computing services support AMD and Intel machines, not Axion, suggesting its audited security setup is limited to x86 processors.

Google says the TPU 8tx can deliver up to twice the performance of the TPU 8t on latency, with nearly no performance penalty, while adding hardware-enforced protection for AI workloads.

1 source

Related

What people are saying

GoogleCompany
keeping sensitive data and model weights protected and isolated even while in active use.
via TechRadar