1 hr ago

AMD Unveils Halo Station With 576GB HBM3E for Local AI

AMD Unveils Halo Station With 576GB HBM3E for Local AI
576GB of HBM3E under a desk: AMD's Halo Station is aimed squarely at Nvidia's DGX · wionews.com

AMD announced a very powerful computer called Threadripper Halo Station.

It is designed to sit beside a person instead of inside a large data center.

The machine can use up to four special AI chips.

Together, those chips can provide 576GB of very fast memory.

AMD says this could let people run AI models with more than one trillion parameters without using the cloud.

This may help groups handling private medical, defense, or financial information.

It could also help researchers avoid waiting for cloud computers.

However, AMD has not said how much the machine will cost or when it will be available.

Key facts

Processor
96-core, 192-thread Threadripper PRO 9995WX based on Zen 5, with boost speeds up to 5.4GHz.
System memory
Supports up to 2TB of DDR5 memory.
AI accelerators
Supports up to four Instinct MI350P accelerators.
GPU memory
Each accelerator has 144GB of HBM3E; four cards provide 576GB total.
Presented configuration
AMD showed a two-card configuration providing 288GB of HBM3E.
Intended workload
Local AI inference for models exceeding one trillion parameters.
Unreleased details
AMD has not announced pricing, availability, or complete system specifications.

Sources

Related news