On-PREM AI workstation promises to put up to 576 GB of HBM3e and 16 TB/s of memory bandwidth on your desk. Machine learning researchers have a new and expensive option for doing local AI. AMD's Threadripper Halo, announced at IFA 2026, marks the first time AMD’s Instinct accelerators are offered in a workstation form factor.
The system, powered by a 96-core Threadripper PRO 9995WX CPU with up to 2 TB of DDR5 and 2.6 TB of combined system memory, is positioned as a local AI workstation for researchers. It supports up to four PCIe-based Instinct GPUs (MI350P), each with 144 GB HBM3e and 4 TB/s bandwidth, totaling 576 GB HBM3e and 16 TB/s bandwidth. The system can run models exceeding a trillion parameters at four-bit precision, including large open-weight models like Moonshot.AI’s 2.8 trillion-parameter Kimi K3.
However, the high power draw (up to 2.6 TB/s) may require significant electrical upgrades. Pricing is expected between $100,000 and $150,000, positioning it competitively against Nvidia’s DGX Station, which features a 252 GB B300 GPU, 72-core Grace CPU, and 496 GB LPDDR5x memory, priced similarly. AMD’s Threadripper Halo is set to launch next year.
Source: The Register
