OnPrem World地端世界

Hardware Published:

AMD's next Ryzen AI Halo: Ryzen AI Max+ PRO 495 with up to 192 GB of unified memory

AMD introduced its next Ryzen AI Halo developer platform on October 12, built on the Ryzen AI Max+ PRO 495 with 16 Zen 5 CPU cores, 40 RDNA 3.5 GPU compute units and up to 192 GB of LPDDR5x unified memory. Up to 160 GB of that memory can be assigned to the GPU, which AMD says is enough for models of 300 billion parameters and more at 4-bit quantization. It comes with a validated ROCm software stack and is sold through Micro Center, with Windows-based versions listed as coming soon.

Why it matters locally

That is 64 GB more than the 128 GB maximum of the Ryzen AI Max+ 395 generation, but at about 273 GB/s of bandwidth big dense models will generate slowly; mixture-of-experts models with few active parameters suit it best.

Source

Read the official source: AMD blog ↗

Summaries are written by OnPrem World from the official source. We link to the original and never republish it.

On this site

More news

All news →