getnews.online

35B: AMD runs a large model on an NPU through Unsloth Desktop

AMD added XDNA 2 NPU support to Unsloth Desktop, so AI models can run locally without the cloud.

35Bparameters in the demo model

Hype check

Hype4
Real4
As advertised

The noise matches the real change.

Your call: hype or real?

Real = it will matter in daily use. Hype = louder than it is. One vote, and it can’t be changed.

Why it matters

Running models on the eases the load on the CPU and GPU and saves power on laptops.

For most people

Skip: news for owners of high-end PCs.

The details

  • AMD and Unsloth demonstrated a 35-billion-parameter Qwen 3.6 model running on an NPU.
  • It is the first time Unsloth Desktop supports NPUs, and it works with the XDNA 2 architecture.
  • The runs use Lemonade and FastFlowLM.
  • Full context needs about 28 GB for the NPU, and with Windows' default settings 64 GB of system memory.
  • Unsloth Desktop's connects to 100+ applications, including Cline, Open WebUI and Visual Studio Code.
WatchWatch: an AMD demo that awaits independent testing.

Receipts

One trusted outlet reports it. Not confirmed yet. Open the sources and check us.

Written with the help of AI tools and checked against the sources above. How we work

Get the daily brief by email

One email each morning. Unsubscribe with one click.

See a mistake? Tell us and we’ll fix it.