Cast by rathermercurial.eth
Show the cast this replies toNot trippin. AMD makes a separate "AI Engine" (the part that's supposed to run the models) which is a separate wafer from your GPU's. amd.com/en/products/processors/laptop/ryzen/ai-300-series/amd-ryzen-ai-max-385.html My main reason for mentioning it is that my setup is solar-assisted also, and I also setup my Ai mini-pc (minisforum um890) in gpu-only mode when I got it. It was running at 1/3 speed and using 3x power than it should have on paper. Anyway not a performance nitpick so much as "I've got one of those new tools too, and I think you're holding it the wrong way"... Like you said, unified systems are new and there's a lot of misconceptions to unlearn (like skeumorphically selecting a gpu-only runtime even when we paid the extra $ for an AI CPU)
1 reply
Broski, I think you misunderstand what the NPU is for. Your system is limited by data throughput significantly more than mine is, so your need to run on the CPU is more of a product of hardware limitations(necessity) and not one of optimum performance. You have about 60+gbps of bandwidth, I am running 256gbps 🤷♂️
Definitely think you're reading the specs wrong on that. It's cool; once the small.moxels runtimes get more accessible, you'll figure it out. Gl!
