r/LocalLLaMA πŸ€– Ai πŸ‘ 0

Terrible Vulkan pp/tg on Arrow Lake iGPUs

Hi, I recently tried to get llama.cpp with SYCL running on an Arrow Lake system but gave up halfway through since Vulkan is just way easier to set up. But, the pp/tg I'm getting on Vulkan w/ Arc 130T is disgustingly bad

πŸ“„

This source provides headlines only. Use the button below to read the complete article on the original site.

πŸ“° Read the original article on r/LocalLLaMA

Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes β€” full credit and traffic to the original publisher.