LM Studio / Windows / Vulkan possible to prioritize GPU order?
With CUDA you can prioritize GPU usage which worked well with a 3090ti and 3060 12GB. Under 24GB, fastest, under 36GB, slower, >36GB moving some layers to CPU so slowest. I just added a R9700 so while my GPU VRAM has in
π
This source provides headlines only. Use the button below to read the complete article on the original site.
π° Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes β full credit and traffic to the original publisher.