Anything beat Qwen 3.8 27B yet?
I have 32 GB of VRAM and 32 GB of system RAM. The best dense model I've managed to run so far is Qwen 3.8 27B at Q6 quantization. I can also run some larger MoE models by offloading the experts to the CPU, as long as the
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.