How do I improve my T/S
I have a laptop with 5070 Ti (12GB VRAM), 32Gb of ram, Intel core ultra 9 275HX and Windows 11 amd I am using llama-server. I see people with 6 GB of VRAM running MoEs with 30-40 t/s but I cannot push my Qwen3.6-35B-A3B
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.