[3090] Gemma4 QAT + MTP quick TPS numbers [TLDR 1.2-1.8x better]
These last few weeks have been godsend for 24GB (and below) gpu poor peeps. Killer models released (Gemma 4 / Qwen 3.6) Free intelligence via QAT Bonus speed via MTP We're at the tipping point where GPU poor (24gb and
![[3090] Gemma4 QAT + MTP quick TPS numbers [TLDR 1.2-1.8x better]](https://preview.redd.it/sqcwpyzee26h1.png?width=140&height=36&auto=webp&s=aa35a209b2b7baa1197095070bb57c49327a1f08)
π
This source provides headlines only. Use the button below to read the complete article on the original site.
π° Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes β full credit and traffic to the original publisher.