Weird to get near linear scaling by adding another GPU?
Single steam benchmarks (club-3090) model: qwen3.6-27b-autoround-int4 BEFORE: 1x3090 *Their default script recipe for single 3090'*s (4-bit quant and 4-bit kv cache, mtp=2) NARRATIVE decode_TPS: mean = 53 std = 0.6 CODE
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.