Qwen3.6-27B on 2x3090s: llama.cpp vs vLLM, all the flags, and the MTP acceptance/inference speed/context
written 20%-ish by me and 80% by Claude code Spent basically a whole day getting my box to run Qwen3.6-27B as one OpenAI-compatible endpoint that hot-swaps between four quant/backend combos (llama.cpp Q6_K and Q8_0, vLLM
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.