Qwen 3.6 27b MTP vLLM
Hello everyone, i am banging my head trying to properly configure qwen 3.6 27b mtp in vllm. I am using vllm v0.20.0 in docker, unquantized model with tp4 (4 3090s), max context length. At low context size, mtp with valu
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.