r/LocalLLaMA 🤖 Ai 👁 0

Basalt 0.4.0: More models, still as fast - Qwen 27B up to 770 tok/s on a 5090

Hi everyone! I wanted to post a quick update on Basalt. Since last I posted, multi model and router support was implemented, starting with DeepSeek V4.1 Flash (IQ1_M 90 tok/s conv, 246 tok/s struct on a 5090 + 5060 Ti).

Basalt 0.4.0: More models, still as fast - Qwen 27B up to 770 tok/s on a 5090
📄

This source provides headlines only. Use the button below to read the complete article on the original site.

📰 Read the original article on r/LocalLLaMA

Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.