r/LocalLLaMA 🤖 Ai 👁 0

Anyone else running one of the pre-release branches of MTP support to maintain the higher speeds?

I cant help myself its ~20% faster for me, I took the highest speed branch(for me), added the vision fix, and am just riding it out for now Dual Xeon 8268, 1.5t 2666, Tesla T4 ~122eval ~38t/s out i tried using the releas

📄

This source provides headlines only. Use the button below to read the complete article on the original site.

📰 Read the original article on r/LocalLLaMA

Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.