Build 9254 fixes my TG regression and adds PDL for NVIDIA GPUs
I was seeing TG regression on both mtp and non models with the last few builds and had to fall back to b9202 but I just ran the new b9254 and TG has been restored with a bonus ~5% uplift on 2x5060ti 16gb on tensor split.
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.