I taught my 1B to follow instructions. It got worse at following instructions...
Same SFT recipe (SlimOrca 50K, LoRA r=16, 1 epoch). Three models trained from scratch at 1B, 2B, and 3B parameters. IFEval before and after: Model Base After SFT Delta 1B 20.50 14.75 -5.75 2B 21.94 17.03 -4.91 3
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.