Continual learning on 4 days of real news: an 8B model keeps day 1 at 90.7% vs 26.7% for LoRA, GSM8K unchanged (sealed test) [R]
I've been working on continual learning. Each night a model learns that day's news into its weights, then gets asked about it the next morning with nothing in the prompt. One day turns out to be easy. A plain LoRA traine
![Continual learning on 4 days of real news: an 8B model keeps day 1 at 90.7% vs 26.7% for LoRA, GSM8K unchanged (sealed test) [R]](https://preview.redd.it/24hvufz5670i1.jpeg?width=640&crop=smart&auto=webp&s=616840e2bfe52c272f061b4cf70bf4ab5277df80)
π
This source provides headlines only. Use the button below to read the complete article on the original site.
π° Read the original article on r/MachineLearning
Originally published by r/MachineLearning. Aggregated on AIWithGhost for educational purposes β full credit and traffic to the original publisher.