parentheses-1.0-240M: a 253M recurrent linear attention LM with a fixed 4.85 MB state, trained on one 8GB laptop GPU [P]
We are releasing a small recurrent language modell and its eval code. Limits first, since they matter more than the headline. Limits - Small samples: 9 benchmarks x 4 runs, 960 generations in total. Run 1 is greedy, runs
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/MachineLearning
Originally published by r/MachineLearning. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.