Scaffold CoT: A CoT dataset built around the failures of small language models (>5B Params) free form thinking. Currently running experiments, but wanted to release it to the community beforehand in case it was of use [P]
TL;DR - A ~4M example, ~3B token CoT dataset designed around helping small models think more concise…