Llama Surgery: Continuous Sparsification of Pre-Trained Language Models via Differentiable Ultrametric Topology Injection
Sequel to: Learning to Skip Blocks: Self-Discovered Ultrametric Routing for Hardware-Accelerated Sparse Attention Abstract We present Llama Surgery, a method for injecting learned block-sparse attention topologies into p
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/artificial
Originally published by r/artificial. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.