I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)[P]
ALHR- Adaptive learnable Hierarchical Routing is a static binary tree based system that uses learnable functions to REDUCE the amount of keys used. It takes less memory and SCALES much better VRAM with tokens submitte
![I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)[P]](https://external-preview.redd.it/zVOPn_mNnDJX1JYwwkAFVvoaRxIz-xqSHTWymSih1MY.png?width=640&crop=smart&auto=webp&s=beb6f8279ccc7f34963604a3f8d155247380823d)
đ
This source provides headlines only. Use the button below to read the complete article on the original site.
đ° Read the original article on r/MachineLearning
Originally published by r/MachineLearning. Aggregated on AIWithGhost for educational purposes â full credit and traffic to the original publisher.