OSCAR RotationZoo - Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization
https://huggingface.co/Zhongzhu/OSCAR-RotationZoo OSCAR RotationZoo Precomputed K/V rotation matrices for OSCAR INT2 KV-cache quantization. This repository contains the artifacts for the paper: OSCAR: Offline Spectral Co
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.