Kimi K3 for local use (1.56TB → 594GB) compressed and released by Unsloth
The model was quantized to 8, 4, 2, and 1 bit. Characteristics: Q8: 8-bit 1.56 TB, lossless Q4: 4-bit, 1.51 TB Q2: 2-bit: 861 GB Q1: 1-bit, 594 GB The smallest Q1 model keeps 78.9% accuracy, while being almost 3 times
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.