Jetson AGX Orin 64GB: q8_0 good, q6_k bad
Just a quick observation for all three users of Jetson AGX Orin 64GB in this sub: q8_0 quant gives >20% faster prefill (prompt processing) than q6_k, and 10% faster than q4_k_xl. Tested with Unsloth Qwen3.6-27B-MTP-GGUF
📄
This source provides headlines only. Use the button below to read the complete article on the original site.
📰 Read the original article on r/LocalLLaMA
Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.