r/LocalLLaMA 🤖 Ai 👁 0

Gemma4 26B A4B NVFP4 GGUF

Hey everyone! I’ve just uploaded a GGUF version of nvidia/Gemma-4-26B-A4B-NVFP4. It is not currently possible to run it with the main branch of llama.cpp, so I’ve also made a Docker image for it. It’s available at catli

📄

This source provides headlines only. Use the button below to read the complete article on the original site.

📰 Read the original article on r/LocalLLaMA

Originally published by r/LocalLLaMA. Aggregated on AIWithGhost for educational purposes — full credit and traffic to the original publisher.