r/LocalLLaMA

Local vs Frontier on low-level systems engineering

Hey r/LocalLLaMA, Before anyone jumps on me, this is absolutely not a post about how great Qwen is 😄…

Qwen3.6-35B-A3B-Uncensored-Claude-4.6-Genesis-APEX-GGUF

Here model: https://huggingface.co/LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Claude-4.6-Genesis-APEX-GG…

DeepSeek V4 Flash is amazing! (WIP llama.cpp PR #24162)

In case you're not aware already, the DeepSeek V4 series is finally getting supported on llama.cpp w…

AA comparison of the latest local models

I picked models I consider local (usable on 3×3090), so there are no 300B models, and you should pro…

Any LiteRT user's in here on linux ?

if anyone on here is using litert , check out this GUI for ubuntu/debian ... you might like it ! www…

A quick Gemma4 31B comparison (Q4_k_M, QAT, heretic)

No numbers. Not sure if anybody cares… I’ve run the UD version of Q4_k_m for a month. I talk to this…

Github Copilot finally supporting custom endpoints

https://preview.redd.it/082gnmin1l5h1.png?width=1740&format=png&auto=webp&s=2c89f6310c8c654611188183…

OpenLumara - A different kind of AI agent, written from scratch, not vibecoded. Extremely token-efficient, super small system prompt, made for local models. Everything is modular.

Hi locallama community! Yes, I know, yet another AI agent announcement post. There are a dime a doze…

Gemma 4 QAT benchmark results (AMD 7900 XTX): faster, less VRAM, no quality loss

I’ve been doing lots of testing back and forth with this 7900xtx. All of my workloads were relying o…

Running Qwen3.6-35B-A3B on a laptop RTX 4060 (8GB) — what worked, what didn't, and a surprising speculative-decoding result

TL;DR: I spent a long session tuning a 35B MoE on a tiny 8GB laptop GPU. Three things mattered a lot…

dots.tts 2B🎙️ SOTA TTS from RedNote

🔗 Blog: https://rednote-hilab.github.io/dots.tts-demo/ 🔗 GitHub: https://github.com/rednote-hilab/do…

A 10 year old Xeon is all you need

Thanks to u/demian_west for finding it. submitted by /u/arbv [link] [comments]…