r/LocalLLaMA

If you've been waiting to try local AI development, please try it

I have snobbishly long felt that the local models were not 'up to my standards' for local developmen…

Does the "6 months gap" still hold?

Hi. It is quite a consensus that the "jump" in quality of agentic development happened sometime in D…

Solidity

Hey all! I have spent the last few evenings building a modern solidity LM with sota CoT/tool calling…

FPGAs for speculative decoding

Anyone who knows stuff about fpgas: - What max model size can one be designed for (I've read 20-30m …

Qwen3.6-27B vs Coder-Next

Burned about 20 hours of side-by-side compute on my two RTX PRO 6000 Blackwells trying to get a defi…

CAISI releases evaluation report: DeepSeek V4 becomes the most powerful model in China, but still lags about 8 months behind the US frontier

https://preview.redd.it/pz8qeln0auyg1.png?width=1400&format=png&auto=webp&s=00ee5218734cfae4783d7024…

GLaDOS TTS Build Kit: Train GLaDOS Voice if You Own Portal 1 and 2

I put together a repo for training a local GLaDOS-style TTS voice from your own installed copies of …

Qwen 3.6 seems to have a lot of trouble with tool calling

(I'm on Windows system running these models locally) I've used both Codex and OpenCode with Qwen 3.6…

The use Q8 a waste of resources?

I can run G4 31B Q8 XL with ctx 75k and Gwen's 27B and 35B Q8 XL ctx 145k, but I'm wondering if I'm …

Karpathy's MicroGPT running at 50,000 tps on an FPGA

Sure, it's only 4,192 parameters, but it's a start. Project write-up here: https://v2.talos.wtf/ and…

GPT 5.5 just leaked its chain of thought to me in codex, and it looks like an idea from 5 months ago in this sub.

https://www.reddit.com/r/LocalLLaMA/comments/1p0lnlo/make_your_ai_talk_like_a_caveman_and_decrease/ …

Local image generation on Mac: 10 models compared (SD 1.5 → Flux dev → Qwen-Image → Gemini)

Tested 10 image generation models on M1 Max 64GB for photorealism, text rendering, and cultural accu…